Share your thoughts, 1 month free Claude Pro on usSee more

Protein-related instruction tasks on Mol-Instructions

62.09Protein Function ROUGE-L

BioMatrix-4B

Updated 1mo ago

Evaluation Results

Method	Links
BioMatrix-4B 2026.06		62.09	68.56	73.46	73.06	60.36	56.22	80.19	79.2	70.64	67.64
BioMatrix-1.7B 2026.06		61.88	68.46	74.09	73.45	56.16	52.55	79	78.03	69.43	66.48
BioT5+ 2026.06		57	-	-	72	-	53	-	68	-	62.5
SciReasoner-data-4B 2026.06		53.21	59.93	53.87	52.54	48.3	45.46	69.07	67.6	57.95	54.7
Qwen3 (PFUA) 2026.06		44.29	66.43	72.32	54.18	54.98	44.26	63.6	41.9	64.33	46.16
Mol-Instructions-7B 2026.06		43	-	-	52	-	46	-	44	-	46.25
SciReasoner-data-1.7B 2026.06		42.9	49.67	48.41	46.99	52.66	49.7	30.12	26.23	45.22	41.46
DeepSeek-R1 2026.06		38.31	59.71	47.95	34.15	48.36	34.36	58.11	35.7	53.53	35.63
Qwen2.5-3B-R1 2026.06		38.04	49.1	61.33	46.54	51.01	41.1	42.56	32.37	51	39.51
Kimi-k2 2026.06		35.73	57.98	67.68	46.9	39.76	28.56	60.08	36.78	56.38	36.99
Qwen2.5-3B-SFT 2026.06		30.85	40.74	41.45	34.52	42.6	32.13	33.95	25.68	39.69	30.79
BioMedGPT-R1 2026.06		26.8	35.16	27.64	22.22	30.6	23.33	27.78	20.82	30.3	23.29
DeepSeek-R1 2026.06		25.68	38.23	32.36	23.75	30.35	21.46	28.54	16.73	32.37	21.91
Qwen3 2026.06		24.52	37.42	50.66	40.67	16.44	12.44	42.61	26.34	36.78	25.99
DeepSeek-R1 2026.06		19.68	26.65	21.86	18.02	26.09	19.7	16.53	10.76	22.78	17.04
Kimi-k2 2026.06		17.32	25.08	22.99	17.97	27.28	20.07	22.3	14.8	24.41	17.54
Kimi-k2 2026.06		14.14	22.3	18.56	13.15	21.64	17.12	45.41	26.44	26.98	17.71
Qwen3 2026.06		12.62	18.53	15.93	12.27	15.13	11.28	18.59	11.94	17.05	12.03
Prot2Text 2026.06		11.61	16.56	18.24	13.05	11.49	9.37	49.14	47.38	23.86	20.35
ProtT3 2026.06		10.81	15.46	17.36	12.41	16.83	12.22	19.49	15.96	17.28	12.85
GPT-OSS 2026.06		5	-	-	2	-	2	-	7	-	4
BioMedGPT 2026.06		4.28	5.98	7.97	6.28	1.81	1.81	4.84	4.12	5.15	4.12