Share your thoughts, 1 month free Claude Pro on usSee more

Multilingual Medical Question Answering on MMedBench (test)

83.07Accuracy (Chinese)

No-conflict

Updated 1mo ago

Evaluation Results

Method	Links
No-conflict 2025.05		83.07	50.9	48.6	44.38	57.81	52.88	56.27
KaFT 2025.05		82.81	51.61	47.66	40.62	63.67	52.63	56.5
Base 2025.05		82.25	46.19	41.12	35.62	55.08	49.02	51.55
Self-aligning 2025.05		82.11	47.29	46.11	38.75	58.59	51.5	54.06
Vanilla SFT 2025.05		79.16	46.82	45.48	36.25	61.72	49.12	53.09
KaFT 2025.05		60.19	63.24	58.88	46.25	63.67	62	59.04
Self-aligning 2025.05		59.78	60.49	57.63	45.62	62.5	62.31	58.09
No-conflict 2025.05		59.4	60.72	58.57	46.25	62.5	61.42	58.14
Vanilla SFT 2025.05		58.2	61.74	57.01	42.38	63.67	61.93	57.49
Base 2025.05		56.98	58.68	53.58	40	55.86	59.48	54.1
No-conflict 2025.05		48.63	53.57	42.06	35	51.17	51.17	46.93
KaFT 2025.05		48.22	53.42	46.11	33.12	51.95	52.81	47.61
Self-aligning 2025.05		47.72	52.4	39.56	33.12	51.17	50.95	45.82
Vanilla SFT 2025.05		47.14	53.1	40.81	33.75	51.95	51.79	46.42
Base 2025.05		46.15	49.65	40.81	28.12	50.78	49.31	44.14
No-conflict 2025.05		41.77	56.56	49.84	36.25	62.5	56.2	50.52
KaFT 2025.05		41.36	58.37	48.29	38.12	62.11	57.22	50.91
Vanilla SFT 2025.05		41.07	58.99	48.29	30	60.94	58.02	49.55
Self-aligning 2025.05		41.04	54.91	46.11	32.5	61.33	55.87	48.63
Base 2025.05		35.76	51.06	41.24	26.88	48.05	49.27	42.13