Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multiple-choice Question Answering on mCSQA
Loading...
36.8
Accuracy (ZH)
ORACLE
23.8
27.175
30.55
33.925
Apr 18, 2026
Accuracy (ZH)
Accuracy (DE)
Average Accuracy
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy (ZH)
Accuracy (DE)
Average Accuracy
Accuracy
ORACLE
Strategy=Upper bound s...
2026.04
36.8
45.7
39.9
-
ORACLE
Base Model=Llama3.3-70B
2026.04
33.4
41.8
36.2
-
CLASSIFIER (Ours)
Strategy=Learned Routi...
2026.04
28.4
39.1
33.8
-
TRANSLATE
Strategy=Translate-the...
2026.04
28.2
38.5
33.4
-
NATIVE
Strategy=Native infere...
2026.04
27.6
38.2
32.9
-
XGBOOST (Ours)
Base Model=Llama3.3-70B
2026.04
26.5
34.6
30.6
-
NATIVE
Base Model=Llama3.3-70B
2026.04
26.1
33.8
30
-
MLP (Ours)
Base Model=Llama3.3-70B
2026.04
26.1
35.2
30.6
-
TRANSLATE
Base Model=Llama3.3-70B
2026.04
24.3
33.5
28.9
-
Feedback
Search any
task
Search any
task