Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Science Question Answering on ARC Challenge (Character-level Accuracy)
Loading...
52.2
Character-level Accuracy
LFM2 1.2B
28.072
34.336
40.6
46.864
Mar 16, 2026
Character-level Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Character-level Accuracy
LFM2 1.2B
Parameter Count=1.2B,...
2026.03
52.2
MobileLLM-Flash 1.4B
Parameter Count=1.4B,...
2026.03
50.56
LFM2 700M
Parameter Count=700M,...
2026.03
49.4
LFM2 350M
Parameter Count=350M,...
2026.03
44.54
MobileLLM-Flash 650M
Parameter Count=650M,...
2026.03
42.58
Nemotron-Flash 1B
Parameter Count=1B, Ev...
2026.03
41.47
MobileLLM-Flash 350M
Parameter Count=350M,...
2026.03
38.89
Qwen3 0.6B
Parameter Count=0.6B,...
2026.03
38.57
Gemma3 1B
Parameter Count=1B, Ev...
2026.03
38.4
Llama3.2 1B
Parameter Count=1B, Ev...
2026.03
38.28
Gemma3 270M
Parameter Count=270M,...
2026.03
29
Feedback
Search any
task
Search any
task