Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Domain Reasoning on MMLU CS
Loading...
70.1
MMLU CS Domain Reasoning Accuracy
KARMA
44.1
50.85
57.6
64.35
Jul 3, 2026
MMLU CS Domain Reasoning Accuracy
Updated 18d ago
Evaluation Results
Method
Method
Links
MMLU CS Domain Reasoning Accuracy
KARMA
Backbone=Qwen2.5-7B-In...
2026.07
70.1
Simple SFT (Open-Data)
Backbone=Qwen2.5-7B-In...
2026.07
65.5
Qwen2.5-7B-Instruct
Backbone=Qwen2.5-7B-In...
2026.07
65.1
Simple SFT (KARMA-Data)
Backbone=Qwen2.5-7B-In...
2026.07
45.1
Feedback
Search any
task
Search any
task
