Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Domain Reasoning on MMLU-Pro Computer Science
Loading...
25.6
MMLU-Pro CS Domain Reasoning Accuracy
KARMA
17.696
19.748
21.8
23.852
Jul 3, 2026
MMLU-Pro CS Domain Reasoning Accuracy
Updated 18d ago
Evaluation Results
Method
Method
Links
MMLU-Pro CS Domain Reasoning Accuracy
KARMA
Backbone=Qwen2.5-7B-In...
2026.07
25.6
Simple SFT (Open-Data)
Backbone=Qwen2.5-7B-In...
2026.07
24.3
Qwen2.5-7B-Instruct
Backbone=Qwen2.5-7B-In...
2026.07
19.5
Simple SFT (KARMA-Data)
Backbone=Qwen2.5-7B-In...
2026.07
18
Feedback
Search any
task
Search any
task