Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Math Reasoning on AIME 24 (Token Usage and Throughput)
Loading...
3.82
Mean Accepted Tokens
LongSpec
0.8872
1.6486
2.41
3.1714
Feb 24, 2025
Mean Accepted Tokens
Throughput (Tokens/s)
Improvement Factor
Updated 11d ago
Evaluation Results
Method
Method
Links
Mean Accepted Tokens
Throughput (Tokens/s)
Improvement Factor
LongSpec
Model=QwQ-32B, Maximum...
2025.02
3.82
42.63
2.25
Vanilla
Model=QwQ-32B, Maximum...
2025.02
1
18.92
-
Feedback
Search any
task
Search any
task
