Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Token Cost on MMLU-Pro (Medical Reasoning)
Loading...
1,350
Token Cost (tokens/question)
DyLAN
561.72
5,882.61
11,203.5
16,524.39
Aug 11, 2025
Token Cost (tokens/question)
Updated 17d ago
Evaluation Results
Method
Method
Links
Token Cost (tokens/question)
DyLAN
Model=GPT-4o, Framewor...
2025.08
1,350
ReConcile
Model=GPT-4o, Framewor...
2025.08
1,925
TMA-AllCompon
Model=MedGemma-4B, Fra...
2025.08
3,427
TMA-AllCompon
Model=Gemma-3-4B, Fram...
2025.08
3,427
TMA-AllCompon
Model=GPT-4o, Framewor...
2025.08
3,427
ReConcile
Model=Gemma-3-4B, Fram...
2025.08
6,271
DyLAN
Model=Gemma-3-4B, Fram...
2025.08
7,977
MedAgents
Model=Gemma-3-4B, Fram...
2025.08
10,362
MedAgents
Model=GPT-4o, Framewor...
2025.08
10,362
MDAgents
Model=Gemma-3-4B, Fram...
2025.08
21,057
MDAgents
Model=GPT-4o, Framewor...
2025.08
21,057
Feedback
Search any
task
Search any
task