Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Token Cost Evaluation on PubMedQA
Loading...
1,509
Token Cost (tokens/question)
TMA-AllCompon
451.88
7,587.44
14,723
21,858.56
Aug 11, 2025
Token Cost (tokens/question)
Updated 17d ago
Evaluation Results
Method
Method
Links
Token Cost (tokens/question)
TMA-AllCompon
Model=MedGemma-4B, Fra...
2025.08
1,509
TMA-AllCompon
Model=Gemma-3-4B, Fram...
2025.08
1,509
TMA-AllCompon
Model=GPT-4o, Framewor...
2025.08
1,509
DyLAN
Model=GPT-4o, Framewor...
2025.08
2,652
ReConcile
Model=GPT-4o, Framewor...
2025.08
3,579
ReConcile
Model=Gemma-3-4B, Fram...
2025.08
6,621
DyLAN
Model=Gemma-3-4B, Fram...
2025.08
9,621
MDAgents
Model=Gemma-3-4B, Fram...
2025.08
17,654
MedAgents
Model=Gemma-3-4B, Fram...
2025.08
24,471
MedAgents
Model=GPT-4o, Framewor...
2025.08
24,471
MDAgents
Model=GPT-4o, Framewor...
2025.08
27,937
Feedback
Search any
task
Search any
task