Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Financial Question Answering on FinMMR Hard
Loading...
50.8
Accuracy
Claude Sonnet
2.024
14.687
27.35
40.013
Jun 16, 2026
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Claude Sonnet
Group=General LLMs
2026.06
50.8
Llama
Group=General LLMs
2026.06
48.7
Qwen3-VL-8B + FINACUMEN
Group=FINACUMEN
2026.06
46.1
GPT
Group=General LLMs
2026.06
45.4
Gemini 2.0 Flash
Group=General LLMs
2026.06
44.4
Qwen2.5-VL-72B
Group=General LLMs
2026.06
43.3
Qwen3-VL-8B-Instruct
Group=Base
2026.06
31.4
FinLLaVA
Group=Financial LLMs
2026.06
3.9
Feedback
Search any
task
Search any
task