Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Contextual Reasoning on HellaSwag
Loading...
88
EM
DeepSeek-V4-Pro Base
52.1928
61.4889
70.785
80.0811
Dec 18, 2025
Jan 8, 2026
Jan 30, 2026
Feb 20, 2026
Mar 14, 2026
Apr 4, 2026
Apr 26, 2026
EM
Updated 1mo ago
Evaluation Results
Method
Method
Links
EM
DeepSeek-V4-Pro Base
# Shots=0-shot, Archit...
2026.04
88
DeepSeek-V3.2 Base
# Shots=0-shot, Archit...
2026.04
86.4
DeepSeek-V4-Flash Base
# Shots=0-shot, Archit...
2026.04
85.7
DeepSeek-V2 Lite
# Shots=10-shot, Archi...
2025.12
80.55
Sigma-MoE-Tiny Base
# Shots=10-shot, Archi...
2025.12
79.79
Gemma-3 4B Base
# Shots=10-shot, Archi...
2025.12
77.76
Qwen3 0.6B Base
# Shots=10-shot, Archi...
2025.12
53.57
Feedback
Search any
task
Search any
task