Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
LLM Training on Qwen2.5-7B 256K context (train)
Loading...
1,301.6
Throughput (tokens/sec)
OOMB (Sparse Attn)
-1.104
337.098
675.3
1,013.502
Feb 2, 2026
Throughput (tokens/sec)
Updated 3d ago
Evaluation Results
Method
Method
Links
Throughput (tokens/sec)
OOMB (Sparse Attn)
Hardware=1xH200, Atten...
2026.02
1,301.6
OOMB (Sparse Attn)
Hardware=4xH200, Atten...
2026.02
1,265.59
OOMB (Dense Attn)
Hardware=1xH200, Atten...
2026.02
266.13
OOMB (Dense Attn)
Hardware=4xH200, Atten...
2026.02
261.47
RFA
Hardware=4xH200
2026.02
218.41
Ring Attn (report)
Hardware=8xA100
2026.02
50
Ring Attn (report)
Hardware=16xTPUv4
2026.02
49
Feedback
Search any
task
Search any
task