Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
LLM Training Throughput on Qwen2.5-7B 64K context (train)
Loading...
1,560.38
Throughput (tokens/sec)
OOMB (Sparse Attn)
844.9952
1,030.7201
1,216.445
1,402.1699
Feb 2, 2026
Throughput (tokens/sec)
Updated 3d ago
Evaluation Results
Method
Method
Links
Throughput (tokens/sec)
OOMB (Sparse Attn)
Hardware=1xH200, Atten...
2026.02
1,560.38
OOMB (Sparse Attn)
Hardware=4xH200, Atten...
2026.02
1,542.85
OOMB (Dense Attn)
Hardware=1xH200, Atten...
2026.02
936.22
OOMB (Dense Attn)
Hardware=4xH200, Atten...
2026.02
933.84
RFA
Hardware=4xH200
2026.02
872.51
Feedback
Search any
task
Search any
task