Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
LLM Training Throughput on Qwen2.5-7B 128K context (train)
Loading...
1,394.16
Throughput (tokens/sec)
OOMB (Sparse Attn)
426.1384
677.4517
928.765
1,180.0783
Feb 2, 2026
Throughput (tokens/sec)
Updated 4d ago
Evaluation Results
Method
Method
Links
Throughput (tokens/sec)
OOMB (Sparse Attn)
Hardware=1xH200, Atten...
2026.02
1,394.16
OOMB (Sparse Attn)
Hardware=4xH200, Atten...
2026.02
1,371.41
OOMB (Dense Attn)
Hardware=1xH200, Atten...
2026.02
504.12
OOMB (Dense Attn)
Hardware=4xH200, Atten...
2026.02
500.26
RFA
Hardware=4xH200
2026.02
463.37
Feedback
Search any
task
Search any
task