Inference Throughput on 700M random-initialized models
1,935Throughput (Seq Len 256)
BDLM attention
Updated 18d ago
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.07 | 1,935 | 1,887 | 1,955 | 1,927 | 1,728 | 1,663 | 1,331 | 508 | 263 | 142 | 91 | 74 | |
| 1,146 | 1,167 | 1,082 | 1,158 | 1,019 | 1,281 | 1,234 | 941 | 694 | 450 | 364 | 278 | ||
2026.07 | 1,035 | 915 | 1,421 | 1,062 | 761 | 351 | 122 | 36 | - | - | - | - | |
2026.07 | 470 | 541 | 498 | 461 | 387 | 429 | 240 | 101 | 35 | - | - | - |