Inference Efficiency on HotpotQA
496Time to Last Token (ms)
SeleCom
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.01 | 496 | 1,271 | 49 | |
2026.01 | 505 | 1,416 | 53 | |
2026.01 | 541 | 1,905 | 138 | |
2026.01 | 553 | 1,927 | 141 | |
2026.01 | 563 | 1,799 | 89 | |
2026.01 | 716 | 2,082 | 76 | |
2026.01 | 738 | 3,293 | 164 | |
2026.01 | 1,006 | 2,694 | 57 | |
2026.01 | 1,024 | 2,570 | 63 | |
2026.01 | 1,073 | 1,270 | 47 | |
2026.01 | 1,188 | 1,158 | 71 | |
2026.01 | 1,459 | 4,038 | 80 |