Inference Performance and Accuracy for Long-Context Summarization on GovReport
3.09Speedup
Graft
Updated 14d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.05 | 3.09 | - | - | 5.95 | |
2026.05 | 2.84 | - | - | 5.81 | |
2026.05 | 2.09 | - | - | 3.46 | |
2026.05 | 1.83 | - | - | 3.36 | |
2026.05 | 1.77 | - | - | 3.87 | |
2026.05 | 1.68 | - | - | 3.23 | |
2026.05 | 1.64 | - | - | 2.41 | |
2026.05 | 1.59 | - | - | 3.79 | |
2026.05 | 1.58 | - | - | 1.74 | |
2026.02 | 1.47 | 13 | 94.4 | - | |
2026.05 | 1.44 | - | - | 3.12 | |
2026.02 | 1.33 | 8.62 | 91.6 | - | |
2026.02 | 1.28 | 25 | 97 | - | |
2026.02 | 1.24 | 36.47 | 95.2 | - | |
2026.02 | 1.22 | 6.82 | 93.4 | - | |
2026.02 | 1.11 | 14.15 | 91.7 | - | |
2026.02 | 1.11 | 58.79 | 96.1 | - | |
2026.02 | 1.08 | 18.45 | 64 | - | |
2026.02 | 1.08 | 18.91 | 85.7 | - | |
2026.02 | 1.05 | 13.72 | 62.1 | - | |
2026.02 | 1.03 | 31.32 | 83.8 | - | |
2026.02 | 1.02 | 33.75 | 83.6 | - | |
2026.02 | 1 | 6.75 | - | - | |
2026.02 | 1 | 15.71 | - | - | |
2026.02 | 1 | 22.58 | - | - | |
2026.02 | 1 | 46.56 | - | - | |
2026.02 | 0.89 | 49.31 | 55.6 | - | |
2026.02 | 0.87 | 6.62 | 0.1 | - | |
2026.02 | 0.84 | 23.72 | 36 | - | |
2026.02 | 0.74 | 15.72 | 0.1 | - | |
2026.05 | 0.68 | - | - | 2.05 |