Inference Performance Evaluation on 1,424 simulated conversations on AWS EC2 P5 (test)
0.92Latency (s)
π_θ^EAGLE+FP8
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.06 | 0.92 | 3.8 | 6.54 | 4.48 | |
2026.06 | 1.6 | - | 3.66 | 2.5 | |
2026.06 | 1.69 | - | 3.4 | 2.33 | |
2026.06 | 3.92 | - | 1.46 | 1 |