LLM Inference Efficiency on Instruction-in-Wild self-instructed prompts 36
2.52Throughput (samples/s)
Ground Truth Preditor
Updated 3mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2023.05 | 2.52 | 107 | 201 | |
2023.05 | 2.27 | 86 | 208 | |
2023.05 | 2.1 | 72 | 210 | |
2023.05 | 1.96 | 61 | 216 | |
2023.05 | 1.77 | 45 | 211 | |
2023.05 | 1.4 | 15 | 328 | |
2023.05 | 1.22 | - | 377 |