LLM Routing Systems
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| LLM Routing Resource Efficiency | LLM Routing Systems | GPU Memory Usage (GB)0 | 6 | |
| LLM Routing | LLM Routing Systems | Latency Overhead (ms)40 | 5 |
Showing 2 of 2 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| LLM Routing Resource Efficiency | LLM Routing Systems | GPU Memory Usage (GB)0 | 6 | |
| LLM Routing | LLM Routing Systems | Latency Overhead (ms)40 | 5 |