LLM Inference Scheduling

Benchmarks

Dataset Name	SOTA Method	Metric	Trend
Alpaca	TIE	Average Per-token Latency (s/token)0.52		8	17d ago
LMSYS-Chat-1M	TIE	Average Per-token Latency (s/token)2.41		4	17d ago

Showing 2 of 2 rows