Mobile and IoT Device Latency Benchmark
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Model Inference | Mobile and IoT Device Latency Benchmark llama.cpp (inference evaluation) | Throughput (Sample, tokens/s)4,215 | 16 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Model Inference | Mobile and IoT Device Latency Benchmark llama.cpp (inference evaluation) | Throughput (Sample, tokens/s)4,215 | 16 |