Mamba2
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Model Compression | Mamba2 8B | Compression Time16 | 3 | |
| Latency Profiling | Mamba2-8B on Nano 8G (inference) | TPOT (Time Per Output Token)55.3 | 2 | |
| Energy Profiling | Mamba2-8B Jetson Orin Nano 8G (512 prefill 512 generation tokens) (inference) | Energy (J/req)153.64 | 2 |
Showing 3 of 3 rows