| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Code Assistant | DReSD | TPS104 | 20 | 1mo ago | |
| Decode Phase BS=1 | BWTA (Bitnet-b1.58-2B) | Latency (s)0.152 | 18 | 12d ago | |
| FinanceQA | SpecBundle | Throughput1,779 | 18 | 1mo ago | |
| GPQA | SpecBundle | Throughput2,341.3 | 18 | 1mo ago | |
| Prefill Phase SeqLen=2k | BWTA (Bitnet-b1.58-2B) | Prefill Time (s)0.025 | 15 | 12d ago | |
| Held-out datasets chatbot_instruction_prompts and finance-alpaca (test) | Aurora (Qwen3-Coder-Next (FP8)) | Throughput (TPS)265.7 | 14 | 1mo ago | |
| Llama 3.2 1B | TPOTH1.94 | 4 | 1mo ago | ||
| Llama 3.1 | RoME | Latency (ms)48.1 | 2 | 5d ago |
