| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| GPQA Diamond | FLARE-2B | Throughput (tokens/s)1,440.8 | 27 | 1mo ago | |
| LLaMA-2 13B | Token Filtering | Throughput (tokens/s)19.4 | 20 | 5mo ago | |
| System Throughput Evaluation (test) | GKA | Throughput (tokens/GPU/sec)6,898.53 | 12 | 2mo ago | |
| Synthetic Throughput Benchmark 125M, T=1024, mb=8 single H100 | Transformer | Throughput (tokens/s)159.8 | 8 | 1mo ago | |
| CartPole | CartPole JAX (scan) | Speedup Factor (vs Gymnasium)43,279 | 3 | 26d ago | |
| ARC (Abstraction and Reasoning Corpus) | JaxARC | Speedup903 | 2 | 5mo ago | |
| Pong | Pong JAX (scan) | SPS1.4 | 1 | 4mo ago | |
| HalfCheetah | HalfCheetah JAX | Steps Per Second (SPS)13,100,000 | 1 | 4mo ago |
