IOI
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Circuit Discovery | IOI | AUC83.6 | 12 | |
| MCQ Classification | IOI 2 v1 (Eva) | Accuracy100 | 6 | |
| MCQ Classification | IOI v1 (Infer) | Accuracy1 | 6 | |
| Circuit Discovery | IOI | KL Div0.668 | 6 | |
| Autointerpretation | IOI | Accuracy76 | 4 | |
| Circuit Discovery | IOI | Sparsity96.74 | 3 | |
| Circuit Discovery | IOI 400 examples v1 | KL Divergence0.22 | 3 | |
| Circuit Discovery | IOI 200 examples v1 | KL Divergence0.25 | 3 | |
| Circuit Discovery | IOI 100K examples v1 | KL Divergence0.2 | 2 |
Showing 9 of 9 rows