| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| OpenBookQA 1.0 (test) | TituLLM-3b-v2.0 | Accuracy35 | 33 | 4mo ago | |
| NQ-Open Open-Book | DCO | Exact Match79.51 | 17 | 1mo ago | |
| OpenBookQA n=991 (20%) | MTO-MP | Accuracy57.52 | 13 | 1mo ago | |
| OpenBookQA 5% n=298 | MTO-MP | Accuracy53.6 | 13 | 1mo ago | |
| OpenBookQA | T-Free | Normalized Log Accuracy89.4 | 12 | 4mo ago | |
| OpenBookQA FS n=30 | MTO-MCP | Accuracy38.47 | 6 | 1mo ago | |
| OpenBookQA | Score43.36 | 6 | 3mo ago | ||
| RealtimeQA December 16, 2022 | EM55 | 6 | 4mo ago | ||
| OBQA | Dual | Normalized PLL Score12.8 | 4 | 4mo ago |
