Reasoning Agreement Benchmark
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| LLM Judging Agreement | Reasoning Agreement Benchmark 500-sample human-annotated | Cohen's Kappa0.91 | 15 | |
| LLM Judging Agreement | Reasoning Agreement Benchmark 2,500 samples | Parsing Success Rate100 | 15 |
Showing 2 of 2 rows