Counterfactual Eval
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Counterfactual Reasoning | Counterfactual Eval (dev) | Mean Score63.4 | 52 | |
| Logical and Mathematical Reasoning under Counterfactuals | Counterfactual Eval Manual Initialization 5 random samples 1.0 (train and dev) | Arithmetic Base 8 (Mean)32 | 4 |
Showing 2 of 2 rows