Numerical Question Answering on FinQA (test)
91.16Execution Accuracy
Human Expert Performance
Updated 3d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2021.09 | 91.16 | 87.49 | |
2022.10 | 91.16 | 87.49 | |
| 70 | 68.76 | ||
| 69.37 | - | ||
2022.10 | 68.96 | 65.21 | |
| 66.02 | - | ||
2022.10 | 65.05 | 63.52 | |
2022.10 | 62.66 | 59.28 | |
2021.09 | 61.24 | 58.86 | |
2022.10 | 60.1 | 58.38 | |
2021.09 | 56.1 | 54.38 | |
2021.09 | 53.52 | 51.62 | |
2022.10 | 52.48 | 49.9 | |
2021.09 | 50.68 | 48.17 | |
2022.10 | 50.68 | 48.17 | |
2021.09 | 50.1 | 47.52 | |
2021.09 | 50 | 48 | |
2021.09 | 48.57 | 46.76 | |
| 45.33 | - | ||
| 41.84 | - | ||
| 41.75 | - | ||
| 39.3 | - | ||
2025.12 | 36.27 | - | |
2025.12 | 34.76 | - | |
| 24.69 | - | ||
| 22.03 | - | ||
| 21.9 | 20.48 | ||
2021.09 | 19.71 | 18.38 | |
2022.10 | 10.29 | - | |
2022.10 | 2.32 | - | |
2021.09 | 1.01 | 0.9 | |
2022.10 | 0.37 | 0 | |
| 0.3 | - |