Question Answering on NewsQA (dev)
75.5F1 Score
ORACLE
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2018.05 | 75.5 | 59.2 | |
2024.06 | 73.41 | - | |
2024.06 | 72.45 | - | |
2024.06 | 71.63 | - | |
2024.06 | 69.36 | - | |
2024.06 | 68.97 | - | |
2020.01 | 68.6 | 58.5 | |
2020.01 | 67.5 | 57.1 | |
2020.01 | 67 | 56.9 | |
2020.01 | 66.5 | 56.3 | |
2020.01 | 65.7 | 52.5 | |
2018.05 | 63.8 | 50.7 | |
2018.01 | 63.3 | 48.4 | |
2020.01 | 63.3 | 48.4 | |
2018.05 | 63.2 | 50.1 | |
2018.05 | 62.3 | 49.3 | |
2024.06 | 61.78 | - | |
2024.06 | 61.43 | - | |
2024.06 | 61.01 | - | |
2024.06 | 60.34 | - | |
2024.06 | 60.21 | - | |
2024.06 | 60.11 | - | |
2024.06 | 59.28 | - | |
2024.06 | 58.83 | - | |
2024.06 | 57.38 | - | |
2024.06 | 57.32 | - | |
2023.10 | 56.9 | - | |
2023.10 | 56.8 | - | |
2024.06 | 56.58 | - | |
2017.03 | 56.4 | 43.7 | |
2018.01 | 56.4 | 43.7 | |
2017.03 | 56.1 | 43.7 | |
2018.05 | 56.1 | 43.7 | |
2018.01 | 56.1 | 43.7 | |
2020.05 | 56.1 | 43.7 | |
2024.06 | 54.67 | - | |
2023.10 | 54.2 | - | |
2023.10 | 53.7 | - | |
2024.06 | 52.83 | - | |
2023.10 | 52.3 | - | |
2023.10 | 51.8 | - | |
2024.06 | 50.24 | - | |
2024.06 | 50.24 | - | |
2023.10 | 50 | - | |
2024.06 | 49.9 | - | |
2024.06 | 49.82 | - | |
2017.03 | 49.6 | 36.1 | |
2018.01 | 49.6 | 34.4 | |
2018.01 | 49.6 | 36.1 | |
2020.05 | 49.6 | 34.4 | |
2020.01 | 49.6 | 36.1 | |
2020.01 | 49.6 | 34.4 | |
2017.03 | 48.9 | 35.2 | |
2024.06 | 47.56 | - | |
2024.06 | 47.36 | - | |
2024.06 | 47.21 | - | |
2023.10 | 46.5 | - | |
2020.05 | 46.3 | 33.6 | |
2024.06 | 46.29 | - | |
2024.06 | 45.75 | - | |
2024.06 | 45.65 | - | |
2023.10 | 44.9 | - | |
2024.06 | 43.65 | - | |
2023.10 | 43.5 | - | |
2023.10 | 43.2 | - | |
2020.05 | 42.2 | 29 | |
2024.06 | 41.78 | - | |
2024.06 | 40.86 | - | |
2023.10 | 40.2 | - | |
2024.06 | 38.88 | - | |
2024.06 | 38.71 | - | |
2017.03 | 37.6 | 25.8 | |
2018.01 | 37.6 | 25.8 | |
2023.10 | 37.4 | - | |
2024.06 | 36.8 | - | |
2023.10 | 36.6 | - | |
2023.10 | 36.1 | - | |
2024.06 | 35.81 | - | |
2024.06 | 34.98 | - | |
2024.06 | 33.27 | - | |
2023.10 | 33 | - | |
2024.06 | 32.09 | - | |
2023.10 | 31.9 | - | |
2024.06 | 30.14 | - | |
2023.10 | 30.1 | - | |
2024.06 | 29.87 | - | |
2023.10 | 29.5 | - | |
2024.06 | 29.31 | - | |
2024.06 | 28.89 | - | |
2020.05 | 28.5 | 19.6 | |
2023.10 | 27.5 | - | |
2024.06 | 27.32 | - | |
2024.06 | 22.45 | - | |
2023.10 | 20.8 | - | |
2023.10 | 16.7 | - | |
2023.10 | 12.5 | - | |
2023.10 | 7.6 | - | |
2023.10 | 7.2 | - | |
2023.10 | 4.6 | - | |
2023.10 | 3.2 | - |
Showing 100 of 101 rows