Logical Reasoning on ReClor (test)
80.6Accuracy
IDOL
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2023.06 | 80.6 | - | |
2023.06 | 80 | - | |
2023.06 | 79.3 | - | |
2023.06 | 79.2 | - | |
2023.06 | 76.1 | - | |
2023.06 | 75.3 | - | |
2021.05 | 73.3 | - | |
2021.05 | 73.1 | - | |
2021.05 | 72.3 | - | |
2021.05 | 71.8 | - | |
2023.06 | 71.1 | - | |
2023.06 | 70.9 | - | |
2023.06 | 70.7 | - | |
2021.05 | 68.9 | - | |
2023.06 | 67.3 | - | |
2024.05 | 64.1 | - | |
2023.06 | 63.9 | - | |
2026.01 | 63.78 | - | |
2023.06 | 63.5 | - | |
2024.05 | 63.5 | -0.6 | |
2022.03 | 63 | - | |
2021.05 | 63 | - | |
2024.05 | 63 | - | |
2022.03 | 62.4 | - | |
2022.12 | 62.4 | - | |
2021.05 | 62.4 | - | |
2023.06 | 62.4 | - | |
2024.05 | 62.4 | -1.7 | |
2024.05 | 61.6 | -2.5 | |
2022.12 | 60.7 | - | |
2023.06 | 60.7 | - | |
2026.01 | 60.4 | - | |
2026.01 | 60.4 | - | |
2022.03 | 60.2 | - | |
2023.06 | 60.2 | - | |
2024.05 | 60.2 | -3.9 | |
2026.01 | 60 | - | |
2021.05 | 59.6 | - | |
2026.01 | 59.4 | - | |
2022.03 | 58.9 | - | |
2022.12 | 58.9 | - | |
2021.05 | 58.9 | - | |
2024.05 | 58.9 | -5.2 | |
2025.04 | 58.8 | - | |
2021.05 | 58.7 | - | |
2021.03 | 58.3 | - | |
2022.03 | 58.3 | - | |
2022.03 | 58.3 | - | |
2021.05 | 58.3 | - | |
2021.05 | 58.3 | - | |
2024.05 | 58.3 | -5.8 | |
2021.03 | 58.2 | - | |
2022.12 | 58.2 | - | |
2022.12 | 58.2 | - | |
2021.05 | 58.2 | - | |
2023.06 | 58.2 | - | |
2021.05 | 57.9 | - | |
2025.04 | 57.6 | - | |
2025.04 | 57.4 | - | |
2025.04 | 56.2 | - | |
2021.03 | 56 | - | |
2022.03 | 56 | - | |
2024.05 | 56 | -8.1 | |
2025.04 | 56 | - | |
2025.04 | 55.8 | - | |
2021.03 | 55.6 | - | |
2022.03 | 55.6 | - | |
2022.12 | 55.6 | - | |
2021.05 | 55.6 | - | |
2023.06 | 55.6 | - | |
2024.05 | 55.6 | -8.5 | |
2025.04 | 55 | - | |
2025.04 | 54.8 | - | |
2025.04 | 54.8 | - | |
2025.04 | 54 | - | |
2026.01 | 53.6 | - | |
2023.06 | 53.3 | - | |
2025.04 | 52.8 | - | |
2021.03 | 49.8 | - | |
2022.03 | 49.8 | - | |
2023.06 | 49.8 | - | |
2024.05 | 49.8 | -14.3 | |
2025.04 | 49.4 | - | |
2025.04 | 46.4 | - | |
2025.04 | 45 | - | |
2025.04 | 43.6 | - | |
2024.05 | 25 | - |