Cross-lingual Language Understanding on XTREME
83.9XNLI Accuracy
FILTER
Updated 1mo ago
Evaluation Results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2020.10 | 83.9 | 76.2 | 67.7 | 91.4 | 68 | 82.4 | 57.7 | 76.2 | 50.9 | 68.3 | 74.9 | 76 | - | - | - | |
2020.10 | 83 | 75.1 | 65.7 | 91.1 | 66.3 | 79.9 | 54.9 | 73.1 | 58.9 | 75 | 74.1 | 75.1 | - | - | - | |
2022.02 | 82.5 | 77.8 | 67.9 | 90.5 | 66.1 | 80.4 | 54.9 | 73.3 | 48.2 | 66.8 | - | 76.8 | 82.9 | 83 | - | |
2022.02 | 82.3 | 77.3 | 67.3 | 90.3 | 65.6 | 80 | 54.4 | 72.9 | 47.6 | 66.3 | - | 76.4 | 82.5 | 82.7 | - | |
2023.06 | 81.4 | - | - | - | - | - | 55.2 | 73.6 | - | - | - | - | - | - | - | |
2026.02 | 81.26 | 83.74 | - | 91.32 | - | 77.91 | - | 70.67 | - | 56.34 | 76.19 | - | - | - | 72.06 | |
2023.06 | 81.2 | 77 | 68.5 | 88.9 | 64.4 | 79.2 | 56.4 | 73.7 | 55.7 | 72.7 | - | - | - | - | - | |
2023.06 | 81.1 | 76.9 | 68.1 | 88.7 | 63.9 | 79 | 53.5 | 72.4 | 55 | 72.1 | - | - | - | - | - | |
2020.10 | 80.8 | 76.5 | 70.1 | 87.5 | 64 | 79.6 | 55 | 73.1 | 63 | 77 | 74.4 | 75.4 | - | - | - | |
2026.02 | 80.54 | 84.33 | - | 92.34 | - | 77.79 | - | 71.48 | - | 63.95 | 77.76 | - | - | - | 73.89 | |
2020.10 | 80 | 74.9 | 64 | 87.9 | 63.3 | 78.7 | 53.7 | 72.4 | 59.5 | 76 | 72.7 | 73.5 | - | - | - | |
2023.06 | 79.9 | 75.1 | 65.7 | 88.7 | 61.8 | 77.3 | 53.2 | 71.7 | 49.1 | 67.6 | - | - | - | - | - | |
2022.02 | 79.3 | 73.5 | 63.2 | 86.5 | 61 | 76.7 | 53.6 | 71.9 | 45.6 | 65.4 | - | 73 | 79.9 | 76.8 | - | |
2020.10 | 79.2 | 73.8 | 65.4 | 86.4 | 60.8 | 76.6 | 53.2 | 71.6 | 45 | 65.1 | 70.1 | 71.4 | - | - | - | |
2023.06 | 79.2 | 72.6 | 65.4 | 86.4 | 60.8 | 76.6 | 53.2 | 71.6 | 45 | 65.1 | - | - | - | - | - | |
2026.02 | 79.09 | 85.36 | - | 90.36 | - | 75.45 | - | 68.67 | - | 53.96 | 75.51 | - | - | - | 75.65 | |
2022.02 | 79 | 72.7 | 62.3 | 86.3 | 60.4 | 76.2 | 53 | 71.4 | 45 | 65 | - | 72.4 | 79.2 | 76 | - | |
2022.02 | 78.9 | 76.8 | 63.1 | 88.6 | 61.8 | 75.4 | 50.4 | 68 | 48.1 | 64.1 | - | 73.7 | 80 | 79.8 | - | |
2022.02 | 78.5 | 76.2 | 62.6 | 88.2 | 61.5 | 75 | 50.1 | 67.8 | 47.6 | 63.8 | - | 73.3 | 79.6 | 79.4 | - | |
2026.02 | 78.25 | 85.55 | - | 89.5 | - | 75.61 | - | 68.91 | - | 56.41 | 75.42 | - | - | - | 73.69 | |
2026.02 | 77.9 | 82.5 | - | 89.55 | - | 74.37 | - | 68.05 | - | 51.07 | 73.78 | - | - | - | 73.05 | |
2021.06 | 76.6 | 75.6 | 63.5 | 88.3 | 60.2 | 76.2 | 49.8 | 68.3 | 45.7 | 62.4 | 69.3 | - | - | - | - | |
2021.06 | 76.5 | - | - | - | - | - | 49.6 | 68.1 | - | - | - | - | - | - | - | |
2021.06 | 76.2 | 76 | 63.7 | 86.8 | 59 | 74.7 | 49.8 | 68.1 | 44.8 | 62.1 | 68.9 | - | - | - | - | |
2021.06 | 76.2 | 76 | 63.7 | 86.8 | 59 | 74.7 | 49.8 | 68.1 | 44.8 | 62.1 | 68.9 | - | - | - | - | |
2021.06 | 75.4 | - | 55.7 | 86.4 | 49 | 67 | 45 | 64.6 | 41.2 | 57.2 | - | - | - | - | - | |
2023.06 | 75.4 | 74.3 | 63.8 | 86.6 | 60.4 | 75.3 | 49.4 | 67.4 | 41.6 | 58.5 | - | - | - | - | - | |
2021.06 | 75.4 | - | 56.6 | 87.4 | 49 | 67 | 45 | 64.6 | 42.8 | 58.1 | - | - | - | - | - | |
2022.02 | 75.2 | 76 | 62.1 | 85.1 | 57.1 | 72.3 | 47.4 | 65.5 | 39.2 | 56 | - | 70.5 | 78.2 | 74.5 | - | |
2021.06 | 75.1 | 74.2 | 62.7 | 87.1 | 58.2 | 74.3 | 49.7 | 67.8 | 40.6 | 57.8 | 67.6 | - | - | - | - | |
2023.06 | 75.1 | - | 55.7 | 86.4 | 49 | 67 | 45 | 64.6 | 41.2 | 57.2 | - | - | - | - | - | |
2023.06 | 75.1 | 74.2 | 62.7 | 87.1 | 58.2 | 74.3 | 49.7 | 67.8 | 40.6 | 57.8 | - | - | - | - | - | |
2023.06 | 75.1 | 73.9 | 63.6 | 86 | 61.5 | 75.8 | 50.1 | 68.7 | 42.8 | 59.3 | - | - | - | - | - | |
2021.06 | 75 | 75.6 | 61.8 | 84.9 | 56.4 | 71.9 | 47.2 | 65.1 | 38.3 | 55.4 | 66.4 | - | - | - | - | |
2023.06 | 75 | 75.6 | 61.8 | 84.9 | 56.4 | 71.9 | 47.2 | 65.1 | 38.3 | 55.4 | - | - | - | - | - | |
2021.06 | 75 | 75.6 | 61.8 | 84.9 | 56.4 | 71.9 | 47.2 | 65.1 | 38.3 | 55.4 | 66.4 | - | - | - | - | |
2022.02 | 74.8 | 75.5 | 61.6 | 84.8 | 56.6 | 71.9 | 47 | 65.2 | 38.4 | 55.5 | - | 70 | 77.6 | 73.8 | - | |
2021.06 | 69.1 | 70.1 | 61.2 | 80.9 | 44.3 | 59.8 | 32.6 | 48.5 | 29.1 | 43.6 | 58.6 | - | - | - | - | |
2023.06 | 69.1 | 71.3 | 61.2 | 80.9 | 44.3 | 59.8 | 32.6 | 48.5 | 29.1 | 43.6 | - | - | - | - | - | |
2021.06 | 69.1 | 70.1 | 61.2 | 80.9 | 44.3 | 59.8 | 32.6 | 48.5 | 29.1 | 43.6 | 58.6 | - | - | - | - | |
2021.06 | 65.4 | 70.3 | 62.2 | 81.9 | 49.4 | 64.5 | 44.2 | 61.4 | 43.9 | 59.7 | 63.1 | - | - | - | - | |
2021.06 | 65.1 | 70.3 | 62.2 | 81.9 | 49.4 | 64.5 | 44.2 | 61.4 | 43.9 | 59.7 | 63.1 | - | - | - | - | |
2023.06 | 65.1 | 70.3 | 62.2 | 81.9 | 49.4 | 64.5 | 44.2 | 61.4 | 43.9 | 59.7 | - | - | - | - | - | |
2021.06 | - | - | - | - | - | - | - | - | - | - | - | 63.1 | - | - | - | |
2021.06 | - | - | - | - | - | - | - | - | - | - | - | 66.4 | - | - | - | |
2021.06 | - | - | - | - | - | - | - | - | - | - | - | 68.9 | - | - | - | |
2021.06 | - | - | - | - | - | - | - | - | - | - | - | 69.3 | - | - | - | |
2021.06 | - | - | - | - | - | - | - | - | - | - | - | 67.6 | - | - | - |