BLEND
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Cultural Pluralism Alignment (Cultural Knowledge) | BLEND | Entropy (0-100)83 | 20 | |
| Short Question Answering | BLEnD Short Question Answer | Average Accuracy41.5 | 18 | |
| Cross-lingual Cultural Consistency | BLEnD Non-Indo-European | Max Sigma0.022 | 15 | |
| Cross-lingual Cultural Consistency | BLEnD Indo-European | Max Sigma0.021 | 15 | |
| Cross-lingual Cultural Consistency | BLEnD Lower-Resource | Max Sigma0.02 | 15 | |
| Cross-lingual Cultural Consistency | BLEnD Higher-Resource | Max Sigma0.025 | 15 | |
| Cross-lingual Cultural Consistency | BLEnD All 8 Languages | Max Sigma0.017 | 15 | |
| Cultural Reasoning | BLEnD (test) | Accuracy85.81 | 10 | |
| Open-ended cultural | BLEnD | chrF22.1 | 9 | |
| Cultural Question Answering | BLEnD MCQ subset | Accuracy (low-su)68.18 | 6 | |
| Multilingual Cultural Knowledge | BLEnD average | Accuracy32.8 | 4 | |
| Cultural alignment | BLEnD Local | Cultural Alignment (UK)82.24 | 2 | |
| Cultural alignment | BLEnD English | Alignment Score (UK)82.24 | 2 |
Showing 13 of 13 rows