Aya
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Watermark Detection | Aya-23 8B 10 unsupported languages | AUC0.974 | 40 | |
| Safety Classification | Aya Redteaming | Recall94 | 14 | |
| Machine Translation | Aya Language Families 23 | COMET (AUS)59.3 | 11 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (uk) | AUC0.979 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (iw) | AUC0.974 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (vi) | AUC0.976 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (bn) | AUC97.8 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 ja 8B | AUC0.975 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (ko) | AUC96.8 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (hi) | AUC97.8 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (ru) | AUC0.971 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (pl) | AUC0.975 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (es) | AUC0.976 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (it) | AUC97.8 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (de) | AUC0.973 | 4 | |
| Watermarking Robustness (Translation Attack) | Aya-23 8B (fr) | AUC97.6 | 4 |
Showing 16 of 16 rows