Synonym Substitution Robustness on ELI5 prompts 32-bit payload Llama3.1-8B (test)
70.7Bit Accuracy (10% Substitution)
Ours+
Updated 21d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2026.05 | 70.7 | 64.2 | 59.1 | 56.2 | 54.3 | |
2026.05 | 67.1 | 61.9 | 57.8 | 55.1 | 53.6 | |
2026.05 | 66.6 | 61.6 | 58 | 55.6 | 53.6 | |
2026.05 | 61.2 | 57.5 | 55.5 | 53.2 | 52.4 | |
2026.05 | 60.9 | 57.2 | 54.9 | 53.7 | 52.6 | |
2026.05 | 54.4 | 52.3 | 50.9 | 51.1 | 50.5 | |
2026.05 | 50.9 | 50.6 | 50.3 | 49.9 | 50.1 |