Natural Language Inference on HANS evaluated subset
157Rule-bearing
MechaRule (Qwen2-1.5B)
Updated 28d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2026.05 | 157 | 0.911 | 114 | 32.2 | 14.2 | |
2026.05 | 33 | 0.924 | 24 | 61.2 | 19 | |
2026.05 | 29 | 0.945 | 25 | 32.2 | 13.2 | |
2026.05 | 29 | 0.925 | 21 | 61.5 | 18.6 | |
2026.05 | 28 | 0.915 | 21 | 61.2 | 18.8 | |
2026.05 | 26 | 0.934 | 24 | 32.2 | 13.4 | |
2026.05 | 26 | 0.899 | 17 | 61.5 | 17.6 | |
2026.05 | 24 | 0.945 | 22 | 32.2 | 13.5 | |
2026.05 | 16 | 0.93 | 14 | 32.2 | 11.5 |