First-Order Logic translation on FOLIO (test)
66BLEU
Qwen3-1.7B-SGRPO
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.12 | 66 | - | 87.4 | |
2025.12 | 61.2 | - | 85 | |
2025.12 | 38.4 | 82.6 | 80.9 | |
2025.12 | 38.4 | 85.8 | - | |
2025.12 | 37.8 | 84.1 | - | |
2025.12 | 37.6 | 83 | 79.2 | |
2025.12 | 37 | 80.2 | 77.6 |