Semantic Consistency Evaluation on Semantic-stress diagnostic dataset (evaluation subset)
0.0093Mean ∆lex
Gemma3-4B
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2026.06 | 0.0093 | 0.0092 | 100 | -0.0016 | -0.0016 | 12.8 | |
2026.06 | 0.019 | 0.0188 | 100 | -0.0156 | -0.0158 | 5.3 | |
2026.06 | 0.0381 | 0.0377 | 100 | -0.0399 | -0.0403 | 3.2 | |
2026.06 | 0.0681 | 0.0678 | 100 | -0.0147 | -0.0149 | 8.6 | |
2026.06 | 0.1293 | 0.1284 | 99.9 | 0.0295 | 0.0288 | 85.3 |