Summarization Evaluation on SummEval (Correlation Metrics)
0.6Avg Spearman Rho
CoR
Updated 4d ago
Evaluation Results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2025.12 | 0.6 | 0.506 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.05 | 0.597 | 0.575 | 0.61 | 0.588 | 0.643 | 0.614 | 0.542 | 0.515 | 0.593 | 0.582 | - | - | - | - | - | |
2025.12 | 0.586 | 0.467 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 0.58 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 0.569 | 0.477 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 0.55 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 0.546 | 0.453 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.05 | 0.533 | 0.45 | 0.522 | 0.42 | 0.6 | 0.553 | 0.495 | 0.416 | 0.517 | 0.412 | - | - | - | - | - | |
2024.05 | 0.528 | 0.458 | 0.477 | 0.412 | 0.595 | 0.516 | 0.501 | 0.432 | 0.539 | 0.472 | - | - | - | - | - | |
2025.12 | 0.521 | 0.432 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.05 | 0.507 | 0.459 | 0.486 | 0.41 | 0.628 | 0.596 | 0.41 | 0.393 | 0.505 | 0.436 | - | - | - | - | - | |
2025.12 | 0.493 | 0.401 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.05 | 0.474 | 0.377 | 0.575 | 0.442 | 0.446 | 0.371 | 0.449 | 0.371 | 0.426 | 0.325 | - | - | - | - | - | |
2024.05 | 0.472 | 0.447 | 0.565 | 0.521 | 0.516 | 0.492 | 0.397 | 0.386 | 0.41 | 0.389 | - | - | - | - | - | |
2025.12 | 0.466 | 0.404 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 0.46 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 0.456 | 0.383 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 0.45 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 0.435 | 0.403 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.05 | 0.421 | 0.356 | 0.467 | 0.365 | 0.521 | 0.501 | 0.311 | 0.302 | 0.386 | 0.256 | - | - | - | - | - | |
2025.12 | 0.401 | 0.335 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 0.4 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 0.398 | 0.329 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.05 | 0.394 | 0.344 | 0.284 | 0.242 | 0.506 | 0.48 | 0.415 | 0.39 | 0.306 | 0.265 | - | - | - | - | - | |
2024.05 | 0.387 | 0.32 | 0.522 | 0.406 | 0.396 | 0.331 | 0.277 | 0.267 | 0.354 | 0.277 | - | - | - | - | - | |
2024.05 | 0.385 | 0.305 | 0.448 | 0.342 | 0.382 | 0.315 | 0.356 | 0.292 | 0.356 | 0.273 | - | - | - | - | - | |
2026.02 | 0.38 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 0.364 | 0.323 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.05 | 0.35 | 0.309 | 0.407 | 0.348 | 0.354 | 0.325 | 0.241 | 0.223 | 0.398 | 0.341 | - | - | - | - | - | |
2026.02 | 0.32 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.05 | 0.29 | 0.25 | 0.35 | 0.279 | 0.403 | 0.368 | 0.158 | 0.148 | 0.248 | 0.206 | - | - | - | - | - | |
2026.02 | 0.28 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 0.25 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 0.24 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.05 | 0.225 | 0.175 | 0.284 | 0.211 | 0.11 | 0.09 | 0.193 | 0.158 | 0.312 | 0.243 | - | - | - | - | - | |
2024.05 | 0.191 | 0.148 | 0.159 | 0.118 | 0.157 | 0.127 | 0.129 | 0.105 | 0.318 | 0.244 | - | - | - | - | - | |
2025.12 | 0.19 | 0.151 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 0.168 | 0.132 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2024.05 | 0.165 | 0.128 | 0.128 | 0.099 | 0.115 | 0.092 | 0.105 | 0.084 | 0.311 | 0.237 | - | - | - | - | - | |
2025.12 | 0.009 | 0.01 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.01 | - | - | 0.89 | - | 0.55 | - | 0.89 | - | 0.91 | - | 0.25 | 0.07 | 0.21 | 0.09 | - | |
2026.01 | - | - | 0.94 | - | 0.91 | - | 0.9 | - | 0.92 | - | 0.05 | 0.05 | 0.06 | 0.29 | - | |
2026.01 | - | - | 0.92 | - | 0.88 | - | 0.89 | - | 0.93 | - | 0.04 | 0.92 | 0.6 | 0.06 | - | |
2026.01 | - | - | 0.87 | - | 0.6 | - | 0.9 | - | 0.86 | - | 0.17 | 0.15 | 0.15 | 0.22 | - | |
2026.01 | - | - | 0.92 | - | 0.66 | - | 0.91 | - | 0.89 | - | 0.09 | 0.08 | 0.09 | 0.16 | - | |
2026.01 | - | - | 0.84 | - | 0.63 | - | 0.81 | - | 0.83 | - | 0.36 | 0.25 | 0.13 | 0.18 | - | |
2026.01 | - | - | 0.88 | - | 0.78 | - | 0.92 | - | 0.92 | - | 0.17 | 0.07 | 0.15 | 0.15 | - | |
2025.12 | - | 0.72 | - | - | - | - | - | - | - | - | - | - | - | - | 0.05 | |
2025.12 | - | 0.6 | - | - | - | - | - | - | - | - | - | - | - | - | 0.06 | |
2025.12 | - | 0.67 | - | - | - | - | - | - | - | - | - | - | - | - | 0.08 | |
2025.12 | - | 0.69 | - | - | - | - | - | - | - | - | - | - | - | - | 0.04 | |
2025.12 | - | 0.61 | - | - | - | - | - | - | - | - | - | - | - | - | 0.05 |