LLM-as-a-Judge Evaluation Consistency on PreferenceBench
79.73Kappa
CalibraEval
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2024.10 | 79.73 | 97.29 | 97.6 | |
2024.10 | 79.42 | 93.5 | 94.11 | |
2024.10 | 58.54 | 88.17 | 89.43 | |
2024.10 | 58.25 | 86.23 | 86.61 |
CalibraEval
| Method | Links | |||
|---|---|---|---|---|
2024.10 | 79.73 | 97.29 | 97.6 | |
2024.10 | 79.42 | 93.5 | 94.11 | |
2024.10 | 58.54 | 88.17 | 89.43 | |
2024.10 | 58.25 | 86.23 | 86.61 |