| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| MT-Bench | EAGLE-3 | Kendall's Tau (τ)4.01 | 74 | 18d ago | |
| EmpatheticDialogues | MDD-C | Spearman Correlation0.404 | 19 | 4mo ago | |
| Arena-Hard | DSpark | Accepted Length (τ)3.29 | 12 | 18d ago | |
| Alpaca | DSpark | Accepted Length (τ)3.58 | 12 | 18d ago | |
| DSTC9 Interactive Dialogue Evaluation Track (test) | Human Baseline | Human Rating5 | 12 | 4mo ago | |
| Topical-Chat turn-level | UniEval (Dial) | Naturalness (Pearson r)0.444 | 11 | 4mo ago | |
| SVBench | GPT-4o | SA58.26 | 10 | 1mo ago | |
| ConsistentChat (test) | MDS | G-E Score7.3 | 10 | 3mo ago | |
| Banking (test) | MDS | G-E6.72 | 10 | 3mo ago | |
| Ice-breaker human evaluation 1.0 (test) | Model A | Overall Score0.552 | 10 | 4mo ago | |
| Twitter-Eval | Spearman Correlation0.301 | 10 | 4mo ago | ||
| Movie Eval | DEB | Spearman Correlation0.649 | 10 | 4mo ago | |
| Topical-Eval | MDD-S | Spearman Correlation0.52 | 10 | 4mo ago | |
| Persona-Eval | MDD-S | Spearman Correlation0.621 | 10 | 4mo ago | |
| DailyDialog (eval) | MDD-S | Spearman Correlation0.579 | 10 | 4mo ago | |
| ConvAI2 | QuantiDCE | Pearson Correlation0.554 | 9 | 4mo ago | |
| TopicalChat | CV (Understandability)0.48 | 7 | 4mo ago | ||
| USR-PersonaChat (test) | USL-H | Pearson Correlation (r)0.495 | 7 | 4mo ago | |
| USR-TopicalChat (test) | RADE | Pearson Correlation (r)0.48 | 7 | 4mo ago | |
| Chatbot Domain | Correlation Score0.93 | 6 | 4mo ago | ||
| Human/Model Chats (test) | MMB Style | Engagement Score83 | 6 | 4mo ago | |
| Empathetic Dialogues | USR RET0.996 | 5 | 4mo ago | ||
| Wizard of Internet (WoI) | OPT-175B | Perplexity12 | 4 | 4mo ago | |
| Blended Skill Talk (BST) | R2C2 BlenderBot | Perplexity11.7 | 4 | 4mo ago | |
| Empathetic Dialogues (ED) | BlenderBot 1 | Perplexity9 | 4 | 4mo ago |
