URO-Bench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Spoken Dialogue Evaluation | URO-Bench English Basic Track | Repeat Rate1.08 | 16 | |
| Spoken Dialogue | URO-Bench Chinese Basic Track | Repeat Score99.83 | 15 | |
| Logical Reasoning | URO-Bench | GSM8k Score95.53 | 13 | |
| Audio Synthesis | URO-Bench | NMOS4.23 | 12 | |
| Speech-to-Speech | URO-Bench Pro Task | Understanding Score55.47 | 12 | |
| Spoken Dialogue | URO-Bench Basic Track | Understanding Accuracy85.82 | 12 | |
| Speech Conversation | URO-Bench English Pro | Understanding Score76.5 | 9 | |
| Speech Conversation | URO-Bench English Basic | Understanding Score (U)94.2 | 9 | |
| Speech Conversation | URO-Bench Chinese Pro | Understanding (U)77.2 | 9 | |
| Speech Conversation | URO-Bench Chinese Basic | Understanding Score93.6 | 9 | |
| Spoken understanding and reasoning | URO-Bench English Pro | U Score75.4 | 8 | |
| Spoken understanding and reasoning | URO-Bench English Basic | U Score92.7 | 8 | |
| Spoken understanding and reasoning | URO-Bench Chinese (Pro) | U Score93.9 | 8 | |
| Spoken understanding and reasoning | URO-Bench Chinese Basic | U Score91.1 | 8 | |
| Talking Head Video Generation | URO-Bench | Lip LMD21.91 | 7 | |
| Audio Quality Assessment | URO-Bench | Open-D61 | 7 | |
| Dual-agent Video Emotion Evaluation | URO-Bench | Emo Score36.04 | 5 | |
| Dialogue | URO-Bench-pro | Understanding Score69.1 | 3 |
Showing 18 of 18 rows