sWUGGY
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Speech Semantic Understanding | sWUGGY | sWUGGY Accuracy73.9 | 10 | |
| Structural Consistency | sWUGGY | sWUGGY Structural Consistency75.36 | 8 | |
| Audio Language Modeling | sWUGGY | Accuracy75.28 | 8 | |
| Linguistic Evaluation | sWUGGY | sWUGGY Score74.3 | 7 | |
| Lexical knowledge | sWUGGY Speech (test) | Accuracy79.2 | 7 | |
| Zero-shot Speech Evaluation | sWUGGY | sWUGGY In-Vocab Score84.1 | 7 | |
| Lexical knowledge evaluation | sWUGGY ZeroResource Challenge 2021 (dev) | Success Rate (All)97.9 | 7 | |
| Zero-resource speech modeling | sWUGGY (in-vocabulary) | Inter Score74.24 | 5 | |
| Lexical knowledge | sWUGGY Text (test) | Accuracy84.1 | 4 |
Showing 9 of 9 rows