StoryCloze
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Story completion | StoryCloze | Accuracy99.47 | 80 | |
| Commonsense Reasoning | StoryCloze | Accuracy97.6 | 34 | |
| Commonsense Reasoning | Spoken StoryCloze | Accuracy89.1 | 17 | |
| Sentence Completion | StoryCloze | Accuracy90.8 | 11 | |
| Audio-to-Audio Story Continuation | StoryCloze tSC | A2A-tSC Score88.3 | 10 | |
| Zero-shot Reasoning | StoryCloze zero-shot | Accuracy79.95 | 8 | |
| Audio Language Modeling | sStoryCloze | Accuracy68.55 | 7 | |
| Audio Language Modeling | StoryCloze sTopic | Accuracy83.64 | 7 | |
| Story Completion | StoryCloze | Accuracy (0-shot)83.3 | 6 | |
| Commonsense Reasoning | StoryCloze 2016 | Accuracy74.67 | 6 | |
| Text-to-Text Story Continuation | StoryCloze tSC | T2T-tSC Accuracy99.4 | 5 | |
| Audio-to-Text Story Continuation | StoryCloze tSC | Accuracy (tSC)95.7 | 5 | |
| Commonsense Reasoning | StoryCloze (test) | Accuracy79.82 | 5 | |
| Language Modeling | StoryCloze | Accuracy (%)57.56 | 4 | |
| Spoken Language Understanding | Spoken StoryCloze (TSTORYCLOZE) | Accuracy90.2 | 4 | |
| Spoken Language Understanding | Spoken StoryCloze (SSTORYCLOZE) | Accuracy79.9 | 4 |
Showing 16 of 16 rows