Clotho
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Audio-to-Text Retrieval | Clotho (test) | R@138.6 | 92 | |
| Text-to-Audio Retrieval | Clotho (test) | R@128.3 | 85 | |
| Audio Captioning | Clotho | CIDEr50.9 | 82 | |
| Audio Captioning | Clotho 2.1 (test) | SPICE0.199 | 75 | |
| Audio-to-Text Retrieval | Clotho | R@126.5 | 49 | |
| Audio Captioning | Clotho (test) | METEOR19.7 | 43 | |
| Audio Retrieval | Clotho | R@123.7 | 33 | |
| Text-to-Audio Retrieval | Clotho | R@10.212 | 31 | |
| Cross-modal retrieval | Clotho (test) | R@146.4 | 29 | |
| Text-to-audio retrieval | CLOTHO v1 (test) | SR98 | 24 | |
| Audio Understanding | ClothoAQA | Accuracy87.17 | 20 | |
| Audio Question and Answering | ClothoAQA | Accuracy85.6 | 20 | |
| Text-to-audio Retrieval | Clotho V2 (test) | R@116.56 | 17 | |
| Audio-to-text Retrieval | Clotho V2 (test) | Recall@118.78 | 17 | |
| Text-to-Audio Generation | Clotho (test) | FID17.23 | 17 | |
| Text-to-Audio Retrieval | Clotho T→A | Recall@124 | 15 | |
| Text-to-Audio Retrieval | Clotho V1 | R@125.3 | 15 | |
| Audio Hallucination Evaluation | Clotho-1K | HR16.98 | 14 | |
| Text-to-text retrieval | Clotho | R@164.52 | 13 | |
| Text-to-Audio Retrieval | Clotho (evaluation) | R@122.87 | 13 | |
| Text-to-Audio Retrieval | Clotho V2 | R@1 (%)27.2 | 13 | |
| Audio Captioning | Clotho v2 (test) | BLEU-10.602 | 12 | |
| Automated Audio Captioning | Clotho | AAC Score55.92 | 12 | |
| Automated Audio Captioning | Clotho 2.1 (evaluation) | SPIDEr33.4 | 12 | |
| Audio Question Answering | Clotho (test) | Token-Level Accuracy52.8 | 11 |
Showing 25 of 57 rows