FSC
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Object Counting | FSC-147 1.0 (val) | MAE9.52 | 50 | |
| Audio Classification | FSC-89 | Average Accuracy (AA)41.88 | 25 | |
| Intent Classification | FSC (test) | Accuracy99.7 | 25 | |
| Object Counting | FSC-147 (Average) | MAE6.93 | 19 | |
| Intent Prediction | FSC | Accuracy99.2 | 17 | |
| Spoken Language Understanding | FSC (test) | Intent Accuracy100 | 16 | |
| Intent Classification | FSC (val) | Accuracy97.8 | 14 | |
| Counting | FSC-133 (test) | MAE13.85 | 11 | |
| Open-set Few-shot Classification | FSC-89 5-way 5-shot | Accuracy80.83 | 9 | |
| Open-set Few-shot Classification | FSC-89 5-way 1-shot | Accuracy63.62 | 9 | |
| Automatic Speech Recognition | FSC Phase-4 (Eval) | WER25.7 | 9 | |
| Automatic Speech Recognition | FSC Phase-4 (dev) | WER23.7 | 9 | |
| Spoken Language Understanding | FSC 3 tasks | Avg Accuracy99.28 | 9 | |
| Pointing & Counting | FSC-147 | Pass@111.3 | 7 | |
| Grounding & counting | FSC-147 | MAE17.9 | 7 | |
| Audio Classification | FSC | Accuracy98.58 | 6 | |
| Spoken Language Understanding | FSC (test) | EM (Oracle)100 | 4 | |
| Grounding and Counting | 100-FSC-147 (val) | Accuracy81.39 | 4 |
Showing 18 of 18 rows