MM-Telco
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multiple-Choice Question Answering | MM-Telco | CT WG1 Accuracy84.5 | 9 | |
| Information Retrieval | MM-Telco | Top-1 Accuracy76.9 | 7 | |
| Long Question Answering | MM-Telco Long QA | ROUGE-141 | 6 | |
| Long-Form Question Answering | MM-Telco Telecom Blog | ROUGE-127 | 6 | |
| Image caption generation | MM-Telco | sacreBLEU9.51 | 3 | |
| Image Based QA | MM-Telco | sacreBLEU13 | 3 | |
| Image retrieval | MM-Telco | Top-1 Accuracy42 | 2 |
Showing 7 of 7 rows