Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

WIT

Benchmarks

Task NameDataset NameSOTA ResultTrend
Text RetrievalWIT translated English (test)
Recall@10.3079
13
Image RetrievalWIT translated English (test)
Recall@129.98
13
Image-Text RetrievalWIT Under-resourced v1 (test)
Recall@1 (tg)0.729
8
Image-Text RetrievalWIT Well-resourced v1 (test)
Retrieval Score (en)82.4
8
Bridged ClusteringWIT reversed input/output mapping (transductive)
Win Rate30
6
Bridged ClusteringWIT standard (transductive)
Win-rate32
6
Cluster MappingWIT rev. (inductive)
Win Rate30
6
Cluster MappingWIT (inductive)
Win Rate32
6
Machine TranslationWIT EN-AF (test)
BLEU14
5
Machine TranslationWIT EN-RO (test)
BLEU14.4
5
Machine TranslationWIT ES-FR (test)
BLEU Score16.6
5
Machine TranslationWIT (DE-ES) (test)
BLEU11.3
5
Machine TranslationWIT EN-FR (test)
BLEU18.8
5
Machine TranslationWIT EN-ES (test)
BLEU27.5
5
Machine TranslationWIT EN-DE (test)
BLEU17.5
5
Machine TranslationWIT
EN->DE Score36.8
5
Showing 16 of 16 rows