Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

VATEX

Benchmarks

Task NameDataset NameSOTA ResultTrend
Text-to-Video RetrievalVATEX
R@195.1
95
Video-to-Text RetrievalVATEX
Recall@194.8
68
Text-to-Video RetrievalVATEX (test)
R@178.5
62
Video CaptioningVATEX (test)
CIDEr84.2
59
Video CaptioningVATEX
CIDEr99.5
46
Video CaptioningVATEX (public test)
CIDEr94.5
24
Human Judgment CorrelationVATEX EVAL (val)
Kendall Tau-b38.1
20
Video-to-Text RetrievalVATEX (test)
Recall@182.3
15
Video CaptioningVATEX online evaluation (test)
CIDEr73
15
Video CaptioningVATEX (private test)
CIDEr96.6
14
Multimodal Machine TranslationVaTex En-Zh (half of val)
BLEU36.43
12
Video CaptioningVATEX V (test)
CIDEr76.3
11
Text-to-Video RetrievalVATEX HGR partition (test)
R@163.5
9
Human CorrelationVATEX-EVAL 9 References
Kendall's Tau Correlation0.3681
8
Human CorrelationVATEX EVAL 1 Reference
Kendall's Tau0.2863
8
Video/Caption RetrievalVatex full (test)
R@145.9
8
Video-to-adverb retrievalVATEX
Acc-A0.817
7
Adverb-to-video retrievalVATEX
mAP W29
7
Adverb RecognitionVATEX Adverbs
mAP (W)28.3
7
Adverb recognitionVATEX Adverbs v1 (test)
mAP W16.9
7
Video-Text RetrievalVATEX (HGR)
R@165.4
7
Video-to-Text RetrievalVATEX HGR partition (test)
R@178.7
6
Text-to-Video RetrievalVATEX (standard)
Recall@183
6
Text-to-Video RetrievalVATEX English (test)
Recall@136.8
6
Visual CaptioningVATEX Chinese In-domain (test)
BLEU-429.7
5
Showing 25 of 39 rows