Share your thoughts, 1 month free Claude Pro on usSee more

Task progression failure detection on Cover Object (Combined)

100TPR

GPT-4o Image QA

Updated 1mo ago

Evaluation Results

Method	Links
GPT-4o Image QA 2026.03		100	7	47
GPT-4o Video QA 2026.03		100	5	46
Gemini 1.5 Pro Video QA 2026.03		100	0	44
Claude 3.5 Sonnet Video QA + Success Video 2026.03		94	77	85
Gemini 1.5 Pro Image QA 2026.03		91	5	42
Sentinel (STAC MMD* + Claude 3.5 Sonnet Prompt Ensemble*) 2026.03		88	89	88
Claude 3.5 Sonnet Prompt Ensemble* 2026.03		85	93	90
Sentinel (STAC MMD* + Claude 3.5 Sonnet Video QA) 2026.03		82	80	81
Claude 3.5 Sonnet Video QA 2026.03		79	84	82
Claude 3.5 Sonnet Video QA + Goal Images 2026.03		76	93	86
Claude 3.5 Sonnet Image QA 2026.03		71	82	77
STAC MMD* 2026.03		12	93	58
Temporal Non-Distr. Min. 2026.03		9	93	56
STAC For. KL 2026.03		6	95	56
STAC Rev. KL 2026.03		6	93	55
Diffusion Output Variance 2026.03		0	77	44