Share your thoughts, 1 month free Claude Pro on usSee more

Multiple Choice Video Question Answering on EgoSchema

72.2Accuracy

Gemini-1.5-Pro

Updated 1mo ago

Evaluation Results

Method	Links
Gemini-1.5-Pro 2025.03		72.2
VideoTree 2024.11		66.2
VideoTree 2024.11		66.2
VideoTree 2024.11		66.2
Gemini-1.5-Flash 2025.03		65.7
DrVideo 2024.06		61
VideoAgent 2024.11		60.2
VideoAgent 2024.11		60.2
VideoAgent 2024.11		60.2
VideoAgent 2024.06		60.2
LLaVA-OV-7B 2025.03		60.1
LLaVAction-7B 2025.03		59
TS-LLaVA 2024.11		57.8
TS-LLaVA 2024.11		57.8
TS-LLaVA 2024.11		57.8
LLaVA-Video-7B 2025.03		57.3
KTV-34B-dense 2026.02		57
DYTO 2026.02		56.8
MovieChat+ 2024.11		56.4
MovieChat+ 2024.11		56.4
SF-LLAVA 2024.11		55.8
SF-LLAVA 2024.11		55.8
SF-LLAVA 2024.11		55.8
KTV-34B-sparse 2026.02		55.6
KTV-34B-normal 2026.02		55.6
SF-LLaVA-7B 2026.02		55
VideoAgent 2024.06		54.1
IG-VLM 2024.11		53.6
IG-VLM 2024.11		53.6
IG-VLM 2024.11		53.6
IG-VLM 2026.02		53.4
Video-LLAMA2 2024.11		53.3
VideoLLaMA2 2026.02		53.3
Video-LLaMA2 2024.11		51.7
Video-LLaMA2 2024.11		51.7
MoReVQA 2024.06		51.7
VideoLLaMA2-7B 2025.03		51.7
KTV-7B-dense 2026.02		51
KTV-7B-normal 2026.02		50.4
LLoVi 2024.11		50.3
LLoVi 2024.11		50.3
LLoVi 2024.11		50.3
LLoVi 2024.06		50.3
TS-LLaVA 2024.11		50.2
TS-LLaVA 2024.11		50.2
KTV-7B-sparse 2026.02		49.6
DYTO 2026.02		48.6
Vamos 2024.06		48.3
SF-LLaVA 2024.11		47.2
SF-LLaVA 2024.11		47.2
SF-LLaVA-7B 2026.02		44.2
DeepStack-L 2024.11		38.4
DeepStack-L 2024.11		38.4
MVU 2024.06		37.6
Video-LLaVA 2024.11		37
Video-LLaVA 2024.11		37
M3 2024.11		36.8
M3 2024.11		36.8
IG-VLM 2024.11		35.8
IG-VLM 2024.11		35.8
IG-VLM 2026.02		35.8