Share your thoughts, 1 month free Claude Pro on usSee more

Multiple-Choice Video QA on EgoSchema latest (test)

72.2Accuracy

GPT4-O

Updated 1mo ago

Evaluation Results

Method	Links
GPT4-O 2024.06		72.2
VideoLLaMA2 2024.06		63.9
Gemini 1.5 Pro 2024.06		63.2
LLaVA-OneVision 2024.06		62
Gemini 1.0 Ultra 2024.06		61.5
LLaVA-NeXT-Video 2024.06		60.9
VILA 1.5 2024.06		58
Gemini 1.0 Pro 2024.06		55.7
GPT4-V 2024.06		55.6
VideoLLaMA2 2024.06		53.3
VideoLLaMA2.1 2024.06		53.1
VideoLLaMA2 2024.06		51.7
VideoLLaMA2 2024.06		50.5
LLaVA-NeXT-Video 2024.06		43.9
VideoChat2 2024.06		42.2
LLAMA-VID 2024.06		38.5
Video-LLaVA 2024.06		38.4