SOTA Video Understanding benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
MVBench	MACD	Accuracy90	247	2d ago
VideoMME		Overall Score100	192	3d ago
VideoMME		Score (Short)77	127	2d ago
MVBench (test)	FSR	Accuracy100.3	97	2d ago
LongVideoBench	VisionZip† + DyTok (7B)	LongVideoBench Score59.2	79	2d ago
LongVideoBench, MLVU, and VideoMME Aggregate	LLaVA-OneVision-7B	Average Score56.4	75	2d ago
MLVU		Score50	70	2d ago
Video-MME without subtitles	Gemini-1.5-Pro	Overall Score75	67	3d ago
MLVU	Zoom-Zero	M-AVG70.8	54	3d ago
MLVU 3-120min (test)	LLaVA-OneVision-7B	Accuracy47.7	49	3d ago
MLVU 3-120min (dev)	LLaVA-OneVision-7B	Accuracy63	49	3d ago
LongVideoBench 1-60min	CaCoVID	Accuracy56.8	49	3d ago
EgoSchema	LinVT-Qwen2-VL	Accuracy69.5	49	2d ago
VideoMME, EgoSchema, LongVideoBench, MVBench		Avg. Score61.6	48	2d ago
Video-MME (test)	Gemini-2.5-Pro	Accuracy (No Subtitles)84.3	40	3d ago
Perception (test)	PLM-8B	Accuracy82.7	40	3d ago
Video Understanding Suite MVBench, EgoSchema, VMME, LVB, VMMMU	InternVL-3.5-30B-A3B-HF	MVBench Score68.92	34	3d ago
MLVU (test)	FSR	Average100.3	34	2d ago
EgoSchema (test)	Qwen2-VL-72B	Accuracy77.9	34	3d ago
SEED-Bench Video Understanding		Accuracy74.12	33	3d ago
TempCompass MCQ (test)		Accuracy82.8	33	3d ago
Video-MME Long	Gemini-1.5-Pro	Accuracy (Long, wo Sub)67.4	32	3d ago
VideoMME Long	DIG	Score59	25	3d ago
Average VideoMME, LongVideoBench, MLVU	VisionZip† + DyTok (7B)	Score55.9	25	2d ago
LVBench	LongVPO (128f) Stage 2	Overall Accuracy53.6	23	3d ago

Showing 25 of 106 rows