Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Future Prediction on FutureOmni 1.0 (Overall)

62.71Accuracy (Cartoon)

Gemini 3 Flash

Updated 3mo ago

Evaluation Results

Method	Links
Gemini 3 Flash 2026.01		62.71	75	58.7	80.28	68.75	59.03	65.06	53.47	64.8
Claude Haiku 4.5 2026.01		55.08	66	44.57	57.04	51.56	48.9	57.83	41.67	52.03
Qwen3-Omni 2026.01		52.94	68	32.88	62.71	59.05	45.6	62.65	49.25	53.05
Gemini 2.5 Flash 2026.01		50.85	70	47.83	59.15	58.59	51.54	60.24	50	55.61
video-SALMONN 2+ 2026.01		50.43	61	39.13	55.63	52.34	40.09	54.22	33.33	47
Gemini 2.5 Pro 2026.01		49.15	75	54.35	69.01	62.5	51.54	65.06	46.53	57.93
MiniCPM-o 2.6 2026.01		48.72	63	43.48	59.15	50	41.85	62.65	36.11	49.08
Qwen2.5-Omni 2026.01		47.86	55	35.87	59.86	48.44	40.09	61.45	40.28	47.48
Ola 2026.01		44.44	62	42.39	64.08	47.66	41.41	59.04	37.5	48.54
GPT-4o 2026.01		44.06	65	34.78	57.74	52.34	50.22	51.8	36.11	49.7
VideoLLaMA2 2026.01		43.59	47	29.35	53.52	40.62	32.6	57.83	31.94	40.75
video-SALMONN 2 2026.01		43.59	55	39.13	57.04	48.44	40.97	57.83	34.72	46.03
LLaVA-NeXT 2026.01		43.59	49	31.52	49.3	35.94	38.33	50.6	31.94	40.62
Qwen2.5-VL 2026.01		43.59	58	30.43	52.82	48.44	37	53.01	34.72	43.71
VideoLLaMA3 2026.01		42.74	59	33.7	58.16	42.97	43.61	67.47	35.66	46.8
Qwen3-VL 2026.01		41.88	66	43.48	59.15	53.12	41.85	61.45	39.58	49.32
Video-LLaVA 2026.01		39.32	47	33.7	41.55	42.19	32.16	44.58	29.86	37.72
Qwen3-VL 2026.01		39.32	64	34.78	58.45	48.44	38.33	57.83	36.11	45.84
Qwen2.5-Omni 2026.01		37.61	51	29.35	57.75	35.94	32.16	51.81	25	38.91
AVicuna 2026.01		31.62	39	26.09	35.21	32.81	28.19	33.73	20.83	30.37