Share your thoughts, 1 month free Claude Pro on usSee more

Audio-Visual Understanding on DailyOmni

82.71Average Score

OmniAgent

Updated 19d ago

Evaluation Results

Method	Links
OmniAgent 2025.12		82.71	81.05	80.67	83.36	86.86	80.83	83.21	80.37	85.45
D-ORCA 2026.02		78.5	-	-	-	-	-	-	-	-
OmniSIFT 2026.02		73.2	66.7	70.2	83.1	78.9	69.9	79.4	-	-
Gemini 2.5-Flash 2025.12		72.7	-	-	-	-	-	-	-	-
OmniSIFT 2026.02		72.5	66.7	68.9	82.5	77.7	71	76.3	-	-
Full Tokens 2026.02		72.2	66.7	70.6	79.2	76.6	69.9	77.1	-	-
Qwen3-Omni-30B 2025.12		72.08	65.32	61.9	82.67	85.92	69.47	79.25	71.28	74.29
video-SALMONN 2+ 2026.02		71.8	-	-	-	-	-	-	-	-
XGC-AVis 2025.12		71.5	64.4	63.5	85.1	82.3	68.4	77.1	71.6	71.5
AVoCaDO 2026.02		69.8	-	-	-	-	-	-	-	-
Qwen3-Omni-Instruct 2026.02		69.8	-	-	-	-	-	-	-	-
DyCoke 2026.02		67.9	61.4	63.9	77.9	75.4	63.7	74.8	-	-
Gemini 2.0-Flash 2025.12		67.84	63.72	62.18	76.62	75.43	63.73	73.28	67.23	68.55
OmniZip 2026.02		67.7	63.7	63	77.3	76.6	59.1	74.8	-	-
Full Tokens 2026.02		67	60.1	62.2	78.6	74.9	62.2	74.8	-	-
OmniVinci 2026.02		66.5	-	-	-	-	-	-	-	-
Random 2026.02		66.3	58.5	61.8	77.9	73.7	63.2	74	-	-
OmniZip 2026.02		66.2	61.8	59.7	75.3	75.4	60.6	74	-	-
OmniSIFT 2026.02		65.3	57.8	58.8	77.3	73.7	64.8	69.5	-	-
Random 2026.02		65.2	61.1	56.7	78.6	71.4	60.1	73.3	-	-
Qwen3-VL-Plus 2025.12		65	66.99	51.68	71.43	68.57	61.66	77.1	63.68	66.55
DyCoke 2026.02		64.7	57.2	56.7	80	74.3	61.1	71	-	-
OmniZip 2026.02		64.7	60.5	56.7	76.6	72	59.6	72.5	-	-
OmniSIFT 2026.02		64.7	58.5	59.7	75.3	73.7	60.6	70.2	-	-
OmniZip 2026.02		64.2	57.8	55	75.3	70.3	58.5	70	-	-
DyCoke 2026.02		63.2	53.9	52.5	79.2	76	60.1	72.5	-	-
ARC-Qwen-Video-Narrator 2026.02		63.2	-	-	-	-	-	-	-	-
Random 2026.02		62.9	55.9	54.2	76	74.3	60.1	68.7	-	-
Qwen2.5-Omni 2026.02		62.7	-	-	-	-	-	-	-	-
Daily-Omni 2025.12		61.82	53.92	51.68	78.57	71.43	60.1	68.7	63.99	59.27
DyCoke 2026.02		61.7	52.6	54.6	74.7	74.3	58	69.5	-	-
Random 2026.02		61.2	53.3	54.2	76.6	72	55.4	67.9	-	-
DVD 2025.12		59.22	58.45	49.32	70.37	63.24	57.12	57.47	56.31	62.41
GPT-4o 2025.12		56.47	52.61	47.9	66.23	66.29	52.33	62.6	55.64	57.45
Ola-7B + AVATAR 2025.08		55.7	-	-	-	-	-	-	-	-
Ola-7B + GRPO 2025.08		54.1	-	-	-	-	-	-	-	-
Qwen 2.5 Omni + MoD-DPO++ 2026.03		53.82	-	-	-	-	-	-	53.45	54.18
AV-Reasoner 2025.08		53.8	-	-	-	-	-	-	-	-
Qwen 2.5 Omni + MoD-DPO 2026.03		53	-	-	-	-	-	-	52.45	53.54
Ola-7B 2025.08		52.3	-	-	-	-	-	-	-	-
Qwen 2.5 Omni + DPO 2026.03		51.44	-	-	-	-	-	-	50.95	51.93
Ola-7B 2025.12		50.71	43.46	40.34	63.64	69.71	40.41	61.07	51.47	49.82
Qwen 2.5 Omni + OmniDPO 2026.03		50.07	-	-	-	-	-	-	49.24	50.89
Gemini 2.5-Flash + RAG + Agent 2026.02		48.83	53.23	26.92	59.09	60	46.65	34.38	-	-
HumanOmni 2025.08		47.6	-	-	-	-	-	-	-	-
Qwen2.5-Omni-7B 2025.12		47.45	40.52	44.12	57.79	61.71	38.86	51.15	46.68	48.36
Qwen 2.5 Omni 2026.03		47.34	-	-	-	-	-	-	46.74	48.46
Qwen2.5-Omni + AVATAR 2025.08		47	-	-	-	-	-	-	-	-
Omni-R1 2025.08		46.8	-	-	-	-	-	-	-	-
Gemini 2.5-Flash + RAG 2026.02		46.48	41.94	38.46	54.55	55.56	45.65	39.39	-	-
Echolnk 2025.08		46.2	-	-	-	-	-	-	-	-
Qwen2.5-Omni-7B + RAG + Agent + RL 2026.02		44.92	59.09	27.45	45.45	45.95	51.22	32.14	-	-
Qwen2.5-Omni + GRPO 2025.08		44.8	-	-	-	-	-	-	-	-
Gemini 2.5-Flash 2026.02		44.53	37.1	34.63	56.82	51.11	50	34.38	-	-
Qwen2.5-Omni 2025.08		44	-	-	-	-	-	-	-	-
Qwen2.5-Omni-7B + RAG + Agent 2026.02		42.19	33.33	45.1	48.48	35.14	56.1	39.29	-	-
Qwen2.5-Omni-3B + RAG + Agent + RL 2026.02		40.09	40.54	39.22	36.36	51.35	41.46	28.57	-	-
Qwen2.5-Omni-7B + RAG 2026.02		39.84	33.33	37.25	42.42	48.65	46.34	35.71	-	-
Qwen2.5-Omni-3B + RAG + Agent 2026.02		37.11	25.76	37.25	42.42	51.35	41.46	32.14	-	-
MiniCPM-O 2.6 + MoD-DPO++ 2026.03		36.6	-	-	-	-	-	-	43.33	29.87
Qwen2.5-Omni-7B 2026.02		36.33	51.52	29.41	21.21	32.43	41.46	28.57	-	-
Qwen2.5-Omni-3B + RAG 2026.02		35.94	22.73	27.45	48.48	37.84	60.98	28.57	-	-
MiniCPM-O 2.6 + MoD-DPO 2026.03		35.71	-	-	-	-	-	-	42.86	28.56
VideoLLaMA2-7B 2025.12		35.17	31.7	35.71	40.91	34.29	35.75	35.88	38.02	31.82
MiniCPM-O 2.6 + OmniDPO 2026.03		34.33	-	-	-	-	-	-	40.68	27.98
MiniCPM-O 2.6 + DPO 2026.03		34.13	-	-	-	-	-	-	39.97	28.28
Qwen2.5-Omni-3B 2026.02		32.03	25.76	39.22	33.33	29.73	41.46	21.43	-	-
MiniCPM-O 2.6 2026.03		30.55	-	-	-	-	-	-	38.02	23.09
Unified-IO-2 XXL-8B 2025.12		28.24	25.82	25.63	35.06	29.71	26.42	31.3	26.74	30