Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models

About

We introduce Eagle 2.5, a family of frontier vision-language models (VLMs) for long-context multimodal learning. Our work addresses the challenges in long video comprehension and high-resolution image understanding, introducing a generalist framework for both tasks. The proposed training framework incorporates Automatic Degrade Sampling and Image Area Preservation, two techniques that preserve contextual integrity and visual details. The framework also includes numerous efficiency optimizations in the pipeline for long-context data training. Finally, we propose Eagle-Video-110K, a novel dataset that integrates both story-level and clip-level annotations, facilitating long-video understanding. Eagle 2.5 demonstrates substantial improvements on long-context multimodal benchmarks, providing a robust solution to the limitations of existing VLMs. Notably, our best model Eagle 2.5-8B achieves 72.4% on Video-MME with 512 input frames, matching the results of top-tier commercial model such as GPT-4o and large-scale open-source models like Qwen2.5-VL-72B and InternVL2.5-78B.

Guo Chen, Zhiqi Li, Shihao Wang, Jindong Jiang, Yicheng Liu, Lidong Lu, De-An Huang, Wonmin Byeon, Matthieu Le, Tuomas Rintamaki, Tyler Poon, Max Ehrlich, Tuomas Rintamaki, Tyler Poon, Tong Lu, Limin Wang, Bryan Catanzaro, Jan Kautz, Andrew Tao, Zhiding Yu, Guilin Liu• 2025

Related benchmarks

TaskDatasetResultRank
Video UnderstandingMVBench
Accuracy74.8
635
Long Video UnderstandingLongVideoBench
Score66.4
290
Long Video UnderstandingLongVideoBench (val)
Accuracy66.4
282
Text-based Visual Question AnsweringTextVQA (val)
Accuracy83.7
276
Long Video UnderstandingLVBench
Accuracy50.9
267
Long Video UnderstandingMLVU
Accuracy77.6
265
Multimodal UnderstandingMMMU (val)
MMMU Score55.8
211
Video Question AnsweringNExT-QA (test)
Accuracy85
204
Video UnderstandingMVBench (test)
Accuracy74.8
201
Video UnderstandingEgoSchema--
185
Showing 10 of 102 rows
...

Other info

Follow for update