Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

FocalOrder: Focal Preference Optimization for Reading Order Detection

About

Reading order detection is the foundation of document understanding. Most existing methods rely on uniform supervision, implicitly assuming a constant difficulty distribution across layout regions. In this work, we challenge this assumption by revealing a critical flaw: \textbf{Positional Disparity}, a phenomenon where models demonstrate mastery over the deterministic start and end regions but suffer a performance collapse in the complex intermediate sections. This degradation arises because standard training allows the massive volume of easy patterns to drown out the learning signals from difficult layouts. To address this, we propose \textbf{FocalOrder}, a framework driven by \textbf{Focal Preference Optimization (FPO)}. Specifically, FocalOrder employs adaptive difficulty discovery with exponential moving average mechanism to dynamically pinpoint hard-to-learn transitions, while introducing a difficulty-calibrated pairwise ranking objective to enforce global logical consistency. Extensive experiments demonstrate that FocalOrder establishes new state-of-the-art results on OmniDocBench v1.0 and Comp-HRDoc. Our compact model not only outperforms competitive specialized baselines but also significantly surpasses large-scale general VLMs. These results demonstrate that aligning the optimization with intrinsic structural ambiguity of documents is critical for mastering complex document structures.

Fuyuan Liu, Dianyu Yu, He Ren, Nayu Liu, Xiaomian Kang, Delai Qiu, Fa Zhang, Genpeng Zhen, Shengping Liu, Jiaen Liang, Wei Huang, Yining Wang, Junnan Zhu• 2026

Related benchmarks

TaskDatasetResultRank
Reading Order DetectionOmniDocBench EN v1.0
Edit Distance0.038
28
Reading Order DetectionOmniDocBench ZH v1.0
Edit Distance0.055
28
Reading Order DetectionOmniDocBench v1.5
Edit Distance0.044
21
Reading Order DetectionComp-HRDoc
Text Region REDS0.971
4
Showing 4 of 4 rows

Other info

Follow for update