Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DocVAL: Validated Chain-of-Thought Distillation for Grounded Document VQA

About

Document visual question answering (DocVQA) requires models to jointly reason over textual content and spatial layout, yet current systems exhibit a sharp accuracy--efficiency trade-off: large teacher models achieve strong grounding but are too expensive for deployment, while compact students suffer substantial drops in localization performance. We propose DocVAL, a validated chain-of-thought distillation framework that transfers the spatial reasoning ability of a large teacher into a deployable student VLM through three key components: (1) teacher supervision with validation-time text detection to filter and denoise training signals, (2) a multi-module validator (VAL) that enforces answer correctness and geometric consistency while producing fine-grained, pixel-level error feedback, and (3) a two-stage student training scheme that first learns from validated CoT traces and then undergoes iterative refinement driven by VAL feedback. Our student (Gemma-3 12B) achieves 91.4\% ANLS and 82.4\% mAP on DocVQA as a pure VLM requiring no text detection or OCR at inference. Extensive ablations demonstrate that validated feedback contributes 6.3 mAP gain and iterative refinement accounts for 9.7 mAP improvement. We release 95k high-quality, validator-verified CoT traces to advance spatial reasoning research in document understanding.

Ahmad Mohammadshirazi, Pinaki Prasad Guha Neogi, Dheeraj Kulshrestha, Rajiv Ramnath• 2025

Related benchmarks

TaskDatasetResultRank
Document Visual Question AnsweringDocVQA
ANLS91.4
164
Document Visual Question AnsweringVisualMRC
ANLS73.7
12
Document Visual Question AnsweringFUNSD
ANLS92.2
12
Document Visual Question AnsweringCORD
ANLS88.8
12
Document Visual Question AnsweringSROIE
ANLS95.2
12
Showing 5 of 5 rows

Other info

Follow for update