Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

$G^2$-Reader: Dual Evolving Graphs for Multimodal Document QA

About

Retrieval-augmented generation is a practical paradigm for question answering over long documents, but it remains brittle for multimodal reading where text, tables, and figures are interleaved across many pages. First, flat chunking breaks document-native structure and cross-modal alignment, yielding semantic fragments that are hard to interpret in isolation. Second, even iterative retrieval can fail in long contexts by looping on partial evidence or drifting into irrelevant sections as noise accumulates, since each step is guided only by the current snippet without a persistent global search state. We introduce $G^2$-Reader, a dual-graph system, to address both issues. It evolves a Content Graph to preserve document-native structure and cross-modal semantics, and maintains a Planning Graph, an agentic directed acyclic graph of sub-questions, to track intermediate findings and guide stepwise navigation for evidence completion. On VisDoMBench across five multimodal domains, $G^2$-Reader with Qwen3-VL-32B-Instruct reaches 66.21\% average accuracy, outperforming strong baselines and a standalone GPT-5 (53.08\%).

Yaxin Du, Junru Song, Yifan Zhou, Cheng Wang, Jiahao Gu, Zimeng Chen, Menglan Chen, Wen Yao, Yang Yang, Ying Wen, Siheng Chen• 2026

Related benchmarks

TaskDatasetResultRank
Multi-Modal Long Document Question AnsweringVisDoMBench (Full)
SPIQA Score73.19
25
Multimodal Document QAVisDoMBench PaperTab (full)
Accuracy57.1
11
Multimodal Document QAVisDoMBench SlideVQA (full)
Accuracy72.31
11
Multimodal Document QAVisDoMBench SPIQA (full)
Accuracy73.19
11
Multimodal Document QAVisDoMBench FetaTab (full)
Accuracy66.89
11
Multimodal Document QAVisDoMBench SciGraphQA (full)
Accuracy61.56
11
Document UnderstandingLongDocURL
Accuracy (TXT)57.82
8
Showing 7 of 7 rows

Other info

Follow for update