Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Bridging Efficiency and Transparency: Explainable CoT Compression in Multimodal Large Reasoning Models

About

Long chains of thought (Long CoTs) are widely employed in multimodal reasoning models to tackle complex tasks by capturing detailed visual information. However, these Long CoTs are often excessively lengthy and contain redundant reasoning steps, which can hinder inference efficiency. Compressing these long CoTs is a natural solution, yet existing approaches face two major challenges: (1) they may compromise the integrity of visual-textual reasoning by removing essential alignment cues, and (2) the compression process lacks explainability, making it difficult to discern which information is critical. To address these problems, we propose XMCC, an eXplainable Multimodal CoT Compressor that formulates compression as a sequential decision-making process optimized via reinforcement learning. XMCC can effectively shorten reasoning trajectories while preserving key reasoning steps and answer correctness, and simultaneously generates natural-language explanations for its compression decisions. Extensive experiments on representative multimodal reasoning benchmarks demonstrate that XMCC not only reduces reasoning length but also provides explainable explanations, validating its effectiveness.

Yizhi Wang, Linan Yue, Min-Ling Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Multimodal ReasoningWeMath
Accuracy63
43
Multimodal ReasoningMMStar
Accuracy59
29
Multimodal ReasoningMathVista
Accuracy45.3
29
Multimodal ReasoningR1-Onevision-Bench (Overall)
Accuracy33.3
23
Multimodal ReasoningR1-Onevision-Bench Physics
Accuracy34.9
8
Multimodal ReasoningR1-Onevision-Bench Deduction
Accuracy27.6
8
Multimodal ReasoningR1-Onevision-Bench Math
Accuracy25.4
8
Multimodal ReasoningMMMU
Accuracy54.8
8
Visual Information Preservation and Explainability EvaluationMultimodal Reasoning Benchmarks (MathVista, WeMath, MMStar, MMMU, R1-Onevision-Bench) (test)
Visual Info Preservation Score3.95
4
Showing 9 of 9 rows

Other info

Follow for update