Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BUS: Brain-Inspired Unsupervised Self-Reflection via Backward Prediction for Multimodal Reasoning

About

Current Vision-Language Models (VLMs) often struggle to handle complex visual tasks that require consistent and fine-grained reasoning. Recent methods aim to train models to facilitate self-reflective reasoning, i.e., reviewing and improving the generated reasoning. However, they require large volumes of annotated data and lack explicit reflective behavior during test time. By contrast, humans perform explicit and efficient self-reflection through mechanisms such as backward prediction, i.e., predicting which current states are likely to precede a given future state. Inspired by neuroscience, this work proposes a novel solution to address these challenges. We first observe and investigate the phenomenon that mainstream VLMs can perform backward prediction, similar to the human brain. A label-free training framework named Brain-inspired Unsupervised Self-reflection (BUS) is proposed to leverage and exploit backward prediction capability to enhance reflective reasoning in complex visual tasks. BUS enables self-verification of reflective reasoning based on backward prediction, providing explicit learning signals under unsupervised conditions. In this way, BUS eliminates reliance on annotated data while improving reasoning performance. Designed as a model-agnostic plug-in, our framework is compatible with popular fine-tuning methods, such as Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). Initialized from Qwen3-VL-8B, it improves HR-Bench-8K (+8.0%), HR-Bench-4K (+7.7%), V* Bench (+6.3%), and MME-RealWorld-Lite (+5.8%), proving backward prediction is key to advancing reflective reasoning.

Jiacheng Yang, Tongying Xiao, Yunkai Dang, Cong Wang, Yuekun Yang, Qi Fan, Tianyu Ding, Wenbin Li, Feng Miao, Yang Gao• 2026

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningWeMath
Accuracy71.3
317
Mathematical ReasoningMathVerse
Accuracy56.2
266
Fine-grained Visual ReasoningMME-RW-Lite ID
Overall Score54.4
20
Fine-grained Visual ReasoningHR-Bench-4K OOD
Overall Score80.1
20
General ReasoningMMStar
Accuracy (General Reasoning)67.1
20
Fine-grained Visual ReasoningV* OOD
Overall Score83.8
20
Fine-grained Visual ReasoningHR-Bench-8K OOD
FSP Score82.3
19
Mathematical ReasoningMathVista
Accuracy (MathVista Reasoning)72.6
13
Showing 8 of 8 rows

Other info

Follow for update