Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning

About

Recent advancements in large language models (LLMs) have witnessed a surge in the development of advanced reasoning paradigms, which are now being integrated into multimodal large language models (MLLMs). However, existing approaches often fall short: methods solely employing reinforcement learning (RL) can struggle with sample inefficiency and activating entirely absent reasoning capabilities, while conventional pipelines that initiate with a cold-start supervised fine-tuning (SFT) phase before RL may restrict the model's exploratory capacity and face suboptimal convergence. In this work, we introduce \textbf{Metis-RISE} (\textbf{R}L \textbf{I}ncentivizes and \textbf{S}FT \textbf{E}nhances) for multimodal reasoning model learning. Unlike conventional approaches, Metis-RISE distinctively omits an initial SFT stage, beginning instead with an RL phase (e.g., using a Group Relative Policy Optimization variant) to incentivize and activate the model's latent reasoning capacity. Subsequently, the targeted SFT stage addresses two key challenges identified during RL: (1) \textit{inefficient trajectory sampling} for tasks where the model possesses but inconsistently applies correct reasoning, which we tackle using self-distilled reasoning trajectories from the RL model itself; and (2) \textit{fundamental capability absence}, which we address by injecting expert-augmented knowledge for prompts where the model entirely fails. This strategic application of RL for incentivization followed by SFT for enhancement forms the core of Metis-RISE, leading to two versions of our MLLMs (7B and 72B parameters). Evaluations on the OpenCompass Multimodal Reasoning Leaderboard demonstrate that both models achieve state-of-the-art performance among similar-sized models, with the 72B version ranking fourth overall. Please refer to our project page for open-source information.

Haibo Qiu, Xiaohan Lan, Fanfan Liu, Xiaohu Sun, Delian Ruan, Peng Shi, Lin Ma• 2025

Related benchmarks

TaskDatasetResultRank
Multimodal ReasoningMMMU
Accuracy55.8
208
Multimodal ReasoningMathVision
Accuracy28.7
162
Multimodal ReasoningLogicVista
Accuracy49.7
147
Multimodal ReasoningMathVerse
Accuracy51
130
Multimodal ReasoningMMStar
Accuracy66.6
78
Multi-modal ReasoningEMMA
Accuracy28.5
57
Multimodal ReasoningMathVista
Accuracy75.8
46
Multimodal ReasoningSciQA
Accuracy93.4
14
Showing 8 of 8 rows

Other info

Follow for update