Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EVE: Verifiable Self-Evolution of MLLMs via Executable Visual Transformations

About

Self-evolution of multimodal large language models (MLLMs) remains a critical challenge: pseudo-label-based methods suffer from progressive quality degradation as model predictions drift, while template-based methods are confined to a static set of transformations that cannot adapt in difficulty or diversity. We contend that robust, continuous self-improvement requires not only deterministic external feedback independent of the model's internal certainty, but also a mechanism to perpetually diversify the training distribution. To this end, we introduce EVE (Executable Visual transformation-based self-Evolution), a novel framework that entirely bypasses pseudo-labels by harnessing executable visual transformations continuously enriched in both variety and complexity. EVE adopts a Challenger-Solver dual-policy architecture. The Challenger maintains and progressively expands a queue of visual transformation code examples, from which it synthesizes novel Python scripts to perform dynamic visual transformations. Executing these scripts yields VQA problems with absolute, execution-verified ground-truth answers, eliminating any reliance on model-generated supervision. A multi-dimensional reward system integrating semantic diversity and dynamic difficulty calibration steers the Challenger to enrich its code example queue while posing progressively more challenging tasks, preventing mode collapse and fostering reciprocal co-evolution between the two policies. Extensive experiments demonstrate that EVE consistently surpasses existing self-evolution methods, establishing a robust and scalable paradigm for verifiable MLLM self-evolution. The code is available at https://github.com/0001Henry/EVE .

Yongrui Heng, Chaoya Jiang, Han Yang, Shikun Zhang, Wei Ye• 2026

Related benchmarks

TaskDatasetResultRank
Multimodal ReasoningMM-Vet
MM-Vet Score69.63
517
Multimodal UnderstandingMMStar
Accuracy73.47
407
Visual PerceptionBLINK
Accuracy67.3
241
Hallucination EvaluationHallusionBench--
153
Visual Hallucination EvaluationHallusionBench
Accuracy61.89
120
Multi-image ReasoningMuirBench
Accuracy74.4
89
General VQAMMVet
Score71.9
63
Math ReasoningMathVista
Score77.9
30
General VQAMMStar
Accuracy73.9
26
Mathematical ReasoningVisuLogic
Accuracy (VisuLogic Math)27.8
24
Showing 10 of 15 rows

Other info

Follow for update