Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Enhancing the Geometric Problem-Solving Ability of Multimodal LLMs via Symbolic-Neural Integration

About

Recent advances in Multimodal Large Language Models (MLLMs) have achieved remarkable progress in general domains and demonstrated promise in multimodal mathematical reasoning. However, applying MLLMs to geometry problem solving (GPS) remains challenging due to lack of accurate step-by-step solution data and severe hallucinations during reasoning. In this paper, we propose GeoGen, a pipeline that can automatically generates step-wise reasoning paths for geometry diagrams. By leveraging the precise symbolic reasoning, \textbf{GeoGen} produces large-scale, high-quality question-answer pairs. To further enhance the logical reasoning ability of MLLMs, we train \textbf{GeoLogic}, a Large Language Model (LLM) using synthetic data generated by GeoGen. Serving as a bridge between natural language and symbolic systems, GeoLogic enables symbolic tools to help verifying MLLM outputs, making the reasoning process more rigorous and alleviating hallucinations. Experimental results show that our approach consistently improves the performance of MLLMs, achieving remarkable results on benchmarks for geometric reasoning tasks. This improvement stems from our integration of the strengths of LLMs and symbolic systems, which enables a more reliable and interpretable approach for the GPS task. Codes are available at https://github.com/ycpNotFound/GeoGen.

Yicheng Pan, Zhenrong Zhang, Pengfei Hu, Jiefeng Ma, Jun Du, Jianshu Zhang, Quan Liu, Jianqing Gao, Feng Ma• 2025

Related benchmarks

TaskDatasetResultRank
Geometry Problem SolvingPGPS9K (test)--
57
Geometry Problem SolvingGeo3K
Top-1 Accuracy58.4
41
Geometric Question AnsweringGeoQA (test)
Total Accuracy78
34
Math ReasoningMathVista GPS (test)
Accuracy74
31
Geometry Problem SolvingGeoQA
Top-1 Acc64.6
26
Geometric Question AnsweringGeoQA
Success Rate78
14
Multimodal Math Question AnsweringMathVista GPS
Accuracy74
13
Geometry Problem SolvingUniGeo calculation (test)
Top-1 Accuracy78
11
Mathematical Problem SolvingMathVista GPS (N=208)
Top-1 Accuracy74
6
Geometry Problem SolvingPGPS9K N=1000
Top-1 Accuracy54.3
6
Showing 10 of 10 rows

Other info

Follow for update