Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipeline

About

The International Mathematical Olympiad (IMO) is widely regarded as the world championship of high-school mathematics. IMO problems are renowned for their difficulty and novelty, demanding deep insight, creativity, and rigor. Although large language models perform well on many mathematical benchmarks, they often struggle with Olympiad-level problems. Using carefully designed prompts, we construct a model-agnostic, verification-and-refinement pipeline. We demonstrate its effectiveness on the recent IMO 2025, avoiding data contamination for models released before the competition. Equipped with any of the three leading models -- Gemini 2.5 Pro, Grok-4, or GPT-5 -- our pipeline correctly solved 5 out of the 6 problems ($\approx$85.7% accuracy). This is in sharp contrast to their baseline accuracies: 31.6% (Gemini 2.5 Pro), 21.4% (Grok-4), and 38.1% (GPT-5), obtained by selecting the best of 32 candidate solutions. The substantial improvement underscores that the path to advanced AI reasoning requires not only developing more powerful base models but also designing effective methodologies to harness their full potential for complex tasks.

Yichen Huang, Lin F. Yang• 2025

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningAIME 2024
Pass@1 Accuracy74.79
236
Mathematical ReasoningMATH 500
Pass@1 Rate86.83
236
Mathematical ReasoningAIME 2025
Pass@1 Accuracy65.2
192
Math ReasoningIMO-AnswerBench 50
Pass@1 Accuracy31.06
68
Math ReasoningHLE Math-100
Pass@130.41
68
Autonomous Machine Learning EngineeringMLE-Bench Lite
Any Medal Rate22.7
57
Mathematical ReasoningMathematical Reasoning Suite MATH 500, AIME 2024, AIME 2025, AMC 2023, Olympiad Bench
Average Score76.36
29
Safety EvaluationTRIDENT
Harmfulness1.7
28
Safety EvaluationSafetyBench
Accuracy85
28
Harmful Action EvaluationInsider Threat
Harmful Action Rate3
28
Showing 10 of 16 rows

Other info

Follow for update