Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipeline
About
The International Mathematical Olympiad (IMO) is widely regarded as the world championship of high-school mathematics. IMO problems are renowned for their difficulty and novelty, demanding deep insight, creativity, and rigor. Although large language models perform well on many mathematical benchmarks, they often struggle with Olympiad-level problems. Using carefully designed prompts, we construct a model-agnostic, verification-and-refinement pipeline. We demonstrate its effectiveness on the recent IMO 2025, avoiding data contamination for models released before the competition. Equipped with any of the three leading models -- Gemini 2.5 Pro, Grok-4, or GPT-5 -- our pipeline correctly solved 5 out of the 6 problems ($\approx$85.7% accuracy). This is in sharp contrast to their baseline accuracies: 31.6% (Gemini 2.5 Pro), 21.4% (Grok-4), and 38.1% (GPT-5), obtained by selecting the best of 32 candidate solutions. The substantial improvement underscores that the path to advanced AI reasoning requires not only developing more powerful base models but also designing effective methodologies to harness their full potential for complex tasks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Mathematical Reasoning | AIME 2024 | Pass@1 Accuracy74.79 | 236 | |
| Mathematical Reasoning | MATH 500 | Pass@1 Rate86.83 | 236 | |
| Mathematical Reasoning | AIME 2025 | Pass@1 Accuracy65.2 | 192 | |
| Math Reasoning | IMO-AnswerBench 50 | Pass@1 Accuracy31.06 | 68 | |
| Math Reasoning | HLE Math-100 | Pass@130.41 | 68 | |
| Autonomous Machine Learning Engineering | MLE-Bench Lite | Any Medal Rate22.7 | 57 | |
| Mathematical Reasoning | Mathematical Reasoning Suite MATH 500, AIME 2024, AIME 2025, AMC 2023, Olympiad Bench | Average Score76.36 | 29 | |
| Safety Evaluation | TRIDENT | Harmfulness1.7 | 28 | |
| Safety Evaluation | SafetyBench | Accuracy85 | 28 | |
| Harmful Action Evaluation | Insider Threat | Harmful Action Rate3 | 28 |