Inductive Deductive Synthesis: Enabling AI to Generate Formally Verified Systems
About
AI agents increasingly excel at generating, testing, and refining code. However, they fall short on tasks requiring formal guarantees of full coverage that testing alone cannot provide. Distributed systems are a prime example: properties such as consistency between reads and writes must hold under every possible interleaving of events. Mechanized formal verification can guarantee such correctness, but typically demands months to years of expert effort. As evidence, even SOTA coding agents (Codex with GPT-5.4 and Claude Code with Opus 4.6) succeed on only 2/7 distributed key-value-store specifications. In this paper, we present the first effective approach to addressing this gap, Inductive Deductive Synthesis (IDS), which jointly and incrementally synthesizes implementation and proof, and learns from failed attempts to systematically try promising strategies. Built as an agentic LLM system, IDS achieves 7/7 in about 6.8 hours and $106 per spec on average, roughly 200x faster than expert effort and 17% cheaper than SOTA agents. IDS further incorporates performance feedback into the same loop, yielding implementations up to 3x faster than published verified systems.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Code Verification | VERINA | Success Count176 | 8 | |
| annotations | DafnyBench 100 hardest tasks | Pass Count88 | 4 | |
| annotations | Verus-Bench full 150 tasks | Pass Count149 | 4 | |
| code + proof | AlgoVeri | Pass Count0.8442 | 4 | |
| proof | CodeProps mini sorting | Pass Count100 | 4 | |
| proof | CoqStoq 100 hardest tasks | Pass Count97 | 4 | |
| Synthesis Correctness | Chapar Causal Consistency | Pass Rate3 | 3 | |
| Synthesis Correctness | IDS suite Monotonic Reads | Pass Rate3 | 3 | |
| Synthesis Correctness | IDS suite RYW + MW | Pass Rate3 | 3 | |
| Synthesis Correctness | IDS suite Causal Consistency | Pass Rate2 | 3 |