Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Proof-of-Perception: Certified Tool-Using Multimodal Reasoning with Compositional Conformal Guarantees

About

We present Proof-of-Perception (PoP), a tool-using framework that casts multimodal reasoning as an executable graph with explicit reliability guarantees. Each perception or logic node outputs a conformal set, yielding calibrated, stepwise uncertainty; a lightweight controller uses these certificates to allocate compute under a budget, expanding with extra tool calls only when needed and stopping early otherwise. This grounds answers in verifiable evidence, reduces error compounding and hallucinations, and enables principled accuracy-compute trade-offs. Across document, chart, and multi-image QA benchmarks, PoP improves performance and reliability over strong chain-of-thought, ReAct-style, and program-of-thought baselines while using computation more efficiently.

Arya Fayyazi, Haleh Akrami• 2026

Related benchmarks

TaskDatasetResultRank
Chart Question AnsweringChartQA H
Exact Match (EM)87.8
5
Document Grounded DialogueMultiDoc2Dial
EM66.1
5
Visual Question AnsweringDocVQA T1
EM78.6
5
Visual Question AnsweringTextVQA
F1 Score72.9
5
Showing 4 of 4 rows

Other info

Follow for update