Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FaithMed: Training LLMs For Faithful Evidence-Based Medical Reasoning

About

Faithful reasoning is essential in medicine, where clinical decisions require transparent justification grounded in reliable evidence. Current medical LLMs either lack active access to evidence or use retrieved evidence without supervising how it should be appraised and applied during reasoning. To address this, we formalize evidence-based medicine principles as process-level criteria and introduce FaithMed, a framework that combines clinician-designed, automatically refined rubrics with reinforcement learning using step-level process reward assignment and advantage grouping. Across seven medical benchmarks, FaithMed improves over agentic-search baselines (+9% on average) and outcome-only RL (+5.8%), while raising average evidence-based medicine rubric scores over agentic-search Qwen3 baselines (+15.5%). This work demonstrates that explicit step-level supervision can improve both task success and the faithfulness of the reasoning process. Code is available at https://github.com/cxcscmu/FaithMed.

Zhiyun Zhang, Liwen Sun, Xiang Qian, Chenyan Xiong• 2026

Related benchmarks

TaskDatasetResultRank
Question AnsweringMedMCQA
Accuracy64.1
125
Question AnsweringHeadQA
Accuracy85.7
84
Medical Question AnsweringMedbullets
Accuracy55.6
81
Medical calculationMedCalc-Bench
Accuracy56.5
31
Clinical Question AnsweringMedQA
Accuracy74.8
30
Medical Question AnsweringMMLU-Pro Health
Accuracy63.5
28
Medical ReasoningMedXpertQA
Accuracy28.2
20
Showing 7 of 7 rows

Other info

Follow for update