Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

When Correct Beliefs Collapse: Epistemic Resilience of LLMs under Clinical Pressure

About

Despite strong medical benchmark accuracy, LLMs can exhibit severe multi-turn sycophancy in clinical dialogue, abandoning initial correct diagnosis under escalating pressure. We propose \textbf{\textsc{Med-Stress}}, a targeted stress test framework that evaluates belief stability under escalating pressure. Across nine frontier large language models (LLMs), we find a clear dissociation between medical knowledge and robustness: high initial diagnostic capability does not imply high belief stability, yielding large knowledge-robustness gaps for several LLMs. To mitigate this failure mode, we propose a lightweight inference-time defense, \textbf{\texttt{RBED}} (\textbf{R}ole-\textbf{B}ased \textbf{E}pistemic \textbf{D}efense), and \textbf{\texttt{R-FT}} (\textbf{R}esilience-oriented \textbf{F}ine-\textbf{T}uning), a training-time approach that internalizes evidence-based resistance to pressure. Experiments show that \textbf{\texttt{R-FT}} nearly eliminates belief change and substantially improves robustness.

Boyu Xiao, Xiuqi Tian, Xuwen Song, Haochun Wang, Guanchun Song, Sendong Zhao, Bing Qin• 2026

Related benchmarks

TaskDatasetResultRank
Clinical DiagnosisMedical Clinical Diagnosis--
9
Medical Question Answering Robustnessmedical testbed 800-question
IDC76.88
7
General-domain Persuasion RobustnessFarm
NQ1 Score63
3
Showing 3 of 3 rows

Other info

Follow for update