Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TheraAgent: Self-Improving Therapeutic Agent for Precise and Comprehensive Treatment Planning

About

Formulating a treatment plan is inherently a complex reasoning and refinement task rather than a simple generation problem. However, existing large language models (LLMs) mainly rely on one-shot output without explicit verification, which may result in rough, incomplete, and potentially unsafe treatment plans. To address these limitations, we propose TheraAgent, an agentic framework that replaces one-shot generation with an iterative generate-judge-refine pipeline. By mirroring the actual reasoning process of human experts who iteratively revise treatment plans, our framework progressively transforms coarse and incomplete drafts into precise, comprehensive, and safer therapeutic regimens. To facilitate the critical judge component, we introduce TheraJudge, a treatment-specific evaluation module integrated into the inference loop to enforce clinical standards. Experiments show TheraAgent achieves state-of-the-art results on HealthBench, leading in Accuracy and Completeness. In expert evaluations, it attains an 86% win rate against physicians, with superior Targeting and Harm Control. Moreover, the highly agreement between TheraJudge and HealthBench evaluations confirms the reliability of our framework.

Junkai Li, Yunghwei Lai, Tianyi Zhu, Zheng Long Lee, Weizhi Ma, Yang Liu• 2026

Related benchmarks

TaskDatasetResultRank
Treatment PlanningHealthBench treatment-related conversations
Overall Score48.94
15
Medical DialogueMTMedDialog Sample 15 cases per department
Overall Accuracy69.32
5
Showing 2 of 2 rows

Other info

Follow for update