Small Agent Group is the Future of Digital Health
About
The rapid adoption of large language models (LLMs) in digital health has been driven by a "scaling-first" philosophy, i.e., the assumption that clinical intelligence increases with model size and data. However, real-world clinical needs include not only effectiveness, but also reliability and reasonable deployment cost. Since clinical decision-making is inherently collaborative, we challenge the monolithic scaling paradigm and ask whether a Small Agent Group (SAG) can support better clinical reasoning. SAG shifts from single-model intelligence to collective expertise by distributing reasoning, evidence-based analysis, and critical audit through a collaborative deliberation process. To assess the clinical utility of SAG, we conduct extensive evaluations using diverse clinical metrics spanning effectiveness, reliability, and deployment cost. Our results show that SAG achieves superior performance compared to a single giant model, both with and without additional optimization or retrieval-augmented generation. These findings suggest that the synergistic reasoning represented by SAG can substitute for model parameter growth in clinical settings. Overall, SAG offers a scalable solution to digital health that better balances effectiveness, reliability, and deployment efficiency.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Clinical Question Answering | MedQA | Accuracy91.4 | 14 | |
| Clinical Question Answering | MedMCQA | Accuracy86.1 | 14 | |
| Clinical Question Answering | NEJM-MedQA | Accuracy86.7 | 14 | |
| Clinical Question Answering | GPQA Bio | Accuracy92.6 | 14 | |
| Medical Question Answering | MedQA (M-QA) | Base Accuracy Std Dev0.12 | 13 | |
| Medical Question Answering | NEJM-MedQA | Base Deviation0.22 | 13 | |
| Fairness evaluation | EquityMedQA cross-population (test) | CDR (Race)0.8 | 8 | |
| Deployment Cost Analysis | General Queries | Peak Memory (GB)79.5 | 6 | |
| Fairness evaluation | EquityMedQA (test) | Race CDR4.9 | 6 |