Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on PubMedQA

83.6Accuracy

Multi-Agent Medical Decision Consensus Matrix System

Updated 1mo ago

Evaluation Results

Method	Links
Multi-Agent Medical Decision Consensus Matrix System 2025.12		83.6
URCA 2025.05		81.1
BioGPT-Large 2022.10		81
GraphRAG 2025.05		80.6
RankRAG 2025.05		79.8
RAG 2025.05		79.6
TeamMedAgents 2025.12		79.2
MDAgents 2025.12		78.5
MetaGen BlendedRAG 2025.05		77.9
Weighted Voting 2025.12		77.9
BioMistral 7B SLERP 2024.02		77.8
BioMistral 7B DARE 2024.02		77.7
Galactica 2022.11		77.6
BioMistral 7B 2024.02		77.5
BioMistral 7B Ensemble 2024.02		77.5
BioMistral 7B TIES 2024.02		77.5
No RAG 2025.05		77.5
Few-shot CoT 2023.11		77.2
ModelMerge 2025.12		77.2
MedAgents 2023.11		76.8
BioMedGPT-LM-7B 2024.02		76.8
Majority Voting 2025.12		76.4
Zero-shot 2023.11		76.2
Borda Count 2025.12		76.1
Original 2025.12		76
Chain-of-Thought 2025.12		75.8
Zero-shot CoT + SC 2023.11		75.7
Mistral 7B Instruct 2024.02		75.7
Few-shot CoT + SC 2023.11		75.6
PSI 2025.12		75.6
Zero-shot CoT + SC 2023.11		75.3
Few-shot CoT + SC 2023.11		75.2
5x Human 2023.10		75.08
Llama-3.1-8B-Instruct 2026.02		75
Few-shot CoT 2023.11		74.9
MediTron-7B 2024.02		74.9
Single-Agent 2025.12		74.3
ModelMerge 2025.12		74.2
AlzheimerRAG 2025.05		74
RESTA 2025.12		73.8
IMFL 2023.10		73.76
Zero-shot 2023.11		73.7
BLOOM 2022.11		73.6
MedAlpaca 7B 2024.02		73.6
Few-shot CoT + SC 2023.11		73.4
Few-shot 2023.11		73.4
RAFT (LLaMA2-7B) 2025.05		73.3
BioMistral-7B 2026.02		73.25
Original 2025.12		73
MedAgents 2023.11		72.9
PMC-LLaMA 7B 2024.02		72.9
4x Human 2023.10		72.66
GPT-3.5 Turbo 1106 2024.02		72.66
PSI 2025.12		72
Single-Agent 2025.12		72
DSF + RAG 2025.05		71.6
FLAN-T5 xlarge 2026.02		71.5
Few-shot CoT 2023.11		71.4
Zero-shot CoT 2023.11		71
MEDRAG + GPT-4 2025.05		70.6
OPT 2022.11		70.2
3x Human 2023.10		70.15
RESTA 2025.12		70
2x Human 2023.10		67.64
Few-shot 2023.11		67.6
All GPT-3.5 2023.10		66.87
1x Human 2023.10		65.28
OLTQA 2023.05		64.4
OLTQA 2023.05		64.4
Teacher Selection 2026.02		63.5
PLM Classifier 2026.02		62.5
OLTQA (w/o Pm) 2023.05		62.07
Zero-shot CoT 2023.11		61.3
Similarity-based Router 2026.02		61
Dense Model 2026.01		60.7
Dense Model 2026.01		60.7
EPR 2023.05		59.67
GradPruner 2026.01		59.4
Dense Model 2026.01		59.3
FT(Llama3.2) 2026.01		59.2
FT(Llama3.2) 2026.01		59.1
GradPruner 2026.01		59.1
Dense Model 2026.01		59.1
GradPruner 2026.01		58.8
GradPruner 2026.01		58.6
ProQA 2023.05		58
TTARAG 2026.01		57.4
Muppet 2023.05		56.73
SAT 2026.01		56.7
Plackett-Luce Ranking 2026.02		56.5
OLTQA (w/o Pk) 2023.05		56.27
APT 2026.01		56.1
SAT 2026.01		56.1
LLMPruner 2026.01		56
Laco 2026.01		55.6
MINITRON 2026.01		55.5
APT 2026.01		55.5
Laco 2026.01		55.3
Laco 2026.01		55.2
PLM Classifier 2026.02		55

Showing 100 of 145 rows