Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on PubMedQA PQA-L (test)

78.2Accuracy

BioGPT

Updated 20d ago

Evaluation Results

Method	Links
BioGPT 2022.10		78.2
MediSwift-XL 2024.03		76.8
ClinicalAgents 2026.03		76.6
ReConcile 2026.03		76.4
MediSwift-XL 2024.03		76.3
Intern-S1 2026.03		75.8
BioGPT-large 2024.03		75.5
MediSwift-XL 2024.03		75.4
GPT-4 2024.03		75.2
MediSwift-Large 2024.03		75.1
Few-shot + CoT 2026.03		74.6
BioMedLM 2024.03		74.4
MediSwift-Med 2024.03		74.2
MediSwift-Large 2024.03		74.2
MDAgents 2026.03		74.2
MedChain-Agents 2026.03		74.2
MediSwift-Med 2024.03		73.8
BioGPT-med 2024.03		73.6
DRAGON 2024.03		73.4
PMC-Llama 2024.03		73.4
MediSwift-Large 2024.03		73.4
ReAct 2026.03		73.2
MediSwift-Med 2024.03		72.4
MedAgents 2026.03		72.4
ColaCare 2026.03		72.4
BioLinkBERT 2022.10		72.2
BioLinkBERT-large 2024.03		72.2
RAG 2026.03		71.8
GPT-3.5 2024.03		71.6
AutoGen 2026.03		71.4
BioLinkBERT 2022.10		70.2
BioLinkBERT-base 2024.03		70.2
Llama-4-Maverick-17B 2026.03		68.8
GPT-5.2 2026.03		68.2
MedGemma-4B 2026.03		66.8
FineMedLM-o1-8B 2026.03		64.4
BioELECTRA 2022.10		64.2
BioELECTRA 2024.03		64.2
DeepSeek-R1 2026.03		62
Qwen3-VL-235B 2026.03		56.2
PubMedBERT 2022.10		55.8
PubMedBERT 2024.03		55.8
HuaTuoGPT-o1-7B 2026.03		55.2