Share your thoughts, 1 month free Claude Pro on usSee more

Multiple Choice Question Answering on MedQA 5 opts

87Accuracy

GPT-4o

Updated 1mo ago

Evaluation Results

Method	Links
GPT-4o 2024.10		87
GPT-4o 2024.10		86
GPT-4T (May 2024) 2024.10		78
GPT-4T (May 2024) 2024.10		75
GPT-3.5 Turbo 1106 2024.02		50.82
GPT-3.5 Turbo 1106 2024.02		50.82
BioMistral 7B DARE 2024.02		45.2
BioMistral 7B SLERP 2024.02		44.3
BioMistral 7B Ensemble 2024.02		43.6
BioMistral 7B TIES 2024.02		43.2
BioMistral 7B 2024.02		42.8
Mistral 7B Instruct 2024.02		40.9
BioMistral 7B SLERP 2024.02		38.9
BioMistral 7B DARE 2024.02		38.8
BioMistral 7B TIES 2024.02		37.7
BioMistral 7B 2024.02		37.4
BioMistral 7B Ensemble 2024.02		37.1
BioMedGPT-LM-7B 2024.02		34.9
Mistral 7B Instruct 2024.02		34.5
BioMedGPT-LM-7B 2024.02		33.9
MedAlpaca 7B 2024.02		33.7
MedAlpaca 7B 2024.02		30.4
MediTron-7B 2024.02		28.1
MediTron-7B 2024.02		26.3
PMC-LLAMA 7B 2024.02		21.1
PMC-LLaMA 7B 2024.02		20.2