Share your thoughts, 1 month free Claude Pro on usSee more

Rare disease mention extraction on MIMIC3 RD Code n=79 docs (test)

52.6Micro-F1 Score

Mistral 24B

Updated 20d ago

Evaluation Results

Method	Links
Mistral 24B 2025.07		52.6
Qwen3 32B 2025.07		46.7
GPT-5 2025.07		46.5
Llama-3 70B 2025.07		43.9
GPT-5 2025.07		39.1
Dictionary 2025.07		38.4
Qwen3 32B 2025.07		14.3
Llama-3 70B 2025.07		13.9
GPT-5 2025.07		9.8
Llama-3 8B 2025.07		9.7
BioClinicalBERT 2025.07		5
BioBERT-MRC 2025.07		4.6
Mistral 24B 2025.07		3.2
Llama-3 8B 2025.07		2.5
i2b2 2025.07		1.9
Mistral 24B 2025.07		0.2
Llama-3 70B 2025.07		0
Llama-3 8B 2025.07		0
Qwen3 32B 2025.07		0