Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on PubMedQA Retrieval OS Setting (test)

76.4Accuracy

OS-8B

Updated 16d ago

Evaluation Results

Method	Links
OS-8B 2026.04		76.4	-
LoRA FT 2ep 10k context 2026.04		58.01	55.83
Full FT 5ep 16k context 2026.04		58.01	56.21
Llama 3.2 3B Instruct 2026.04		49.11	49.04
Llama 3.1 8B Instruct 2026.04		45.91	43.35