Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge

About

Large Language Models (LLMs), such as the LLaMA model, have demonstrated their effectiveness in various general-domain natural language processing (NLP) tasks. Nevertheless, LLMs have not yet performed optimally in biomedical domain tasks due to the need for medical expertise in the responses. In response to this challenge, we propose HuaTuo, a LLaMA-based model that has been supervised-fine-tuned with generated QA (Question-Answer) instances. The experimental results demonstrate that HuaTuo generates responses that possess more reliable medical knowledge. Our proposed HuaTuo model is accessible at https://github.com/SCIR-HI/Huatuo-Llama-Med-Chinese.

Haochun Wang, Chi Liu, Nuwa Xi, Zewen Qiang, Sendong Zhao, Bing Qin, Ting Liu• 2023

Related benchmarks

TaskDatasetResultRank
Medical Diagnosisagent-CMB
Rounds16.56
25
Medical DiagnosisMedQA agent
Rounds16.7
25
Terminology UnderstandingChemistry Domain Dataset
Recall@1020.1
12
Terminology UnderstandingCode Domain Dataset
Recall@1013
12
Terminology UnderstandingMedical Domain Dataset
Recall@100.346
12
Medical history-takingAvey
Precision28.2
7
Medical history-takingMIMIC
Precision32.2
7
Showing 7 of 7 rows

Other info

Follow for update