Share your thoughts, 1 month free Claude Pro on usSee more

Financial Named Entity Recognition

91.2F1 Score (NER)

DeepSeek-R1-8B + NEFTune

Updated 1mo ago

Evaluation Results

Method	Links
DeepSeek-R1-8B + NEFTune 2026.06		91.2	91.1	91.3
DeepSeek-R1-8B 2026.06		90.1	90	90.2
Llama3-8B 2026.06		89.4	89.3	89.5
Qwen3-8B 2026.06		83.3	84.3	82.4
Baichuan2-7B 2026.06		79.2	80.1	78.2
T5 2026.06		76.7	77.6	75.8
BERT-Base 2026.06		70.8	71.7	70
GPT-4 (gpt-4-0613) 2024.02		0.8	-	-
FinTral-DPO 2024.02		0.7	-	-
ChatGPT (gpt-3.5-turbo) 2024.02		0.53	-	-
FinTral-INST 2024.02		0.4	-	-
FinMA-7B 2024.02		0.38	-	-
FinMA-7B-full 2024.02		0.35	-	-
Llama-2-7b-chat-hf 2024.02		0.07	-	-
Llama-2-13b-chat-hf 2024.02		0.02	-	-
Vicuna-7B 2024.02		0.01	-	-
FinMA-7B-trade 2024.02		0	-	-
Llama-2-7b-hf 2024.02		0	-	-
Mistral-7B-v0.1 2024.02		0	-	-
Mistral-7B-Instruct-v0.1 2024.02		0	-	-