Our new X account is live! Follow @wizwand_team for updates

Named Entity Recognition on NCBI-disease (test)

90.08Precision

SOTA (Tian et al., 2020)

Updated 3d ago

Evaluation Results

Method
SOTA (Tian et al., 2020) 2023.05	90.08	-	-	-	-	-
SpanPred x SEQ 2023.05	89.6	-	-	91.9	-	87.4
SpanPred x SEQ x SeqCRF 2023.05	89.5	-	-	88.8	-	90.1
Meta(SpanPred U SEQ) 2023.05	89.1	-	-	86.3	-	92.2
SpanPred 2023.05	89	-	-	88.1	-	89.9
SciFive 2021.05	88.82	-	-	90.14	89.23	-
SEQ 2023.05	88.7	-	-	87.8	-	89.5
SciFive 2021.05	88.65	-	-	90.14	87.96	-
BioBERT 2021.05	88.52	-	-	89.82	88.46	-
SciFive 2021.05	88.32	-	-	90.14	88.46	-
BlueBERT 2021.05	88.28	-	-	89.3	89.71	-
BioBERT 2021.04	88.22	-	-	91.25	89.71	-
T5 2021.05	88.22	-	-	91.25	88.54	-
SpanPred U SEQ 2023.05	88.2	-	-	84.6	-	92.2
BlueBERT 2021.05	88.1	-	-	90.14	89.17	-
SeqCRF 2023.05	87.9	-	-	86.2	-	89.6
SciFive 2021.05	87.7	-	-	89.9	88.78	-
T5 2021.05	87.7	-	-	89.9	89.11	-
SciFive 2021.05	87.64	-	-	89.3	89.47	-
SciFive 2021.05	87.48	-	-	90.14	89.39	-
BioBERT-v1.1 2022.09	87.23	-	-	90.07	88.62	-
BERT 2021.05	87.18	-	-	89.93	85.63	-
SpanPred U SEQ U SeqCRF 2023.05	87.1	-	-	81.4	-	93.8
CompactBioBERT 2022.09	86.91	-	-	90.5	88.67	-
DistilBioBERT 2022.09	86.74	-	-	89.14	87.93	-
BioBERT 2021.05	86.28	-	-	89.71	88.79	-
ELECTRAMed 2021.04	85.87	-	-	89.29	87.54	-
DistilBERT 2022.09	85.02	-	-	87.78	86.38	-
SOTA 2021.05	84.12	-	-	87.19	88.6	-
TinyBioBERT 2022.09	82.11	-	-	88.57	85.22	-
HighGEN + RoSTER 2022.10	77.4	-	-	69.4	73.2	-
RoSTER 2022.10	75.9	-	-	72.7	74.3	-
GeNER + RoSTER 2022.10	74.1	-	-	68.1	71	-
HighGEN + BOND 2022.10	72.9	-	-	67.6	70.2	-
GeNER + BOND 2022.10	70.8	-	-	63.5	67	-
HighGEN + RoSTER 2022.10	69.7	-	-	73.2	71.4	-
Standard 2022.10	67.5	-	-	65.7	66.6	-
HighGEN + Standard 2022.10	66.4	-	-	44.6	53.3	-
BOND 2022.10	63.7	-	-	70.6	67	-
GeNER + Standard 2022.10	59	-	-	37.6	45.9	-
BioBERT 2019.03	-	89.36	-	-	-	-
SciBERT 2019.03	-	88.57	-	-	-	-
SOTA (Dogan et al., 2014) 2019.03	-	-	89.36	-	-	-
BERT-Base 2019.03	-	-	84.06	-	-	-
BERT-Base 2019.03	-	-	86.88	-	-	-
SCIBERT 2019.03	-	-	86.39	-	-	-
SCIBERT 2019.03	-	-	88.57	-	-	-
Spark NLP 2021.04	-	-	-	-	89.13	-
BioFLAIR 2021.04	-	-	-	-	88.85	-
T5v1.1-large 2023.05	-	-	-	-	-	26.02
T5v1.1-large 2023.05	-	-	-	-	-	37.63
GPT2-xl 2023.05	-	-	-	-	-	25.54
GPT2-xl 2023.05	-	-	-	-	-	33.25
T5-xl 2023.05	-	-	-	-	-	23.1
T5-xl 2023.05	-	-	-	-	-	36.78
GPT-J-6B 2023.05	-	-	-	-	-	35.82
GPT-J-6B 2023.05	-	-	-	-	-	40.98
T5-xxl 2023.05	-	-	-	-	-	12.19
T5-xxl 2023.05	-	-	-	-	-	26.34
OPT-13B 2023.05	-	-	-	-	-	23.73
OPT-13B 2023.05	-	-	-	-	-	34
GPT-Neox-20B 2023.05	-	-	-	-	-	35.42
GPT-Neox-20B 2023.05	-	-	-	-	-	42.85
OPT-30B 2023.05	-	-	-	-	-	22.31
OPT-30B 2023.05	-	-	-	-	-	32.76
OPT-66B 2023.05	-	-	-	-	-	25.87
OPT-66B 2023.05	-	-	-	-	-	34.58
ProtoNet 2023.05	-	-	-	-	-	24.73
ProtoNet 2023.05	-	-	-	-	-	42.32
NNShot 2023.05	-	-	-	-	-	31.59
NNShot 2023.05	-	-	-	-	-	33.14
StructShot 2023.05	-	-	-	-	-	19.87
StructShot 2023.05	-	-	-	-	-	31.48
CONTAINER 2023.05	-	-	-	-	-	23.24
CONTAINER 2023.05	-	-	-	-	-	27.02
MetaNER-base 2023.05	-	-	-	-	-	35
MetaNER-base 2023.05	-	-	-	-	-	37.24
MetaNER 2023.05	-	-	-	-	-	40.01
MetaNER 2023.05	-	-	-	-	-	44.92