Word Sense Disambiguation

Benchmarks

Dataset Name	SOTA Method	Metric
WiC	VERA	Avg Accuracy74.5	84	3d ago
SensEval-3 (test)	BERT kNN	F1 Score80.12	51	3d ago
SemEval-2007 Task 17 (test)		F1 Score71.4	36	3d ago
SensEval-2 (test)	BERT kNN	F1 Score76.52	35	3d ago
WiC (dev)	ROBERTa-WL+ w/ COSINE	Accuracy89.5	32	3d ago
SemEval Task 7 (S7-T7) 2007 (test)		F1 Score90.6	29	3d ago
WiC (test)	ROBERTa-WL+ w/ COSINE	Accuracy85.3	26	3d ago
CoarseWSD-20	Z-LaVI (SBERT)	Accuracy90.6	20	3d ago
Senseval-3	GASext	F1 Score70.5	20	3d ago
Senseval-2	GASext	F1 Score72.4	20	3d ago
English All-Words Average (test)	BERT Gated Linear Unit (GLU)	F1 Score74.1	19	2d ago
SemEval Task 13 2015 (test)	BERT Gated Linear Unit (GLU)	F176.2	19	3d ago
SemEval Task 12 2013 (test)	BERT Gated Linear Unit (GLU)	F1 Score71.1	19	3d ago
WiC v1.0 (test)	SenseBERT	Accuracy72.1	19	3d ago
All-Words WSD Concatenation SE2+SE3+SE13+SE15 3.0 (test)	SemEq-Large-Expert	Overall F180.7	16	3d ago
SemEval-15 (SE15) 3.0 (test)	AdaptBERT_Large	F1 Score84.4	16	3d ago
SemEval-13 (SE13) 3.0 (test)	SemEq-Large-Expert	F1 Score81.2	16	3d ago
Senseval-2 (SE2) 3.0 (test)	SemEq-Large-Expert	F1 Score81.8	16	3d ago
SemEval-07 3.0 (dev)		F1 Score75.2	14	3d ago
Senseval-3 English all-words	LSTMLP	F1 Score71.8	14	3d ago
Senseval-3 English Lexical Sample (test)	BERT	Accuracy80	13	3d ago
SemEval English 2015 (test)	BEM + WSE-Exemplar	F1 (all)81.7	13	2d ago
SemEval 2007	Our Model	F1 Score74.4	13	3d ago
Concatenation of Datasets SE2 SE3 SE13 SE15 (test)	GASext	Noun Accuracy0.722	12	3d ago
SemEval Task 13 2015	GASext	F1 Score72.6	12	3d ago

Showing 25 of 69 rows