Word Sense Disambiguation

Benchmarks

Dataset Name	SOTA Method	Metric
WiC	VERA	Avg Accuracy74.5	87	4d ago
SensEval-3 (test)	BERT kNN	F1 Score80.12	51	1mo ago
SemEval-2007 Task 17 (test)		F1 Score71.4	36	1mo ago
SensEval-2 (test)	BERT kNN	F1 Score76.52	35	1mo ago
WiC (dev)	ROBERTa-WL+ w/ COSINE	Accuracy89.5	32	1mo ago
SemEval Task 7 (S7-T7) 2007 (test)		F1 Score90.6	29	1mo ago
WiC (test)	ROBERTa-WL+ w/ COSINE	Accuracy85.3	26	1mo ago
CoarseWSD-20	Z-LaVI (SBERT)	Accuracy90.6	20	1mo ago
Senseval-3	GASext	F1 Score70.5	20	1mo ago
Senseval-2	GASext	F1 Score72.4	20	1mo ago
hardEN	Qwen	F1 Score54.19	19	1mo ago
42D	Qwen	F1 Score78.48	19	1mo ago
FEWS (test)		F1 Score90.7	19	1mo ago
English All-Words Average (test)	BERT Gated Linear Unit (GLU)	F1 Score74.1	19	1mo ago
SemEval Task 13 2015 (test)	BERT Gated Linear Unit (GLU)	F176.2	19	1mo ago
SemEval Task 12 2013 (test)	BERT Gated Linear Unit (GLU)	F1 Score71.1	19	1mo ago
WiC v1.0 (test)	SenseBERT	Accuracy72.1	19	1mo ago
All-Words WSD Concatenation SE2+SE3+SE13+SE15 3.0 (test)	SemEq-Large-Expert	Overall F180.7	16	1mo ago
SemEval-15 (SE15) 3.0 (test)	AdaptBERT_Large	F1 Score84.4	16	1mo ago
SemEval-13 (SE13) 3.0 (test)	SemEq-Large-Expert	F1 Score81.2	16	1mo ago
Senseval-2 (SE2) 3.0 (test)	SemEq-Large-Expert	F1 Score81.8	16	1mo ago
SemEval-07 3.0 (dev)		F1 Score75.2	14	1mo ago
Senseval-3 English all-words	LSTMLP	F1 Score71.8	14	1mo ago
Senseval-3 English Lexical Sample (test)	BERT	Accuracy80	13	1mo ago
SemEval English 2015 (test)	BEM + WSE-Exemplar	F1 (all)81.7	13	1mo ago

Showing 25 of 70 rows