Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SemEval

Benchmarks

Task NameDataset NameSOTA ResultTrend
Relation ClassificationSemEval-2010 Task 8 (test)
F1 Score91.9
128
Relation ExtractionSemEval
Micro-F191.9
63
Aspect-level Sentiment ClassificationSemEval Laptop 2014 (test)
Accuracy86.46
59
Relation ExtractionSemEval (test)
Micro F190.4
55
Lexical Semantic Change DetectionSemEval Task 1 Subtask 2 English 2020
Spearman Correlation0.774
54
Multi-label emotion classificationSemEval Task 1:E-c 2018 (test)
Macro F157.8
53
Word Sense DisambiguationSemEval-2007 Task 17 (test)
F1 Score71.4
36
Keyword ExtractionSemEval 2010
F1 Score (k=10)37.5
31
Aspect-Based Sentiment AnalysisSemEval Task 4 Subtask 2 Restaurant domain 2014 (test)
Accuracy91.76
30
Word Sense DisambiguationSemEval Task 7 (S7-T7) 2007 (test)
F1 Score90.6
29
Binary Lexical Semantic Change DetectionSemEval Subtask 1 (English) 2020
Accuracy0.73
28
Opinion Term ExtractionSemEval res 2015 (test)
Precision79.18
28
Aspect term-polarity pair extractionSemEval Laptop (SL) (test)
F1 Score0.7071
28
Target-Oriented Opinion Word ExtractionSemEval res 2016 (test)
Precision89.2
27
Target-Oriented Opinion Word Extraction14lap SemEval 2014 (test)
Precision82.4
27
Machine-Generated Text DetectionSemEval (test)
ASR66.2
26
Sarcasm DetectionSemEval 2018
Accuracy71.4
24
Sentence-level Relation ExtractionSemEval (test)
F1 (micro)0.887
24
Relationship ExtractionSemEval Task 8 2010 (test)
F1 Score90.36
24
Taxonomy ExpansionSemEval Sci 2016 (test)
Accuracy64.7
23
Taxonomy ExpansionSemEval Env 2016 (test)
Accuracy67.3
23
Keyphrase extractionSemEval 2017
F1@527.14
23
Keyword ExtractionSemEval 2017
F1 Score @ 1054
22
Discriminative Attribute IdentificationSemeval Task 10 2018
F1 Score76
20
Aspect-based Sentiment AnalysisSemEval Laptop 2014
F1 Score85.16
19
Showing 25 of 155 rows