SemEval-2010 Task 8: Multi-Way Classification of Semantic Relations Between Pairs of Nominals
About
In response to the continuing research interest in computational semantic analysis, we have proposed a new task for SemEval-2010: multi-way classification of mutually exclusive semantic relations between pairs of nominals. The task is designed to compare different approaches to the problem and to provide a standard testbed for future research. In this paper, we define the task, describe the creation of the datasets, and discuss the results of the participating 28 systems submitted by 10 teams.
Iris Hendrickx, Su Nam Kim, Zornitsa Kozareva, Preslav Nakov, Diarmuid \'O S\'eaghdha, Sebastian Pad\'o, Marco Pennacchiotti, Lorenza Romano, Stan Szpakowicz• 2019
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Relation Classification | SemEval-2010 Task 8 (test) | F1 Score82.2 | 128 | |
| Relation Classification | Chinese literature text | F1 Score48.9 | 14 |
Showing 2 of 2 rows