Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Predicting the Type and Target of Offensive Posts in Social Media

About

As offensive content has become pervasive in social media, there has been much research in identifying potentially offensive messages. However, previous work on this topic did not consider the problem as a whole, but rather focused on detecting very specific types of offensive content, e.g., hate speech, cyberbulling, or cyber-aggression. In contrast, here we target several different kinds of offensive content. In particular, we model the task hierarchically, identifying the type and the target of offensive messages in social media. For this purpose, we complied the Offensive Language Identification Dataset (OLID), a new dataset with tweets annotated for offensive content using a fine-grained three-layer annotation scheme, which we make publicly available. We discuss the main similarities and differences between OLID and pre-existing datasets for hate speech identification, aggression detection, and similar tasks. We further experiment with and we compare the performance of different machine learning models on OLID.

Marcos Zampieri, Shervin Malmasi, Preslav Nakov, Sara Rosenthal, Noura Farra, Ritesh Kumar• 2019

Related benchmarks

TaskDatasetResultRank
Offensive Language IdentificationOffensEval Danish (test)
Macro F10.699
15
Offensive Language IdentificationOLID English Sub-task A 1.0 (test)
Macro F10.728
9
Categorization of offensive language typeOLID English Sub-task B
Macro F10.593
5
Offensive language target identificationOLID English 2019 (test)
Macro F145.8
5
Showing 4 of 4 rows

Other info

Follow for update