Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

pysentimiento: A Python Toolkit for Opinion Mining and Social NLP tasks

About

In recent years, the extraction of opinions and information from user-generated text has attracted a lot of interest, largely due to the unprecedented volume of content in Social Media. However, social researchers face some issues in adopting cutting-edge tools for these tasks, as they are usually behind commercial APIs, unavailable for other languages than English, or very complex to use for non-experts. To address these issues, we present pysentimiento, a comprehensive multilingual Python toolkit designed for opinion mining and other Social NLP tasks. This open-source library brings state-of-the-art models for Spanish, English, Italian, and Portuguese in an easy-to-use Python library, allowing researchers to leverage these techniques. We present a comprehensive assessment of performance for several pre-trained language models across a variety of tasks, languages, and datasets, including an evaluation of fairness in the results.

Juan Manuel P\'erez, Mariela Rajngewerc, Juan Carlos Giudici, Dami\'an A. Furman, Franco Luque, Laura Alonso Alemany, Mar\'ia Vanina Mart\'inez• 2021

Related benchmarks

TaskDatasetResultRank
Hate Speech DetectionSBIC
Total F135
11
Text ClassificationSBIC
Total Metric0.0014
11
Hate Speech DetectionCREHate
Total F1 Score33
11
Text ClassificationCREHate
Total Score-0.0023
11
Showing 4 of 4 rows

Other info

Follow for update