Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Multilingual Polarization Detection Using Transformer-Based Models with Class Weighting and Threshold Tuning

About

This paper describes our submission to SemEval-2026 Task 9 on detecting multilingual, multicultural, and multievent online polarization. We address all three subtasks: binary polarization detection, polarization type classification, and manifestation identification for English and Swahili. Our approach leverages transformer-based models (RoBERTa-base for English, AfroXLMR-base for Swahili) with class-weighted loss functions to address severe label imbalance and per-label threshold tuning to optimize multi-label classification. On the test set, we achieve F1 macro scores of 0.7901 (English) and 0.7910 (Swahili) for Subtask 1, 0.4615 (English) and 0.4808 (Swahili) for Subtask 2 and 0.4791 (English) and 0.5830 (Swahili) for Subtask 3, which give competitive performance on the leaderboard, demonstrating the effectiveness of our methods for handling imbalanced multi-label polarization detection. Our error analysis reveals that models struggle with dehumanization detection and lack of empathy.

Aaron Bundi Anampiu• 2026

Related benchmarks

TaskDatasetResultRank
Binary Polarization DetectionSubtask 1 English (test)
Macro F179.01
3
Binary Polarization DetectionSubtask 1 Swahili (test)
Macro F179.1
3
Multi-label Manifestation ClassificationSubtask 3 English (test)
Macro F147.91
3
Multi-label Manifestation ClassificationSubtask 3 Swahili (test)
Macro F158.3
3
Multi-label Type ClassificationSubtask 2 English (test)
Macro F146.15
3
Multi-label Type ClassificationSubtask 2 Swahili (test)
Macro F148.08
3
Showing 6 of 6 rows

Other info

Follow for update