Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HierBias: Context-Conditioned Hierarchical Media Bias Detection with Multi-Task Type Classification

About

Media bias detection is a critical task for ensuring fair and balanced information dissemination, yet existing sentence-level approaches classify each sentence independently, ignoring inter-sentence contextual signals that human annotators naturally exploit. We present \textbf{HierBias}, a hierarchical context-conditioned media bias detector that formally models document context in bias prediction. We introduce the \emph{context-conditioned bias probability} and prove theoretically that leveraging document context strictly reduces the Bayes error of sentence-level classification when inter-sentence mutual information is non-zero. A multi-task generalization bound further establishes that jointly training binary bias detection and fine-grained bias type classification improves sample efficiency on small annotated corpora. Architecturally, HierBias pairs a sentence-level RoBERTa encoder with a cross-sentence Transformer aggregator and dual output heads for binary detection and four-class type classification. Evaluated on BABE and BASIL, HierBias achieves 0.853 F1 and 0.723 MCC, surpassing the state-of-the-art bias-detector by $+2.6\%$ F1 and $+4.3\%$ MCC (McNemar's test, $p < 0.05$). Ablation experiments confirm that each theoretical component contributes independently and consistently.

Kaining Li, Ruichen Yan, Yuxin Dong• 2026

Related benchmarks

TaskDatasetResultRank
Sentence-level binary bias detectionBABE (test)
F1 Score85.3
7
Sentence-level binary bias detectionBASIL (test)
F1 Score76.9
7
Fine-grained bias type classificationBABE type-annotated
Macro-F161.4
4
Showing 3 of 3 rows

Other info

Follow for update