Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Learning Robust Pair Confidence for Multimodal Emotion-Cause Pair Extraction

About

Multimodal emotion-cause pair extraction (MECPE) requires reliable pair confidence over candidate pairs. Existing pair scorers commonly use pair-level cross entropy over valid candidates, which treats links mostly independently. This leaves the relative confidence geometry among competing causes under-constrained, allowing gold pairs to stay close to hard negatives or rely on incidental non-gold context. We study this vulnerability as pair-confidence brittleness and propose RPCL (Robust Pair Confidence Learning), a training-only framework for pair-confidence learning. RPCL encourages pair confidence to be both discriminative and stable: gold pairs are separated from row-wise hard negatives through a confidence-difference margin constraint, and clean pair predictions are aligned with predictions from a corrupted view where non-gold contextual utterance representations are partially corrupted. The original clean pair scorer and decoding pipeline are used unchanged at inference time. On ECF, MECAD, and MEC4, RPCL improves the three-seed mean Pair F1 over a matched base model by 2.58 to 2.83 percentage points in the full text-audio-video setting, and improves mean Pair AUPRC on all three datasets. Diagnostic analysis further shows larger gold-negative confidence gaps and lower margin-violation severity. These results suggest that explicitly shaping pair confidence is an effective training strategy for MECPE.

Zhuangzhuang Pan, Ning Dong, Yingna Su, Yan Xia• 2026

Related benchmarks

TaskDatasetResultRank
Cause ExtractionECF (official split)
Precision69.28
4
Emotion ExtractionECF (official split)
Precision79.59
4
Emotion ExtractionMECAD (official split)
Precision72.97
4
Pair ExtractionECF (official split)
Precision52.2
4
Pair ExtractionMECAD (official split)
Precision40.95
4
Cause ExtractionMECAD (official)
Precision62.57
4
Pair ExtractionMEC4
Precision29.67
4
Showing 7 of 7 rows

Other info

Follow for update