Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Tight Boundary Prediction in Speaker Diarization Using Causal-Anticausal Consistency

About

Multi-talker conversational automatic speech recognition data are often used to train speaker diarization models. Because such data prioritize semantic continuity, pauses and boundary margins are included within speech segments, resulting in loose annotations. Models trained on such data tend to internalize mechanisms that reproduce this looseness, although tight speech intervals are sometimes preferable for downstream applications. In this paper, we address the novel task of enabling models to produce tight predictions using loose labels. Our method generates tighter pseudo labels using causal and anticausal models, which are inherently incapable of learning loosening behavior. We further propose a co-training scheme that iteratively tightens labels and updates both models for more progressive refinement. Experimental results show that the proposed method recovers about 70 % of the tightening effect achieved by ideal tight-label training and improves downstream performance.

Shota Horiguchi, Marc Delcroix, Naohiro Tawara, Takanori Ashihara, Atsushi Ando• 2026

Related benchmarks

TaskDatasetResultRank
Multi-speaker Automatic Speech RecognitionAMI SDM (test)
tcpWER26.31
14
Speaker DiarizationDIHARD III
DER25.28
10
Multi-talker Automatic Speech RecognitionAMI MDM (test)
tcpWER29.44
5
Showing 3 of 3 rows

Other info

Follow for update