Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Unifying Speech Editing Detection and Content Localization via Prior-Enhanced Audio LLMs

About

Speech editing achieves semantic inversion by performing fine-grained segment-level manipulation on original utterances, while preserving global perceptual naturalness. Existing detection studies mainly focus on manually edited speech with explicit splicing artifacts, and therefore struggle to cope with emerging end-to-end neural speech editing techniques that generate seamless acoustic transitions. To address this challenge, we first construct a large-scale bilingual dataset, AiEdit, which leverages large language models to drive precise semantic tampering logic and employs multiple advanced neural speech editing methods for data synthesis, thereby filling the gap of high-quality speech editing datasets. Building upon this foundation, we propose PELM (Prior-Enhanced Audio Large Language Model), the first large-model framework that unifies speech editing detection and content localization by formulating them as an audio question answering task. To mitigate the inherent forgery bias and semantic-priority bias observed in existing audio large models, PELM incorporates word-level probability priors to provide explicit acoustic cues, and further designs a centroid-aggregation-based acoustic consistency perception loss to explicitly enforce the modeling of subtle local distribution anomalies. Extensive experimental results demonstrate that PELM significantly outperforms state-of-the-art methods on both the HumanEdit and AiEdit datasets, achieving equal error rates (EER) of 0.57\% and 9.28\% (localization), respectively.

Jun Xue, Yi Chai, Yanzhen Ren, Jinshen He, Zhiqiang Tang, Zhuolin Yi, Yihuan Huang, Yuankun Xie, Yujie Chen• 2026

Related benchmarks

TaskDatasetResultRank
Content LocalizationPool HumanEdit and AiEdit average
Accuracy98.46
5
Speech Editing DetectionHumanEdit
Accuracy99.62
5
Speech Editing DetectionAiEdit
Accuracy95.2
5
Speech Editing DetectionPool HumanEdit and AiEdit average
Acc98.46
5
Content LocalizationHumanEdit
Accuracy94.31
5
Content LocalizationAiEdit
Accuracy91.77
5
Showing 6 of 6 rows

Other info

Follow for update