Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MoSEs: Uncertainty-Aware AI-Generated Text Detection via Mixture of Stylistics Experts with Conditional Thresholds

About

The rapid advancement of large language models has intensified public concerns about the potential misuse. Therefore, it is important to build trustworthy AI-generated text detection systems. Existing methods neglect stylistic modeling and mostly rely on static thresholds, which greatly limits the detection performance. In this paper, we propose the Mixture of Stylistic Experts (MoSEs) framework that enables stylistics-aware uncertainty quantification through conditional threshold estimation. MoSEs contain three core components, namely, the Stylistics Reference Repository (SRR), the Stylistics-Aware Router (SAR), and the Conditional Threshold Estimator (CTE). For input text, SRR can activate the appropriate reference data in SRR and provide them to CTE. Subsequently, CTE jointly models the linguistic statistical properties and semantic features to dynamically determine the optimal threshold. With a discrimination score, MoSEs yields prediction labels with the corresponding confidence level. Our framework achieves an average improvement 11.34% in detection performance compared to baselines. More inspiringly, MoSEs shows a more evident improvement 39.15% in the low-resource case. Our code is available at https://github.com/creator-xi/MoSEs.

Junxi Wu, Jinpeng Wang, Zheng Liu, Bin Chen, Dongjian Hu, Hao Wu, Shu-Tao Xia• 2025

Related benchmarks

TaskDatasetResultRank
Machine-generated text detectionSQuAD--
30
MGT detectionTLDR
Accuracy71.63
16
MGT detectionCMV
Accuracy86.9
16
MGT detectionWP
Accuracy83.06
16
MGT detectionSCI
Accuracy91.17
16
MGT detectionROCT
Accuracy61.55
16
MGT detectionXsum
Accuracy86.39
16
MGT detectionHSWAG
Accuracy87.87
16
MGT detectionYelp
Accuracy82.09
16
MGT detectionELI5
Accuracy79.99
16
Showing 10 of 21 rows

Other info

Follow for update