Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Non-Parametric Machine Text Detection via Multi-View Gaussian Processes

About

Adversarial conditions such as paraphrasing and targeted style transfer sharply degrade the accuracy of machine text detectors. A document, however, carries multiple complementary signals (e.g., stylistic features, likelihood and rank-order features, and structural features), and an attack that suppresses one may leave others intact. While a parametric classifier can learn to combine these features given sufficient supervision, classifiers are prone to making confidently incorrect predictions when the distribution shifts (e.g., novel attacks or unseen language models). To address this, we propose a multi-view, non-parametric detection framework that extracts complementary feature views from the same document and aggregates per-view evidence through a Gaussian process ensemble. By aggregating evidence across views, an adversary must simultaneously defeat multiple independent axes of detection, substantially raising the cost of evasion. The Gaussian process formulation additionally provides calibrated probabilities and principled abstention on out-of-distribution inputs, supporting reliable deployment in high-stakes settings. We evaluate on three benchmarks spanning diverse generators and attacks: the DetectRL and RAID benchmarks, and the PAN2025 shared task and demonstrate that our multi-view detector maintains strong performance under the considered attacks, outperforming existing approaches against held out attacks.

Aleem Khan, Nicholas Andrews• 2026

Related benchmarks

TaskDatasetResultRank
AI-generated text detection and calibrationDetectRL Prompt Attack
AUC@1%80.9
20
AI-generated text detection and calibrationDetectRL (Paraphrase)
AUC@1%80.4
10
DetectionRAID Reviews
AUC@1%89.5
10
Detection and CalibrationRAID News domain
AUC @ 1%0.93
10
Detection and CalibrationRAID Reddit domain
AUC@1%77.5
10
Machine Text Detection and CalibrationPAN MP (Machine-polished) 2025
AUC@1%61
10
Machine Text Detection and CalibrationPAN MC (Machine-continued) 2025
AUC@1%61.2
10
Showing 7 of 7 rows

Other info

Follow for update