Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Adversarial Creation and Detection of AI-Generated Social Bot Content

About

The convergence of large language models and social bots allows malicious actors to manipulate the information ecosystem by generating human-like content at scale. Existing models for detecting AI-generated content often fail in the wild, primarily due to the lack of ground-truth data. We address this gap through an adversarial methodology that models the impersonation of real social media users by malicious actors. Using this methodology, we curate a multilingual, cross-platform dataset of paired human and AI-generated messages. Training on such adversarial data yields accurate detection of AI-generated text. Our approach significantly outperforms existing models for content-based bot detection in real-world, out-of-distribution data.

Mykola Trokhymovych, Ricardo Baeza-Yates, Alessandro Flammini, Diego Saez-Trumper, Filippo Menczer• 2026

Related benchmarks

TaskDatasetResultRank
AI-powered social bot detectionOur data
AUC99.3
9
AI-powered social bot detectionFox8-23
AUC0.989
9
Showing 2 of 2 rows

Other info

Follow for update