Adversarial Creation and Detection of AI-Generated Social Bot Content
About
The convergence of large language models and social bots allows malicious actors to manipulate the information ecosystem by generating human-like content at scale. Existing models for detecting AI-generated content often fail in the wild, primarily due to the lack of ground-truth data. We address this gap through an adversarial methodology that models the impersonation of real social media users by malicious actors. Using this methodology, we curate a multilingual, cross-platform dataset of paired human and AI-generated messages. Training on such adversarial data yields accurate detection of AI-generated text. Our approach significantly outperforms existing models for content-based bot detection in real-world, out-of-distribution data.
Mykola Trokhymovych, Ricardo Baeza-Yates, Alessandro Flammini, Diego Saez-Trumper, Filippo Menczer• 2026
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| AI-powered social bot detection | Our data | AUC99.3 | 9 | |
| AI-powered social bot detection | Fox8-23 | AUC0.989 | 9 |
Showing 2 of 2 rows