Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Algospeak, Hiding in the Open: The Trade-off Between Legible Meaning and Detection Avoidance

About

As large language models (LLMs) increasingly mediate both content generation and moderation, linguistic evasion strategies known as Algospeak have intensified the coevolution between evaders and detectors. This research formalizes the underlying dynamics grounded in a joint action model: when Algospeak increases, detectability and understandability decrease. Further, the concept of Majority Understandable Modulation (MUM) is introduced and defined as the modulation level at which additional evasive alteration increases detector evasion but loses comprehension for the majority of recipients. To empirically probe this trade-off, we introduce a reproducible framework that can be used to create meaning-preserving, Algospeak-style variants, based on an existing taxonomy and with tunable modulation levels. Using COVID-19 disinformation as a first proof-by-example setting, we construct a reference dataset of 700 modulated items, drawn from twenty base sentences across five modulation levels and seven strategies. We then run two linked evaluations with seven different language models: one testing for interpretation through meaning recovery and one for disinformation detection through classification. Curve fitting over modulation levels yields an estimate of the Majority Understandable Modulation threshold and enables sensitivity analyses across strategies and models, see Figure 1. Results reveal the characteristic relationships between understandability and modulation. This study lays the groundwork for understanding the dynamics behind Algospeak and provides the framework, dataset, and experimental setups described.

Jan Fillies, Ronald E. Robertson, Jeffrey Hancock• 2026

Related benchmarks

TaskDatasetResultRank
UnderstandabilityUnderstandability Experiment New word strategy
Significance Count7
8
UnderstandabilityUnderstandability Experiment Paraphrase strategy
Significance Count (out of 7)6
8
UnderstandabilityUnderstandability Experiment Phonetic strategy
Significance Count (N=7)6
8
UnderstandabilityUnderstandability Experiment Abbreviation strategy
Significance Count5
8
UnderstandabilityUnderstandability Experiment Emotion strategy
Significant Results Count4
8
UnderstandabilityUnderstandability Experiment Code strategy
Significant Results Count5
8
UnderstandabilityUnderstandability Experiment Unknown word strategy
Significance Count1
8
DetectionAlgospeak Unkn. word 1.0 (test)--
7
DetectionAlgospeak New word 1.0 (test)--
7
DetectionAlgospeak Abbreviation 1.0 (test)--
7
Showing 10 of 22 rows

Other info

Follow for update