Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Persuasion Index: A Theory-Guided Framework for Persuasion Analysis

About

Identifying persuasive rhetorical cues is critical across domains, from detecting information manipulation and improving AI safety to advancing public health communication. We propose Persuasion Index (PI), a taxonomy of 15 dimensions grounded in persuasion theories from psychology and communication, and one transparent implementation using 55 sub-features built from lexicons and rule-based detectors. The taxonomy is modular: individual detectors can be replaced while preserving the theoretical structure. By evaluating PI on four public datasets varying in domain, style, and outcome measures, we show that PI provides a shared feature space for interpreting rhetorical patterns associated with persuasion-related outcomes. Linear models show that PI features carry meaningful predictive signal while remaining computationally lightweight. Dimension-level analyses reveal recurring associations between PI dimensions and persuasion outcomes across datasets, while also highlighting topic- and stance-specific variation. We release PI as an open-source package and web interface for principled and auditable analysis of human and AI-mediated communication.

Liancheng Gong, Zhiyang Wang, Yiwei Xu, Julia Mendelsohn• 2026

Related benchmarks

TaskDatasetResultRank
Binary Persuasion PredictionCMV (test)
F1 Score58.8
8
Persuasion PredictionIBM Argument Quality (test)
F159
4
Binary Persuasion PredictionAnthropic (test)
Precision35.9
4
Pairwise Persuasion PredictionIBM (test)
Precision58.1
4
Pairwise Persuasion PredictionUKP (test)
Precision76.8
4
Persuasion PredictionUKPConvArg 1.0 (test)
F1 Score76.8
4
Persuasion PredictionAnthropic Persuasion (test)
F1 Score43.2
4
Showing 7 of 7 rows

Other info

Follow for update