Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Leveraging Large Language Models to Detect Influence Campaigns in Social Media

About

Social media influence campaigns pose significant challenges to public discourse and democracy. Traditional detection methods fall short due to the complexity and dynamic nature of social media. Addressing this, we propose a novel detection method using Large Language Models (LLMs) that incorporates both user metadata and network structures. By converting these elements into a text format, our approach effectively processes multilingual content and adapts to the shifting tactics of malicious campaign actors. We validate our model through rigorous testing on multiple datasets, showcasing its superior performance in identifying influence efforts. This research not only offers a powerful tool for detecting campaigns, but also sets the stage for future enhancements to keep up with the fast-paced evolution of social media-based influence tactics.

Luca Luceri, Eric Boniardi, Emilio Ferrara• 2023

Related benchmarks

TaskDatasetResultRank
IO User DetectionEgypt
AUPRC68.59
10
IO User DetectionRussia 1
AUPRC18.48
10
IO User DetectionUAE
AUPRC68.59
10
IO User DetectionChina 1
AUPRC16.7
10
IO User DetectionIran 1
AUPRC30.75
10
IO User DetectionEgypt IO
F1 Score76.56
4
IO User DetectionChina 1
Recall66.05
4
IO User DetectionIran 1
Recall68.48
4
IO User DetectionRussia_1 IO
F1 Score24.3
4
IO User DetectionUAE IO
F1 Score76.56
4
Showing 10 of 25 rows

Other info

Follow for update