Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Decoding Hidden Deception in Reasoning LLMs: Activation Explainers for Deception Auditing

About

As LLMs acquire stronger reasoning capabilities, deceptive behavior becomes an increasingly serious safety concern. Existing deception monitors either score visible transcripts or derive scalar probe scores from representation vectors, leaving little inspectable evidence about why a response is suspicious. We introduce STATEWITNESS, an activation explainer for deception auditing. A separate decoder reads a target model's hidden states, then answers natural-language queries or emits structured reports about them. We evaluate STATEWITNESS on two target reasoning LLMs across seven deception datasets. STATEWITNESS reaches 0.916 mean AUROC, a relative gain of 11.6% over the best black-box text monitor and 25.0% over the best activation-probe baseline under the same evaluation protocol. When combined with existing monitors, STATEWITNESS reduces missed deceptive examples in simple threshold ensembles. Beyond scalar detection, the decoder returns query-level answers, schema reports, and token- or sentence-level evidence traces for human inspection. We view this interface as a potential building block for broader interpretability and alignment tools.

Kexin Chen, Yi Liu, Haonan Zhang, Yanhui Li, Xinyu Deng, Dongxia Wang• 2026

Related benchmarks

TaskDatasetResultRank
Deception DetectionSandbagging (Sandbag)
AUROC99.9
16
Deception DetectionMASK
AUROC0.822
16
Deception DetectionAgentic Misalignment
AUROC92.4
16
Deception DetectionInstrumentalEval (InstEval)
AUROC0.867
16
Deception DetectionRoleplaying
AUROC93.2
16
Deception DetectionInsider Trading
AUROC100
16
Deception DetectionInstructed Deception
AUROC98.7
16
Deception Detection7 non-control benchmark families GPT-OSS-20B
AUROC0.92
3
Deception Detection7 non-control benchmark families GEMMA4-26B-A4B-IT
AUROC91.1
3
Deception Detection7 non-control benchmark families Mean across targets
AUROC91.6
3
Showing 10 of 10 rows

Other info

Follow for update