Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking

About

Recent multi-bit watermarking methods for large language models (LLMs) prioritize capacity over reliability, often conflating decoding with detection. Our analysis reveals that existing ECC-based extractors suffer from catastrophic false positive rates (FPR), and applying rejection thresholds merely collapses detection sensitivity (TPR) to random guessing. To resolve this structural limitation, we propose BREW (Block-wise Reliable Embedding for Watermarking), a framework shifting the paradigm to designated verification. BREW employs a two-stage mechanism: (i) blind message estimation via independent block voting, followed by (ii) window-shifting verification that rigorously validates the payload against local edits. Experiments demonstrate that BREW achieves a TPR of 0.965 with an FPR of 0.02 under 10% synonym substitution, demonstrating that the high-FPR issue is not an inherent trade-off of multi-bit watermarking, but a solvable structural flaw of prior decoding-centric designs. Our framework is model-agnostic and theoretically grounded, providing a scalable solution for reliable forensic deployment.

Joeun Kim, HoEun Kim, Dongsup Jin, Young-Sik Kim• 2026

Related benchmarks

TaskDatasetResultRank
Watermark DetectionOpenGen 10% Deletion Attack
True Positive Rate (TPR)100
10
Watermark DetectionOpenGen 10% Substitution Attack
TPR94.7
10
Watermark DetectionOpenGen 10% Insertion Attack
TPR42.8
10
Watermark DetectionC4
True Positive Rate (TPR)54
10
Watermark DetectionOpenGen
TPR61
10
Watermark DetectionC4 10% deletion attack
True Positive Rate (TPR)99
5
Watermark DetectionC4 clean setting T = 500
TPR92
5
Watermark DetectionC4 10% insertion attack
TPR44.8
5
Watermark DetectionC4 10% substitution attack
TPR65.5
5
Watermark Detection RobustnessC4 (test)
TPR (Substitution 10%)89.3
5
Showing 10 of 10 rows

Other info

Follow for update