Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking
About
Recent multi-bit watermarking methods for large language models (LLMs) prioritize capacity over reliability, often conflating decoding with detection. Our analysis reveals that existing ECC-based extractors suffer from catastrophic false positive rates (FPR), and applying rejection thresholds merely collapses detection sensitivity (TPR) to random guessing. To resolve this structural limitation, we propose BREW (Block-wise Reliable Embedding for Watermarking), a framework shifting the paradigm to designated verification. BREW employs a two-stage mechanism: (i) blind message estimation via independent block voting, followed by (ii) window-shifting verification that rigorously validates the payload against local edits. Experiments demonstrate that BREW achieves a TPR of 0.965 with an FPR of 0.02 under 10% synonym substitution, demonstrating that the high-FPR issue is not an inherent trade-off of multi-bit watermarking, but a solvable structural flaw of prior decoding-centric designs. Our framework is model-agnostic and theoretically grounded, providing a scalable solution for reliable forensic deployment.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Watermark Detection | OpenGen 10% Deletion Attack | True Positive Rate (TPR)100 | 10 | |
| Watermark Detection | OpenGen 10% Substitution Attack | TPR94.7 | 10 | |
| Watermark Detection | OpenGen 10% Insertion Attack | TPR42.8 | 10 | |
| Watermark Detection | C4 | True Positive Rate (TPR)54 | 10 | |
| Watermark Detection | OpenGen | TPR61 | 10 | |
| Watermark Detection | C4 10% deletion attack | True Positive Rate (TPR)99 | 5 | |
| Watermark Detection | C4 clean setting T = 500 | TPR92 | 5 | |
| Watermark Detection | C4 10% insertion attack | TPR44.8 | 5 | |
| Watermark Detection | C4 10% substitution attack | TPR65.5 | 5 | |
| Watermark Detection Robustness | C4 (test) | TPR (Substitution 10%)89.3 | 5 |