CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarking
About
Reliable provenance for LLM outputs requires multi-bit watermarks that remain robust under editing while maintaining strict false-positive control. Existing ECC-based LLM watermarks rely largely on hard-decision decoding, discarding token-level reliability information. We propose CORE-BREW, a Constant-hit-Rate Embedding extension of block-wise BREW for robust multi-bit watermarking. CORE-BREW calibrates the watermark channel by targeting a fixed hit rate p-star, yielding closed-form per-token log-likelihood ratios (LLRs) for principled soft-decision decoding. It supports two detection modes: Strict-Safe, which preserves the bounded-distance designated-codeword acceptance region, and FPR-Calibrated, which uses likelihood-based scoring and lightweight list decoding to characterize the FPR-TPR trade-off. Experiments on open-source LLMs under token-level edits and paraphrasing demonstrate improved low-FPR discrimination and robustness over prior multi-bit watermarking baselines while maintaining comparable semantic quality.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Watermark Detection | OpenGen 10% Substitution Attack | TPR96.8 | 10 | |
| Watermark Detection | OpenGen 10% Deletion Attack | True Positive Rate (TPR)100 | 10 | |
| Watermark Detection | OpenGen 10% Insertion Attack | TPR46.7 | 10 | |
| Watermark Detection | C4 | True Positive Rate (TPR)64 | 10 | |
| Watermark Detection | OpenGen | TPR64 | 10 | |
| Watermark Detection | C4 clean setting T = 500 | TPR94 | 5 | |
| Watermark Detection | C4 10% substitution attack | TPR67.3 | 5 | |
| Watermark Detection | C4 10% deletion attack | True Positive Rate (TPR)98.5 | 5 | |
| Watermark Detection | C4 10% insertion attack | TPR46 | 5 | |
| Watermark Detection Robustness | C4 (test) | TPR (Substitution 10%)90 | 5 |