Watermark Evasion on vicuna-7b 50 samples, UMD watermarking v1.5-16k (test)
58ASR (0 Unattacked)
SCTS
Updated 4d ago
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2024.03 | 58 | 80 | 92 | 96 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | - | |
2024.03 | 24 | 38 | 68 | - | 98 | 100 | 100 | 100 | 100 | 100 | 100 | - | |
2024.03 | 18 | 18 | 18 | 18 | 18 | 18 | 18 | 18 | 18 | 20 | 28 | 96 | |
2024.03 | 18 | 18 | 18 | 18 | 18 | 22 | 20 | 24 | 26 | 30 | 36 | 94 | |
2024.03 | 18 | 18 | 18 | 18 | 18 | 24 | 26 | 28 | 32 | 36 | 46 | 100 | |
2024.03 | 18 | 18 | 18 | 18 | 18 | 24 | 30 | 26 | 40 | 40 | 58 | 96 | |
2024.03 | 18 | 18 | 18 | 20 | 18 | 24 | 30 | 28 | 44 | 42 | 62 | 100 | |
2024.03 | 18 | 28 | 28 | 28 | 30 | 30 | 32 | 30 | 28 | 40 | 40 | 82 | |
2024.03 | 18 | 44 | 60 | 72 | 82 | 90 | 92 | 94 | 100 | 100 | 100 | - | |
2024.03 | 18 | 56 | 74 | 92 | 96 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | |
2024.03 | 16 | 42 | 72 | 92 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | |
2024.03 | 16 | 54 | 80 | 92 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | |
2024.03 | 12 | 44 | 60 | 72 | 88 | 96 | 100 | 100 | 100 | 100 | 100 | - | |
2024.03 | 10 | 36 | 66 | 88 | 96 | 98 | 98 | 98 | 98 | 98 | 98 | - | |
2024.03 | 8 | 46 | 68 | 92 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 |