OpenGen
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text Completion | OpenGen | Bit Accuracy90.62 | 20 | |
| Text Completion | OpenGen (test) | Bit Accuracy (BA)95.88 | 16 | |
| Text Watermarking | OpenGen 48 Bits payload (test) | Perplexity3.58 | 13 | |
| Text Watermarking | OpenGen 36 Bits payload (test) | Perplexity3.61 | 13 | |
| Text Watermarking | OpenGen 24 Bits payload (test) | Perplexity3.51 | 13 | |
| Text Watermarking | OpenGen 12 Bits payload (test) | Perplexity3.53 | 13 | |
| Text Watermarking | OpenGen 200 generated tokens (test) | Perplexity (12 Bits)3.84 | 13 | |
| Watermarking | OpenGen b=64 | BA99.06 | 12 | |
| Watermarking | OpenGen b=32 | Bit Accuracy (BA)100 | 12 | |
| Watermark detection | OpenGen | TPR100 | 10 | |
| Watermark Detection | OpenGen 10% Insertion Attack | TPR100 | 10 | |
| Watermark Detection | OpenGen 10% Deletion Attack | True Positive Rate (TPR)100 | 10 | |
| Watermark Detection | OpenGen 10% Substitution Attack | TPR100 | 10 | |
| Watermark Detection | OpenGen OPT-6.7B | TPR100 | 8 | |
| Watermark Detection | OpenGen Llama-3.1-8B | TPR100 | 8 | |
| Machine-Generated Text Detection | OpenGen 10% Editing | TPR99.8 | 3 | |
| Machine-Generated Text Detection | OpenGen No Editing | TPR1 | 3 |
Showing 17 of 17 rows