Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Data Extraction on The Pile (test)
Loading...
63.4
Fractional Extraction Rate
GPT-Neo 1.3B
6.512
21.281
36.05
50.819
May 19, 2023
Fractional Extraction Rate
Perplexity
Updated 4d ago
Evaluation Results
Method
Method
Links
Fractional Extraction Rate
Perplexity
GPT-Neo 1.3B
theta=0 (no defense)
2023.05
63.4
9.213
GPT-Neo 125M
theta=0 (no defense)
2023.05
35
15.71
GPT-Neo 1.3B
theta=0.5
2023.05
31.6
9.758
GPT-Neo 125M
theta=1.25
2023.05
19.2
16.601
GPT-Neo 1.3B
theta=0.75
2023.05
17.1
10.267
GPT2 1.5B
2023.05
16.6
17.155
GPT-Neo 1.3B
theta=1
2023.05
12.8
10.775
GPT-Neo 125M
theta=1.5
2023.05
12.3
17.499
GPT2 124M
2023.05
9.9
30.323
GPT-Neo 125M
theta=1.75
2023.05
8.7
19.691
Feedback
Search any
task
Search any
task