Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Top-1 White-box Attack on NQ (test)
Loading...
55.7
ASR
HotFlip-based
4.324
17.662
31
44.338
Apr 24, 2025
ASR
Top-10 Accuracy
Top-50 Accuracy
BLEU Score
LLM Q1 Score
LLM Q2 Score
Perplexity
Inference Time (s)
Updated 1mo ago
Evaluation Results
Method
Method
Links
ASR
Top-10 Accuracy
Top-50 Accuracy
BLEU Score
LLM Q1 Score
LLM Q2 Score
Perplexity
Inference Time (s)
HotFlip-based
Target Model=SimLM
2025.04
55.7
77.3
81.7
2.5
98.3
83
8,021.7
588.3
Ours
Target Model=SimLM
2025.04
41.7
49
70
9.9
94
79.3
231.2
127.5
Random Token
Target Model=SimLM
2025.04
17.7
21.7
40
34.8
94
59.7
2,889.4
0.1
Random Noise
Target Model=SimLM
2025.04
6.3
3
10
5.2
100
99.3
3,001.5
0.1
Feedback
Search any
task
Search any
task