Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Safety Evaluation on CATQA Chinese (test)
Loading...
55.67
Chinese Accuracy
SFT
24.054
32.262
40.47
48.678
Feb 19, 2024
Chinese Accuracy
English Accuracy
Average Accuracy
Safety Delta
Updated 4d ago
Evaluation Results
Method
Method
Links
Chinese Accuracy
English Accuracy
Average Accuracy
Safety Delta
SFT
Training Regime=PEFT
2024.02
55.67
54.59
55.13
39.81
SFT
Training Regime=Full-FT
2024.02
49.36
54.49
51.93
36.61
RESTA
Training Regime=PEFT
2024.02
38.9
36.66
37.78
22.46
RESTA
Training Regime=Full-FT
2024.02
25.27
29.51
27.39
12.07
Feedback
Search any
task
Search any
task
