Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Safety Evaluation on CATQA Chinese (test)
Loading...
55.67
Chinese Accuracy
SFT
24.054
32.262
40.47
48.678
Feb 19, 2024
Chinese Accuracy
English Accuracy
Average Accuracy
Safety Delta
Updated 1mo ago
Evaluation Results
Method
Method
Links
Chinese Accuracy
English Accuracy
Average Accuracy
Safety Delta
SFT
Training Regime=PEFT
2024.02
55.67
54.59
55.13
39.81
SFT
Training Regime=Full-FT
2024.02
49.36
54.49
51.93
36.61
RESTA
Training Regime=PEFT
2024.02
38.9
36.66
37.78
22.46
RESTA
Training Regime=Full-FT
2024.02
25.27
29.51
27.39
12.07
Feedback
Search any
task
Search any
task
