Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Model Editing on SCOTUS
Loading...
81
TRR
GRACE
16.52
33.26
50
66.74
Nov 20, 2022
TRR
ERR
Average Performance
Number of Edits
Updated 4d ago
Evaluation Results
Method
Method
Links
TRR
ERR
Average Performance
Number of Edits
GRACE
Backbone=BERT
2022.11
81
82
82
381
FT+EWC
Backbone=BERT
2022.11
67
50
58
408
FT+Retrain
Backbone=BERT
2022.11
67
83
75
403
FT
Backbone=BERT
2022.11
52
52
52
415
Defer
Backbone=BERT
2022.11
33
41
37
506
Memory
Backbone=BERT
2022.11
21
20
21
780
MEND
Backbone=BERT
2022.11
19
27
23
672
Feedback
Search any
task
Search any
task