Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Knowledge Modification on ZSRE (test)
Loading...
100
Edit Success Rate
FT-M
41.344
56.572
71.8
87.028
Jun 17, 2024
Edit Success Rate
Portability
Locality
Fluency
PPL
Updated 4d ago
Evaluation Results
Method
Method
Links
Edit Success Rate
Portability
Locality
Fluency
PPL
FT-M
Backbone=Llama2-7b-chat
2024.06
100
54.47
53.84
580.1
27.33
ICE
Backbone=Llama2-7b-chat
2024.06
100
55.52
56.97
562.7
15.5
ROME
Backbone=Llama2-7b-chat
2024.06
96.66
52.9
26.61
573.02
53.88
MEMIT
Backbone=Llama2-7b-chat
2024.06
95.61
52.73
24.79
563.42
38.67
FT-L
Backbone=Llama2-7b-chat
2024.06
43.6
43.9
51.38
560.94
30.36
Feedback
Search any
task
Search any
task