zsRE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Knowledge Editing | ZSRE | Generality97.62 | 268 | |
| Lifelong Model Editing | ZsRE | Efficacy91.09 | 89 | |
| Model Editing | ZsRE | Reliability1 | 72 | |
| Model Editing | zsRE | Efficacy99.79 | 71 | |
| Sequential model editing | ZsRE | Efficacy99.74 | 55 | |
| Sequential Knowledge Editing | ZsRE | Efficacy99.67 | 46 | |
| Knowledge Unlearning | ZsRE | Efficiency40.77 | 42 | |
| Sequential Model Editing | ZsRE T = 300 | Efficacy98.8 | 36 | |
| Subject inference attack | zsRE batch-edit tasks | Recall99 | 36 | |
| Sequential Knowledge Editing | ZsRE sequential editing 10,000 Samples | Efficacy Success (Eff)97.8 | 33 | |
| Knowledge Editing | ZsRE 10,000 facts | Reliability100 | 27 | |
| Model Editing | ZsRE | Reliability80.5 | 26 | |
| Relation Extraction | ZSRE | Accuracy22.82 | 22 | |
| Model Editing | ZSRE sequential editing of 1000 facts | Efficacy99.7 | 21 | |
| Knowledge Editing | ZsRE (evaluation) | Reliability99 | 21 | |
| One-Time Knowledge Editing | ZsRE | Efficacy99.27 | 20 | |
| Slot Filling | zsRE | Coverage EM57.29 | 20 | |
| Knowledge Editing | ZsRE (test) | Normalized Editing Time0.65 | 18 | |
| Sequential Model Editing | ZsRE T = 5000 | Efficacy98.9 | 16 | |
| Model Editing | ZSRE | Reliability0.975 | 16 | |
| Lifelong Knowledge Editing | ZsRE | Reliability73.5 | 14 | |
| Sequential Model Editing | ZSRE (test) | Reliability99.6 | 14 | |
| Model Editing | ZsRE 3,000 samples (test) | Relational Score99.1 | 13 | |
| Knowledge Editing | ZsRE N = 10000 | Reliability1 | 12 | |
| Knowledge Editing | ZsRE N = 5000 | Reliability100 | 12 |
Showing 25 of 55 rows