zsRE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Knowledge Editing | ZSRE | Generality97.36 | 110 | |
| Subject inference attack | zsRE batch-edit tasks | Recall99 | 36 | |
| Sequential Knowledge Editing | ZsRE sequential editing 10,000 Samples | Efficacy Success (Eff)97.8 | 33 | |
| Knowledge Editing | ZsRE 10,000 facts | Reliability100 | 27 | |
| Model Editing | ZsRE | Reliability80.5 | 26 | |
| Model Editing | zsRE | Efficacy98.91 | 24 | |
| Sequential model editing | ZsRE | Efficacy96.87 | 24 | |
| Knowledge Editing | ZsRE (evaluation) | Reliability99 | 21 | |
| Slot Filling | zsRE | Coverage EM57.29 | 20 | |
| Knowledge Editing | ZsRE (test) | Normalized Editing Time0.65 | 18 | |
| Model Editing | ZSRE | Reliability0.975 | 16 | |
| Lifelong Knowledge Editing | ZsRE | Reliability73.5 | 14 | |
| Sequential Model Editing | ZSRE (test) | Reliability99.6 | 14 | |
| Model Editing | ZsRE 3,000 samples (test) | Relational Score99.1 | 13 | |
| Sequential Knowledge Editing | ZsRE | Efficacy0.8447 | 12 | |
| Prompt recovery attack | zsRE | Top-1 Accuracy40 | 12 | |
| Knowledge Editing | ZsRE 1000 edits Sequential (test) | Efficiency100 | 12 | |
| Knowledge Editing | ZsRE 500 edits Sequential (test) | Efficiency100 | 12 | |
| Knowledge Editing | ZsRE 100 edits Sequential (test) | Efficiency100 | 12 | |
| Slot Filling | zsRE KILT (test) | KILT Accuracy72.55 | 12 | |
| Prompt recovery attack | zsRE (test) | Top-1 Accuracy34 | 9 | |
| Model Editing | ZsRE 3,000 samples | Rel Score (QA Context)77.8 | 8 | |
| Knowledge Editing | ZsRE (val) | Rel.1 | 8 | |
| Relation Extraction | zsRE (val) | Efficacy99.8 | 8 | |
| Model Editing | zsRE | TRR72 | 7 |
Showing 25 of 34 rows