RWKU
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Machine Unlearning | RWKU Llama 3.1 8B (Forget Set) | FB Score85.9 | 39 | |
| Knowledge Unlearning | RWKU (Forget Set) | FB85.9 | 23 | |
| Membership Inference Attack | RWKU MIA Set | FM Score7.1544 | 17 | |
| Knowledge Retention | RWKU Neighbor Set | FB Score64.64 | 17 | |
| LLM Unlearning | RWKU | USR89.3 | 16 | |
| Machine Unlearning | RWKU Llama 3.1 8B (Neighbor Set) | FB95.6 | 15 | |
| Membership Inference Attack | RWKU MIA Set Llama 3.1 8B | FM Rate2.1 | 11 | |
| Relearning Attack | RWKU | RAP38.9 | 8 | |
| Knowledge Unlearning | RWKU Utility Set | Fac Score58.2 | 6 | |
| Knowledge Unlearning | RWKU MIA Set | FM228 | 6 | |
| Knowledge Unlearning | RWKU (Neighbor Set) | FB Score95.6 | 6 | |
| Model Utility Maintenance | RWKU Utility Set (MMLU, BBH, TruthfulQA, TriviaQA, AlpacaEval) 1.0 | Generation Score66.1 | 4 | |
| Knowledge Unlearning | RWKU | FB47.5 | 3 |
Showing 13 of 13 rows