TOFU
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Machine Unlearning | TOFU (5%) | Forget Quality86.6 | 59 | |
| Machine Unlearning | TOFU Forget01 (1% authors) | Forget Quality (Rouge-L)0.99 | 48 | |
| Machine Unlearning | TOFU | Forget Quality (FQ)1 | 43 | |
| Machine Unlearning | TOFU Forget10 (10% authors split) | Forget Quality - Rouge-L0.99 | 42 | |
| Machine Unlearning | TOFU Forget05 (5% authors) | Forget Quality (ROUGE-L)0.99 | 42 | |
| Knowledge Recovery | TOFU 10% (400 samples) 1.0 (forget) | ASR60 | 42 | |
| Machine Unlearning | TOFU (10%) | Forget Quality (FQ)1 | 37 | |
| Machine Unlearning | TOFU (1%) | Forget Quality (FQ)0.0002 | 36 | |
| Machine Unlearning | TOFU 1.0 (forget01) | MU Score78.88 | 33 | |
| Machine Unlearning | TOFU Forget 1% | Aggregation Score62 | 27 | |
| Machine Unlearning | TOFU Forget 5% | Aggregation Metric64 | 27 | |
| Machine Unlearning | TOFU Forget 10% | Aggregation Score65 | 27 | |
| LLM Unlearning | TOFU 5% (forget set) | FQ-13.591 | 25 | |
| Machine Unlearning | TOFU Forget10 Phi-1.5B model | Forget Quality (FQ)1 | 24 | |
| Machine Unlearning | TOFU Forget01 Phi-1.5B model (1%) | Forget Quality (Rouge-L)96 | 24 | |
| Machine Unlearning | TOFU 1.0 (Retain Set) | ROUGE-L100 | 24 | |
| Machine Unlearning | TOFU forget10 1.0 | MU75.85 | 21 | |
| Machine Unlearning | TOFU forget05 1.0 | Model Utility (MU)75.85 | 21 | |
| Machine Unlearning | TOFU Forget05 Phi-1.5B model (5%) | Forget Quality (Rouge-L)0.72 | 20 | |
| Machine Unlearning | TOFU 5% forget | Loss0.1434 | 20 | |
| Machine Unlearning | TOFU Llama-3.2 Instruct (average of 1%, 5%, 10% forget sets) | FQ Score-81.257 | 18 | |
| Machine Unlearning | TOFU 10% forget set 1.0 | FQ-238.973 | 18 | |
| Machine Unlearning | TOFU 1% (forget set) | FQ-2.17 | 18 | |
| Membership Inference Attack | TOFU MIA Set | FM2.1448 | 17 | |
| Unlearning | TOFU Neighbor Set | FB Score66.85 | 17 |
Showing 25 of 66 rows