Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

RWKU

Benchmarks

Task NameDataset NameSOTA ResultTrend
Machine UnlearningRWKU Llama 3.1 8B (Forget Set)
FB Score85.9
39
LLM UnlearningRWKU
USR89.3
16
Machine UnlearningRWKU Llama 3.1 8B (Neighbor Set)
FB95.6
15
Membership Inference AttackRWKU MIA Set Llama 3.1 8B
FM Rate2.1
11
Relearning AttackRWKU
RAP38.9
8
Model Utility MaintenanceRWKU Utility Set (MMLU, BBH, TruthfulQA, TriviaQA, AlpacaEval) 1.0
Generation Score66.1
4
Knowledge UnlearningRWKU
FB47.5
3
Showing 7 of 7 rows