Knowledge Retention

Benchmarks

Dataset Name	SOTA Method	Metric
MMLU (full)		MMLU Accuracy88.3	60	3mo ago
Knowledge Retention Evaluation Set	SaLoRA	Cosine Similarity98.04	49	2mo ago
WMDP retain	NPO	Retain48.3	36	2mo ago
Source domain	LaLoRA	Source Domain Accuracy65.9	23	4mo ago
RWKU Neighbor Set	DirectQA	FB Score64.64	17	3mo ago
WMDP cyber (retain)	MANSU	Rt54.1	16	2mo ago
WMDP-chem (retain)		Rt (Knowledge Retention)56	16	2mo ago
WMDP bio (retain)		Rt80.3	16	2mo ago
ImageNet		Control Accuracy75.5	15	1mo ago
MUSE utility	LUNAR	Util Score18.4	14	2mo ago
Complete 30% (retain)	GA_diff	Class QA Accuracy64.64	14	2mo ago
Personalized (retain)	MMunlearner	Class VQA Accuracy67.42	14	2mo ago
Selective (retain)	GA_diff	Class VQA Accuracy64.39	14	2mo ago
Internal e-commerce benchmark Neighbours medium-scale seller 387 items		Rouge Score80.8	14	4mo ago
CIFAR-100 Task-0 (test)	BiCLIP	Accuracy86.2	12	2mo ago
Knowledge Retention Suite MME, MMBench, SEEDBench2 Plus, OCRVQA, ScienceQA, MMMU, MIA-Bench, MMDU, MathVista, MathVision, POPE, HallusionBench		COM65.61	12	2mo ago
Proposed Driving Benchmark	RecogDrive-8B	KRR74	9	3mo ago
Sequential Unlearning 16-task Retained Data Avg		Specificity100	9	4mo ago
MUSE Retain set (Dr)		KnowMem56	9	4mo ago
Knowledge Retention Evaluation Suite		MME82.54	8	2mo ago
MMBench General Knowledge Retention		COM Score81.18	8	2mo ago
16-task Sequential Unlearning Retained Data Last	CORE	Specificity96.54	8	4mo ago
internal e-commerce benchmark large-scale seller 1065 items (Neighbours)	ME+GD	Rouge Score58.2	8	4mo ago
RWKU Famous People Neighbor Set	ICU	FB Score56.6	7	4mo ago
MATH (retain)		Accuracy37	4	1mo ago

Showing 25 of 27 rows