Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Clear

Benchmarks

Task NameDataset NameSOTA ResultTrend
Out-of-Distribution DetectionCLEAR10 ID
AUROC (COCO)99.66
40
Out-of-Distribution DetectionCLEAR100 ID
AUROC (COCO)97.37
40
Visual Question AnsweringCLEAR 1.0 (Retain)
Accuracy70.9
32
ClassificationCLEAR
Error Rate4
24
Multimodal Machine UnlearningCLEAR
Forget VQA Accuracy32.4
16
Machine UnlearningCLEAR (test 2)
Forget Accuracy44
16
Machine UnlearningCLEAR (test 1)
Forget Accuracy42
16
Question AnsweringCLEAR Real-world 1.0
Acc94.7
16
Question AnsweringCLEAR 1.0 (Retain)
R-L Score0.352
16
Question AnsweringCLEAR Forget 1.0
R-L Score0.367
16
Visual Question AnsweringCLEAR Forget 1.0
Accuracy34.2
16
Domain-incremental learningCLEAR-10
Accuracy67.67
13
Online Continual Self-Supervised LearningCLEAR100 11 experiences (streaming online)
Final Accuracy51.5
9
ClassificationCLEAR (Realworld)
Accuracy (Realworld)74.66
5
Text GenerationCLEAR 5% forget
Forget Gen.42
5
ClassificationCLEAR 5% Forget
Accuracy (Forget Set)78.19
5
Bias EvaluationCLEAR Bias
Age Performance82.9
5
Readability AssessmentCLEAR
Pearson Correlation0.735
4
Visual Question AnsweringCLEAR Real QA
Accuracy (Aut)76.6
4
Identity RecognitionCLEAR (Retain)
Recall4.21
4
Identity RecognitionCLEAR (Forget)
Recall62
4
Depth CompletionClear-Real (test)
RMSE0.041
4
PredictionCLEAR Control Group
Time per 1000 Iterations287.85
3
PredictionCLEAR (Treatment Group)
Time per 1000 Iterations232.64
3
Causal ReasoningCLEAR
Accuracy60.5
3
Showing 25 of 30 rows