Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Clip

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationCLIP benchmark (test)
Accuracy93
72
Deferral-adviceCLIP prompt-escalation (val)
True Deferral-Advice Loss0.337
66
Membership InferenceCLIP image-text (train)
Precision91.68
36
Image ClassificationCLIP Zero-shot Evaluation Suite (10 datasets)
Cars Accuracy89.6
16
Multilabel ClassificationCLIP (test)
Micro F180.9
12
Image ClassificationCLIP Classification Suite
CIFAR-10 Accuracy97.2
11
ClassificationCLIP 21-dataset Zero-Shot standard (test val)
ImageNet Accuracy45
11
ClassificationCLIP 200 random samples (test)
Macro F1 Score0.24
6
Lyric Intelligibility PredictionCLIP (evaluation)
RMSE (%)27.07
3
Lyric Intelligibility PredictionCLIP (val)
RMSE (%)27.13
3
Image DenoisingClip300 sigma=60
Average PSNR (dB)25.51
3
Image DenoisingClip300 sigma=15
Average PSNR (dB)31.68
3
Multi-shot Backdoor ClassificationCLIP Multi-shot Downstream
BA70.27
2
Showing 13 of 13 rows