Multi-task image classification

Benchmarks

Dataset Name	SOTA Method	Metric
20 Vision Tasks		Accuracy94.8	48	29d ago
14 vision tasks		Accuracy94.3	48	29d ago
8 vision tasks		Accuracy95.9	48	29d ago
8 Vision Tasks Low Confidence setting (test)		Absolute Accuracy94	32	4mo ago
8 Vision Tasks Norm Mismatch setting (test)		Absolute Accuracy93.3	32	4mo ago
20-task Model Merging Benchmark (14-task + EMNIST, CIFAR10, Food101, FashionMNIST, RenderedSST2, KMNIST)	Fine-tuned	Avg Absolute Accuracy94.7	30	4mo ago
8-task vision suite	TALL-Masks	Average Performance94.3	28	29d ago
TA-8 (test)		Accuracy94.3	28	4mo ago
Vision Benchmark 20-task		Average Accuracy94.7	24	4mo ago
8-task vision benchmark		Average Accuracy95.8	24	4mo ago
7 Vision Benchmarks (test)		Accuracy (MNIST)99.53	13	22d ago
50 computer vision tasks		Accuracy90.8	13	1mo ago
Vision Tasks Suite (50 tasks) ViT-B/32 (test)		Accuracy90.8	12	29d ago
Vision Tasks Suite 30 tasks ViT-B/32 (test)		Accuracy93.1	12	29d ago
Vision Tasks Suite (20 tasks) ViT-B/32 (test)		Accuracy91.4	12	29d ago
Vision Tasks Suite 14 tasks ViT-B/32 (test)		Accuracy90.9	12	29d ago
Vision Tasks Suite 8 tasks ViT-B/32 (test)		Accuracy92.9	12	29d ago
30 Vision Tasks		Accuracy93.1	12	29d ago
MNIST multi-task (test)	MuDSC_Zip	Accuracy94.62	9	4mo ago
TALL-20 (test)		Accuracy93.5	8	4mo ago
TALL-14 (test)		Accuracy93.4	8	4mo ago
Multi-Fashion MNIST (test)	DSelect-k	Accuracy 183.78	7	4mo ago
Multi-MNIST (test)		Task 1 Accuracy92.61	7	4mo ago
8 vision classification tasks (test)	MoErging (Best LoRAs (256 steps))	Average Accuracy87.3	3	1mo ago

Showing 24 of 24 rows