Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Distribution Alignment: A Unified Framework for Long-tail Visual Recognition

About

Despite the recent success of deep neural networks, it remains challenging to effectively model the long-tail class distribution in visual recognition tasks. To address this problem, we first investigate the performance bottleneck of the two-stage learning framework via ablative study. Motivated by our discovery, we propose a unified distribution alignment strategy for long-tail visual recognition. Specifically, we develop an adaptive calibration function that enables us to adjust the classification scores for each data point. We then introduce a generalized re-weight method in the two-stage learning to balance the class prior, which provides a flexible and unified solution to diverse scenarios in visual recognition tasks. We validate our method by extensive experiments on four tasks, including image classification, semantic segmentation, object detection, and instance segmentation. Our approach achieves the state-of-the-art results across all four recognition tasks with a simple and unified framework. The code and models will be made publicly available at: https://github.com/Megvii-BaseDetection/DisAlign

Songyang Zhang, Zeming Li, Shipeng Yan, Xuming He, Jian Sun• 2021

Related benchmarks

TaskDatasetResultRank
Object DetectionLVIS v1.0 (val)
APbbox33.7
518
Image ClassificationiNaturalist 2018
Top-1 Accuracy74.1
287
Image ClassificationImageNet LT
Top-1 Accuracy53.4
251
Long-Tailed Image ClassificationImageNet-LT (test)
Top-1 Acc (Overall)52.9
220
Image ClassificationiNaturalist 2018 (test)
Top-1 Accuracy70.2
192
Instance SegmentationLVIS v1.0 (val)
AP (Rare)18.4
189
Image ClassificationImageNet-LT (test)
Top-1 Acc (All)52.9
159
Image ClassificationPlaces-LT (test)
Accuracy (Medium)42.4
128
Image ClassificationiNaturalist 2018 (val)
Top-1 Accuracy69.5
116
Long-tailed Visual RecognitionImageNet LT
Overall Accuracy52.9
89
Showing 10 of 25 rows

Other info

Code

Follow for update