Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Deep High-Resolution Representation Learning for Visual Recognition

About

High-resolution representations are essential for position-sensitive vision problems, such as human pose estimation, semantic segmentation, and object detection. Existing state-of-the-art frameworks first encode the input image as a low-resolution representation through a subnetwork that is formed by connecting high-to-low resolution convolutions \emph{in series} (e.g., ResNet, VGGNet), and then recover the high-resolution representation from the encoded low-resolution representation. Instead, our proposed network, named as High-Resolution Network (HRNet), maintains high-resolution representations through the whole process. There are two key characteristics: (i) Connect the high-to-low resolution convolution streams \emph{in parallel}; (ii) Repeatedly exchange the information across resolutions. The benefit is that the resulting representation is semantically richer and spatially more precise. We show the superiority of the proposed HRNet in a wide range of applications, including human pose estimation, semantic segmentation, and object detection, suggesting that the HRNet is a stronger backbone for computer vision problems. All the codes are available at~{\url{https://github.com/HRNet}}.

Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yadong Mu, Mingkui Tan, Xinggang Wang, Wenyu Liu, Bin Xiao• 2019

Related benchmarks

TaskDatasetResultRank
Semantic segmentationADE20K (val)
mIoU45.66
2731
Image ClassificationImageNet (val)
Top-1 Acc76.8
1206
Semantic segmentationCityscapes (test)
mIoU83.9
1145
Image ClassificationImageNet-1k (val)
Top-1 Acc76.8
706
Semantic segmentationCityscapes (val)
mIoU81.6
572
Human Pose EstimationCOCO (test-dev)
AP75.5
408
2D Human Pose EstimationCOCO 2017 (val)
AP76.3
386
Semantic segmentationCityscapes (val)
mIoU80.4
332
Pose EstimationCOCO (val)
AP76.3
319
Semantic segmentationCityscapes (val)
mIoU84.7
287
Showing 10 of 131 rows
...

Other info

Code

Follow for update