Deep High-Resolution Representation Learning for Visual Recognition
About
High-resolution representations are essential for position-sensitive vision problems, such as human pose estimation, semantic segmentation, and object detection. Existing state-of-the-art frameworks first encode the input image as a low-resolution representation through a subnetwork that is formed by connecting high-to-low resolution convolutions \emph{in series} (e.g., ResNet, VGGNet), and then recover the high-resolution representation from the encoded low-resolution representation. Instead, our proposed network, named as High-Resolution Network (HRNet), maintains high-resolution representations through the whole process. There are two key characteristics: (i) Connect the high-to-low resolution convolution streams \emph{in parallel}; (ii) Repeatedly exchange the information across resolutions. The benefit is that the resulting representation is semantically richer and spatially more precise. We show the superiority of the proposed HRNet in a wide range of applications, including human pose estimation, semantic segmentation, and object detection, suggesting that the HRNet is a stronger backbone for computer vision problems. All the codes are available at~{\url{https://github.com/HRNet}}.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic segmentation | ADE20K (val) | mIoU45.66 | 2731 | |
| Image Classification | ImageNet (val) | Top-1 Acc76.8 | 1206 | |
| Semantic segmentation | Cityscapes (test) | mIoU83.9 | 1145 | |
| Image Classification | ImageNet-1k (val) | Top-1 Acc76.8 | 706 | |
| Semantic segmentation | Cityscapes (val) | mIoU81.6 | 572 | |
| Human Pose Estimation | COCO (test-dev) | AP75.5 | 408 | |
| 2D Human Pose Estimation | COCO 2017 (val) | AP76.3 | 386 | |
| Semantic segmentation | Cityscapes (val) | mIoU80.4 | 332 | |
| Pose Estimation | COCO (val) | AP76.3 | 319 | |
| Semantic segmentation | Cityscapes (val) | mIoU84.7 | 287 |