Multiple-Human Parsing in the Wild
About
Human parsing is attracting increasing research attention. In this work, we aim to push the frontier of human parsing by introducing the problem of multi-human parsing in the wild. Existing works on human parsing mainly tackle single-person scenarios, which deviates from real-world applications where multiple persons are present simultaneously with interaction and occlusion. To address the multi-human parsing problem, we introduce a new multi-human parsing (MHP) dataset and a novel multi-human parsing model named MH-Parser. The MHP dataset contains multiple persons captured in real-world scenes with pixel-level fine-grained semantic annotations in an instance-aware setting. The MH-Parser generates global parsing maps and person instance masks simultaneously in a bottom-up fashion with the help of a new Graph-GAN model. We envision that the MHP dataset will serve as a valuable data resource to develop new multi-human parsing models, and the MH-Parser offers a strong baseline to drive future research for multi-human parsing in the wild.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Human Parsing | MHP v2.0 (val) | APp5018 | 27 | |
| Instance-aware Human Parsing | PASCAL-Person-Part v1 (test) | APr @ IoU=50%42.3 | 10 | |
| Human part segmentation | MHP v2.0 (val) | AP^p @ IoU=0.5017.9 | 6 | |
| Multi-Human Parsing | MHP Top 20% (test) | APp @ 0.541.67 | 4 | |
| Multi-Human Parsing | MHP Top 5% (test) | APp 0.533.69 | 4 | |
| Instance Segmentation | Buffy (episode 4, 5 and 6) | Average Score71.53 | 4 | |
| Multi-Human Parsing | MHP All (test) | APp @ 0.550.1 | 4 | |
| Multi-Human Parsing | MHP v1.0 (test) | AP_vol^0.550.1 | 4 | |
| Multi-Human Parsing | MHP 2.0 (test) | APp@0.5 (All)17.99 | 3 |