End-to-End Wireframe Parsing
About
We present a conceptually simple yet effective algorithm to detect wireframes in a given image. Compared to the previous methods which first predict an intermediate heat map and then extract straight lines with heuristic algorithms, our method is end-to-end trainable and can directly output a vectorized wireframe that contains semantically meaningful and geometrically salient junctions and lines. To better understand the quality of the outputs, we propose a new metric for wireframe evaluation that penalizes overlapped line segments and incorrect line connectivities. We conduct extensive experiments and show that our method significantly outperforms the previous state-of-the-art wireframe and line extraction algorithms. We hope our simple approach can be served as a baseline for future wireframe parsing studies. Code has been made publicly available at https://github.com/zhou13/lcnn.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Line Segment Detection | YorkUrban (test) | sAP (10px)28.2 | 39 | |
| Line Segment Detection | Wireframe dataset (test) | sAP^{10}62.9 | 34 | |
| Line Segment Detection | YorkUrban | sAP527.5 | 33 | |
| Line Segment Detection | Wireframe | sAP50.594 | 18 | |
| Line Segment Detection | ShanghaiTech v1.0 (test) | sAP558.9 | 15 | |
| Wireframe Parsing | YorkUrban v1 (test) | sAP525 | 14 | |
| Wireframe Parsing | Wireframe v1 (test) | sAP559.7 | 14 | |
| Wireframe Parsing | Wireframe | AP (5)59.7 | 11 | |
| Wireframe Parsing | YorkUrban | sAP525 | 11 | |
| Line Segment Detection | Wireframe (test) | Rep-5 (ds)0.434 | 8 |