Neural Design Network: Graphic Layout Generation with Constraints
About
Graphic design is essential for visual communication with layouts being fundamental to composing attractive designs. Layout generation differs from pixel-level image synthesis and is unique in terms of the requirement of mutual relations among the desired components. We propose a method for design layout generation that can satisfy user-specified constraints. The proposed neural design network (NDN) consists of three modules. The first module predicts a graph with complete relations from a graph with user-specified relations. The second module generates a layout from the predicted graph. Finally, the third module fine-tunes the predicted layout. Quantitative and qualitative experiments demonstrate that the generated layouts are visually similar to real design layouts. We also construct real designs based on predicted layouts for a better understanding of the visual quality. Finally, we demonstrate a practical application on layout recommendation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Conditional layout generation (Category to Size and Position) | Rico | FID28.4 | 27 | |
| Conditional layout generation (Category to Size and Position) | PubLayNet | FID61.1 | 27 | |
| Conditional Layout Generation | PubLayNet (test) | IoU0.34 | 12 | |
| Conditional Layout Generation | RICO (test) | FID13.76 | 6 | |
| Conditional Layout Generation | Magazine layout (test) | FID23.27 | 6 |