Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Moebius: 0.2B Lightweight Image Inpainting Framework with 10B-Level Performance

About

While 10B-level industrial foundation models have pushed the boundaries of image inpainting, their prohibitive computational costs severely hinder practical deployment. Constructing a highly optimized task-specific specialist offers a promising solution; however, extreme structural compression inevitably triggers a severe representation bottleneck. To conquer this, we propose Moebius, a highly efficient lightweight inpainting framework. We systematically reconstruct the diffusion backbone by introducing the Local-$\lambda$ Mix Interaction ($L\lambda MI$) block. Comprising Local-$\lambda$ and Interactive-$\lambda$ modules, it elegantly summarizes spatial contexts and global semantic priors into fixed-size linear matrices, preserving complex latent interactions while drastically shedding parameters. Furthermore, to unlock the full representational capacity of this highly compact architecture, we synergistically pair it with an adaptive multi-granularity distillation strategy. Operating strictly within the latent space to avoid expensive pixel-space decoding, this strategy dynamically balances multiple gradient-based losses to achieve high-fidelity alignment. Extensive experiments across natural and portrait benchmarks demonstrate that this optimal synergy enables Moebius to rival or even surpass the generation quality of the 10B-level industrial generalist FLUX.1-Fill-Dev. Remarkably, Moebius achieves this using less than 2\% of the parameters (0.22B vs. 11.9B) while delivering a $>15\times$ acceleration in total inference time, setting a new efficiency standard for high-fidelity inpainting. Project page at https://hustvl.github.io/Moebius.

Kangsheng Duan, Ziyang Xu, Wenyu Liu, Xiaohu Ruan, Xiaoxin Chen, Xinggang Wang• 2026

Related benchmarks

TaskDatasetResultRank
Image InpaintingPlaces2 (test)
FID9.48
72
Image InpaintingFFHQ 256x256
LPIPS0.231
21
Image InpaintingCelebA-HQ 512x512 (test)
LPIPS0.122
20
Portrait InpaintingCelebA-HQ 512
FID5.39
18
Natural scene image inpaintingPlaces2 (Small)
FID0.92
14
Natural scene image inpaintingPlaces2 Large
FID2.35
14
Natural scene image inpaintingPlaces2 256
FID14.13
13
Image InpaintingLVIS OOD Natural 11 (10k images)
FID17.81
7
Image InpaintingDeepFakeFace OOD Portrait wiki 39
FID15.32
6
Image InpaintingPlaces2 Small (test)
FID0.92
4
Showing 10 of 10 rows

Other info

GitHub

Follow for update