Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PI-Light: Physics-Inspired Diffusion for Full-Image Relighting

About

Full-image relighting remains a challenging problem due to the difficulty of collecting large-scale structured paired data, the difficulty of maintaining physical plausibility, and the limited generalizability imposed by data-driven priors. Existing attempts to bridge the synthetic-to-real gap for full-scene relighting remain suboptimal. To tackle these challenges, we introduce Physics-Inspired diffusion for full-image reLight ($\pi$-Light, or PI-Light), a two-stage framework that leverages physics-inspired diffusion models. Our design incorporates (i) batch-aware attention, which improves the consistency of intrinsic predictions across a collection of images, (ii) a physics-guided neural rendering module that enforces physically plausible light transport, (iii) physics-inspired losses that regularize training dynamics toward a physically meaningful landscape, thereby enhancing generalizability to real-world image editing, and (iv) a carefully curated dataset of diverse objects and scenes captured under controlled lighting conditions. Together, these components enable efficient finetuning of pretrained diffusion models while also providing a solid benchmark for downstream evaluation. Experiments demonstrate that $\pi$-Light synthesizes specular highlights and diffuse reflections across a wide variety of materials, achieving superior generalization to real-world scenes compared with prior approaches.

Zhexin Liang, Zhaoxi Chen, Yongwei Chen, Tianyi Wei, Tengfei Wang, Xingang Pan• 2026

Related benchmarks

TaskDatasetResultRank
Inverse Neural RenderingObject50 (test)
Albedo PSNR22.09
5
Inverse Neural RenderingObject500 (test)
Albedo PSNR20.47
5
Inverse Neural RenderingScene200 (test)
Albedo PSNR14.46
5
Inverse Neural RenderingScene36 (test)
Albedo PSNR14.1
5
Forward RenderingObject50 reconstruction (test)
PSNR15.06
4
Normal estimationObject50
Threshold 11.25°36
4
Normal estimationScene200
Accuracy (11.25° Threshold)52.1
4
Forward RenderingObject50 (test)
PSNR14.09
3
Showing 8 of 8 rows

Other info

Follow for update