Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NeAR: Coupled Neural Asset-Renderer Stack

About

Neural asset authoring and neural rendering have traditionally evolved as disjoint paradigms: one generates digital assets for fixed graphics pipelines, while the other maps conventional assets to images. However, treating them as independent entities limits the potential for end-to-end optimization in fidelity and consistency. In this paper, we bridge this gap with NeAR, a Coupled Neural Asset--Renderer Stack. We argue that co-designing the asset representation and the renderer creates a robust "contract" for superior generation. On the asset side, we introduce the Lighting-Homogenized SLAT (LH-SLAT). Leveraging a rectified-flow model, NeAR lifts casually lit single images into a canonical, illumination-invariant latent space, effectively suppressing baked-in shadows and highlights. On the renderer side, we design a lighting-aware neural decoder tailored to interpret these homogenized latents. Conditioned on HDR environment maps and camera views, it synthesizes relightable 3D Gaussian splats in real-time without per-object optimization. We validate NeAR on four tasks: (1) G-buffer-based forward rendering, (2) random-lit reconstruction, (3) unknown-lit relighting, and (4) novel-view relighting. Extensive experiments demonstrate that our coupled stack outperforms state-of-the-art baselines in both quantitative metrics and perceptual quality. We hope this coupled asset-renderer perspective inspires future graphics stacks that view neural assets and renderers as co-designed components instead of independent entities.

Hong Li, Chongjie Ye, Houyuan Chen, Weiqing Xiao, Ziyang Yan, Lixing Xiao, Zhaoxi Chen, Jianfeng Xiang, Shaocong Xu, Xuhui Liu, Yikai Wang, Baochang Zhang, Xiaoguang Han, Jiaolong Yang, Hao Zhao• 2025

Related benchmarks

TaskDatasetResultRank
Reflective Object ReconstructionGlossy Synthetic
PSNR25.32
19
RelightingADT
LPIPS0.0693
9
RelightingDTC
LPIPS0.0475
9
RelightingGlossy Synthetic
LPIPS0.0465
9
RelightingObjaverse
LPIPS0.0486
9
Dynamic ReconstructionADT
PSNR22.89
7
ReconstructionDTC
LPIPS0.0532
4
ReconstructionObjaverse
LPIPS0.0394
4
Forward RenderingADT
LPIPS0.0488
2
Forward RenderingDTC
LPIPS0.0458
2
Showing 10 of 12 rows

Other info

Follow for update