Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Adaptive Time-step Training for Enhancing Spike-Based Neural Radiance Fields

About

Spiking Neural Networks (SNNs) provide an energy-efficient computing paradigm for neural rendering, but existing spike-based Neural Radiance Field (NeRF) models usually use a fixed inference time step for all scenes. This fixed temporal budget is inefficient because NeRF follows a scene-specific training paradigm, and different scenes require different temporal capacities to preserve rendering quality. This paper proposes Pretraining-based Adaptive Time-step Adjustment (PATA), a scene-wise adaptive time-step training framework for spike-based NeRF. PATA parameterizes the target inference time step as a trainable variable and optimizes it through a two-stage training process. A hybrid input mode strengthens early time-step outputs, while full-step soft supervision, smoothed rendering loss, and temporal-budget loss jointly maintain rendering fidelity and reduce temporal computation. The learned target time step is shared by all ray samples within a scene, preserving the parallel rendering structure of NeRF. Experiments on INGP-NeRF and TensoRF backbones across Synthetic-NeRF, Mip-NeRF 360, and LLFF show that PATA consistently reduces inference cost while maintaining competitive rendering quality. PATA reduces the estimated inference energy by up to 57.57\% on INGP-NeRF and 68.90\% on TensoRF, demonstrating its effectiveness across different neural rendering representations.

Ranxi Lin, Canming Yao, Jiayi Li, Weihang Liu, Xin Lou, Pingqiang Zhou• 2025

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisLLFF
PSNR26.62
144
Novel View SynthesisNeRF Synthetic
PSNR33.1
125
Novel View SynthesisSynthetic-NeRF
PSNR32.91
7
Novel View SynthesisMip-NeRF 360
PSNR25.09
7
Showing 4 of 4 rows

Other info

Follow for update