Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SoLAR: Error-Resilient Streamable Long-Horizon Free-Viewpoint Video Reconstruction with Anchor Activation and Latent Recalibration

About

Free-Viewpoint Video (FVV) has emerged as a cornerstone of next-generation immersive media systems and attracted widespread attention. Previous methods primarily focus on short video sequences and suffer from significant performance degradation when processing long-horizon free-viewpoint video (LFVV). Motivated by bit allocation theory, we analyze dynamic-anchor-based volumetric video representation within a rate-distortion optimization framework and propose \textbf{SoLAR}, which is the first error-resilient streamable FVV framework that maintains stable reconstruction quality on long sequences without requiring group-of-pictures partitioning. We propose the Anchor Activation Dynamics (AAD), which enables dynamic anchors to model non-rigid transformations by dynamically activating informative anchors and suppressing redundant ones. Furthermore, we introduce Latent Discrepancy Aware Recalibration (LaDAR), which is a mechanism to identify discrepancies between latent representations and recalibrate the correspondences encoded in the network, effectively mitigating error propagation in LFVV without compromising real-time performance or storage compactness. Extensive experiments demonstrate that \textbf{SoLAR} achieves state-of-the-art reconstruction performance while maintaining minimum storage overhead, which provides a new direction for LFVV reconstruction and advances the practical deployment of immersive systems. Demo free-viewpoint videos are provided in the supplementary material.

Haotian Zhang, Xu Mo, Yixin Yu, Guanhua Zhu, Jian Xue, Tongda Xu, Yan Wang, Jiaqi Zhang, Siwei Ma, Wen Gao• 2026

Related benchmarks

TaskDatasetResultRank
Dynamic Scene ReconstructionN3DV
PSNR (dB)33.43
13
Dynamic Scene ReconstructionMeeting Room
PSNR (dB)33.62
9
Neural 3D Video ReconstructionBar
PSNR32.45
7
Dynamic View SynthesisAvatarRex-ZXC
PSNR27.63
6
Novel View SynthesisAvatarRex-LBN1
PSNR (dB)32.28
6
Novel View SynthesisAvatarRex LBN2
PSNR27.46
6
Showing 6 of 6 rows

Other info

Follow for update