Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

A Causal Diffusion Model for Video Reconstruction from Ultra-Low-Bitrate Representations

About

We study video reconstruction from ultra-low-bitrate representations, where the primary challenge shifts from encoding to decoding. In this regime, reconstruction with classical and neural codecs introduces blur, while generative and semantic approaches often struggle to jointly preserve fidelity, temporal consistency, and perceptual quality. To address these limitations, we propose a causal video diffusion model that reconstructs videos from ultra-low-bitrate semantics and highly compressed frames by jointly modeling their complementary information. We further introduce temporal-only distillation from a bidirectional teacher to enable parameter-efficient training and causal few-step inference. Through extensive quantitative, qualitative, and subjective evaluation, we show that the proposed method outperforms classical, neural, generative, and semantic baselines in ultra-low-bitrate video reconstruction.

Cem Eteke, Batuhan Tosun, Martin Piccolrovazzi, Alexander Griessel, Wolfgang Kellerer, Eckehard Steinbach• 2026

Related benchmarks

TaskDatasetResultRank
Video CompressionCityscapes
PSNR21.89
15
Video ReconstructionYCB-Sim (test)
PSNR22.02
15
Showing 2 of 2 rows

Other info

Follow for update