Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DeLux: Cross-Modal Local Artifact Restoration in Video Using Neuromorphic Data

About

Conventional RGB cameras suffer from lighting artifacts such as flare, glare, flicker, and overexposure, leading to irrecoverable information loss that necessitates computational restoration. However, existing approaches treat these problems in isolation, failing to recover structural details completely obscured by complex spatially discrete image degradations. In this paper, we propose a novel cross-modal restoration paradigm and present DeLux, a modular proof-of-concept pipeline that leverages neuromorphic event streams as a structural prior to guide the targeted detection and inpainting of lighting artifacts in RGB video. Validation on synthetic benchmarks and real-world automotive footage demonstrates that DeLux effectively suppresses local artifacts and restores affected regions. The proposed approach outperforms existing RGB-only baselines and event-guided HDR models, achieving an average MS-SSIM of over 0.99 across all artifact types and demonstrating up to an 88% reduction in artifact severity in real-world automotive footage. The synthetic artifact generation tools and curated real-world evaluation datasets are made publicly available to foster future research on cross-modal restoration.

Bartosz Stachowiak, Dariusz Brzezinski• 2026

Related benchmarks

TaskDatasetResultRank
Artifact SuppressionReal-world Automotive Sequences Sun and Zurich City
Δ SAS (%)88.32
54
Artifact RemovalSynthetic Artifacts Cityscapes-based
MS-SSIM99.7
30
Inference Speed Analysis100-frame sample (test)
CPU Latency (s)13.7
6
Artifact DetectionSynthetic (test)
Accuracy (Glare)98.5
5
Showing 4 of 4 rows

Other info

Follow for update