Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Accelerating Atmospheric Turbulence Simulation via Learned Phase-to-Space Transform

About

Fast and accurate simulation of imaging through atmospheric turbulence is essential for developing turbulence mitigation algorithms. Recognizing the limitations of previous approaches, we introduce a new concept known as the phase-to-space (P2S) transform to significantly speed up the simulation. P2S is build upon three ideas: (1) reformulating the spatially varying convolution as a set of invariant convolutions with basis functions, (2) learning the basis function via the known turbulence statistics models, (3) implementing the P2S transform via a light-weight network that directly convert the phase representation to spatial representation. The new simulator offers 300x -- 1000x speed up compared to the mainstream split-step simulators while preserving the essential turbulence statistics.

Zhiyuan Mao, Nicholas Chimitt, Stanley H. Chan• 2021

Related benchmarks

TaskDatasetResultRank
Visual Question AnsweringIR-VQA 9,720-sample (test)
Scene Accuracy21.59
36
Image CaptioningInfrared Image Dataset downstream (test)
ROUGE-L12.11
30
Scene ClassificationScene Classification (test)
ASR36.9
25
Image Processing Speedframe 256x256
Time per Frame (s)0.35
5
Caption and VQA degradationQwen2.5-VL cases
Raw Attack30.104
5
Showing 5 of 5 rows

Other info

Follow for update