Accelerating Atmospheric Turbulence Simulation via Learned Phase-to-Space Transform
About
Fast and accurate simulation of imaging through atmospheric turbulence is essential for developing turbulence mitigation algorithms. Recognizing the limitations of previous approaches, we introduce a new concept known as the phase-to-space (P2S) transform to significantly speed up the simulation. P2S is build upon three ideas: (1) reformulating the spatially varying convolution as a set of invariant convolutions with basis functions, (2) learning the basis function via the known turbulence statistics models, (3) implementing the P2S transform via a light-weight network that directly convert the phase representation to spatial representation. The new simulator offers 300x -- 1000x speed up compared to the mainstream split-step simulators while preserving the essential turbulence statistics.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Visual Question Answering | IR-VQA 9,720-sample (test) | Scene Accuracy21.59 | 36 | |
| Image Captioning | Infrared Image Dataset downstream (test) | ROUGE-L12.11 | 30 | |
| Scene Classification | Scene Classification (test) | ASR36.9 | 25 | |
| Image Processing Speed | frame 256x256 | Time per Frame (s)0.35 | 5 | |
| Caption and VQA degradation | Qwen2.5-VL cases | Raw Attack30.104 | 5 |