Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ANTIC: Adaptive Neural Temporal In-situ Compressor

About

The persistent storage requirements for high-resolution, spatiotemporally evolving fields governed by large-scale and high-dimensional partial differential equations (PDEs) have reached the petabyte-to-exabyte scale. Transient simulations modeling Navier-Stokes equations, magnetohydrodynamics, plasma physics, or binary black hole mergers generate data volumes that are prohibitive for modern high-performance computing (HPC) infrastructures. To address this bottleneck, we introduce ANTIC (Adaptive Neural Temporal in situ Compressor), an end-to-end in situ compression pipeline. ANTIC consists of an adaptive temporal selector tailored to high-dimensional physics that identifies and filters informative snapshots at simulation time, combined with a spatial neural compression module based on continual fine-tuning that learns residual updates between adjacent snapshots using neural fields. By operating in a single streaming pass, ANTIC enables a combined compression of temporal and spatial components and effectively alleviates the need for explicit on-disk storage of entire time-evolved trajectories. Experimental results demonstrate how storage reductions of several orders of magnitude relate to physics accuracy.

Sandeep S. Cranganore, Andrei Bodnar, Gianluca Galletti, Fabian Paischer, Johannes Brandstetter• 2026

Related benchmarks

TaskDatasetResultRank
Scientific Data Compression3D BSSN 0.7 GiB/snapshot
Compression Ratio (CR)3.75e+3
7
Scientific Data Compression2D Kolmogorov flows
Compression Ratio (CR)47
7
Showing 2 of 2 rows

Other info

Follow for update