N4MC: Neural 4D Mesh Compression
About
We present N4MC, the first 4D neural compression framework to efficiently compress time-varying mesh sequences by exploiting their temporal redundancy. Unlike prior neural mesh compression methods that treat each mesh frame independently, N4MC takes inspiration from inter-frame compression in 2D video codecs, and learns motion compensation in long mesh sequences. Specifically, N4MC converts consecutive irregular mesh frames into regular 4D tensors to provide a uniform and compact representation. These tensors are then condensed using an auto-decoder, which captures both spatial and temporal correlations for redundancy removal. To enhance temporal coherence, we introduce a transformer-based interpolation model that predicts intermediate mesh frames conditioned on latent embeddings derived from tracked volume centers, eliminating motion ambiguities. Extensive evaluations show that N4MC outperforms state-of-the-art in rate-distortion performance, while enabling real-time decoding of 4D mesh sequences. The implementation of our method is available at: https://github.com/frozzzen3/N4MC.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 4D Mesh Compression | Dancer MPEG sequence (test) | D2-PSNR67.276 | 5 | |
| 4D Mesh Compression | Basketball Player MPEG sequence (test) | D2-PSNR66.107 | 5 | |
| 4D Mesh Compression | Mitch MPEG sequence (test) | D2-PSNR73.129 | 5 | |
| 4D Mesh Compression | Thomas MPEG sequence (test) | D2-PSNR72.759 | 5 | |
| 4D Mesh Compression | Mixed | Time (ms)7.33 | 5 | |
| Mesh Compression | Thingi10K | Mean Point-to-Mesh Distance10.42 | 2 |