Renormalization Group Guided Tensor Network Structure Search
About
Tensor network structure search (TN-SS) aims to automatically discover optimal network topologies and rank configurations for efficient tensor decomposition in high-dimensional data representation. Despite recent advances, existing TN-SS methods face significant limitations in computational tractability, structure adaptivity, and optimization robustness across diverse tensor characteristics. They struggle with three key challenges: single-scale optimization missing multi-scale structures, discrete search spaces hindering smooth structure evolution, and separated structure-parameter optimization causing computational inefficiency. We propose RGTN (Renormalization Group guided Tensor Network search), a physics-inspired framework transforming TN-SS via multi-scale renormalization group flows. Unlike fixed-scale discrete search methods, RGTN uses dynamic scale-transformation for continuous structure evolution across resolutions. Its core innovation includes learnable edge gates for optimization-stage topology modification and intelligent proposals based on physical quantities like node tension measuring local stress and edge information flow quantifying connectivity importance. Starting from low-complexity coarse scales and refining to finer ones, RGTN finds compact structures while escaping local minima via scale-induced perturbations. Extensive experiments on light field data, high-order synthetic tensors, and video completion tasks show RGTN achieves state-of-the-art compression ratios and runs 4-600$\times$ faster than existing methods, validating the effectiveness of our physics-inspired approach.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Light field data compression | Knights light field data | Compression Ratio29.9 | 24 | |
| Light field data compression | Bunny light field data | Compression Ratio22.3 | 24 | |
| Video Completion | News | MPSNR32.04 | 8 | |
| Video Completion | Salesman | MPSNR31.9 | 8 | |
| Video Completion | Silent | MPSNR30.62 | 8 | |
| Tensor Compression | 6th-order synthetic tensors | Compression Ratio0.76 | 8 | |
| Tensor Compression | 8th-order synthetic tensors | Compression Ratio0.009 | 7 |