Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Renormalization Group Guided Tensor Network Structure Search

About

Tensor network structure search (TN-SS) aims to automatically discover optimal network topologies and rank configurations for efficient tensor decomposition in high-dimensional data representation. Despite recent advances, existing TN-SS methods face significant limitations in computational tractability, structure adaptivity, and optimization robustness across diverse tensor characteristics. They struggle with three key challenges: single-scale optimization missing multi-scale structures, discrete search spaces hindering smooth structure evolution, and separated structure-parameter optimization causing computational inefficiency. We propose RGTN (Renormalization Group guided Tensor Network search), a physics-inspired framework transforming TN-SS via multi-scale renormalization group flows. Unlike fixed-scale discrete search methods, RGTN uses dynamic scale-transformation for continuous structure evolution across resolutions. Its core innovation includes learnable edge gates for optimization-stage topology modification and intelligent proposals based on physical quantities like node tension measuring local stress and edge information flow quantifying connectivity importance. Starting from low-complexity coarse scales and refining to finer ones, RGTN finds compact structures while escaping local minima via scale-induced perturbations. Extensive experiments on light field data, high-order synthetic tensors, and video completion tasks show RGTN achieves state-of-the-art compression ratios and runs 4-600$\times$ faster than existing methods, validating the effectiveness of our physics-inspired approach.

Maolin Wang, Bowen Yu, Sheng Zhang, Linjie Mi, Wanyu Wang, Yiqi Wang, Pengyue Jia, Xuetao Wei, Zenglin Xu, Ruocheng Guo, Xiangyu Zhao• 2025

Related benchmarks

TaskDatasetResultRank
Light field data compressionKnights light field data
Compression Ratio29.9
24
Light field data compressionBunny light field data
Compression Ratio22.3
24
Video CompletionNews
MPSNR32.04
8
Video CompletionSalesman
MPSNR31.9
8
Video CompletionSilent
MPSNR30.62
8
Tensor Compression6th-order synthetic tensors
Compression Ratio0.76
8
Tensor Compression8th-order synthetic tensors
Compression Ratio0.009
7
Showing 7 of 7 rows

Other info

Follow for update