Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Equivariance via Minimal Frame Averaging for More Symmetries and Efficiency

About

We consider achieving equivariance in machine learning systems via frame averaging. Current frame averaging methods involve a costly sum over large frames or rely on sampling-based approaches that only yield approximate equivariance. Here, we propose Minimal Frame Averaging (MFA), a mathematical framework for constructing provably minimal frames that are exactly equivariant. The general foundations of MFA also allow us to extend frame averaging to more groups than previously considered, including the Lorentz group for describing symmetries in space-time, and the unitary group for complex-valued domains. Results demonstrate the efficiency and effectiveness of encoding symmetries via MFA across a diverse range of tasks, including $n$-body simulation, top tagging in collider physics, and relaxed energy prediction. Our code is available at https://github.com/divelab/MFA.

Yuchao Lin, Jacob Helwig, Shurui Gui, Shuiwang Ji• 2024

Related benchmarks

TaskDatasetResultRank
Initial Structure to Relaxed EnergyOC20 IS2RE (val)
Energy MAE (ID)0.5437
39
Initial Structure to Relaxed EnergyOC20 IS2RE (ID)
Energy MAE (eV)0.5437
22
Initial Structure to Relaxed EnergyOC20 IS2RE (OOD Cat)
Energy MAE (eV)0.5415
14
Initial Structure to Relaxed Energy (IS2RE) predictionOC20 IS2RE (OOD Ads)
Energy MAE (eV)0.6203
9
Initial Structure to Relaxed Energy (IS2RE) predictionOC20 IS2RE (OOD-BOTH)
Energy MAE (eV)0.5708
9
Initial Structure to Relaxed Energy (IS2RE) predictionOC20 IS2RE (Average)
Energy MAE (eV)0.5691
9
top taggingTop Tagging (test)
Accuracy94.2
9
n-body simulationn-body experiment
MSE0.0036
8
Binary ClassificationEXP
Accuracy (EXP)100
6
Graph SeparationGraph8c
Number of Unseparated Pairs0.00e+0
6
Showing 10 of 12 rows

Other info

Follow for update