Learning Noise-Robust Stable Koopman Operator for Control with Hankel DMD
About
We propose a noise-robust learning framework for the Koopman operator of nonlinear dynamical systems, with guaranteed long-term stability and improved model performance for better model-based predictive control tasks. Unlike some existing approaches that rely on ad hoc observables or black-box neural networks in extended dynamic mode decomposition (EDMD), our framework leverages observables generated by the system dynamics, when the system dynamics is known, through a Hankel matrix, which shares similarities with discrete Polyflow. When system dynamics is unknown, we approximate them with a neural network while maintaining structural similarities to discrete Polyflow. To enhance noise robustness and ensure long-term stability, we developed a stable parameterization of the Koopman operator, along with a progressive learning strategy for rollout loss. To further improve the performance of the model in the phase space, a simple iterative data augmentation strategy was developed. Numerical experiments of prediction and control of classic nonlinear systems with ablation study showed the effectiveness of the proposed techniques over several state-of-the-art practices.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Dynamics Prediction | 4R Manipulator noise-less trajectories | Prediction Error0.533 | 16 | |
| Trajectory tracking | 4R Manipulator 30dB feedback noise | Tracking Error (rad)0.502 | 16 | |
| Trajectory Prediction | Van der Pol Oscillator 40dB noise | Mean Prediction Error0.054 | 4 | |
| Trajectory Prediction | Van der Pol Oscillator 20dB noise | Mean Prediction Error0.127 | 4 | |
| Trajectory Prediction | Van der Pol Oscillator 25dB noise | Mean Prediction Error0.089 | 4 | |
| Trajectory Prediction | Van der Pol Oscillator 30dB noise | Mean Prediction Error0.088 | 4 | |
| Trajectory Prediction | Van der Pol Oscillator 35dB noise | Mean Prediction Error0.087 | 4 | |
| Trajectory tracking | Gazebo Simulation Low feedback noise 80 dB | Hypotrochoid Tracking Error (m)0.074 | 3 |