Learning Stable Deep Dynamics Models
About
Deep networks are commonly used to model dynamical systems, predicting how the state of a system will evolve over time (either autonomously or in response to control inputs). Despite the predictive power of these systems, it has been difficult to make formal claims about the basic properties of the learned systems. In this paper, we propose an approach for learning dynamical systems that are guaranteed to be stable over the entire state space. The approach works by jointly learning a dynamics model and Lyapunov function that guarantees non-expansiveness of the dynamics under the learned Lyapunov function. We show that such learning systems are able to model simple dynamical systems and can be combined with additional deep generative models to learn complex dynamics, such as video textures, in a fully end-to-end fashion.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Classification | CIFAR-10 | Orig90.03 | 7 | |
| Image Classification | CIFAR-100 | Acc (FGSM, 8/255)18.86 | 7 | |
| Image Classification | Tiny-ImageNet | FGSM Error (eps=8/255)9.93 | 7 | |
| Image Classification | SVHN | Robustness Acc (FGSM, ε=8/255)65.04 | 7 | |
| Image Classification | SVHN | Accuracy (Original)97.09 | 7 | |
| Image Classification | Tiny-ImageNet | Accuracy (Original)51.94 | 7 | |
| Image Classification | CIFAR-10 | FGSM Accuracy (8/255)45.05 | 7 | |
| Image Classification | CIFAR-10 | Accuracy (Original)90.03 | 7 | |
| Image Classification | CIFAR-100 | Accuracy (Original)69.55 | 7 | |
| Trajectory Learning | LASA-2D | Mean DTWD0.37 | 4 |