Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
About
The goal of precipitation nowcasting is to predict the future rainfall intensity in a local region over a relatively short period of time. Very few previous studies have examined this crucial and challenging weather forecasting problem from the machine learning perspective. In this paper, we formulate precipitation nowcasting as a spatiotemporal sequence forecasting problem in which both the input and the prediction target are spatiotemporal sequences. By extending the fully connected LSTM (FC-LSTM) to have convolutional structures in both the input-to-state and state-to-state transitions, we propose the convolutional LSTM (ConvLSTM) and use it to build an end-to-end trainable model for the precipitation nowcasting problem. Experiments show that our ConvLSTM network captures spatiotemporal correlations better and consistently outperforms FC-LSTM and the state-of-the-art operational ROVER algorithm for precipitation nowcasting.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic segmentation | PASCAL 5-shot 5i | Mean mIoU60.5 | 100 | |
| Video Prediction | KTH 10 -> 20 steps (test) | PSNR23.58 | 88 | |
| Few-shot Semantic Segmentation | COCO 5-shot 20i | mIoU29.6 | 85 | |
| Human Motion Prediction | Human3.6M (test) | -- | 85 | |
| Video Prediction | Moving MNIST (test) | MSE29.8 | 82 | |
| Few-shot Semantic Segmentation | COCO 20i 1-shot | mIoU (Overall)24.4 | 77 | |
| Video Prediction | KTH 10 -> 40 steps (test) | PSNR22.85 | 77 | |
| Few-shot Semantic Segmentation | FSS-1000 (test) | mIoU88.1 | 58 | |
| Semantic segmentation | PASCAL 1-shot 5i | mIoU (fold1)54.7 | 57 | |
| Video Prediction | Moving MNIST | SSIM0.8477 | 52 |