SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow
About
We introduce SEA-RAFT, a more simple, efficient, and accurate RAFT for optical flow. Compared with RAFT, SEA-RAFT is trained with a new loss (mixture of Laplace). It directly regresses an initial flow for faster convergence in iterative refinements and introduces rigid-motion pre-training to improve generalization. SEA-RAFT achieves state-of-the-art accuracy on the Spring benchmark with a 3.69 endpoint-error (EPE) and a 0.36 1-pixel outlier rate (1px), representing 22.9% and 17.8% error reduction from best published results. In addition, SEA-RAFT obtains the best cross-dataset generalization on KITTI and Spring. With its high efficiency, SEA-RAFT operates at least 2.3x faster than existing methods while maintaining competitive performance. The code is publicly available at https://github.com/princeton-vl/SEA-RAFT.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Optical Flow Estimation | KITTI 2015 (train) | Fl-epe1.6 | 431 | |
| Optical Flow Estimation | MPI Sintel Final (train) | Endpoint Error (EPE)3.74 | 209 | |
| Optical Flow Estimation | MPI Sintel Clean (train) | EPE1.19 | 202 | |
| Optical Flow | Sintel (train) | AEPE (Clean)1.19 | 179 | |
| Optical Flow | KITTI-15 (test) | Fl-all4.3 | 85 | |
| Optical Flow | MPI Sintel (test) | EPE (Final)1.96 | 27 | |
| Optical Flow | Sintel Clean | EPE1.309 | 27 | |
| Optical Flow | Sintel Final | EPE2.601 | 27 | |
| Optical Flow | Spring (test) | EPE0.363 | 18 | |
| Optical Flow | SRFlow (test) | EPE0.5314 | 18 |