FrameONE: Hierarchical Motion Modeling for Universal Multi-View Echocardiographic Keyframe Detection
About
Accurate detection of end-systole (ES) and end-diastole (ED) frames is fundamental to echocardiographic assessment. Existing methods are typically developed in a view-specific manner, depend on auxiliary annotations or intensive visual modeling, which limits their generalizability. In multi-view modeling, keyframe detection is driven by shared cardiac motion, yet large appearance differences and motion patterns make unified modeling challenging. To address these issues, we propose FrameONE, a unified end-to-end framework for multi-view echocardiographic keyframe detection. FrameONE introduces a Hierarchical Motion Modeling strategy: an intra-view multi-task learning reduces appearance bias and promotes motion-focused representations within each view; an inter-view general motion learning module further separates view-agnostic dynamics from view-specific patterns, enabling shared yet flexible motion representation learning across views. Extensive experiments on 25,872 videos spanning four standard views demonstrate that FrameONE achieves state-of-the-art keyframe detection accuracy with strong cross-view generalization. Code is available at https://github.com/szuboy/FrameONE.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Keyframe detection | Echocardiography A4C (test) | MAE2.339 | 7 | |
| Keyframe detection | Echocardiography PSAX (test) | MAE2.52 | 7 | |
| Keyframe detection | Echocardiography PLAX (test) | MAE2.25 | 7 | |
| Keyframe detection | Echocardiography A2C (test) | MAE3.121 | 7 | |
| Keyframe detection | Echocardiography Average (test) | MAE2.386 | 2 |