Temporal-Emerged Prompting for Segment Anything in Multiframe Infrared Small Target Detection
About
Accurately localizing and segmenting small targets in low signal-to-noise ratio (SNR) infrared sequences remains a challenging task. Since targets are often indistinguishable from the background in individual frames, existing methods, even when equipped with advanced foundation model and powerful inter-frame association mechanisms, still fail to detect them. Motivated by the observation that targets tend to emerge gradually from the background over time and become distinguishable, we propose Temporal-Emerged Prompting for Segment Anything Model (TEP-SAM), a principled framework designed to explicitly exploit such temporal-emerged cues to modulate and prompt SAM. TEP-SAM operates by jointly modeling global motion patterns and local motion deviations to locate potential targets. It further enhances target region features by leveraging motion discrepancy, thereby generating temporal-emerged cues for SAM and enabling non-interactive segmentation. By bridging large-scale semantic pretraining with task-specific temporal modeling, TEP-SAM effectively adapts SAM to the challenging multiframe infrared small target detection task. Extensive experiments demonstrate the effectiveness of our approach, particularly under severely low-SNR conditions and in complex dynamic background.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multiframe Infrared Small Target Detection | NUDT-MIRSDT (All) | IoU86.27 | 35 | |
| Multiframe Infrared Small Target Detection | NUDT-MIRSDT Hard subset | IoU71.65 | 35 | |
| Multiframe Infrared Small Target Detection | TSIRMT (All) | IoU74.34 | 34 | |
| Multiframe Infrared Small Target Detection | TSIRMT Hard | IoU65.63 | 34 | |
| Infrared Small Target Detection | IRSTD | Params (M)5.88 | 9 |