Drift-Resilient Temporal Priors for Visual Tracking
About
Temporal information is crucial for visual tracking, but existing multi-frame trackers are vulnerable to model drift caused by naively aggregating noisy historical predictions. In this paper, we introduce DTPTrack, a lightweight and generalizable module designed to be seamlessly integrated into existing trackers to suppress drift. Our framework consists of two core components: (1) a Temporal Reliability Calibrator (TRC) mechanism that learns to assign a per-frame reliability score to historical states, filtering out noise while anchoring on the ground-truth template; and (2) a Temporal Guidance Synthesizer (TGS) module that synthesizes this calibrated history into a compact set of dynamic temporal priors to provide predictive guidance. To demonstrate its versatility, we integrate DTPTrack into three diverse tracking architectures--OSTrack, ODTrack, and LoRAT-and show consistent, significant performance gains across all baselines. Our best-performing model, built upon an extended LoRATv2 backbone, sets a new state-of-the-art on several benchmarks, achieving a 77.5% Success rate on LaSOT and an 80.3% AO on GOT-10k.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Visual Object Tracking | GOT-10k (test) | Average Overlap80.3 | 408 | |
| Visual Object Tracking | UAV123 | AUC0.723 | 172 | |
| Visual Object Tracking | TNL2K | AUC63.7 | 121 | |
| Single Object Tracking | TrackingNet | Pnorm90.8 | 52 | |
| Single Object Tracking | LaSoT | AUC77.5 | 31 | |
| Visual Tracking | VOT STB 2022 | EAO61 | 17 | |
| Single Object Tracking | VastTrack | AUC47.2 | 12 | |
| Model Efficiency Analysis | NVIDIA A100 GPU | MACs (G)53.8 | 11 | |
| Visual Object Tracking | OTB 2015 | AUC (OTB 2015)74.7 | 6 | |
| Visual Object Tracking | VOTS 2024 | EAO0.63 | 2 |