Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Rethinking Generic Object Tracking Toward Human-Level Perceptual Intelligence

About

At the heart of human visual perception lies the ability to maintain a continuous and coherent understanding of the external world. By integrating observations with accumulated experience, the human visual system can continuously adapt to variations in both the target and its surrounding environment, while preserving robust visual continuity as scene dynamics evolve. Human vision can therefore integrate prior knowledge, spatial geometry, and semantic context to understand complex scenes and their changes. As a core problem in computer vision, visual object tracking aims to bring machine perception closer to human visual perception. These capabilities are central to the task of Generic Object Tracking (GOT). In this task, a visual tracker is initialized only with the bounding box of an arbitrarily specified target in the first frame, and must continuously localize the target in subsequent dynamic visual streams. However, future events, observations, and real-world variations are inherently unpredictable; therefore, the model's generalization and online adaptation capabilities remain bottlenecks. Tracking reliability can deteriorate when the target undergoes severe deformation, is affected by complex distractors, encounters significant environmental changes, or belongs to a category unseen during training. This dissertation aims to narrow the gap between machine visual tracking systems and human visual perception by proposing a series of methods that systematically enhance the target discrimination, robust adaptation, and geometric reasoning capabilities of tracking models.

Shih-Fang Chen• 2026

Related benchmarks

TaskDatasetResultRank
Object TrackingLaSoT--
519
Visual Object TrackingGOT-10k
AO80.2
357
Visual Object TrackingTrackingNet
Success Rate (AUC)86.7
64
Visual Object TrackingOTB100 (test)
Success Rate (IoU>0.50)71.3
52
Visual TrackingAVisT--
50
Visual Object TrackingOTB-100
Success Rate (SUC)75
38
Visual Object TrackingNfS
Success Rate (SR)71.1
34
Visual Object TrackingAVisT
SUC64.7
29
Visual Object TrackingVOT ST 2020
Robustness90.3
26
Visual TrackingVOT STB 2022
Robustness (R)89.8
21
Showing 10 of 17 rows

Other info

Follow for update