Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Foresee-to-Ground: From Predictive Temporal Perception to Evidence-Driven Reasoning for Video Temporal Grounding

About

Current Video-LLM approaches for Video Temporal Grounding (VTG) typically rely on direct timestamp generation from an unstructured visual-token stream, often leading to brittle numerics and inconsistent boundaries. To address this, we propose Foresee-to-Ground (F2G), a framework that reformulates VTG as a verifiable Identify-then-Measure problem. F2G integrates Predictive Temporal Perception with Evidence-Driven Reasoning: it learns boundary-sensitive temporal representations to build a video-wide evidence pool of candidate event segments, and exposes these segments to the LLM as citable evidence units that bind boundary prediction to explicit event hypotheses. By decoupling event identification from precise boundary measurement, F2G stabilizes grounding and makes predictions verifiable. Extensive experiments demonstrate that F2G consistently improves grounding accuracy across diverse benchmarks, transfers robustly across different Video-LLM backbones, and preserves general video understanding capabilities.

Zelin Zheng, Xinyan Liu, Ruixin Li, Antoni B. Chan, Guorong Li, Qingming Huang, Laiyun Qing• 2026

Related benchmarks

TaskDatasetResultRank
Video Temporal GroundingActivityNet Captions
Recall @ IoU=0.546.1
43
Video Temporal GroundingCharades-TimeLens
R1@0.374.2
31
Video Temporal GroundingActivityNet TimeLens
R@0.369.8
31
Video Temporal GroundingQVHighlights TimeLens
R1@0.379.6
20
Video Temporal GroundingCharades-STA zero-shot transfer
R@0.550.4
11
Video Temporal GroundingQVHighlights zero-shot transfer
mAP (zero-shot)29.7
8
Showing 6 of 6 rows

Other info

Follow for update