Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PROGRESSLM: Towards Progress Reasoning in Vision-Language Models

About

Estimating task progress requires reasoning over long-horizon dynamics rather than recognizing static visual content. While modern Vision-Language Models (VLMs) excel at describing what is visible, it remains unclear whether they can infer how far a task has progressed from partial observations. To this end, we introduce Progress-Bench, a benchmark for systematically evaluating progress reasoning in VLMs. Beyond benchmarking, we further explore a human-inspired two-stage progress reasoning paradigm through both training-free prompting and training-based approach based on curated dataset ProgressLM-45K. Experiments on 14 VLMs show that most models are not yet ready for task progress estimation, exhibiting sensitivity to demonstration modality and viewpoint changes, as well as poor handling of unanswerable cases. While training-free prompting that enforces structured progress reasoning yields limited and model-dependent gains, the training-based ProgressLM-3B achieves consistent improvements even at a small model scale, despite being trained on a task set fully disjoint from the evaluation tasks. Further analyses reveal characteristic error patterns and clarify when and why progress reasoning succeeds or fails.

Jianshu Zhang, Chengxuan Qian, Haosen Sun, Haoran Lu, Dingcheng Wang, Letian Xue, Han Liu• 2026

Related benchmarks

TaskDatasetResultRank
Progress EstimationPROGRESS-BENCH Answerable samples 1.0
NSE (Vision)13.8
16
Progress ReasoningProgress-Bench Same-View 1.0 (test)
NSE10.3
16
Progress ReasoningProgress-Bench Cross-View 1.0 (test)
NSE15.2
16
Viewpoint RobustnessProgress-Bench 1.0 (test)
ΔNSE4.9
16
In-the-wild model generalizationHuman Bench Vision-based Demo
NSE15.5
14
In-the-wild model generalizationHuman Bench Average
NSE Score26
14
In-the-wild model generalizationHuman Bench Text-based Demo
NSE30.9
14
Progress EstimationRoboTwin
MRA31.84
12
Progress EstimationAgibot
MRA42.9
12
Progress EstimationBehavior
MRA46.43
12
Showing 10 of 11 rows

Other info

GitHub

Follow for update