Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation

About

ABACUS is a unified vision-language model that handles object counting, crowd counting, referring-expression counting, and count-faithful image generation without any benchmark-specific training required. Our model is built on existing 3B-parameter unified foundation model and is adapted for object localization tasks using three key innovations: density-aware adaptive zooming with objectness maps for spatial grounding; a boundary-aware count policy via GRPO to eliminate crop-boundary errors; and a cycle-consistent GRPO strategy where the understanding branch self-critiques generated outputs, closing the understanding-generation gap without any external annotations. ABACUS achieves state-of-the-art results across seven benchmarks, outperforming both task-specific specialists and larger generalist models.

Anindya Mondal, Sauradip Nag, Anjan Dutta• 2026

Related benchmarks

TaskDatasetResultRank
Object CountingFSC-147 (test)
MAE5.03
379
Object CountingFSC-147 (val)
MAE5.71
279
Crowd CountingShanghaiTech Part A (test)
MAE78.59
279
Crowd CountingShanghaiTech Part B (test)
MAE14.75
215
Car Object CountingCARPK (test)
MAE8.41
123
Referring Expression CountingREC 8K (test)
MAE7.67
40
Count GenerationCoCoCount
YOLOv9 Performance71
7
Count GenerationT2I-CompBench
Human Count Accuracy65
7
Count GenerationGenEval
YOLOv9 Score94
7
Text-to-Image GenerationT2I-CompBench
Aesthetic Quality Score83
7
Showing 10 of 12 rows

Other info

Follow for update