ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation
About
ABACUS is a unified vision-language model that handles object counting, crowd counting, referring-expression counting, and count-faithful image generation without any benchmark-specific training required. Our model is built on existing 3B-parameter unified foundation model and is adapted for object localization tasks using three key innovations: density-aware adaptive zooming with objectness maps for spatial grounding; a boundary-aware count policy via GRPO to eliminate crop-boundary errors; and a cycle-consistent GRPO strategy where the understanding branch self-critiques generated outputs, closing the understanding-generation gap without any external annotations. ABACUS achieves state-of-the-art results across seven benchmarks, outperforming both task-specific specialists and larger generalist models.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Object Counting | FSC-147 (test) | MAE5.03 | 379 | |
| Object Counting | FSC-147 (val) | MAE5.71 | 279 | |
| Crowd Counting | ShanghaiTech Part A (test) | MAE78.59 | 279 | |
| Crowd Counting | ShanghaiTech Part B (test) | MAE14.75 | 215 | |
| Car Object Counting | CARPK (test) | MAE8.41 | 123 | |
| Referring Expression Counting | REC 8K (test) | MAE7.67 | 40 | |
| Count Generation | CoCoCount | YOLOv9 Performance71 | 7 | |
| Count Generation | T2I-CompBench | Human Count Accuracy65 | 7 | |
| Count Generation | GenEval | YOLOv9 Score94 | 7 | |
| Text-to-Image Generation | T2I-CompBench | Aesthetic Quality Score83 | 7 |