Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Fully Distributed Multi-View 3D Tracking in Real-Time

About

Multi-camera tracking with overlapping fields of view typically relies on centralized fusion, which creates computational bottlenecks that prevent deployment at scale. We present MV3DT, a fully distributed framework for real-time multi-view 3D tracking that achieves accurate identity propagation and occlusion recovery through peer-to-peer coordination, eliminating the need for central aggregation. Each camera node executes a lightweight modular pipeline comprising monocular 3D perception, distributed multi-view association, and collaborative fusion via lightweight messaging. MV3DT achieves 96.5% IDF1, 93.1% MOTA, and 94.6% MOTP on WILDTRACK, competitive with state-of-the-art centralized methods, and unprecedented 41.7% IDF1 and 50.9% MOTA on SCOUT while demonstrating superior scalability: sustaining 30 FPS on 100 cameras with <10ms inter-camera latency and only 2.2% communication overhead. MV3DT operates in a zero-shot regime given camera calibrations, requiring no scene-specific learning and making it directly deployable in new environments. These results establish MV3DT as a practical solution for real-time multi-view tracking in large-scale overlapping camera networks.

Byron Hernandez, Fangyu Li, Aotian Wu, Paul J. Shin, Kaustubh Purandare, Henry Medeiros• 2026

Related benchmarks

TaskDatasetResultRank
Multiple Object TrackingWILDTRACK (test)
IDF196.5
22
Multi-view 3D trackingSCOUT last 50% of the 8 annotated cameras (test)
IDF141.7
5
Multi-camera trackingAI City 100-camera Warehouse Scene 2024
IDF182.7
4
Multi-camera trackingAI City Challenge Complete 2024--
3
Showing 4 of 4 rows

Other info

Follow for update