See Silhouettes in Motion with Neuromorphic Vision
About
Quasi-bimodal objects, such as text, road signs, and barcodes, play a basic yet vital role in daily visual communication. By boiling these down to clear silhouettes, binarization uses a minimal language to convey essential vision cues for maximum downstream efficiency, especially for tasks that require simple geometric, topological reasoning rather than heavy appearance modeling. The catch is that frame-based imaging often struggles on mobile platforms like drones, self-driving cars, and underwater vehicles, in which rapid motion causes severe motion blur and harsh lighting washes out scene details. To overcome these physical limits, neuromorphic vision via event cameras, featuring microsecond time resolution and high dynamic range, steps in as a natural solution. Building upon this event-driven paradigm, we propose a simple yet effective dual-modal approach that harnesses the synergy between frames and events for training-free, real-time, high-frame-rate binarization on CPU-only devices. Extensive evaluations show that it earns competitive performance against leading techniques in reducing blur artifacts and delivers impressive improvements under challenging illumination at a lower computational cost. Besides, its asynchronous nature bypasses long-standing event-scarcity issues that break traditional time-binning reconstruction at fixed time slots, maintaining clear target shapes even at extreme kilohertz frame rates. Its binary results further serve as reliable representations to facilitate a range of downstream tasks. This work paves the way towards lightweight perception and interaction in embodied intelligence on resource-constrained edge platforms.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Binarization | HQF Low Light | MCC48 | 11 | |
| Binarization | HQF Bright Glare | MCC0.54 | 11 | |
| Binarization | REBlur Gentle Light | MCC0.86 | 11 | |
| Binarization | REBlur Low Light | MCC0.65 | 11 | |
| Binarization | REBlur Bright Glare | MCC59 | 11 | |
| Binarization | EBT Low Light | MCC0.54 | 11 | |
| Binarization | EBT Bright Glare | MCC66 | 11 | |
| Binarization | HQF Gentle Light | MCC0.62 | 11 | |
| Binarization | EBT Gentle Light | MCC0.73 | 11 | |
| Fiducial Marker Tracking | HQF & EBT Low Light 1.0 (test) | RMSE2.41 | 5 |