Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Retina-Inspired Object Motion Segmentation for Event-Cameras

About

Event-cameras have emerged as a revolutionary technology with a high temporal resolution that far surpasses standard active pixel cameras. This technology draws biological inspiration from photoreceptors and the initial retinal synapse. This research showcases the potential of additional retinal functionalities to extract visual features. We provide a domain-agnostic and efficient algorithm for ego-motion compensation based on Object Motion Sensitivity (OMS), one of the multiple features computed within the mammalian retina. We develop a method based on experimental neuroscience that translates OMS' biological circuitry to a low-overhead algorithm to suppress camera motion bypassing the need for deep networks and learning. Our system processes event data from dynamic scenes to perform pixel-wise object motion segmentation using a real and synthetic dataset. This paper introduces a bio-inspired computer vision method that dramatically reduces the number of parameters by $\text{10}^\text{3}$ to $\text{10}^\text{6}$ orders of magnitude compared to previous approaches. Our work paves the way for robust, high-speed, and low-bandwidth decision-making for in-sensor computations.

Victoria Clerico, Shay Snyder, Arya Lohia, Md Abdullah-Al Kaiser, Gregory Schwartz, Akhilesh Jaiswal, Maryam Parsa (1) __INSTITUTION_7__ George Mason Unviersity, (2) University of Southern, California, (3) Northwestern University)• 2024

Related benchmarks

TaskDatasetResultRank
Future Motion SegmentationEVIMO
mIoU50.77
24
Motion SegmentationGeneral Evaluation Sequences
Mean Inference Time112.7
3
Showing 2 of 2 rows

Other info

Follow for update