Event-Based Vision: A Survey
- PMID: 32750812
- DOI: 10.1109/TPAMI.2020.3008413
Event-Based Vision: A Survey
Abstract
Event cameras are bio-inspired sensors that differ from conventional frame cameras: Instead of capturing images at a fixed rate, they asynchronously measure per-pixel brightness changes, and output a stream of events that encode the time, location and sign of the brightness changes. Event cameras offer attractive properties compared to traditional cameras: high temporal resolution (in the order of μs), very high dynamic range (140 dB versus 60 dB), low power consumption, and high pixel bandwidth (on the order of kHz) resulting in reduced motion blur. Hence, event cameras have a large potential for robotics and computer vision in challenging scenarios for traditional cameras, such as low-latency, high speed, and high dynamic range. However, novel methods are required to process the unconventional output of these sensors in order to unlock their potential. This paper provides a comprehensive overview of the emerging field of event-based vision, with a focus on the applications and the algorithms developed to unlock the outstanding properties of event cameras. We present event cameras from their working principle, the actual sensors that are available and the tasks that they have been used for, from low-level vision (feature detection and tracking, optic flow, etc.) to high-level vision (reconstruction, segmentation, recognition). We also discuss the techniques developed to process events, including learning-based techniques, as well as specialized processors for these novel sensors, such as spiking neural networks. Additionally, we highlight the challenges that remain to be tackled and the opportunities that lie ahead in the search for a more efficient, bio-inspired way for machines to perceive and interact with the world.
Similar articles
-
EVtracker: An Event-Driven Spatiotemporal Method for Dynamic Object Tracking.Sensors (Basel). 2022 Aug 15;22(16):6090. doi: 10.3390/s22166090. Sensors (Basel). 2022. PMID: 36015851 Free PMC article.
-
Adaptive Slicing Method of the Spatiotemporal Event Stream Obtained from a Dynamic Vision Sensor.Sensors (Basel). 2022 Mar 29;22(7):2614. doi: 10.3390/s22072614. Sensors (Basel). 2022. PMID: 35408227 Free PMC article.
-
Neuromorphic Stereo Vision: A Survey of Bio-Inspired Sensors and Algorithms.Front Neurorobot. 2019 May 28;13:28. doi: 10.3389/fnbot.2019.00028. eCollection 2019. Front Neurorobot. 2019. PMID: 31191287 Free PMC article. Review.
-
Low-Latency Line Tracking Using Event-Based Dynamic Vision Sensors.Front Neurorobot. 2018 Feb 19;12:4. doi: 10.3389/fnbot.2018.00004. eCollection 2018. Front Neurorobot. 2018. PMID: 29515386 Free PMC article.
-
Scaling up liquid state machines to predict over address events from dynamic vision sensors.Bioinspir Biomim. 2017 Sep 1;12(5):055001. doi: 10.1088/1748-3190/aa7663. Bioinspir Biomim. 2017. PMID: 28569669 Review.
Cited by
-
Spike-based dynamic computing with asynchronous sensing-computing neuromorphic chip.Nat Commun. 2024 May 25;15(1):4464. doi: 10.1038/s41467-024-47811-6. Nat Commun. 2024. PMID: 38796464 Free PMC article.
-
Optimizing event-based neural networks on digital neuromorphic architecture: a comprehensive design space exploration.Front Neurosci. 2024 Mar 28;18:1335422. doi: 10.3389/fnins.2024.1335422. eCollection 2024. Front Neurosci. 2024. PMID: 38606307 Free PMC article.
-
Adaptive Unsupervised Learning-Based 3D Spatiotemporal Filter for Event-Driven Cameras.Research (Wash D C). 2024 Apr 1;7:0330. doi: 10.34133/research.0330. eCollection 2024. Research (Wash D C). 2024. PMID: 38562525 Free PMC article.
-
Memristive tonotopic mapping with volatile resistive switching memory devices.Nat Commun. 2024 Apr 1;15(1):2812. doi: 10.1038/s41467-024-47228-1. Nat Commun. 2024. PMID: 38561389 Free PMC article.
-
Event-based dataset for the detection and classification of manufacturing assembly tasks.Data Brief. 2024 Mar 16;54:110340. doi: 10.1016/j.dib.2024.110340. eCollection 2024 Jun. Data Brief. 2024. PMID: 38550235 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous