WORKSHOP PAPER
Exploiting Alternating DVS Shot Noise Event Pair Statistics to Reduce Background Activity Rates
Abstract
Dynamic Vision Sensors (DVS) record 'events' corresponding to pixel-level brightness changes, resulting in data-efficient representation of a dynamic visual scene. As DVS expand into increasingly diverse applications, non-ideal behaviors in their output under extreme sensing conditions are important to consider. Under low illumination (below ≈10 lux), their output begins to be dominated by shot noise events (SNEs) which increase the data output and obscure true signal. SNE rates can be controlled to some degree by tuning circuit parameters to reduce sensitivity or temporal response bandwidth at the cost of signal loss. Alternatively, an improved understanding of SNE statistics can be leveraged to develop novel techniques for minimizing uninformative sensor output. This work explains a fundamental observation about sequential pairing of opposite polarity SNEs based on pixel circuit logic and validates this theory using DVS recordings and simulations. It derives a practical result from this new understanding and demonstrates two novel biasing techniques shown to reduce SNEs by 50% and 80% respectively while still retaining sensitivity and/or temporal resolution.Keywords
dynamic vision sensor, event camera, DVS, noise statistics,References
1) G. Gallego, T. Delbruck, G. Orchard, et al., "Event-Based vision: A survey", IEEE Trans. Pattern Anal. Mach. Intell., 2020. https://doi.org/10.1109/tpami.2020.3008413
2) Y. Hu, S.-C. Liu, and T. Delbruck, "V2e: From video frames to realistic DVS events", 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2021. https://doi.org/10.1109/cvprw53098.2021.00144
3) Y. Suh, S. Choi, M. Ito, et al., "A 1280 ×960 dynamic vision sensor with a 4.95-µm pixel pitch and motion artifact minimization", 2020 IEEE International Symposium on Circuits and Systems (ISCAS), 2020. https://doi.org/10.1109/iscas45731.2020.9180436
4) T. Finateu, A. Niwa, D. Matolin, et al., "5.10 a 1280 ×720 Back-Illuminated stacked temporal contrast Event-Based vision sensor with 4.86µm pixels, 1.066GEPS readout, programmable Event-Rate controller and compressive Data-Formatting pipeline", 2020 IEEE International Solid- State Circuits Conference - (ISSCC), 2020. https://doi.org/10.1109/isscc19947.2020.9063149
5) A. Khodamoradi and R. Kastner, "O(N)-Space spatiotemporal filter for reducing noise in neuromorphic vision sensors", IEEE Transactions on Emerging Topics in Computing, 2017. https://doi.org/10.1109/tetc.2017.2788865
6) S. Guo and T. Delbruck, "Low cost and latency event camera background activity denoising", IEEE Trans. Pattern Anal. Mach. Intell., 2022. https://doi.org/10.1109/tpami.2022.3152999
7) D. Czech and G. Orchard, "Evaluating noise filtering for event-based asynchronous change detection image sensors", 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob), 2016. https://doi.org/10.1109/biorob.2016.7523452
R. Graca and T. Delbruck, "Unraveling the paradox of intensity-dependent DVS pixel noise", 2021. https://doi.org/10.60928/n1k7-etj1
8) T. Delbruck, R. Graca, and M. Paluch, "Feedback control of event cameras", 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2021. https://doi.org/10.1109/cvprw53098.2021.00146
9) R. Graca, B. McReynolds, and T. Delbruck, "Shining light on the DVS pixel: A tutorial and discussion about biasing and optimization", 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2023. https://doi.org/10.1109/cvprw59228.2023.00423
10) P. Lichtsteiner, C. Posch, and T. Delbruck, "A 128 ×128 120 dB 15 µs latency asynchronous temporal contrast vision sensor", IEEE J. Solid-State Circuits, 2008. https://doi.org/10.1109/jssc.2007.914337
11) R. Graca, B. McReynolds, and T. Delbruck, "Optimal biasing and physical limits of DVS event noise", 2023 International Image Sensor Workshop (IISW), 2023. https://doi.org/10.60928/dlpf-irjd
12) G. Taverni, D. Paul Moeys, C. Li, et al., "Front and back illuminated dynamic and active pixel vision sensors comparison", IEEE Transactions on Circuits and Systems II: Express Briefs, 2018. https://doi.org/10.1109/tcsii.2018.2824899