WORKSHOP PAPER
Towards a physically realistic computationally efficient DVS pixel model
Rui Graca1, Tobi Delbruck1
1Sensors Group, Inst. of Neuroinformatics, UZH-ETH Zurich, Zurich, Switzerland

Abstract

Dynamic Vision Sensor (DVS) event camera models are important tools for predicting camera response, optimizing biases, and generating realistic simulated datasets. Existing DVS models have been useful, but have not demonstrated high realism for challenging HDR scenes combined with adequate computational efficiency for array-level scene simulation. This paper reports progress towards a physically realistic and computationally efficient DVS model based on large-signal differential equations derived from circuit analysis, with parameters fitted from pixel measurements and circuit simulation. These are combined with an efficient stochastic event generation mechanism based on first-passage-time theory, allowing accurate noise generation with timesteps greater than 1000x longer than previous methods.
Year: 2017
Workshop: IISW
URL: https://doi.org/10.60928/zv98-d2xl
Download PDF

Keywords

Dynamic Vision Sensor, computational efficiency, stochastic event generation,

References

1) R. Graca et al., "Dynamic Vision Sensor event cameras", ESSERC, 2024. https://doi.org/10.1109/ESSERC62670.2024.10719521
2) S. Lin et al., "DVS in ECCV", ECCV, 2022. https://doi.org/10.1007/978-3-031-20071-7_34
3) Z. Zhang et al., "DVS in ICRA", ICRA, 2024. https://doi.org/10.1109/ICRA57147.2024.10609864
8) H. Rebecq et al., "DVS for scientific applications", CoRL, 2018. https://doi.org/10.5167/uzh-175993
9) Y. Hu et al., "DVS simulations for deep learning datasets", CVPRW, 2021. https://doi.org/10.1109/CVPRW53098.2021.00144
10) X. Jiang et al., "Array-level simulator v2e", arXiv, 2024
14) A. Suess et al., "Physically realistic DVS models", IISW, 2023. https://doi.org/10.60928/o8kk-2mew
15) X. Mou et al., "Matching SPICE simulations and measurements", Electronic Imaging, 2024. https://doi.org/10.2352/EI.2024.36.7.ISS-289
16) D. Joubert et al., "Event threshold variation modeling", Front. Neurosci., 2021. https://doi.org/10.3389/fnins.2021.702765
17) R. Graca et al., "Circuit parameters from bias currents", IISW, 2023. https://doi.org/10.60928/dlpf-irjd
18) R. Graca, "Buffer difference equation for DVS pixel model", CVPRW, 2023. https://doi.org/10.1109/CVPRW59228.2023.00423
19) R. Graca, "Photoreceptor and buffer model", ETH Zurich, 2024. https://doi.org/10.3929/ethz-b-000683623
20) E. Bibbona et al., "Modeling Gaussian noise", Metrologia, 2008. https://doi.org/10.1088/0026-1394/45/6/S17
21) M. T. Giraudo et al., "Stochastic event generation", Commun. Stat. Simul. Comput., 1999. https://doi.org/10.1080/03610919908813596
22) R. Graca et al., "Signal and noise event rates in DVS", IISW, 2021. https://doi.org/10.60928/n1k7-etj1