WORKSHOP PAPER
Investigating Diverse Parameters for Characterizing Spatial Contrast Transfer in CMOS Event-Based Cameras
Abstract
Event-Based (EB) cameras generate events in response to relative changes in light. The primary characteristics of an EB camera are its sensitivity to light changes and the latency of change detection. These parameters, and consequently the camera’s response, are strongly impacted by the lighting conditions. Both temporal and spatial light contrast affect detection capabilities, as spatial contrast translates into temporal contrast for moving objects. When an EB camera fails to resolve objects with high spatial frequency textures, the spatial contrast transfer degrades, impacting temporal contrast and data quality. This preliminary work is an initial step in evaluating the ability of EB cameras to transfer contrast at high spatial frequencies.Keywords
Event-Based, CMOS, Cameras, Spatial Contrast Transfer, Sensitivity, Latency, Lighting Conditions, Temporal Contrast, Data Quality, High Spatial Frequencies,References
[1]) Mead, Carver, "How we created neuromorphic engineering", Nature Electronics, 2020. https://doi.org/10.1038/s41928-020-0448-2
[2]) Mahowald, Michelle A. (Misha), "VLSI Analogs of Neuronal Visual Processing: A Synthesis of Form and Function", Dissertation (Ph.D.), California Institute of Technology, 1992
[3]) Posch, Christoph, et al., "Retinomorphic event-based vision sensors: bioinspired cameras with spiking output", Proceedings of the IEEE, 2014. https://doi.org/10.1109/jproc.2014.2346153
[4]) Juan, Le˜nero-Bardallo, et al., "Applications of event-based image sensors—Review and analysis", International Journal of Circuit Theory and Applications, 2018. https://doi.org/10.1002/cta.2546
[5]) Liu, Shih-Chii, "Analog VLSI: Circuits and Principles", MIT Press, 2002
[6]) Posch, Christoph, Daniel Matolin, and Rainer Wohlgenannt, "A QVGA 143 dB dynamic range frame-free PWM image sensor with lossless pixel-level video compression and time-domain CDS", IEEE Journal of Solid-State Circuits, 2010. https://doi.org/10.1109/jssc.2010.2085952
[7]) McMahon-Crabtree, Peter N., et al., "Progress on event-based camera characterization techniques including pre-launch measurements of the falcon odin space experiment", Unconventional Imaging, Sensing, and Adaptive Optics, 2024. https://doi.org/10.1117/12.3026253
[8]) Burks, Stephen D., et al., "Focusing an event-based camera: towards spatiotemporal characterization of neuromorphic vision systems", Infrared Imaging Systems: Design, Analysis, Modeling, and Testing, 2024. https://doi.org/10.1117/12.3013108
[9]) Loebich, Christian, et al., "Digital camera resolution measurements using sinusoidal Siemens stars", Digital Photography III, 2007. https://doi.org/10.1117/12.703817
[10]) T. Finateu et al., "A 1280×720 Back-Illuminated Stacked Temporal Contrast Event-Based Vision Sensor with 4.86µm Pixels, 1.066GEPS Readout, Programmable Event-Rate Controller and Compressive Data-Formatting Pipeline", 2020 IEEE International Solid-State Circuits Conference, 2020. https://doi.org/10.1109/isscc19947.2020.9063149