WORKSHOP PAPER
Bandwidth efficient frame-based CMOS image sensor for edge and contour detection applications
Abstract
In this paper a bandwidth efficient frame-based CMOS image sensor is designed and fabricated for edge and contour detection applications. A novel in-pixel spatial contrast computation with non-overlapping of a 2 x 2 pixel kernel is used to reduce the pixel readout complexity and detect an edge and contour of an object without further processing. A 128 x 128 vision sensor prototype is fabricated in TSMC 0.18 µm CMOS CIS process with a pixel pitch of 11.2 µm, fill factor of 11% and frame rate of 90 fps.Keywords
Spatial Contrast (SC), Dynamic Vision Sensor (DVS), CMOS Image Sensor (CIS), Event Detection (ED),References
[1]) P. Lichtsteiner, C. Posch and T. Delbruck, "A 128 × 128 120 dB 15 µs latency asynchronous temporal contrast vision sensor", IEEE Journal of Solid-State Circuits, vol. 43, no. 2, pp. 566-576, Feb. 2008, 2008. https://doi.org/10.1109/JSSC.2007.914337
[2]) M. Yang, S. -C. Liu and T. Delbruck, "A Dynamic Vision Sensor With 1% Temporal Contrast Sensitivity and In-Pixel Asynchronous Delta Modulator for Event Encoding", IEEE Journal of Solid-State Circuits, vol. 50, no. 9, pp. 2149-2160, Sept. 2015, 2015. https://doi.org/10.1109/JSSC.2015.2425886
[3]) A. Berkovich, M. Lecca, L. Gasparini, P. A. Abshire and M. Gottardi, "A 30 µW 30 fps 110 × 110 pixels vision sensor embedding local binary patterns", IEEE Journal of Solid-State Circuits, vol. 50, no. 9, pp. 2138-2148, Sept. 2015, 2015. https://doi.org/10.1109/JSSC.2015.2444875
[4]) K. Lee, S. Park, S. Y. Park, J. Cho, and E. Yoon, "A 272.49 pJ/pixel CMOS image sensor with embedded object detection and bio-inspired 2D optic flow generation for nano-air-vehicle navigation", Proc. Symp. VLSI Circuits, Kyoto, Japan, Jun. 2017, pp. 294–295, 2017. https://doi.org/10.23919/vlsic.2017.8008514
[5]) X. Zhong, Q. Yu, A. Bermak, C. Tsui and M. Law, "A 2 pJ/pixel/direction MIMO processing based CMOS image sensor for omnidirectional local binary pattern extraction and edge detection", 2018 IEEE Symposium on VLSI Circuits, 2018, pp. 247-248, 2018. https://doi.org/10.1109/VLSIC.2018.8502214
[6]) M. Gottardi and M. Lecca, "A 64 x 64 pixel vision sensor for local binary pattern computation", IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 66, no. 5, pp. 1831-1839, May 2019, 2019. https://doi.org/10.1109/TCSI.2018.2883792