WORKSHOP PAPER
3D-Stacked 1Megapixel Dual-Time-Gated Color SPAD Image Sensor with Simultaneous Dual Image Output Architecture for Efficient Sensor Fusion
K. Chida1, K. Morimoto, N. Isoda, H. Sekine, T. Sasago, Y. Maehashi, S. Mikajiri, K. Tojima, M. Shinohara, A. Abdelghafar, H. Tsuchiya, K. Inoue, S. Omodani, A. Ehara, J. Iwata, T. Itano, Y. Matsuno, K. Sakurai, T. Ichikawa
1Canon Inc., Kanagawa, Japan

Abstract

We present a 5μm-pitch, 3D-BSI 1Megapixel dual-time-gated color SPAD image sensor enabling a simultaneous output of dual images. The developed SPAD image sensor is verified to operate as an RGB-D sensor without complex image alignment. In addition, a novel HDR technique utilizing pileup effect with two parallel in-pixel memories is validated for dynamic range extension in 2D imaging, achieving a dynamic range of 119.5dB. The proposed architecture provides dual image output with the same field-of-view, resolution, and frame timing, and is promising for efficient sensor fusion.
Publisher: null
Year: 2025
Workshop: IISW
URL: https://doi.org/10.60928/p3m1-o0rz

Keywords

3D-Stacked, 1Megapixel, Dual-Time-Gated, Color, SPAD, Image Sensor, Dual Image Output, Architecture, Efficient Sensor Fusion,

References

1) W. Kim et al., "A 1.5Mpixel RGBZ CMOS image sensor for simultaneous color and range image capture", IEEE International Solid-State Circuits Conference, 2012. https://doi.org/10.1109/isscc.2012.6177061
2) S.-J. Kim et al., "A 640×480 image sensor with unified pixel architecture for 2D/3D imaging in 0.11µm CMOS", Symposium on VLSI Circuits - Digest of Technical Papers, 2011
3) A. Tournier et al., "A HDR 98dB 3.2μm Charge Domain Global Shutter CMOS Image Sensor", IEEE Journal of Solid-State Circuits, 2018. https://doi.org/10.1109/iedm.2018.8614615
4) N. A. W. Dutton et al., "High dynamic range imaging at the quantum limit with single photon avalanche diode-based image sensors", Sensors, 2018. https://doi.org/10.3390/s18041166
5) K. Morimoto et al., "Megapixel time-gated SPAD image sensor for 2D and 3D imaging applications", Optica, 2020. https://doi.org/10.1364/optica.386574
6) M. Perenzoni et al., "A 160×120 Pixel Analog-Counting Single-Photon Imager With Time-Gating and Self-Referenced Column-Parallel A/D Conversion for Fluorescence Lifetime Imaging", IEEE Transactions on Electron Devices, 2016. https://doi.org/10.1109/isscc.2015.7062995
7) I. Gyongy et al., "A 256×256, 100-kfps, 61% Fill-Factor SPAD Image Sensor for Time-Resolved Microscopy Applications", IEEE Transactions on Electron Devices, 2018. https://doi.org/10.1109/ted.2017.2779790
8) K. Morimoto et al., "3D-Stacked 1Megapixel Time-Gated SPAD Image Sensor with 2D Interactive Gating Network for Image Alignment-Free Sensor Fusion", IEEE Symposium on VLSI Technology and Circuits, 2024. https://doi.org/10.1109/vlsitechnologyandcir46783.2024.10631424
9) M. Wayne et al., "A 500×500 Dual-Gate SPAD Imager With 100% Temporal Aperture and 1 ns Minimum Gate Length for FLIM and Phasor Imaging Applications", IEEE Transactions on Electron Devices, 2022. https://doi.org/10.1109/ted.2022.3168249
10) M. A. Wayne et al., "Massively parallel, real-time multispeckle diffuse correlation spectroscopy using a 500×500 SPAD camera", Biomedical Optics Express, 2023. https://doi.org/10.1364/boe.473992