{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T15:30:59Z","timestamp":1775143859048,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T00:00:00Z","timestamp":1646179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["17H06102, 18H05240"],"award-info":[{"award-number":["17H06102, 18H05240"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>An ultra-high-speed computational CMOS image sensor with a burst frame rate of 303 megaframes per second, which is the fastest among the solid-state image sensors, to our knowledge, is demonstrated. This image sensor is compatible with ordinary single-aperture lenses and can operate in dual modes, such as single-event filming mode or multi-exposure imaging mode, by reconfiguring the number of exposure cycles. To realize this frame rate, the charge modulator drivers were adequately designed to suppress the peak driving current taking advantage of the operational constraint of the multi-tap charge modulator. The pixel array is composed of macropixels with 2 \u00d7 2 4-tap subpixels. Because temporal compressive sensing is performed in the charge domain without any analog circuit, ultrafast frame rates, small pixel size, low noise, and low power consumption are achieved. In the experiments, single-event imaging of plasma emission in laser processing and multi-exposure transient imaging of light reflections to extend the depth range and to decompose multiple reflections for time-of-flight (TOF) depth imaging with a compression ratio of 8\u00d7 were demonstrated. Time-resolved images similar to those obtained by the direct-type TOF were reproduced in a single shot, while the charge modulator for the indirect TOF was utilized.<\/jats:p>","DOI":"10.3390\/s22051953","type":"journal-article","created":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T22:53:25Z","timestamp":1646261605000},"page":"1953","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["A Dual-Mode 303-Megaframes-per-Second Charge-Domain Time-Compressive Computational CMOS Image Sensor"],"prefix":"10.3390","volume":"22","author":[{"given":"Keiichiro","family":"Kagawa","sequence":"first","affiliation":[{"name":"Research Institute of Electronics, Shizuoka University, Hamamatsu 432-8011, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Masaya","family":"Horio","sequence":"additional","affiliation":[{"name":"Graduate School of Integrated Science and Technology, Shizuoka University, Hamamatsu 432-8011, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anh Ngoc","family":"Pham","sequence":"additional","affiliation":[{"name":"Graduate School of Integrated Science and Technology, Shizuoka University, Hamamatsu 432-8011, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thoriq","family":"Ibrahim","sequence":"additional","affiliation":[{"name":"Graduate School of Integrated Science and Technology, Shizuoka University, Hamamatsu 432-8011, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shin-ichiro","family":"Okihara","sequence":"additional","affiliation":[{"name":"Photonics for Material Processing, The Graduate School for the Creation of New Photonics Industries, Hamamatsu 431-1202, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tatsuki","family":"Furuhashi","sequence":"additional","affiliation":[{"name":"Graduate School of Integrated Science and Technology, Shizuoka University, Hamamatsu 432-8011, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Taishi","family":"Takasawa","sequence":"additional","affiliation":[{"name":"Research Institute of Electronics, Shizuoka University, Hamamatsu 432-8011, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keita","family":"Yasutomi","sequence":"additional","affiliation":[{"name":"Research Institute of Electronics, Shizuoka University, Hamamatsu 432-8011, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shoji","family":"Kawahito","sequence":"additional","affiliation":[{"name":"Research Institute of Electronics, Shizuoka University, Hamamatsu 432-8011, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hajime","family":"Nagahara","sequence":"additional","affiliation":[{"name":"Institute of Datability Science, Osaka University, Suita 565-0871, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tsuji, K. (2018). The Micro-World Observed by Ultra High-Speed Cameras, Springer.","DOI":"10.1007\/978-3-319-61491-5"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1038\/nphoton.2014.163","article-title":"Sequentially timed all-optical mapping photography (STAMP)","volume":"8","author":"Nakagawa","year":"2014","journal-title":"Nat. Photonics"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1038\/nature14005","article-title":"Single-shot compressed ultrafast photography at one hundred billion frames per second","volume":"516","author":"Gao","year":"2014","journal-title":"Nature"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Tochigi, Y., Hanzawa, K., Kato, Y., Kuroda, R., Mutoh, H., Hirose, R., Tominaga, H., Takubo, K., Kondo, Y., and Sugawa, S. (2012, January 19\u201323). A global-shutter CMOS image sensor with readout speed of 1Tpixel\/s burst and 780Mpixel\/s continuous. Proceedings of the IEEE Int\u2019l Solid-State Circuit Conference (ISSCC), San Francisco, CA, USA.","DOI":"10.1109\/ISSCC.2012.6177046"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Etoh, T., Okinaka, T., Takano, Y., Takehara, K., Nakano, H., Shimonomura, K., Ando, T., Ngo, N., Kamakura, Y., and Dao, V. (2019). Light-in-flight imaging by a silicon image sensor: Toward the theoretical highest frame rate. Sensors, 19.","DOI":"10.3390\/s19102247"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Suzuki, M., Sugama, Y., Kuroda, R., and Sugawa, S. (2019, January 23\u201327). Over 100 million frames per second 368 frames global shutter burst CMOS image sensor with pixel-wise trench capacitor memory array. Proceedings of the 2019 International Image Sensor Workshop (IISW), Snowbird, UT, USA.","DOI":"10.3390\/s20041086"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mochizuki, F., Kagawa, K., Okihara, S., Seo, M.-W., Zhang, B., Takasawa, T., Yasutomi, K., and Kawahito, S. (2015, January 22\u201326). Single-shot 200Mfps 5x3-aperture compressive CMOS imager. Proceedings of the IEEE Int\u2019l Solid-State Circuit Conference (ISSCC), San Francisco, CA, USA.","DOI":"10.1109\/ISSCC.2015.7062953"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4155","DOI":"10.1364\/OE.24.004155","article-title":"Single-event transient imaging with an ultra-high-speed temporally compressive multi-aperture CMOS image sensor","volume":"24","author":"Mochizuki","year":"2016","journal-title":"Optics Express"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sonoda, T., Nagahara, H., Endo, K., Sugiyama, Y., and Taniguchi, R. (2016, January 13\u201315). High-speed imaging using CMOS image sensor with quasi pixel-wise exposure. Proceedings of the IEEE Int\u2019l Conference on Computational Photography (ICCP), Evanston, IL, USA.","DOI":"10.1109\/ICCPHOT.2016.7492875"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"31475","DOI":"10.1364\/OE.27.031475","article-title":"CMOS computational camera with a two-tap coded exposure image sensor for single-shot spatial-temporal compressive sensing","volume":"27","author":"Luo","year":"2019","journal-title":"Optics Express"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Remondino, F., and Stoppa, D. (2013). TOF Range-Imaging Cameras, Springer.","DOI":"10.1007\/978-3-642-27523-4"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bamji, C.S., Mehta, S., Thompson, B., Elkhatib, T., Wurster, S., Akkaya, O., Payne, A., Godbaz, J., Fenton, M., and Rajasekaran, V. (2018, January 11\u201315). 1Mpixel 65nm BSI 320MHz Demodulated TOF Image Sensor with 3.5\u03bcm Global Shutter Pixels and Analog Binning. Proceedings of the IEEE Int\u2019l Solid-State Circuit Conference (ISSCC), San Francisco, CA, USA.","DOI":"10.1109\/ISSCC.2018.8310200"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ebiko, Y., Yamagishi, H., Tatani, K., Iwamoto, H., Moriyama, Y., Hagiwara, Y., Maeda, S., Murase, T., Suwa, T., and Arai, H. (2020, January 12\u201318). Low power consumption and high resolution 1280 \u00d7 960 gate assisted photonic demodulator pixel for indirect time of flight. Proceedings of the IEEE Int\u2019l Electron Devices Meeting (IEDM), San Francisco, CA, USA.","DOI":"10.1109\/IEDM13553.2020.9372109"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Keel, M.S., Kim, D., Kim, Y., Bae, M., Ki, M., Chung, B., Son, S., Lee, H., Jo, H., and Shin, S.C. (2021, January 13\u201322). 4-tap 3.5 \u03bcm 1.2 Mpixel indirect time-of-flight CMOS image sensor with peak current mitigation and multi-user interference cancellation. Proceedings of the IEEE Int\u2019l Solid-State Circuit Conference (ISSCC), San Francisco, CA, USA.","DOI":"10.1109\/ISSCC42613.2021.9365854"},{"key":"ref_15","unstructured":"Kawahito, S., Baek, G., Li, Z., Han, S., Seo, M., Yasutomi, K., and Kagawa, K. (2013, January 12\u201316). CMOS lock-in pixel image sensors with lateral electric field control for time-resolved imaging. Proceedings of the Int\u2019l Image Sensor Workshop (IISW), Snowbird, UT, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1847","DOI":"10.1109\/JSSC.2005.848173","article-title":"Design and characterization of a CMOS 3-D image sensor based on single photon avalanche diodes","volume":"40","author":"Niclass","year":"2005","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_17","unstructured":"Kagawa, K., Kokado, T., Sato, Y., Mochizuki, F., Nagahara, H., Takasawa, T., Yasutomi, K., and Kawahito, S. (2019, January 23\u201327). Multi-tap macro-pixel based compressive ultra-high-speed CMOS image sensor. Proceedings of the Int\u2019l Image Sensor Workshop (IISW), Snowbird, UT, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1289","DOI":"10.1109\/TIT.2006.871582","article-title":"Compressed sensing","volume":"52","author":"Donoho","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/MSP.2007.914731","article-title":"An introduction to compressive sampling","volume":"25","author":"Cades","year":"2008","journal-title":"IEEE Signal Processing Mag."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1109\/MSP.2007.4286571","article-title":"Compressive sensing","volume":"24","author":"Baraniuk","year":"2007","journal-title":"IEEE Signal Processing Mag."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1109\/MSP.2007.914730","article-title":"Single-pixel imaging via compressive sampling","volume":"25","author":"Duartte","year":"2008","journal-title":"IEEE Signal Processing Mag."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"B9","DOI":"10.1364\/AO.49.0000B9","article-title":"Compressive video sensors using multichannel imagers","volume":"49","author":"Shankar","year":"2010","journal-title":"Appl. Opt."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"14013","DOI":"10.1364\/OE.15.014013","article-title":"Single-shot compressive spectral imaging with a dual-disperser architecture","volume":"15","author":"Gehm","year":"2007","journal-title":"Optics Express"},{"key":"ref_24","first-page":"718","article-title":"Compressed sensing in astronomy","volume":"2","author":"Bobin","year":"2008","journal-title":"IEEE J. Selected Topics in Sig. Proc."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"C23","DOI":"10.1364\/AO.54.000C23","article-title":"Compressive sensing in medical imaging","volume":"51","author":"Graff","year":"2015","journal-title":"Appl. Opt."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2507","DOI":"10.1109\/ACCESS.2016.2569421","article-title":"A review of compressive sensing in information security field","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"9608","DOI":"10.1109\/TIE.2017.2698406","article-title":"Smart compressed sensing for online evaluation of CFRP structure integrity","volume":"64","author":"Tang","year":"2017","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4961","DOI":"10.3390\/s130404961","article-title":"Compressive sensing image sensors-hardware implementation","volume":"13","author":"Dadkhah","year":"2013","journal-title":"Sensors"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2291","DOI":"10.1109\/JSSC.2019.2916310","article-title":"A sub-100 \u03bcm-range-resolution time-of-flight range image sensor with three-tap lock-in pixels, non-overlapping gate clock, and reference plane sampling","volume":"54","author":"Yasutomi","year":"2019","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_30","unstructured":"Li, C., Yin, W., and Zhang, Y. (2022, January 04). TVAL3: TV Minimization by Augmented Lagrangian and Alternating Direction Algorithms. Available online: https:\/\/www.caam.rice.edu\/~optimization\/L1\/TVAL3\/."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Niclass, C., Soga, M., Matsubara, H., Ogawa, M., and Kagwami, M. (2013, January 17\u201321). A 0.18 \u03bcm CMOS SoC for a 100m-range 10fps 200\u00d796-pixel time-of-flight depth sensor. Proceedings of the IEEE Int\u2019l Solid-State Circuit Conference (ISSCC), San Francisco, CA, USA.","DOI":"10.1109\/ISSCC.2013.6487827"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1145\/2508363.2508428","article-title":"Coded time of flight cameras: Sparse deconvolution to address multipath interference and recover time profiles","volume":"32","author":"Kadambi","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1145\/2461912.2461945","article-title":"Low-budget transient imaging using photonic mixer devices","volume":"32","author":"Heide","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1186\/s41074-017-0026-3","article-title":"Recovering temporal PSF using ToF camera with delayed light emission","volume":"9","author":"Kitano","year":"2017","journal-title":"IPSJ Trans. Comput. Vis. Appl."},{"key":"ref_35","first-page":"202","article-title":"Separation of Multi-Path Components in Sweep-Less Time-of-Flight Depth Imaging with a Temporally-Compressive Multi-Aperture Image Sensor","volume":"6","author":"Mochizuki","year":"2018","journal-title":"ITE Trans. Media Technol. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1705","DOI":"10.1364\/OL.39.001705","article-title":"Resolving multipath interference in time-of-flight imaging via modulation frequency diversity and sparse regularization","volume":"39","author":"Bhandari","year":"2014","journal-title":"OSA Opt. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2319","DOI":"10.1109\/JSSC.2018.2827918","article-title":"A time-resolved four-tap lock-in pixel CMOS image sensor for real-time fluorescence lifetime imaging microscopy","volume":"53","author":"Seo","year":"2018","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sukegawa, S., Umebayashi, T., Nakajima, T., Kawanobe, H., Koseki, K., Hirota, I., Haruta, T., Kasai, M., Fukumoto, K., and Wakano, T. (2013, January 17\u201321). A 1\/4-inch 8Mpixel back-illuminated stacked CMOS image sensor. Proceedings of the IEEE Int\u2019l Solid-State Circuit Conference (ISSCC), San Francisco, CA, USA.","DOI":"10.1109\/ISSCC.2013.6487825"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Hitomi, Y., Gu, J., Gupta, M., Mitsunaga, T., and Nayar, S.K. (2011, January 6\u201313). Video from a single coded exposure photograph using a learned over-complete dictionary. Proceedings of the Int\u2019l Conf. on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126254"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Yoshida, M., Torii, A., Okutomi, M., Endo, K., Sugiyama, Y., Taniguchi, R., and Nagahara, H. (2018, January 8\u201314). Joint optimization for compressive video sensing and reconstruction under hardware constraints. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01249-6_39"},{"key":"ref_41","unstructured":"Yasutomi, K., Inoue, M., Daikoku, S., Mars, K., and Kawahito, S. (2021, January 20\u201323). A 4-tap lock-in pixel time-of-flight range imager with substrate biasing and double-delta correlated multiple sampling. Proceedings of the 2019 International Image Sensor Workshop (IISW), Online."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/5\/1953\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:30:43Z","timestamp":1760135443000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/5\/1953"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,2]]},"references-count":41,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["s22051953"],"URL":"https:\/\/doi.org\/10.3390\/s22051953","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,2]]}}}