{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T19:50:18Z","timestamp":1774900218492,"version":"3.50.1"},"reference-count":33,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2016,3,4]],"date-time":"2016-03-04T00:00:00Z","timestamp":1457049600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>High-speed photography is an important tool for studying rapid physical phenomena. However, low-frame-rate CCD (charge coupled device) or CMOS (complementary metal oxide semiconductor) camera cannot effectively capture the rapid phenomena with high-speed and high-resolution. In this paper, we incorporate the hardware restrictions of existing image sensors, design the sampling functions, and implement a hardware prototype with a digital micromirror device (DMD) camera in which spatial and temporal information can be flexibly modulated. Combined with the optical model of DMD camera, we theoretically analyze the per-pixel coded exposure and propose a three-element median quicksort method to increase the temporal resolution of the imaging system. Theoretically, this approach can rapidly increase the temporal resolution several, or even hundreds, of times without increasing bandwidth requirements of the camera. We demonstrate the effectiveness of our method via extensive examples and achieve 100 fps (frames per second) gain in temporal resolution by using a 25 fps camera.<\/jats:p>","DOI":"10.3390\/s16030331","type":"journal-article","created":{"date-parts":[[2016,3,4]],"date-time":"2016-03-04T10:53:34Z","timestamp":1457088814000},"page":"331","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Per-Pixel Coded Exposure for High-Speed and High-Resolution Imaging Using a Digital Micromirror Device Camera"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7472-7921","authenticated-orcid":false,"given":"Wei","family":"Feng","sequence":"first","affiliation":[{"name":"State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fumin","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinghua","family":"Qu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shiwei","family":"Zheng","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,3,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3215","DOI":"10.1109\/TPS.2014.2338353","article-title":"Observation of underwater streamer discharges produced by pulsed power using high-speed camera","volume":"42","author":"Akiyama","year":"2014","journal-title":"IEEE Trans. Plasma Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"11630","DOI":"10.1073\/pnas.1204718109","article-title":"High-throughput single-microparticle imaging flow analyzer","volume":"109","author":"Goda","year":"2012","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"ref_3","first-page":"539","article-title":"Collision avoidance of intelligent vehicle based on networked high-speed vision system","volume":"2","author":"Hirano","year":"2014","journal-title":"Int. Conf. Inform. Control Autom. Robot."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1038\/nphys1980","article-title":"Time-resolved imaging of purely valence-electron dynamics during a chemical reaction","volume":"7","author":"Hockett","year":"2011","journal-title":"Nat. Phys."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1038\/nature09901","article-title":"Transient ferromagnetic-like state mediating ultrafast reversal of antiferromagnetically coupled spins","volume":"472","author":"Radu","year":"2011","journal-title":"Nature"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2049","DOI":"10.1109\/4.972156","article-title":"A 10,000 frames\/s CMOS digital pixel sensor","volume":"36","author":"Kleinfelder","year":"2001","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2027","DOI":"10.1063\/1.1535250","article-title":"High-speed, electronically shuttered solid-state imager technology (invited)","volume":"74","author":"Reich","year":"2003","journal-title":"Rev. Sci. Instrum."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5081","DOI":"10.3390\/s150305081","article-title":"A High Speed CMOS Image Sensor with a Novel Digital Correlated Double Sampling and a Differential Difference Amplifier","volume":"15","author":"Kim","year":"2015","journal-title":"Sensors"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1109\/JSSC.2012.2219685","article-title":"A Global-Shutter CMOS Image Sensor with Readout Speed of 1-Tpixel\/s Burst and 780-Mpixel\/s Continuous","volume":"48","author":"Tochigi","year":"2013","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_10","unstructured":"Lowrance, J.L., and Kosonocky, W.F. (November, January 27). Million-frame-per-second CCD camera system. Proceedings of the 22nd International Congress on High-Speed Photography and Photonics, Santa Fe, NM, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1109\/TED.2002.806474","article-title":"An image sensor which captures 100 consecutive frames at 1,000,000 frames\/s","volume":"50","author":"Etoh","year":"2003","journal-title":"IEEE Trans. Electron Dev."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"430","DOI":"10.3390\/s90100430","article-title":"CMOS image sensors for high speed applications","volume":"9","author":"Fang","year":"2009","journal-title":"Sensors"},{"key":"ref_13","first-page":"16","article-title":"Toward 100 mega-frames per second: Design of an ultimate ultra-high-speed image sensor","volume":"10","author":"Son","year":"2010","journal-title":"Sensors"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4100","DOI":"10.3390\/s100404100","article-title":"Ultra-high-speed image signal accumulation sensor","volume":"10","author":"Etoh","year":"2010","journal-title":"Sensors"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4640","DOI":"10.3390\/s130404640","article-title":"Toward one gigaframes per second\u2014Evolution of in situ storage image sensors","volume":"13","author":"Etoh","year":"2013","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.nima.2011.03.058","article-title":"Backside illuminated CCD operating at 16,000,000 frames per second with sub-ten-photonsensitivity","volume":"647","author":"Etoh","year":"2011","journal-title":"Nucl. Instr. Meth. Phys. Res. A"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3322","DOI":"10.1109\/TIP.2011.2171700","article-title":"Computational cameras: Convergence of optics and processing","volume":"20","author":"Zhou","year":"2011","journal-title":"IEEE Trans. Image Proc."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1145\/1141911.1141957","article-title":"Coded exposure photography: Motion deblurring using fluttered shutter","volume":"25","author":"Raskar","year":"2006","journal-title":"ACM Trans. Graph."},{"key":"ref_19","first-page":"100","article-title":"Flexible voxels for motion-aware videography","volume":"6311","author":"Gupta","year":"2010","journal-title":"Proc. Eur. Conf. Comput. Vis."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"8246","DOI":"10.1364\/AO.51.008246","article-title":"Platform motion blur image restoration system","volume":"51","author":"Olivas","year":"2012","journal-title":"Appl. Opt."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Reddy, D., Veeraraghavan, A., and Chellappa, R. (2011, January 20\u201325). P2C2: Programmable pixel compressive camera for high speed imaging. Proceedings of the IEEE Conference Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995542"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1109\/TPAMI.2013.129","article-title":"Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging","volume":"36","author":"Liu","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1109\/TPAMI.2010.87","article-title":"Coded strobing photography: Compressive sensing of high speed periodic videos","volume":"33","author":"Veeraraghavan","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1038\/nmeth.1429","article-title":"Temporal pixel multiplexing for simultaneous high-speed, high-resolution imaging","volume":"7","author":"Bub","year":"2010","journal-title":"Nat. Method"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Dudley, D., Duncan, W.M., and Slaughter, J. (2003). Emerging digital micromirror device (DMD) applications. Proc. SPIE, 4985.","DOI":"10.1117\/12.480761"},{"key":"ref_26","first-page":"1","article-title":"Analysis and processing of pixel binning for color image sensor","volume":"1","author":"Jin","year":"2012","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"10711","DOI":"10.3390\/s130810711","article-title":"Light-Addressed Electrodeposition of Enzyme-Entrapped Chitosan Membranes for Multiplexed Enzyme-Based Bioassays Using a Digital Micromirror Device","volume":"13","author":"Huang","year":"2013","journal-title":"Sensors"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5400","DOI":"10.1364\/AO.47.005400","article-title":"Intensity range extension method for three-dimensional shape measurement in phase-measuring profilometry using a digital micromirror device camera","volume":"47","author":"Ri","year":"2008","journal-title":"Appl. Opt."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"792","DOI":"10.3390\/s150100792","article-title":"Automatic Laser Glare Suppression in Electro-Optical Sensors","volume":"15","author":"Ritt","year":"2015","journal-title":"Sensors"},{"key":"ref_30","unstructured":"Smith, W.J. (2007). Modern Optical Engineering, McGraw-Hill. [4th ed.]."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"0631051","DOI":"10.1117\/1.OE.53.6.063105","article-title":"Removal of parasitic image due to metal specularity based on digital micromirror device camera","volume":"53","author":"Zhao","year":"2014","journal-title":"Opt. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"6940","DOI":"10.1364\/AO.45.006940","article-title":"Accurate pixel-to-pixel correspondence adjustment in a digital micromirror device camera by using the phase-shifting moir\u00e9 method","volume":"45","author":"Ri","year":"2006","journal-title":"Appl. Opt."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1016\/S0377-2217(01)00243-0","article-title":"Multicriteria classification and sorting methods: A literature review","volume":"138","author":"Zopounidis","year":"2002","journal-title":"Eur. J. Oper. Res."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/3\/331\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:20:09Z","timestamp":1760210409000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/3\/331"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3,4]]},"references-count":33,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2016,3]]}},"alternative-id":["s16030331"],"URL":"https:\/\/doi.org\/10.3390\/s16030331","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,3,4]]}}}