{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T19:28:44Z","timestamp":1790796524791,"version":"4.1.0"},"reference-count":42,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Imaging Sci."],"published-print":{"date-parts":[[2015,1]]},"abstract":"<jats:p>Spatial multiplexing cameras (SMCs) acquire a (typically static) scene through a series of coded projections using a spatial light modulator (e.g., a digital micromirror device) and a few optical sensors. This approach finds use in imaging applications where full-frame sensors are either too expensive (e.g., for short-wave infrared wavelengths) or unavailable. Existing SMC systems reconstruct static scenes using techniques from compressive sensing (CS). For videos, however, existing acquisition and recovery methods deliver poor quality. In this paper, we propose the CS multiscale video (CS-MUVI) sensing and recovery framework for high-quality video acquisition and recovery using SMCs. Our framework features novel sensing matrices that enable the efficient computation of a low-resolution video preview, while enabling high-resolution video recovery using convex optimization. To further improve the quality of the reconstructed videos, we extract optical-flow estimates from the low-resolution previews and impose them as constraints in the recovery procedure. We demonstrate the efficacy of our CS-MUVI framework for a host of synthetic and real measured SMC video data, and we show that high-quality videos can be recovered at roughly $60\\times$ compression.<\/jats:p>","DOI":"10.1137\/140983124","type":"journal-article","created":{"date-parts":[[2015,7,23]],"date-time":"2015-07-23T11:12:37Z","timestamp":1437649957000},"page":"1489-1518","source":"Crossref","is-referenced-by-count":41,"title":["Video Compressive Sensing for Spatial Multiplexing Cameras Using Motion-Flow Models"],"prefix":"10.1137","volume":"8","author":[{"given":"Aswin C.","family":"Sankaranarayanan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lina","family":"Xu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christoph","family":"Studer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yun","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kevin F.","family":"Kelly","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard G.","family":"Baraniuk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2015,7,23]]},"reference":[{"key":"atypb1","first-page":"301","author":"Ben-Or M.","year":"1988","journal-title":"New York"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1016\/j.crma.2008.03.014"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2005.862083"},{"key":"atypb4","first-page":"155","author":"Cevher V.","year":"2008","journal-title":"France"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1023\/B:JMIV.0000011325.36760.1e"},{"key":"atypb6","unstructured":"H. Chen, M. S. Asif, A. C. Sankaranarayanan, and A. Veeraraghavan,\n                      FPA-CS: Focal plane array-based compressive imaging in short-wave infrared\n                      , in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, 2015."},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2006.871582"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2007.914730"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1561\/2000000033"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1364\/AO.54.000C14"},{"key":"atypb11","unstructured":"T. Goldstein, L. Xu, K. F. Kelly, and R. G. Baraniuk,\n                      The STOne Transform: Multi-resolution Image Enhancement and Real-Time Compressive Video\n                      , preprint, arXiv:1311.3405, 2013."},{"key":"atypb12","first-page":"1","author":"Gu J.","year":"2010","journal-title":"Proceedings of the IEEE International Conference on Computational Photography (ICCP), Cambridge, MA"},{"key":"atypb13","unstructured":"Z. T. Harmany, R. F. Marcia, and R. M. Willett,\n                      Compressive Coded Aperture Keyed Exposure Imaging with Optical Flow Reconstruction\n                      , preprint, arXiv:1306.6281, 2013."},{"key":"atypb14","unstructured":"M. Harwit and N. J. Sloane,\n                      Hadamard Transform Optics\n                      , Academic Press, New York, 1979."},{"key":"atypb15","first-page":"287","author":"Hitomi Y.","year":"2011","journal-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain"},{"key":"atypb16","first-page":"1","author":"Holloway J.","year":"2012","journal-title":"Proceedings of the IEEE International Conference on Computational Photography (ICCP), Seattle, WA"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(81)90024-2"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1145\/103085.103090"},{"key":"atypb19","unstructured":"C. Liu,\n                      Beyond Pixels: Exploring New Representations and Applications for Motion Analysis\n                      , Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA, 2009."},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1364\/OE.21.010526"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1364\/AO.53.008060"},{"key":"atypb22","first-page":"183","author":"Mun S.","year":"2011","journal-title":"Proceedings of the IEEE Conference on Data Compression, Snowbird, UT"},{"key":"atypb23","first-page":"830","author":"Narasimhan S. G.","year":"2008","journal-title":"Berlin"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1137\/040605412"},{"key":"atypb25","first-page":"197","author":"Park J. Y.","year":"2009","journal-title":"Proceedings of the IEEE Picture Coding Symposium, Chicago"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1117\/1.JEI.22.2.021001"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141957"},{"key":"atypb28","first-page":"329","author":"Reddy D.","year":"2011","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO"},{"key":"atypb29","doi-asserted-by":"crossref","unstructured":"I. E. Richardson,\n                      H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia\n                      , John Wiley and Sons, New York, 2004.","DOI":"10.1002\/0470869615"},{"key":"atypb30","first-page":"53","author":"Rubinstein M.","year":"2012","journal-title":"UK"},{"key":"atypb31","first-page":"1","author":"Sankaranarayanan A. C.","year":"2012","journal-title":"Proceedings of the IEEE International Conference on Computational Photography (ICCP), Seattle, WA"},{"key":"atypb32","first-page":"129","author":"Sankaranarayanan A. C.","year":"2010","journal-title":"Berlin"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1137\/120863307"},{"key":"atypb34","doi-asserted-by":"crossref","unstructured":"N. Vaswani,\n                      Kalman filtered compressed sensing\n                      , in Proceedings of the 15th IEEE Conference on Image Processing (ICIP), San Diego, CA, 2008, pp. 893-896.","DOI":"10.1109\/ICIP.2008.4711899"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2010.2051150"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.87"},{"key":"atypb37","first-page":"711","author":"Wakin M. B.","year":"2006","journal-title":"China"},{"key":"atypb38","doi-asserted-by":"crossref","unstructured":"J. Wang, M. Gupta, and A. C. Sankaranarayanan,\n                      LiSens-A scalable architecture for video compressive sensing\n                      , in Proceedings of the IEEE Conference on Computational Photography (ICCP), Houston, TX, 2015.","DOI":"10.1109\/ICCPHOT.2015.7168369"},{"key":"atypb39","first-page":"1089","author":"Waters A. E.","year":"2011","journal-title":"Spain"},{"key":"atypb40","first-page":"W2C","author":"Xu L.","year":"2013","journal-title":"VA"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2012.2192127"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2344294"}],"container-title":["SIAM Journal on Imaging Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/140983124","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T13:20:56Z","timestamp":1787318456000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/140983124"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,1]]},"references-count":42,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2015,1]]}},"alternative-id":["10.1137\/140983124"],"URL":"https:\/\/doi.org\/10.1137\/140983124","relation":{},"ISSN":["1936-4954"],"issn-type":[{"value":"1936-4954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,1]]}}}