{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T11:58:07Z","timestamp":1773835087460,"version":"3.50.1"},"reference-count":28,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2019,8,26]],"date-time":"2019-08-26T00:00:00Z","timestamp":1566777600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"US Air Force","award":["FA8651-17-C-0017"],"award-info":[{"award-number":["FA8651-17-C-0017"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Compressive sensing has seen many applications in recent years. One type of compressive sensing device is the Pixel-wise Code Exposure (PCE) camera, which has low power consumption and individual control of pixel exposure time. In order to use PCE cameras for practical applications, a time consuming and lossy process is needed to reconstruct the original frames. In this paper, we present a deep learning approach that directly performs target tracking and classification in the compressive measurement domain without any frame reconstruction. In particular, we propose to apply You Only Look Once (YOLO) to detect and track targets in the frames and we propose to apply Residual Network (ResNet) for classification. Extensive simulations using low quality optical and mid-wave infrared (MWIR) videos in the SENSIAC database demonstrated the efficacy of our proposed approach.<\/jats:p>","DOI":"10.3390\/s19173702","type":"journal-article","created":{"date-parts":[[2019,8,26]],"date-time":"2019-08-26T10:54:53Z","timestamp":1566816893000},"page":"3702","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Deep Learning-Based Target Tracking and Classification for Low Quality Videos Using Coded Aperture Cameras"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4341-0769","authenticated-orcid":false,"given":"Chiman","family":"Kwan","sequence":"first","affiliation":[{"name":"Applied Research LLC, Rockville, MD 20850, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bryan","family":"Chou","sequence":"additional","affiliation":[{"name":"Applied Research LLC, Rockville, MD 20850, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Yang","sequence":"additional","affiliation":[{"name":"Google, Inc., Mountain View, CA 94043, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Akshay","family":"Rangamani","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Trac","family":"Tran","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jack","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02138, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ralph","family":"Etienne-Cummings","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/MSP.2007.914731","article-title":"An introduction to compressive sampling","volume":"25","author":"Candes","year":"2008","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"9013","DOI":"10.1364\/OE.24.009013","article-title":"Compact all-CMOS spatio-temporal compressive sensing video camera with pixel-wise coded exposure","volume":"24","author":"Zhang","year":"2016","journal-title":"Opt. Express"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1137\/090777761","article-title":"Alternating direction algorithms for l1-problems in compressive sensing","volume":"33","author":"Yang","year":"2011","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2231","DOI":"10.1109\/TIT.2004.834793","article-title":"Greed is good: Algorithmic results for sparse approximation","volume":"50","author":"Tropp","year":"2004","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dao, M., Kwan, C., Koperski, K., and Marchisio, G. (2017, January 19\u201321). A joint sparsity approach to tunnel activity monitoring using high resolution satellite images. Proceedings of the IEEE Ubiquitous Computing, Electronics & Mobile Communication Conference, New York, NY, USA.","DOI":"10.1109\/UEMCON.2017.8249061"},{"key":"ref_6","first-page":"106490E","article-title":"ATR performance improvement using images with corrupted or missing pixels","volume":"Volume 106490","author":"Zhou","year":"2018","journal-title":"Pattern Recognition and Tracking XXIX"},{"key":"ref_7","unstructured":"Applied Research LLC (2016). Phase 1 Final Report, Applied Research LLC."},{"key":"ref_8","unstructured":"Yang, M.H., Zhang, K., and Zhang, L. (2012). Real-Time compressive tracking. European Conference on Computer Vision, Springer."},{"key":"ref_9","unstructured":"Redmon, J., and Farhadi, A. (2018, April 08). YOLOv3: An Incremental Improvement. Available online: https:\/\/arxiv.org\/abs\/1804.02767."},{"key":"ref_10","first-page":"1","article-title":"Target tracking and classification directly using compressive sensing camera for SWIR videos","volume":"6","author":"Kwan","year":"2019","journal-title":"J. Signal Image Video Process."},{"key":"ref_11","first-page":"73","article-title":"Target tracking and classification using compressive measurements of MWIR and LWIR coded aperture cameras","volume":"10","author":"Kwan","year":"2019","journal-title":"J. Signal Inf. Process."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kwan, C., Chou, B., Yang, J., and Tran, T. (2019). Compressive object tracking and classification using deep learning for infrared videos. Pattern Recognition and Tracking XXX (Conference SI120), International Society for Optics and Photonics.","DOI":"10.1117\/12.2518490"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kwan, C., Chou, B., Yang, J., and Tran, T. (2019). Target tracking and classification directly in compressive measurement domain for low quality videos. Pattern Recognition and Tracking XXX (Conference SI120), International Society for Optics and Photonics.","DOI":"10.1117\/12.2518496"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kwan, C., Chou, B., Echavarren, A., Budavari, B., Li, J., and Tran, T. (2018, January 8\u201310). Compressive vehicle tracking using deep learning. Proceedings of the IEEE Ubiquitous Computing, Electronics & Mobile Communication Conference, New York, NY, USA.","DOI":"10.1109\/UEMCON.2018.8796778"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., and Torr, P.H. (2016, January 27\u201330). Staple: Complementary learners for real-time tracking. Proceedings of the Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.156"},{"key":"ref_17","first-page":"2246","article-title":"Adaptive background mixture models for real-time tracking, computer vision and pattern recognition","volume":"2","author":"Stauffer","year":"1999","journal-title":"IEEE Comput. Soc. Conf."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1109\/TPAMI.2015.2469288","article-title":"Reconstruction-free action inference from compressive imagers","volume":"38","author":"Kulkarni","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lohit, S., Kulkarni, K., and Turaga, P.K. (2016, January 25\u201328). Direct inference on compressive measurements using convolutional neural networks. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7532691"},{"key":"ref_20","unstructured":"Adler, A., Elad, M., and Zibulevsky, M. (2016). Compressed Learning: A Deep Neural Network Approach. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Xu, Y., and Kelly, K.F. (2019). Compressed Domain Image Classification Using a Multi-Rate Neural Network. arXiv.","DOI":"10.1109\/ACCESS.2020.3041807"},{"key":"ref_22","unstructured":"Kulkarni, K., and Turaga, P.K. (2016). Fast Integral Image Estimation at 1% Measurement Rate. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, Z.W., Vineet, V., Pittaluga, F., Sinha, S.N., Cossairt, O., and Kang, S.B. (2019, January 16\u201320). Privacy-preserving action recognition using coded aperture videos. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00007"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Vargas, H., Fonseca, Y., and Arguello, H. (2018, January 3\u20137). Object detection on compressive measurements using correlation filters and sparse representation. Proceedings of the 2018 26th European Signal Processing Conference (EUSIPCO), Italy, Rome.","DOI":"10.23919\/EUSIPCO.2018.8553312"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"De\u011ferli, A., Aslan, S., Yamac, M., Sankur, B., and Gabbouj, M. (2018, January 26\u201328). Compressively sensed image recognition. Proceedings of the 7th European Workshop on Visual Information Processing (EUVIP), Tampere, Finland.","DOI":"10.1109\/EUVIP.2018.8611657"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.imavis.2019.03.007","article-title":"Online reconstruction-free single-pixel image classification","volume":"86","author":"Traver","year":"2019","journal-title":"Image Vis. Comput."},{"key":"ref_27","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, Neural Information Processing Systems Foundation, Inc."},{"key":"ref_28","unstructured":"(2019, August 23). MOT Challenge. Available online: https:\/\/motchallenge.net\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/17\/3702\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:14:01Z","timestamp":1760188441000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/17\/3702"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,26]]},"references-count":28,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2019,9]]}},"alternative-id":["s19173702"],"URL":"https:\/\/doi.org\/10.3390\/s19173702","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,26]]}}}