{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T00:12:24Z","timestamp":1772064744704,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2017,2,12]],"date-time":"2017-02-12T00:00:00Z","timestamp":1486857600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents the first attempt at combining Cloud with Graphic Processing Units (GPUs) in a complementary manner within the framework of a real-time high performance computation architecture for the application of detecting and tracking multiple moving targets based on Wide Area Motion Imagery (WAMI). More specifically, the GPU and Cloud Moving Target Tracking (GC-MTT) system applied a front-end web based server to perform the interaction with Hadoop and highly parallelized computation functions based on the Compute Unified Device Architecture (CUDA\u00a9). The introduced multiple moving target detection and tracking method can be extended to other applications such as pedestrian tracking, group tracking, and Patterns of Life (PoL) analysis. The cloud and GPUs based computing provides an efficient real-time target recognition and tracking approach as compared to methods when the work flow is applied using only central processing units (CPUs). The simultaneous tracking and recognition results demonstrate that a GC-MTT based approach provides drastically improved tracking with low frame rates over realistic conditions.<\/jats:p>","DOI":"10.3390\/s17020356","type":"journal-article","created":{"date-parts":[[2017,2,15]],"date-time":"2017-02-15T10:09:07Z","timestamp":1487153347000},"page":"356","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A Real-Time High Performance Computation Architecture for Multiple Moving Target Tracking Based on Wide-Area Motion Imagery via Cloud and Graphic Processing Units"],"prefix":"10.3390","volume":"17","author":[{"given":"Kui","family":"Liu","sequence":"first","affiliation":[{"name":"Intelligent Fusion Technology, Inc., Germantown, MD 20876, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sixiao","family":"Wei","sequence":"additional","affiliation":[{"name":"Intelligent Fusion Technology, Inc., Germantown, MD 20876, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhijiang","family":"Chen","sequence":"additional","affiliation":[{"name":"Intelligent Fusion Technology, Inc., Germantown, MD 20876, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bin","family":"Jia","sequence":"additional","affiliation":[{"name":"Intelligent Fusion Technology, Inc., Germantown, MD 20876, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Genshe","family":"Chen","sequence":"additional","affiliation":[{"name":"Intelligent Fusion Technology, Inc., Germantown, MD 20876, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haibin","family":"Ling","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Sciences, Temple University, Philadelphia, PA 19122, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carolyn","family":"Sheaff","sequence":"additional","affiliation":[{"name":"Air Force Research Laboratory, Information Directorate, Rome, NY 13441, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6894-6108","authenticated-orcid":false,"given":"Erik","family":"Blasch","sequence":"additional","affiliation":[{"name":"Air Force Research Laboratory, Information Directorate, Rome, NY 13441, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,2,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Mendoza-Schrock, O., Patrick, J.A., and Blasch, E. (2009, January 21\u201323). Video Image Registration Evaluation for a Layered Sensing Environment. Proceedings of the IEEE 2009 National, Aerospace & Electronics Conference (NAECON), Fairborn, OH, USA.","DOI":"10.1109\/NAECON.2009.5426624"},{"key":"ref_2","unstructured":"Columbus Large Image Format (CLIF) Dataset. Available online: https:\/\/www.sdms.afrl.af.mil\/index.php?collection=clif2006."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Liu, K., Liu, B., Blasch, E., Shen, D., Wang, Z., Ling, H., and Chen, G. (2015, January 7\u201312). A Cloud Infrastructure for Target Detection and Tracking Using Audio and Video Fusion. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301299"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yi, M., Yang, F., Blasch, E., Sheaff, C., Liu, K., Chen, G., and Ling, H. (2016, January 17). Vehicle classification in WAMI imagery using deep network. Proceedings of the SPIE 9838, Sensors and Systems for Space Applications, Baltimore, MD, USA.","DOI":"10.1117\/12.2224916"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gao, J., Ling, H., Blasch, E., Pham, K., Wang, Z., and Chen, G. (2013, January 29). Pattern of Life from WAMI Objects Tracking based on Context-Aware Tracking and Information Network Models. Proceedings of the SPIE 8745, Signal Processing, Sensor Fusion, and Target Recognition, Baltimore, MD, USA.","DOI":"10.1117\/12.2015612"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gao, J., Ling, H., and Blasch, E. (2013). Context-aware tracking with wide-area motion imagery. SPIE Newsroom.","DOI":"10.1117\/2.1201305.004888"},{"key":"ref_7","unstructured":"Shi, X., Ling, H., Blasch, E., and Hu, W. (2012, January 11\u201315). Context-driven moving vehicle detection in wide area motion imagery. Proceedings of the International Conference on Pattern Recognition (ICPR), Tsukuba, Japan."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jia, B., Liu, K., Pham, K., Blasch, E., and Chen, G. (2016, January 13). Accelerated space object tracking via graphic processing unit. Proceedings of the SPIE 9838, Sensors and Systems for Space Applications, Baltimore, MD, USA.","DOI":"10.1117\/12.2224966"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, K., Jia, B., Chen, G., Pham, K., and Blasch, E. (2015, January 13\u201317). A real-time orbit satellites uncertainty propagation and visualization system using graphics computing unit and multi-threading processing. Proceedings of the IEEE\/AIAA Digital Avionics Systems Conference (DASC), Prague, Czech.","DOI":"10.1109\/DASC.2015.7311467"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"19843","DOI":"10.3390\/s141019843","article-title":"Automatic Association of Chats and Video Tracks for Activity Learning and Recognition in Aerial Video Surveillance","volume":"14","author":"Hammoud","year":"2014","journal-title":"Sensors"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ma, Y., Wu, X., Yu, G., Xu, Y., and Wang, Y. (2016). Pedestrian Detection and Tracking from Low-Resolution Unmanned Aerial Vehicle Thermal Imagery. Sensors, 16.","DOI":"10.3390\/s16040446"},{"key":"ref_12","unstructured":"Air Force Research Laboratory, WPAFB2009 Dataset. Available online: https:\/\/www.sdms.afrl.af.mil\/index.php?collection=wpafb2009."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Priddy, K.L., and Uppenkamp, D.A. (2012, January 3). Automated recognition challenges for wide-area motion imagery. Proceedings of the SPIE, Baltimore, MD, USA.","DOI":"10.1117\/12.924597"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1990","DOI":"10.3390\/s120201990","article-title":"Robust Kernel-Based Tracking with Multiple Subtemplates in Vision Guidance System","volume":"12","author":"Yan","year":"2012","journal-title":"Sensors"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"9380","DOI":"10.3390\/s140609380","article-title":"Object Tracking Using Adaptive Covariance Descriptor and Clustering-Based Model Updating for Visual Surveillance","volume":"14","author":"Qin","year":"2014","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yang, T., Wang, X., Yao, B., Li, J., Zhang, Y., He, Z., and Duan, W. (2016). Small Moving Vehicle Detection in a Satellite Video of an Urban Area. Sensors, 16.","DOI":"10.3390\/s16091528"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Jung, J., Yoon, I., and Paik, J. (2016). Object Occlusion Detection Using Automatic Camera Calibration for a Wide-Area Video Surveillance System. Sensors, 16.","DOI":"10.3390\/s16070982"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Santhaseelan, V., and Asari, V.K. (2013, January 23\u201328). Tracking in wide area motion imagery using phase vector fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Portland, OR, USA.","DOI":"10.1109\/CVPRW.2013.123"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Eekeren, A.V., Huis, J.R.V., Eendebak, P.T., and Baan, J. (2015, January 13). Vehicle tracking in wide area motion imagery from an airborne platform. Proceedings of the SPIE 9648, Electro-Optical and Infrared Systems: Technology and Applications XII; and Quantum Information Science and Technology, Toulouse, France.","DOI":"10.1117\/12.2196392"},{"key":"ref_20","unstructured":"Pelapur, R., Candemir, S., Bunyak, F., Poostchi, M., Seetharaman, G., and Palaniappan, K. (2012, January 9\u201312). Persistent target tracking using likelihood fusion in wide-area and full motion video sequences. Proceedings of the 2012 15th International Conference on Information Fusion (FUSION), Singapore."},{"key":"ref_21","unstructured":"NVIDIA CUDA C Programming Guide. Available online: http:\/\/docs.nvidia.com\/cuda."},{"key":"ref_22","unstructured":"NVIDIA, How to Access Global Memory Efficiently in CUDA C\/C++ Kernels. Available online: http:\/\/docs.nvidia.com\/cuda."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Blasch, E., BiBona, P., Czajkowski, M., and Barry, K. (2014, January 24\u201327). Video Observations for Cloud Activity-Based Intelligence (VOCABI). Proceedings of the IEEE National Aerospace and Electronics (NAECON), Dayton, OH, USA.","DOI":"10.1109\/NAECON.2014.7045804"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Jia, B., Ling, H., Blasch, E., Sheaff, C., Chen, G., and Wang, Z. (2014, January 5\u20139). Aircraft ground monitoring with high performance computing multicore enabled video tracking. Proceedings of the IEEE\/AIAA 33rd Digital Avionics Systems Conference (DASC), Colorado Springs, CO, USA.","DOI":"10.1109\/DASC.2014.6979498"},{"key":"ref_25","first-page":"061505","article-title":"Fast Motion Detection from Airborne Videos Using Graphics Computing Unit","volume":"6","author":"Liu","year":"2011","journal-title":"J. Appl. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, K., Yang, H., Ma, B., and Du, Q. (2010, January 14\u201319). A joint optical flow and principal component analysis approach for motion detection. Proceedings of the 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), Dallas, TX, USA.","DOI":"10.1109\/ICASSP.2010.5495379"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, K., Du, Q., Yang, H., and Ma, B. (2010). Optical Flow and Principal Component Analysis-Based Motion Detection in Outdoor Videos. EURASIP J. Adv. Signal Process., 2010.","DOI":"10.1109\/ICASSP.2010.5495379"},{"key":"ref_28","unstructured":"NVIDIA, CUDA C Programming Best Practices Guide. Available online: http:\/\/docs.nvidia.com\/cuda."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Blasch, E. (2013, January 5\u201310). Enhanced Air Operations Using JView for an Air-Ground Fused Situation Awareness UDOP. Proceedings of the IEEE\/AIAA Digital Avionics Systems Conference (DASC), East Syracuse, NY, USA.","DOI":"10.1109\/DASC.2013.6719678"},{"key":"ref_30","unstructured":"NVIDIA, NVIDIA CUDA Compute Unified Device Architecture Programming Guide. Available online: http:\/\/docs.nvidia.com\/cuda."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shi, X., Ling, H., Xing, J., and Hu, W. (2013, January 23\u201328). Multi-target tracking by rank-1 tensor approximation. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.309"},{"key":"ref_32","unstructured":"Blasch, E.P., Bosse, E., and Lambert, D.A. (2012). High-Level Information Fusion Management and Systems Design, Artech House."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Snidaro, L., Garcia-Herrero, J., Llinas, J., and Blasch, E. (2016). Context-Enhanced Information Fusion: Boosting Real-World Performance with Domain Knowledge, Springer.","DOI":"10.1007\/978-3-319-28971-7"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"SURF: Speeded Up Robust Features","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst. (CVIU)"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1109\/TVT.2015.2400430","article-title":"MIMO Cognitive Radio User Selection With and Without Primary Channel State Information","volume":"65","author":"Xiong","year":"2016","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Li, L., Wang, G., Chen, G., Chen, H.M., Blasch, E., and Pham, K. (2016, January 5\u201312). Robust Airborne Image Transmission Using Joint Source-Channel Coding with UEP. Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2016.7500653"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Campmany, V., Silva, S., Espinosa, A., Moure, J.C., Vazquez, D., and Lopez, A.M. (2016, January 6\u20138). GPU-based Pedestrian Detection for Autonomous Driving. Proceedings of the International Conference on Computational Science (ICCS), San Diego, CA, USA.","DOI":"10.1016\/j.procs.2016.05.455"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/2\/356\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:28:05Z","timestamp":1760207285000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/2\/356"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,2,12]]},"references-count":38,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2017,2]]}},"alternative-id":["s17020356"],"URL":"https:\/\/doi.org\/10.3390\/s17020356","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,2,12]]}}}