{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T16:14:37Z","timestamp":1774368877773,"version":"3.50.1"},"reference-count":54,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,6,24]],"date-time":"2020-06-24T00:00:00Z","timestamp":1592956800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Institute for Information and Communications Technology Promotion (IITP)","award":["No. 2016-0-00406, SIAT CCTV Cloud Platform"],"award-info":[{"award-number":["No. 2016-0-00406, SIAT CCTV Cloud Platform"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the recent past, the number of surveillance cameras placed in the public has increased significantly, and an enormous amount of visual data is produced at an alarming rate. Resultantly, there is a demand for a distributed system for video analytics. However, a majority of existing research on video analytics focuses on improving video content management and rely on a traditional client\/server framework. In this paper, we develop a scalable and flexible framework called TORNADO on top of general-purpose big data technologies for intelligent video big data analytics in the cloud. The proposed framework acquires video streams from device-independent data-sources utilizing distributed streams and file management systems. High-level abstractions are provided to allow the researcher to develop and deploy video analytics algorithms and services in the cloud under the as-a-service paradigm. Furthermore, a unified IR Middleware has been proposed to orchestrate the intermediate results being generated during video big data analytics in the cloud. We report results demonstrating the performance of the proposed framework and the viability of its usage in terms of better scalability, less fault-tolerance, and better performance.<\/jats:p>","DOI":"10.3390\/s20123581","type":"journal-article","created":{"date-parts":[[2020,6,24]],"date-time":"2020-06-24T10:54:59Z","timestamp":1592996099000},"page":"3581","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["TORNADO: Intermediate Results Orchestration Based Service-Oriented Data Curation Framework for Intelligent Video Big Data Analytics in the Cloud"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9222-2468","authenticated-orcid":false,"given":"Aftab","family":"Alam","sequence":"first","affiliation":[{"name":"Data and Knowledge Engineering Laboratory, Department of Computer Engineering, College of Electronics and Information, Kyung Hee University, Yongin-si, Gyeonggi-do 17104, Korea"}]},{"given":"Young-Koo","family":"Lee","sequence":"additional","affiliation":[{"name":"Data and Knowledge Engineering Laboratory, Department of Computer Engineering, College of Electronics and Information, Kyung Hee University, Yongin-si, Gyeonggi-do 17104, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,24]]},"reference":[{"key":"ref_1","first-page":"10","article-title":"Multimedia big data analytics: A survey","volume":"51","author":"Pouyanfar","year":"2018","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Olatunji, I.E., and Cheng, C.H. (2018, January 23\u201325). Dynamic Threshold for Resource Tracking in Observed Scenes. Proceedings of the 2018 9th International Conference on Information, Intelligence, Systems and Applications (IISA), Zakynthos, Greece.","DOI":"10.1109\/IISA.2018.8633691"},{"key":"ref_3","unstructured":"Corporation, I.D. (2020, February 07). The Growth in Connected IoT Devices. Available online: https:\/\/www.idc.com\/getdoc.jsp?containerId=prUS45213219."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Shvachko, K., Kuang, H., Radia, S., and Chansler, R. (2010, January 3\u20137). The Hadoop Distributed File System. Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), Incline Village, NV, USA.","DOI":"10.1109\/MSST.2010.5496972"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1145\/2934664","article-title":"Apache spark: A unified engine for big data processing","volume":"59","author":"Zaharia","year":"2016","journal-title":"Commun. ACM"},{"key":"ref_6","first-page":"145","article-title":"The NIST definition of cloud computing","volume":"800","author":"Mell","year":"2011","journal-title":"NIST Spec. Publ."},{"key":"ref_7","unstructured":"Zikopoulos, P., Deroos, D., Parasuraman, K., Deutsch, T., Giles, J., and Corrigan, D. (2012). Harness the Power of Big Data the IBM Big Data Platform, McGraw Hill Professional."},{"key":"ref_8","unstructured":"Amazon, E. (2020, June 23). Amazon Web Services. Available online: http:\/\/aws.amazon.com\/es\/ec2\/."},{"key":"ref_9","first-page":"94070K","article-title":"Hierarchical video surveillance architecture: A chassis for video big data analytics and exploration","volume":"Volume 9407","author":"Ajiboye","year":"2015","journal-title":"Video Surveillance and Transportation Imaging Applications 2015"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2637","DOI":"10.1109\/ACCESS.2015.2507788","article-title":"A distributed video management cloud platform using hadoop","volume":"3","author":"Liu","year":"2015","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.1007\/s00779-015-0879-3","article-title":"A video cloud platform combing online and offline cloud computing technologies","volume":"19","author":"Zhang","year":"2015","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Freitas, A., and Curry, E. (2016). Big data curation. New Horizons for a Data-Driven Economy, Springer.","DOI":"10.1007\/978-3-319-21569-3_6"},{"key":"ref_13","unstructured":"CheckVideo (2020, June 07). CheckVideo, LLC Develops Video Security Systems. Available online: https:\/\/www.checkvideo.com\/."},{"key":"ref_14","unstructured":"IntelliVision (2020, February 07). IntelliVision LLC IntelliVision Now Inside 4 Million Smart Cameras\u2014Leader in AI-Based Video Analytics Software. Available online: https:\/\/www.intelli-vision.com\/news\/intellivision-now-inside-4-million-smart-cameras-leader-in-ai-based-video-analytics-software\/."},{"key":"ref_15","unstructured":"Google Inc. (2020, April 13). Video AI. Available online: https:\/\/cloud.google.com\/video-intelligence\/."},{"key":"ref_16","first-page":"50","article-title":"The NIST definition of cloud computing","volume":"53","author":"Mell","year":"2009","journal-title":"Natl. Inst. Stand. Technol."},{"key":"ref_17","unstructured":"Marr, B. (2020, February 07). The Emergence of the Algorithm as a Service Model. Available online: https:\/\/medium.com\/@jrodthoughts\/the-emergence-of-the-algorithm-as-a-service-model-960755725592."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1016\/j.dss.2012.05.044","article-title":"Data, Information and Analytics as Services","volume":"55","author":"Delen","year":"2013","journal-title":"Decis. Support Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1108\/10610420510616313","article-title":"Online consumer communities and their value to new product developers","volume":"14","author":"Pitta","year":"2005","journal-title":"J. Prod. Brand Manag."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"135257","DOI":"10.1155\/2014\/135257","article-title":"Framework for a cloud-based multimedia surveillance system","volume":"10","author":"Hossain","year":"2014","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2227","DOI":"10.1109\/ACCESS.2015.2497278","article-title":"A Deep Awareness Framework for Pervasive Video Cloud","volume":"3","author":"Zhang","year":"2015","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/MS.2016.31","article-title":"A deep-intelligence framework for online video processing","volume":"33","author":"Zhang","year":"2016","journal-title":"IEEE Softw."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Pereira, R., Azambuja, M., Breitman, K., and Endler, M. (2010, January 5\u201310). An architecture for distributed high performance video processing in the cloud. Proceedings of the 2010 IEEE 3rd International Conference on Cloud Computing, Miami, FL, USA.","DOI":"10.1109\/CLOUD.2010.73"},{"key":"ref_24","unstructured":"Liu, C., Fan, K., Yang, Z., and Xiu, J. (2014, January 27\u201329). A distributed video share system based on Hadoop. Proceedings of the 2014 IEEE 3rd International Conference on Cloud Computing and Intelligence Systems, Shenzhen, China."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lin, C.F., Yuan, S.M., Leu, M.C., and Tsai, C.T. (2012, January 4\u20137). A framework for scalable cloud video recorder system in surveillance environment. Proceedings of the 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing, Fukuoka, Japan.","DOI":"10.1109\/UIC-ATC.2012.72"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1109\/MC.2017.3641638","article-title":"Real-time video analytics: The killer app for edge computing","volume":"50","author":"Ananthanarayanan","year":"2017","journal-title":"Computer"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ananthanarayanan, G., Bahl, V., Cox, L., Crown, A., Nogbahi, S., and Shu, Y. (2019, January 18\u201320). Demo: Video Analytics-Killer App for Edge Computing. Proceedings of the ACM MobiSys, Seoul, Korea.","DOI":"10.1145\/3307334.3328589"},{"key":"ref_28","unstructured":"Eagle Eye, C. (2020, February 07). Eagle Eye Cloud Based Video Surveillance Solutions for Every Circumstance. Available online: https:\/\/www.een.com\/."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Uddin, M.A., Alam, A., Tu, N.A., Islam, M.S., and Lee, Y.K. (2019). SIAT: A distributed video analytics framework for intelligent video surveillance. Symmetry, 11.","DOI":"10.3390\/sym11070911"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Khan, M.N., Alam, A., and Lee, Y.K. (2020, January 19\u201322). FALKON: Large-Scale Content-Based Video Retrieval Utilizing Deep-Features and Distributed In-memory Computing. Proceedings of the 2020 IEEE International Conference on Big Data and Smart Computing (BigComp), Busan, Korea.","DOI":"10.1109\/BigComp48618.2020.0-102"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Alam, A., Khan, M.N., Khan, J., and Lee, Y.K. (2020, January 19\u201322). IntelliBVR-Intelligent Large-Scale Video Retrieval for Objects and Events Utilizing Distributed Deep-Learning and Semantic Approaches. Proceedings of the 2020 IEEE International Conference on Big Data and Smart Computing (BigComp), Busan, Korea.","DOI":"10.1109\/BigComp48618.2020.0-103"},{"key":"ref_32","unstructured":"Kreps, J., Narkhede, N., and Rao, J. (2011). Kafka: A distributed messaging system for log processing. Proceedings of the NetDB, Association for Computing Machinery."},{"key":"ref_33","unstructured":"Gamma, E. (1995). Design Patterns: Elements of Reusable Object-Oriented Software, Pearson Education India."},{"key":"ref_34","unstructured":"Salesforce, I. (2020, June 07). Apache Phoenix: We Put the SQL Back in NoSQL. Available online: http:\/\/phoenix.apache.org\/presentations\/HPTS.pdf."},{"key":"ref_35","unstructured":"Rivest, R. (2020, June 07). Available online: http:\/\/altronic-srl.com.ar\/md5%20algoritmo.pdf."},{"key":"ref_36","first-page":"1","article-title":"Pkcs# 5: Password-based cryptography specification version 2.1","volume":"8018","author":"Moriarty","year":"2017","journal-title":"Internet Eng. Task Force (IETF)"},{"key":"ref_37","unstructured":"George, L. (2011). HBase: The Definitive Guide: Random Access to Your Planet-Size Data, O\u2019Reilly Media, Inc."},{"key":"ref_38","unstructured":"Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J., McCauley, M., Franklin, M.J., Shenker, S., and Stoica, I. (2012). Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation, USENIX Association."},{"key":"ref_39","first-page":"27","article-title":"Extensible markup language (XML)","volume":"2","author":"Bray","year":"1997","journal-title":"World Wide Web J."},{"key":"ref_40","first-page":"1","article-title":"The Application\/Json Media Type for Javascript Object Notation (json)","volume":"4627","author":"Crockford","year":"2006","journal-title":"RFC"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Gong, L., and Schemers, R. (1998). Signing, Sealing, and Guarding JavaTM Objects. Mobile Agents and Security, Springer.","DOI":"10.1007\/3-540-68671-1_11"},{"key":"ref_42","unstructured":"Marz, N., and Warren, J. (2015). Big Data: Principles and Best Practices of Scalable Real-Time Data Systems, Manning Publications Co."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1654","DOI":"10.14778\/2824032.2824063","article-title":"Building a replicated logging system with Apache Kafka","volume":"8","author":"Wang","year":"2015","journal-title":"Proc. VLDB Endow."},{"key":"ref_44","unstructured":"Hortonworks (2020, February 07). Hortonworks Data Platform. Available online: https:\/\/docs.hortonworks.com\/HDPDocuments\/HDP3\/HDP-3.1.0\/index.html."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wadkar, S., and Siddalingaiah, M. (2014). Apache ambari. Pro Apache Hadoop, Springer.","DOI":"10.1007\/978-1-4302-4864-4"},{"key":"ref_46","unstructured":"Haloi, S. (2015). Apache ZooKeeper Essentials, Packt Publishing Ltd."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Vavilapalli, V.K., Murthy, A.C., Douglas, C., Agarwal, S., Konar, M., Evans, R., Graves, T., Lowe, J., Shah, H., and Seth, S. (2013). Apache hadoop yarn: Yet another resource negotiator. Proceedings of the 4th annual Symposium on Cloud Computing, ACM.","DOI":"10.1145\/2523616.2523633"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"21157","DOI":"10.1109\/ACCESS.2017.2759225","article-title":"Human action recognition using adaptive local motion descriptor in spark","volume":"5","author":"Uddin","year":"2017","journal-title":"IEEE Access"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Yang, M.J., Tham, J.Y., Wu, D., and Goh, K.H. (2009, January 25\u201327). Cost effective IP camera for video surveillance. Proceedings of the 2009 4th IEEE Conference on Industrial Electronics and Applications, Xi\u2019an, China.","DOI":"10.1109\/ICIEA.2009.5138638"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MMUL.2012.24","article-title":"Microsoft kinect sensor and its effect","volume":"19","author":"Zhang","year":"2012","journal-title":"IEEE Multimed."},{"key":"ref_51","first-page":"1","article-title":"Real Time Streaming Protocol (RTSP)","volume":"2326","author":"Schulzrinne","year":"1998","journal-title":"RFC"},{"key":"ref_52","unstructured":"Apple Support (2020, June 23). Use 4K and 60 Frames per Second Video in iMovie. 24 April 2020. Available online: https:\/\/support.apple.com\/en-us\/HT205345."},{"key":"ref_53","unstructured":"Julia, K., and Craig Casey, J.H. (2020, June 23). Media Analytics on the Media Services Platform. Available online: https:\/\/docs.microsoft.com\/en-gb\/azure\/media-services\/previous\/media-services-analytics-overview."},{"key":"ref_54","unstructured":"(2020, June 23). Citilog. Available online: http:\/\/www.citilog.com\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/12\/3581\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:42:30Z","timestamp":1760175750000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/12\/3581"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,24]]},"references-count":54,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["s20123581"],"URL":"https:\/\/doi.org\/10.3390\/s20123581","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,24]]}}}