{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T17:14:39Z","timestamp":1767374079048,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T00:00:00Z","timestamp":1562889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"This work was supported by Institute for Information and communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No. 2016-0-00406, SIAT CCTV Cloud Platform).","award":["No. 2016-0-00406, SIAT CCTV Cloud Platform"],"award-info":[{"award-number":["No. 2016-0-00406, SIAT CCTV Cloud Platform"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>In recent years, the amount of intelligent CCTV cameras installed in public places for surveillance has increased enormously and as a result, a large amount of video data is produced every moment. Due to this situation, there is an increasing request for the distributed processing of large-scale video data. In an intelligent video analytics platform, a submitted unstructured video undergoes through several multidisciplinary algorithms with the aim of extracting insights and making them searchable and understandable for both human and machine. Video analytics have applications ranging from surveillance to video content management. In this context, various industrial and scholarly solutions exist. However, most of the existing solutions rely on a traditional client\/server framework to perform face and object recognition while lacking the support for more complex application scenarios. Furthermore, these frameworks are rarely handled in a scalable manner using distributed computing. Besides, existing works do not provide any support for low-level distributed video processing APIs (Application Programming Interfaces). They also failed to address a complete service-oriented ecosystem to meet the growing demands of consumers, researchers and developers. In order to overcome these issues, in this paper, we propose a distributed video analytics framework for intelligent video surveillance known as SIAT. The proposed framework is able to process both the real-time video streams and batch video analytics. Each real-time stream also corresponds to batch processing data. Hence, this work correlates with the symmetry concept. Furthermore, we introduce a distributed video processing library on top of Spark. SIAT exploits state-of-the-art distributed computing technologies with the aim to ensure scalability, effectiveness and fault-tolerance. Lastly, we implant and evaluate our proposed framework with the goal to authenticate our claims.<\/jats:p>","DOI":"10.3390\/sym11070911","type":"journal-article","created":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T11:49:38Z","timestamp":1562932178000},"page":"911","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["SIAT: A Distributed Video Analytics Framework for Intelligent Video Surveillance"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7718-5627","authenticated-orcid":false,"given":"Md Azher","family":"Uddin","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Kyung Hee University Global Campus, Yongin 17104, Korea"}]},{"given":"Aftab","family":"Alam","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Kyung Hee University Global Campus, Yongin 17104, Korea"}]},{"given":"Nguyen Anh","family":"Tu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Kyung Hee University Global Campus, Yongin 17104, Korea"}]},{"given":"Md Siyamul","family":"Islam","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Kyung Hee University Global Campus, Yongin 17104, Korea"}]},{"given":"Young-Koo","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Kyung Hee University Global Campus, Yongin 17104, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,12]]},"reference":[{"key":"ref_1","unstructured":"(2018, November 05). 37 Mind Blowing Youtube Facts, Figures and Statistics. Available online: https:\/\/merchdope.com\/youtube-stats\/."},{"key":"ref_2","unstructured":"(2018, November 05). Video Streaming Now Makes Up 58% of Internet Usage Worldwide. Available online: http:\/\/digg.com\/2018\/streaming-video-worldwide."},{"key":"ref_3","unstructured":"(2018, November 05). IntelliVision Now Inside 4 Million Smart Cameras\u2014Leader in AI-Based Video Analytics Software. Available online: https:\/\/www.intelli-vision.com\/news\/intellivision-now-inside-4-million-smart-cameras-leader-in-ai-based-video-analytics-software\/."},{"key":"ref_4","unstructured":"(2018, November 05). Video Analytics Market - Global Forecast to 2023. Available online: https:\/\/www.researchandmarkets.com\/reports\/4530884\/videoanalytics-market-by-type-software-and."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"135257","DOI":"10.1155\/2014\/135257","article-title":"Framework for a Cloud-Based Multimedia Surveillance System","volume":"10","author":"Hossain","year":"2014","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.cviu.2015.10.014","article-title":"A scalable and flexible framework for smart video surveillance","volume":"144","author":"Nazare","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.1007\/s00779-015-0879-3","article-title":"A video cloud platform combing online and offline cloud computing technologies","volume":"19","author":"Zhang","year":"2015","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Shvachko, K., Kuang, H., Radia, S., and Chansler, R. (2010, January 3\u20137). The hadoop distributed file system. Proceedings of the IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), Incline Village, NV, USA.","DOI":"10.1109\/MSST.2010.5496972"},{"key":"ref_9","unstructured":"Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J., McCauley, M., Franklin, M.J., Shenker, S., and Stoica, I. (2012, January 25\u201327). Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. Proceedings of the Networked Systems Design and Implementation (NSDI\u201912), San Jose, CA, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"21157","DOI":"10.1109\/ACCESS.2017.2759225","article-title":"Human action recognition using adaptive local motion descriptor in spark","volume":"5","author":"Uddin","year":"2017","journal-title":"IEEE Access"},{"key":"ref_11","unstructured":"Kreps, J., Narkhede, N., and Rao, J. (2011, January 12\u201316). Kafka: A distributed messaging system for log processing. Proceedings of the NetDB, Athens, Greece."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zaharia, M., Das, T., Li, H., Hunter, T., Shenker, S., and Stoica, I. (2013, January 3\u20136). Discretized Streams: Fault-Tolerant Streaming Computation at Scale. Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, Farminton, PA, USA.","DOI":"10.1145\/2517349.2522737"},{"key":"ref_13","unstructured":"Hamilton, M., Raghunathan, S., Annavajhala, A., Kirsanov, D., Leon, E.d., Barzilay, E., Matiach, I., Davison, J., Busch, M., and Oprescu, M. (2017, January 24\u201325). Flexible and scalable deep learning with MMLSpark. Proceedings of the 4th International Conference on Predictive Applications and APIs, Boston, MA, USA."},{"key":"ref_14","unstructured":"Huang, Q., Ang, P., Knowles, P., Nykiel, T., Tverdokhlib, I., Yajurvedi, A., Dapolito, P., Yan, X., Bykov, M., and Liang, C. (2017, January 28\u201331). SVE: Distributed Video Processing at Facebook Scale. Proceedings of the 26th Symposium on Operating Systems Principles, Shanghai, China."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ichinose, A., Takefusa, A., Nakada, H., and Oguchi, M. (2017, January 11\u201314). A study of a video analysis framework using Kafka and spark streaming. Proceedings of the IEEE International Conference on Big Data, Boston, MA, USA.","DOI":"10.1109\/BigData.2017.8258195"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"66123","DOI":"10.1109\/ACCESS.2018.2878865","article-title":"Dynamic scene recognition using spatiotemporal based DLTP on spark","volume":"6","author":"Uddin","year":"2018","journal-title":"IEEE Access"},{"key":"ref_17","unstructured":"Hu, C., Xue, G., Mei, L., Qi, L., Shao, J., Shang, Y., and Wang, J. (September, January 29). Building an intelligent video and image analysis evaluation platform for public security. Proceedings of the 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce, Italy."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chao, W., and Jun, X.M. (2008, January 20\u201322). Multi-agent based distributed video surveillance system over IP. Proceedings of the International Symposium on Computer Science and Computational Technology, Shanghai, China.","DOI":"10.1109\/ISCSCT.2008.118"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ostheimer, D., Lemay, S., Ghazal, M., Mayisela, D., Amer, A., and Dagba, P.F. (2006, January 7\u201310). A modular distributed video surveillance system over IP. Proceedings of the Canadian Conference on Electrical and Computer Engineering, Ottawa, ON, Canada.","DOI":"10.1109\/CCECE.2006.277603"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, H., Yan, J., and Kou, Y. (2016, January 29\u201331). Efficient online surveillance video processing based on spark framework. Proceedings of the International Conference on Big Data Computing and Communications, Shenyang, China.","DOI":"10.1007\/978-3-319-42553-5_26"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Dai, J., Wang, Y., Qiu, X., Ding, D., Zhang, Y., Wang, Y., Jia, X., Zhang, C., Wan, Y., and Li, Z. (2018, November 05). BigDL: A Distributed Deep Learning Framework for Big Data. Available online: https:\/\/bigdl-project.github.io\/master\/whitepaper\/.","DOI":"10.1145\/3357223.3362707"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lv, J., Wu, B., Yang, S., Jia, B., and Qiu, P. (2016, January 5\u20138). Efficient large scale near-duplicate video detection base on spark. Proceedings of the IEEE International Conference on Big Data, Washington, DC, USA.","DOI":"10.1109\/BigData.2016.7840693"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lv, J., Wu, B., Liu, C., and Gut, X. (2018, January 13\u201316). PF-Face: A Parallel Framework for Face Classification and Search from Massive Videos Based on Spark. Proceedings of the IEEE Fourth International Conference on Multimedia Big Data (BigMM), Xi\u2019an, China.","DOI":"10.1109\/BigMM.2018.8499447"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Huang, L., Xu, W., Liu, S., Pandey, V., and Juri, N.R. (2017, January 11\u201314). Enabling Versatile Analysis of Large Scale Traffic Video Data with Deep Learning and HiveQL. Proceedings of the IEEE International Conference on Big Data, Boston, MA, USA.","DOI":"10.1109\/BigData.2017.8258041"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1016\/j.future.2017.02.003","article-title":"Cloud-based scalable object detection and classification in video streams","volume":"80","author":"Yaseen","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Iqbal, B., Iqbal, W., Khan, N., Mahmood, A., and Erradi, A. (2019). Canny edge detection and Hough transform for high resolution video streams using Hadoop and Spark. Clust. Comput., 1\u201312.","DOI":"10.1007\/s10586-019-02929-x"},{"key":"ref_27","first-page":"1","article-title":"Study and comparison of various image edge detection techniques","volume":"3","author":"Maini","year":"2009","journal-title":"Int. J. Image Process."},{"key":"ref_28","unstructured":"(2018, November 05). Eagle Eye Networks. Available online: https:\/\/www.eagleeyenetworks.com\/."},{"key":"ref_29","unstructured":"(2018, November 05). Intelli-Vision. Available online: https:\/\/www.intellivision.com\/."},{"key":"ref_30","unstructured":"(2018, November 05). Google Vision API. Available online: https:\/\/cloud.google.com\/video-intelligence\/."},{"key":"ref_31","unstructured":"(2018, November 05). IBM Intelligent Video Analytics. Available online: https:\/\/www.ibm.com\/cloud\/."},{"key":"ref_32","unstructured":"Ejsmont, A. (2015). Web Scalability for Startup Engineers, McGraw-Hill Education Group. [1st ed.]."},{"key":"ref_33","unstructured":"(2018, November 05). Snappy. Available online: https:\/\/google.github.io\/snappy\/."},{"key":"ref_34","unstructured":"George, L. (2011). HBase: The Definitive Guide: Random Access to Your Planet-Size Data, O\u2019Reilly Media, Inc."},{"key":"ref_35","unstructured":"(2018, November 05). Apache Phoenix. Available online: https:\/\/phoenix.apache.org\/."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, H., Zheng, X., and Xiao, B. (2015, January 19\u201321). Large-scale human action recognition with spark. Proceedings of the IEEE 17th International Workshop on Multimedia Signal Processing (MMSP), Xiamen, China.","DOI":"10.1109\/MMSP.2015.7340818"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1109\/TPAMI.2007.1110","article-title":"Dynamic texture recognition using local binary patterns with an application to facial expressions","volume":"29","author":"Zhao","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","unstructured":"Chiang, T., Lee, H.-J., Pejhan, S., Sodagar, I., and Zhang, Y.-Q. (1997, January 23\u201325). Demonstration of the mpeg-2, mpeg-4 and h.263 video coding standards. Proceedings of the First Signal Processing Society Workshop on Multimedia Signal Processing, Princeton, NJ, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1031","DOI":"10.1016\/j.jvcir.2012.06.013","article-title":"Adaptive key frame extraction for video summarization using an aggregation mechanism","volume":"23","author":"Ejaz","year":"2012","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","article-title":"Multiresolution gray-scale and rotation invariant texture classification with local binary patterns","volume":"24","author":"Ojala","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_42","first-page":"1235","article-title":"MLlib: Machine learning in apache spark","volume":"17","author":"Meng","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.jvcir.2007.05.003","article-title":"A fast mpeg-7 dominant color extraction with new similarity measure for image retrieval","volume":"19","author":"Yang","year":"2008","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_44","unstructured":"Sah, M., and Direkoglu, C. (September, January 29). Semantic annotation of surveillance videos for abnormal crowd behaviour search and analysis. Proceedings of the 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce, Italy."},{"key":"ref_45","unstructured":"(2018, November 05). Mediaont. Available online: https:\/\/www.w3.org\/TR\/mediaont-10\/."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Schuldt, C., Laptev, I., and Caputo, B. (2004, January 26). Recognizing human actions: A local svm approach. Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, Cambridge, UK.","DOI":"10.1109\/ICPR.2004.1334462"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1007\/s00138-012-0450-4","article-title":"Recognizing 50 human action categories of web videos","volume":"24","author":"Reddy","year":"2012","journal-title":"Mach. Vis. Appl. J. (MVAP)"},{"key":"ref_48","unstructured":"Simonyan, K., and Zisserman, A. (2014, January 8\u201313). Two-stream convolutional networks for action recognition in videos. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/7\/911\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:05:04Z","timestamp":1760187904000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/7\/911"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,12]]},"references-count":48,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2019,7]]}},"alternative-id":["sym11070911"],"URL":"https:\/\/doi.org\/10.3390\/sym11070911","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2019,7,12]]}}}