{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T01:31:43Z","timestamp":1775007103749,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,24]],"date-time":"2021-12-24T00:00:00Z","timestamp":1640304000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A fire is an extraordinary event that can damage property and have a notable effect on people\u2019s lives. However, the early detection of smoke and fire has been identified as a challenge in many recent studies. Therefore, different solutions have been proposed to approach the timely detection of fire events and avoid human casualties. As a solution, we used an affordable visual detection system. This method is possibly effective because early fire detection is recognized. In most developed countries, CCTV surveillance systems are installed in almost every public location to take periodic images of a specific area. Notwithstanding, cameras are used under different types of ambient light, and they experience occlusions, distortions of view, and changes in the resulting images from different camera angles and the different seasons of the year, all of which affect the accuracy of currently established models. To address these problems, we developed an approach based on an attention feature map used in a capsule network designed to classify fire and smoke locations at different distances outdoors, given only an image of a single fire and smoke as input. The proposed model was designed to solve two main limitations of the base capsule network input and the analysis of large-sized images, as well as to compensate the absence of a deep network using an attention-based approach to improve the classification of the fire and smoke results. In term of practicality, our method is comparable with prior strategies based on machine learning and deep learning methods. We trained and tested the proposed model using our datasets collected from different sources. As the results indicate, a high classification accuracy in comparison with other modern architectures was achieved. Further, the results indicate that the proposed approach is robust and stable for the classification of images from outdoor CCTV cameras with different viewpoints given the presence of smoke and fire.<\/jats:p>","DOI":"10.3390\/s22010098","type":"journal-article","created":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T01:06:54Z","timestamp":1640567214000},"page":"98","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Novel Video Surveillance-Based Fire and Smoke Classification Using Attentional Feature Map in Capsule Networks"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6223-4502","authenticated-orcid":false,"given":"Muksimova","family":"Shakhnoza","sequence":"first","affiliation":[{"name":"Department of IT Convergence Engineering, Gachon University, Sujeong-gu, Seongnam-si 461-701, Gyeonggi-do, Korea"}]},{"given":"Umirzakova","family":"Sabina","sequence":"additional","affiliation":[{"name":"Department of IT Convergence Engineering, Gachon University, Sujeong-gu, Seongnam-si 461-701, Gyeonggi-do, Korea"}]},{"given":"Mardieva","family":"Sevara","sequence":"additional","affiliation":[{"name":"Department Information Security, Tashkent University of Information Technologies Named after Muhammad al-Khwarizmi Tashkent, Tashkent 100200, Uzbekistan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0184-7599","authenticated-orcid":false,"given":"Young-Im","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Gachon University, Sujeong-gu, Seongnam-si 461-701, Gyeonggi-do, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,24]]},"reference":[{"key":"ref_1","unstructured":"Jun, Z., Payyappalli, V.M., Behrendt, A., and Lukasiewicz, K. (2017). The Total Cost of Fire in the United States, Technical Report for Fire Protection Research Foundation."},{"key":"ref_2","unstructured":"Ahrens, M., and Evarts, B. (2021, September 15). Fire Loss in the United States During 2020. Available online: https:\/\/www.nfpa.org\/\/-\/media\/Files\/News-and-Research\/Fire-statistics-and-reports\/US-Fire-Problem\/osFireLoss.pdf."},{"key":"ref_3","unstructured":"Yoon, L. (2021, October 14). Number of Installed CCTV Cameras in Public Places South Korea 2013\u22122020. Available online: https:\/\/www.statista.com\/statistics\/651509\/south-korea-cctv-cameras\/."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.ijlcj.2018.02.001","article-title":"Conditional effects of open-street closed-circuit television (CCTV) on crime: A case from Korea","volume":"53","author":"Jang","year":"2018","journal-title":"Int. J. Law Crime Justice."},{"key":"ref_5","first-page":"254","article-title":"Real-Time Anomaly Recognition Through CCTV Using Neural Networks","volume":"173","author":"Singha","year":"2020","journal-title":"Procedia Environ. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.icte.2016.05.001","article-title":"A deep-learning-based emergency alert system","volume":"2","author":"Kang","year":"2016","journal-title":"ICT Expess."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3383314","article-title":"Detection of Disaster-Affected Cultural Heritage Sites from Social Media Images using Deep Learning Techniques","volume":"13","author":"Kumar","year":"2020","journal-title":"J. Comput. Cult. Herit."},{"key":"ref_8","unstructured":"Sabour, S., Frosst, N., and Hinton, G.E. (2017, January 4\u22129). Dynamic Routing Between Capsules. Proceedings of the 31th International Conference on Neural Information Processing Systems, Red Hook, NY, USA."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Savc\u0131, M.M., Yildirim, Y., Saygili, G., and Toreyin, B.U. (2019, January 12\u221217). Fire detection in H.264 compressed video. Proceedings of the 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.","DOI":"10.1109\/ICASSP.2019.8683666"},{"key":"ref_10","first-page":"87","article-title":"Machine vision based indoor fire detection using static and dynamic features","volume":"11","author":"Khan","year":"2018","journal-title":"Int. J. Control Autom. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Seebamrungsat, J., Praising, S., and Riyamongkol, P. (2014, January 26\u221227). Fire detection in the buildings using image processing. Proceedings of the 2014 Third ICT International Student Project Conference (ICT-ISPC), Nakhonpathom, Thailand.","DOI":"10.1109\/ICT-ISPC.2014.6923226"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1059","DOI":"10.1016\/j.firesaf.2017.04.035","article-title":"Early fire detection: Are hydrogen sensors able to detect pyrolysis of house hold materials","volume":"91","author":"Despinasse","year":"2017","journal-title":"Fire Saf. J."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.patrec.2005.06.015","article-title":"Computer vision based method for real-time fire and flame detection","volume":"27","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1016\/j.buildenv.2009.10.017","article-title":"Multi-Feature Fusion Based Fast Video Flame Detection","volume":"45","author":"Chen","year":"2010","journal-title":"Build. Environ."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.1007\/s11760-017-1102-y","article-title":"Video fire detection based on Gaussian mixture model and multi-color features","volume":"11","author":"Han","year":"2017","journal-title":"Signal Imag. Video Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1827","DOI":"10.1016\/j.dsp.2013.07.003","article-title":"Video fire detection\u2014review","volume":"23","author":"Dimitropoulos","year":"2013","journal-title":"Digit. Signal Processing"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1109\/TCSVT.2014.2339592","article-title":"Spatio-temporal flame modeling and dynamic Texture analysis for automatic video-based fire detection","volume":"25","author":"Dimitropoulos","year":"2015","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.eswa.2019.04.019","article-title":"Fire detection for video surveillance applications using ICA K-medoids-based color model and efficient spatio-temporal visual features","volume":"130","author":"Hashemzadeh","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_19","unstructured":"Giwa, O., and Benkrid, A. (2018). Fire detection in a still image using color information. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1080\/01431161.2017.1385109","article-title":"A low-cost near-infrared digital camera for fire detection and monitoring","volume":"39","author":"Burnett","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kim, H., Song, C., Son, G.J., Jeong, S.H., Son, J.H., and Kim, Y.D. (2018, January 8\u221213). Hyperspectral image-based night-time fire detection using NKNBD. Proceedings of the 87th International Congress on Advanced Applied Informatics (IIAI-AAI), Yonago, Japan.","DOI":"10.1109\/IIAI-AAI.2018.00208"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Patel, R., Mandaliya, K., Shelar, P., Savani, R., and Patel, C.I. (2018, January 19). Automatic Fire Detection Using Combination of Color Cue and Flame Flicker. Proceedings of the International Conference on Intelligent Systems and Signal Processing, Singapore.","DOI":"10.1007\/978-981-10-6977-2_3"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1142\/S0218001418500131","article-title":"Spectral spatio-temporal fire model for video fire detection","volume":"32","author":"Wu","year":"2018","journal-title":"Int. J. Pattern Recognit Artif Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1016\/j.proeng.2017.12.034","article-title":"Wildland Forest Fire Smoke Detection Based on Faster R-CNN using Synthetic Smoke Images","volume":"211","author":"Zhang","year":"2018","journal-title":"Procedia Eng."},{"key":"ref_25","first-page":"1","article-title":"Forest fire image recognition based on convolutional neural network","volume":"13","author":"Yuanbin","year":"2019","journal-title":"J. Algorithms Comp. Tech."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"9083","DOI":"10.1007\/s11042-019-07785-w","article-title":"Convolutional neural network based early fire detection","volume":"79","author":"Saeed","year":"2020","journal-title":"Multimedia Tools Appl."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sharma, J., Granmo, O.C., Goodwin, M., and Fidje, J.T. (2017). Deep convolutional neural networks for fire detection in images. Engineering Applications of Neural Networks, Springer International Publishing. [1st ed.].","DOI":"10.1007\/978-3-319-65172-9_16"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Liu, T., Cheng, J., Du, X., Luo, X., Zhang, L., Cheng, B., and Wang, Y. (2019). Video Smoke Detection Method Based on Change-Cumulative Image and Fusion Deep Network. Sensors, 19.","DOI":"10.3390\/s19235060"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Shen, D., Chen, X., Nguyen, M., and Yan, W.Q. (2018, January 20\u221223). Flame Detection Using Deep Learning. Proceedings of the 4th International Conference on Control, Automation and Robotics, Auckland, New Zealand.","DOI":"10.1109\/ICCAR.2018.8384711"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Jiao, Z., Zhang, Y., and Mu, L.A. (2019, January 23\u201327). Deep Learning Based Forest Fire Detection Approach Using UAV and YOLOv3. Proceedings of the 1st International Conference on Industrial Artificial Intelligence, Shenyang, China.","DOI":"10.1109\/ICIAI.2019.8850815"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1007\/s11554-020-01044-0","article-title":"Real-time video fire\/smoke detection based on CNN in antifire surveillance systems","volume":"18","author":"Saponara","year":"2021","journal-title":"J Real-Time Imag. Proc."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1109\/TII.2017.2757457","article-title":"Fast Smoke Detection for Video Surveillance Using CUDA","volume":"14","author":"Filonenko","year":"2018","journal-title":"IEEE Trans. Ind. Inf."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lestari, D.P., Kosasih, R., Handhika, T., Sari, I., and Fahrurozi, A. (2019, January 10\u221211). Fire hotspots detection system on CCTV videos using you only look once (YOLO) method and Tiny YOLO model for high buildings evacuation. Proceedings of the 2nd International Conference of Computer and Informatics Engineering, Banyuwangi, Indonesia,.","DOI":"10.1109\/IC2IE47452.2019.8940842"},{"key":"ref_34","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., and Chanan, G. (2019, January 8\u221214). PyTorch: An Imperative Style, High-Performance Deep Learning Library. Proceedings of the 33rd Conference on Neural Information Processing System, Vancouv, CA, USA."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1214\/aoms\/1177729392","article-title":"Wolfowitz Stochastic Estimation of the Maximum of a Regression Function","volume":"23","author":"Kiefer","year":"1952","journal-title":"Ann. Math. Statist."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/s13244-018-0639-9","article-title":"Convolutional neural networks: An overview and application in radiology","volume":"9","author":"Yamashita","year":"2018","journal-title":"Insights Imag."},{"key":"ref_37","unstructured":"Lee, E. (2018, August 26). Multilayer Perceptron. Available online: https:\/\/eungbean.github.io\/2018\/08\/26\/udacity-107-MLP-Reminder\/."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"5947","DOI":"10.4249\/scholarpedia.5947","article-title":"Deep belief networks","volume":"4","author":"Hinton","year":"2009","journal-title":"Scholarpedia"},{"key":"ref_39","unstructured":"Sunil, R. (2017, September 13). Understanding Support Vector Machine (SVM) algorithm from examples. Available online: https:\/\/www.analyticsvidhya.com\/blog\/2017\/09\/understaing-support-vector-machine-example-code\/."},{"key":"ref_40","unstructured":"Shin, B.K. (2019, July 27). KNN (k-Nearest Neighbors). Available online: https:\/\/bkshin.tistory.com\/entry\/\uba38\uc2e0\ub7ec\ub2dd-6-K-\ucd5c\uadfc\uc811\uc774\uc6c3KNN."},{"key":"ref_41","unstructured":"Saishruthi, S. (2018, May 15). Logistic Regression Detailed Overview. Available online: https:\/\/towardsdatascience.com\/logistic-regression-detailed-overview-46c4da4303bc."},{"key":"ref_42","unstructured":"Brownlee, J. (2020, November 25). How to Develop a Light Gradient Boosted Machine (LightGBM) Ensemble. Available online: https:\/\/github.com\/microsoft\/LightGBM."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/98\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:52:41Z","timestamp":1760169161000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/98"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,24]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["s22010098"],"URL":"https:\/\/doi.org\/10.3390\/s22010098","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,24]]}}}