{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:50:06Z","timestamp":1760241006722,"version":"build-2065373602"},"reference-count":20,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2019,11,20]],"date-time":"2019-11-20T00:00:00Z","timestamp":1574208000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61303188","41301491"],"award-info":[{"award-number":["61303188","41301491"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Smoke detection technology based on computer vision is a popular research direction in fire detection. This technology is widely used in outdoor fire detection fields (e.g., forest fire detection). Smoke detection is often based on features such as color, shape, texture, and motion to distinguish between smoke and non-smoke objects. However, the salience and robustness of these features are insufficiently strong, resulting in low smoke detection performance under complex environment. Deep learning technology has improved smoke detection performance to a certain degree, but extracting smoke detail features is difficult when the number of network layers is small. With no effective use of smoke motion characteristics, indicators such as false alarm rate are high in video smoke detection. To enhance the detection performance of smoke objects in videos, this paper proposes a concept of change-cumulative image by converting the YUV color space of multi-frame video images into a change-cumulative image, which can represent the motion and color-change characteristics of smoke. Then, a fusion deep network is designed, which increases the depth of the VGG16 network by arranging two convolutional layers after each of its convolutional layer. The VGG16 and Resnet50 (Deep residual network) network models are also arranged using the fusion deep network to improve feature expression ability while increasing the depth of the whole network. Doing so can help extract additional discriminating characteristics of smoke. Experimental results show that by using the change-cumulative image as the input image of the deep network model, smoke detection performance is superior to the classic RGB input image; the smoke detection performance of the fusion deep network model is better than that of the single VGG16 and Resnet50 network models; the smoke detection accuracy, false positive rate, and false alarm rate of this method are better than those of the current popular methods of video smoke detection.<\/jats:p>","DOI":"10.3390\/s19235060","type":"journal-article","created":{"date-parts":[[2019,11,20]],"date-time":"2019-11-20T11:06:03Z","timestamp":1574247963000},"page":"5060","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Video Smoke Detection Method Based on Change-Cumulative Image and Fusion Deep Network"],"prefix":"10.3390","volume":"19","author":[{"given":"Tong","family":"Liu","sequence":"first","affiliation":[{"name":"College of Electronic Science, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianghua","family":"Cheng","sequence":"additional","affiliation":[{"name":"College of Electronic Science, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiangyu","family":"Du","sequence":"additional","affiliation":[{"name":"College of Electronic Science, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaobing","family":"Luo","sequence":"additional","affiliation":[{"name":"College of Electronic Science, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liang","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Electronic Science, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bang","family":"Cheng","sequence":"additional","affiliation":[{"name":"College of Electronic Science, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Electronic Science, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,20]]},"reference":[{"key":"ref_1","first-page":"303","article-title":"Video smoke detection: A literature survey","volume":"23","author":"Shi","year":"2018","journal-title":"J. Image Graph."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chen, T.H., Yin, Y.H., Huang, S.F., and Ye, Y.-T. (2006, January 18\u201320). The smoke detection for early fire-alarming system base on video processing. Proceedings of the International Conference on Intelligent Information Hiding and Multimedia, Pasadena, CA, USA.","DOI":"10.1109\/IIH-MSP.2006.265033"},{"key":"ref_3","first-page":"237","article-title":"Histogram-based smoke segmentation in forest fire detection system","volume":"38","year":"2009","journal-title":"Inf. Technol. Control."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1110","DOI":"10.1016\/j.firesaf.2009.08.003","article-title":"Smoke detection in video using wavelets and support vector machines","volume":"44","author":"Gubbi","year":"2009","journal-title":"Fire Saf. J."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Russo, A.U., Deb, K., Tista, S.C., and Islam, A. (2018, January 8\u20139). Smoke detection method based on LBP and SVM from surveillance camera. Proceedings of the 2018 International Conference on Computer, Communication, Chemical, Material and Electronic Engineering (IC4ME2), Rajshahi, Bangladesh.","DOI":"10.1109\/IC4ME2.2018.8465661"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.firesaf.2011.01.001","article-title":"Video-based smoke detection with histogram sequence of LBP and LBPV pyramids","volume":"46","author":"Yuan","year":"2011","journal-title":"Fire Saf. J."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4326","DOI":"10.1016\/j.patcog.2012.06.008","article-title":"A double mapping framework for extraction of shape-invariant features based on multi-scale partitions with AdaBoost for video smoke detection","volume":"45","author":"Yuan","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3599","DOI":"10.1109\/TGRS.2018.2886022","article-title":"A CNN with Multiscale Convolution and Diversified Metric for Hyperspectral Image Classification","volume":"57","author":"Gong","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/j.firesaf.2019.03.004","article-title":"Video Smoke Detection Based on Deep Saliency Network","volume":"105","author":"Xu","year":"2019","journal-title":"Fire Saf. J."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Frizzi, S., Kaabi, R., Bouchouicha, M., Ginoux, J.M., Moreau, E., and Fnaiech, F. (2016, January 23\u201326). Convolutional neural network for video fire and smoke detection. Proceedings of the IECON 2016\u201442nd Annual Conference of the IEEE Industrial Electronics Society, Florence, Italy.","DOI":"10.1109\/IECON.2016.7793196"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1016\/j.proeng.2017.12.034","article-title":"Wildland forest fire smoke detection based on faster R-CNN using synthetic smoke images","volume":"211","author":"Zhang","year":"2018","journal-title":"Procedia Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"18429","DOI":"10.1109\/ACCESS.2017.2747399","article-title":"A deep normalization and convolutional neural network for image smoke detection","volume":"5","author":"Yin","year":"2017","journal-title":"IEEE Access"},{"key":"ref_13","unstructured":"Toreyin, B.U., Dedeoglu, Y., and Cetin, A.E. (2006, January 4\u20138). Contour based smoke detection in video using wavelets. Proceedings of the 14th European Signal Processing Conference, Florence, Italy."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yuan, P., Hou, X., and Pu, L. (2018, January 25\u201327). A Smoke Recognition Method Combined Dynamic Characteristics and Color Characteristics of Large Displacement Area. Proceedings of the 2018 2nd IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), Xi\u2019an, China.","DOI":"10.1109\/IMCEC.2018.8469734"},{"key":"ref_15","unstructured":"Kopilovic, I., Vagvolgyi, B., and Szir\u00e1nyi, T. (2000, January 3\u20137). Application of panoramic annular lens for motion analysis tasks: Surveillance and smoke detection. Proceedings of the 15th International Conference on Pattern Recognition, Barcelona, Spain."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1016\/j.firesaf.2011.03.003","article-title":"An effective four-stage smoke-detection algorithm using video images for early fire-alarm systems","volume":"46","author":"Tung","year":"2011","journal-title":"Fire Saf. J."},{"key":"ref_17","unstructured":"(2014, August 21). CVPR Lab. Available online: https:\/\/cvpr.kmu.ac.kr\/."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.neucom.2018.11.031","article-title":"Boosted Convolutional Neural Network for object recognition at large scale","volume":"330","author":"Brahimi","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_19","unstructured":"(2015, May 10). Vido smoke dection. Available online: http:\/\/staff.ustc.edu.cn\/~yfn\/vsd.html."},{"key":"ref_20","unstructured":"(2019, January 18). NASNet, DenseNet. Available online: https:\/\/github.com\/fchollet\/deep-learning-models\/releases."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/23\/5060\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:35:58Z","timestamp":1760189758000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/23\/5060"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,20]]},"references-count":20,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["s19235060"],"URL":"https:\/\/doi.org\/10.3390\/s19235060","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,11,20]]}}}