{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T05:18:26Z","timestamp":1780982306445,"version":"3.54.1"},"reference-count":55,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T00:00:00Z","timestamp":1656633600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Future Network Scientific Research Fund Project","award":["FNSRFP-2021-YB-17"],"award-info":[{"award-number":["FNSRFP-2021-YB-17"]}]},{"name":"Future Network Scientific Research Fund Project","award":["SJCX22_0312"],"award-info":[{"award-number":["SJCX22_0312"]}]},{"name":"Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["FNSRFP-2021-YB-17"],"award-info":[{"award-number":["FNSRFP-2021-YB-17"]}]},{"name":"Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["SJCX22_0312"],"award-info":[{"award-number":["SJCX22_0312"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In recent years, forest-fire monitoring methods represented by deep learning have been developed rapidly. The use of drone technology and optimization of existing models to improve forest-fire recognition accuracy and segmentation quality are of great significance for understanding the spatial distribution of forest fires and protecting forest resources. Due to the spreading and irregular nature of fire, it is extremely tough to detect fire accurately in a complex environment. Based on the aerial imagery dataset FLAME, this paper focuses on the analysis of methods to two deep-learning problems: (1) the video frames are classified as two classes (fire, no-fire) according to the presence or absence of fire. A novel image classification method based on channel domain attention mechanism was developed, which achieved a classification accuracy of 93.65%. (2) We propose a novel instance segmentation method (MaskSU R-CNN) for incipient forest-fire detection and segmentation based on MS R-CNN model. For the optimized model, the MaskIoU branch is reconstructed by a U-shaped network in order to reduce the segmentation error. Experimental results show that the precision of our MaskSU R-CNN reached 91.85%, recall 88.81%, F1-score 90.30%, and mean intersection over union (mIoU) 82.31%. Compared with many state-of-the-art segmentation models, our method achieves satisfactory results on forest-fire dataset.<\/jats:p>","DOI":"10.3390\/rs14133159","type":"journal-article","created":{"date-parts":[[2022,7,4]],"date-time":"2022-07-04T20:59:18Z","timestamp":1656968358000},"page":"3159","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":87,"title":["Forest Fire Segmentation from Aerial Imagery Data Using an Improved Instance Segmentation Model"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1292-0117","authenticated-orcid":false,"given":"Zhihao","family":"Guan","sequence":"first","affiliation":[{"name":"College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyu","family":"Miao","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunjie","family":"Mu","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Quan","family":"Sun","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiaolin","family":"Ye","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Demin","family":"Gao","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ryu, J.-H., Han, K.-S., Hong, S., Park, N.-W., Lee, Y.-W., and Cho, J. (2018). Satellite-based evaluation of the post-fire recovery process from the worst forest fire case in South Korea. Remote Sens., 10.","DOI":"10.3390\/rs10060918"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"112307","DOI":"10.1016\/j.rse.2021.112307","article-title":"Individual tree crown segmentation from airborne LiDAR data using a novel Gaussian filter and energy function minimization-based approach","volume":"256","author":"Yun","year":"2021","journal-title":"Remote Sens. Environ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.scitotenv.2016.03.160","article-title":"Unravelling the importance of forest age stand and forest structure driving microbiological soil properties, enzymatic activities and soil nutrients content in Mediterranean Spanish black pine (Pinus nigra Ar. ssp. salzmannii) Forest","volume":"562","author":"Hedo","year":"2016","journal-title":"Sci. Total Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"154885","DOI":"10.1016\/j.scitotenv.2022.154885","article-title":"Climate change, fire return intervals and the growing risk of permanent forest loss in boreal Eurasia","volume":"831","author":"Burrell","year":"2022","journal-title":"Sci. Total Environ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1071\/WF19039","article-title":"Current and future patterns of forest fire occurrence in China","volume":"29","author":"Wu","year":"2020","journal-title":"Int. J. Wildland Fire"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"104353","DOI":"10.1016\/j.engappai.2021.104353","article-title":"Pixel-level automatic annotation for forest fire image","volume":"104","author":"Yang","year":"2021","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_7","first-page":"100134","article-title":"Deep learning in computer vision: A critical review of emerging techniques and application scenarios","volume":"6","author":"Chai","year":"2021","journal-title":"Mach. Learn. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1109\/TNNLS.2020.3027588","article-title":"Learning robust discriminant subspace based on joint L2, p-and L2, s-Norm distance metrics","volume":"33","author":"Fu","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_9","unstructured":"Ye, Q., Huang, P., Zhang, Z., Zheng, Y., Fu, L., and Yang, W. (2021). Multiview learning with robust double-sided twin SVM. IEEE Trans. Cybern., 1\u201314."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"106874","DOI":"10.1016\/j.compag.2022.106874","article-title":"A high-precision forest fire smoke detection approach based on ARGNet","volume":"196","author":"Zhan","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1007\/s10846-021-01320-6","article-title":"Fault-tolerant time-varying elliptical formation control of multiple fixed-wing UAVs for cooperative forest fire monitoring","volume":"101","author":"Yu","year":"2021","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"105029","DOI":"10.1016\/j.compag.2019.105029","article-title":"Real-time forest smoke detection using hand-designed features and deep learning","volume":"167","author":"Peng","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_13","first-page":"1271","article-title":"Video fire detection based on color and flicker frequency feature","volume":"8","author":"Yan","year":"2014","journal-title":"J. Front. Comput. Sci. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.firesaf.2008.05.005","article-title":"Fire detection in video sequences using a generic color model","volume":"44","author":"Demirel","year":"2009","journal-title":"Fire Saf. J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1109\/TCSVT.2010.2045813","article-title":"A probabilistic approach for vision-based fire detection in videos","volume":"20","author":"Borges","year":"2010","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1109\/TCSVT.2018.2889193","article-title":"3D Parallel Fully Convolutional Networks for Real-Time Video Wildfire Smoke Detection","volume":"30","author":"Li","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_18","first-page":"173","article-title":"Forest fire image classification based on deep neural network of sparse autoencoder","volume":"50","author":"Wang","year":"2014","journal-title":"Comput. Eng. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/s11042-017-5561-5","article-title":"Recurrent convolutional network for video-based smoke detection","volume":"78","author":"Yin","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1783","DOI":"10.5194\/essd-11-1783-2019","article-title":"Global carbon budget 2019","volume":"11","author":"Friedlingstein","year":"2019","journal-title":"Earth Syst. Sci. Data"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Huang, Q., Razi, A., Afghah, F., and Fule, P. (September, January 31). Wildfire spread modeling with aerial image processing. Proceedings of the 2020 IEEE 21st International Symposium on \u201cA World of Wireless, Mobile and Multimedia Networks\u201d (WoWMoM), Cork, Ireland.","DOI":"10.1109\/WoWMoM49955.2020.00063"},{"key":"ref_22","first-page":"242","article-title":"Aerial forest fire detection and monitoring using a small UAV","volume":"5","author":"Gamboa","year":"2020","journal-title":"KnE Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cipri\u00e1n-S\u00e1nchez, J.F., Ochoa-Ruiz, G., Gonzalez-Mendoza, M., and Rossi, L. (2021). FIRe-GAN: A novel deep learning-based infrared-visible fusion method for wildfire imagery. Neural Comput. Appl.","DOI":"10.1007\/s00521-021-06691-3"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1007\/s11760-019-01600-7","article-title":"Additive neural network for forest fire detection","volume":"14","author":"Pan","year":"2019","journal-title":"Signal Image Video Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"10858","DOI":"10.1109\/ACCESS.2021.3050628","article-title":"ATT squeeze U-Net: A lightweight network for forest fire detection and recognition","volume":"9","author":"Zhang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yuan, C., Liu, Z., and Zhang, Y. (2015, January 9\u201312). UAV-based forest fire detection and tracking using image processing techniques. Proceedings of the 2015 International Conference on Unmanned Aircraft Systems (ICUAS), Denver, CO, USA.","DOI":"10.1109\/ICUAS.2015.7152345"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.comcom.2019.10.007","article-title":"Unmanned Aerial Vehicle (UAV) based Forest Fire Detection and monitoring for reducing false alarms in forest-fires","volume":"149","author":"Sudhakar","year":"2019","journal-title":"Comput. Commun."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"108001","DOI":"10.1016\/j.comnet.2021.108001","article-title":"Aerial imagery pile burn detection using deep learning: The FLAME dataset","volume":"193","author":"Shamsoshoara","year":"2021","journal-title":"Comput. Netw."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Huang, Z., Huang, L., Gong, Y., Huang, C., and Wang, X. (2019, January 15\u201320). Mask scoring R-Cnn. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00657"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Xu, Y.-H., Li, J.-H., Zhou, W., and Chen, C. (2022). Learning-empowered resource allocation for air slicing in UAV-assisted cellular V2X communications. IEEE Syst. J., 1\u20134.","DOI":"10.1109\/JSYST.2022.3144159"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chelali, F.Z., Cherabit, N., and Djeradi, A. (2015, January 21\u201323). Face recognition system using skin detection in RGB and YCbCr color space. Proceedings of the 2015 2nd World Symposium on Web Applications and Networking (WSWAN), Sousse, Tunisia.","DOI":"10.1109\/WSWAN.2015.7210329"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1504\/IJSISE.2017.084566","article-title":"State of the Art of Smoke and Fire Detection Using Image Processing","volume":"10","author":"Umar","year":"2017","journal-title":"Int. J. Signal Imaging Syst. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1007\/s11263-020-01302-5","article-title":"Inference, learning and attention mechanisms that exploit and preserve sparsity in CNNs","volume":"128","author":"Hackel","year":"2020","journal-title":"Int. J. Comput. Vis."},{"key":"ref_35","first-page":"2204","article-title":"Recurrent models of visual attention","volume":"2","author":"Mnih","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_38","first-page":"597","article-title":"Convergence analysis of two-layer neural networks with relu activation","volume":"30","author":"Li","year":"2017","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"ref_39","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-Cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft Coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_45","unstructured":"Huh, M., Agrawal, P., and Efros, A.A. (2016). What makes ImageNet good for transfer learning?. arXiv."},{"key":"ref_46","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-Cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"Segnet: A deep convolutional encoder-decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_51","unstructured":"Chen, L.-C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Ba, R., Chen, C., Yuan, J., Song, W., and Lo, S. (2019). SmokeNet: Satellite smoke scene detection using convolutional neural network with spatial and channel-wise attention. Remote Sens., 11.","DOI":"10.3390\/rs11141702"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1080\/02827581.2020.1829029","article-title":"An approach for improving firefighting ability of forest road network","volume":"35","author":"Zhang","year":"2020","journal-title":"Scand. J. For. Res."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Xu, R., Lin, H., Lu, K., Cao, L., and Liu, Y. (2021). A forest fire detection system based on ensemble learning. Forests, 12.","DOI":"10.3390\/f12020217"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"3818","DOI":"10.1109\/TNNLS.2019.2944869","article-title":"Nonpeaked Discriminant Analysis for Data Representation","volume":"30","author":"Ye","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/13\/3159\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:41:41Z","timestamp":1760139701000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/13\/3159"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,1]]},"references-count":55,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["rs14133159"],"URL":"https:\/\/doi.org\/10.3390\/rs14133159","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,1]]}}}