{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T16:23:47Z","timestamp":1774369427479,"version":"3.50.1"},"reference-count":54,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T00:00:00Z","timestamp":1670889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Korea Agency for Technology and Standards","award":["K_G012002073401"],"award-info":[{"award-number":["K_G012002073401"]}]},{"name":"Korea Agency for Technology and Standards","award":["K_G012002234001"],"award-info":[{"award-number":["K_G012002234001"]}]},{"name":"Korea Agency for Technology and Standards","award":["GCU-2019-0794"],"award-info":[{"award-number":["GCU-2019-0794"]}]},{"name":"Gachon University Research","award":["K_G012002073401"],"award-info":[{"award-number":["K_G012002073401"]}]},{"name":"Gachon University Research","award":["K_G012002234001"],"award-info":[{"award-number":["K_G012002234001"]}]},{"name":"Gachon University Research","award":["GCU-2019-0794"],"award-info":[{"award-number":["GCU-2019-0794"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Wildfire is a hazardous natural phenomenon that leads to significant human fatalities, catastrophic environmental damages, and economic losses. Over the past few years, the intensity and frequency of fires have increased worldwide. Studies have been conducted to develop distinctive solutions to minimize forest fires. Systems for distant fire detection and monitoring have been established, showing improvements in data collection and fire characterization. However, wildfires cover vast areas, making other proposed ground systems unsuitable for optimal coverage. Unmanned aerial vehicles (UAVs) have become the subject of active research in recent years. Deep learning-based image-processing methods demonstrate improved performance in various tasks, including detection and segmentation, which can be utilized to develop modern forest firefighting techniques. In this study, we established a novel two-pathway encoder\u2013decoder-based model to detect and accurately segment wildfires and smoke from the images captured using UAVs in real-time. Our proposed nested decoder uses pre-activated residual blocks and an attention-gating mechanism, thereby improving segmentation accuracy. Moreover, to facilitate robust and generalized training, we prepared a new dataset comprising actual incidences of forest fires and smoke, varying from small to large areas. In terms of practicality, the experimental results reveal that our method significantly outperforms existing detection and segmentation methods, despite being lightweight. In addition, the proposed model is reliable and robust for detecting and segmenting drone camera images from different viewpoints in the presence of wildfire and smoke.<\/jats:p>","DOI":"10.3390\/rs14246302","type":"journal-article","created":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T03:32:32Z","timestamp":1670902352000},"page":"6302","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Deep Encoder\u2013Decoder Network-Based Wildfire Segmentation Using Drone Images in Real-Time"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6223-4502","authenticated-orcid":false,"given":"Shakhnoza","family":"Muksimova","sequence":"first","affiliation":[{"name":"Department of IT Convergence Engineering, Gachon University, Sujeong-gu, Seongnam-si 13120, Gyeonggi-do, Republic of Korea"}]},{"given":"Sevara","family":"Mardieva","sequence":"additional","affiliation":[{"name":"Department of IT Convergence Engineering, Gachon University, Sujeong-gu, Seongnam-si 13120, Gyeonggi-do, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0184-7599","authenticated-orcid":false,"given":"Young-Im","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Gachon University, Sujeong-gu, Seongnam-si 13120, Gyeonggi-do, Republic of Korea"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,13]]},"reference":[{"key":"ref_1","unstructured":"(2020, January 06). Number of Fires, Fire Deaths Fall in 2019 \u201cYonhap News Agency\u201d. Available online: https:\/\/en.yna.co.kr\/view\/AEN20200106008000315."},{"key":"ref_2","unstructured":"(2022, July 10). National Interagency Coordination Center Wildland Fire Summary and Statistics Annual Report 2021, Available online: https:\/\/www.predictiveservices.nifc.gov\/intelligence\/2021_statssumm\/annual_report_2021.pdf."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zheng, Z., Hu, Y., Qiao, Y., Hu, X., and Huang, Y. (2022). Real-Time Detection of Winter Jujubes Based on Improved YOLOX-Nano Network. Remote Sens., 14.","DOI":"10.3390\/rs14194833"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"109036","DOI":"10.1016\/j.knosys.2022.109036","article-title":"Detailed feature extraction network-based fine-grained face segmentation","volume":"250","author":"Umirzakova","year":"2022","journal-title":"Knowl.-Based Syst."},{"key":"ref_5","unstructured":"(2021, June 25). Unmanned Aerial Vehicles (UAV). Available online: https:\/\/www.kari.re.kr\/eng\/sub03_02.do."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Frizzi, S., Kaabi, R., Bouchouicha, M., Ginoux, J.-M., Moreau, E., and Fnaiech, F. (2016, January 23\u201326). Convolutional neural network for video fire and smoke detection. Proceedings of the 42nd Annual Conference of the IEEE Industrial Electronics Society (IECON 2016), Florence, Italy.","DOI":"10.1109\/IECON.2016.7793196"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Dzigal, D., Akagic, A., Buza, E., Brdjanin, A., and Dardagan, N. (2019, January 28\u201330). Forest Fire Detection based on Color Spaces Combination. Proceedings of the 2019 11th International Conference on Electrical and Electronics Engineering (ELECO), Bursa, Turkey.","DOI":"10.23919\/ELECO47770.2019.8990608"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Pan, J., Ou, X., and Xu, L. (2021). A Collaborative Region Detection and Grading Framework for Forest Fire Smoke Using Weakly Supervised Fine Segmentation and Lightweight Faster-RCNN. Forests, 12.","DOI":"10.3390\/f12060768"},{"key":"ref_9","unstructured":"Tan, M., and Le, Q.V. (2021). EfficientNetV2: Smaller Models and Faster Training. arXiv."},{"key":"ref_10","unstructured":"(2019, January 05). Applications for Fire Alarms and Fire Safety. Available online: http:\/\/www.vent.co.uk\/ fire-alarms\/fire-alarm-applications.php."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"8235127","DOI":"10.1155\/2018\/8235127","article-title":"Intelligent Smoke Alarm System with Wireless Sensor Network Using ZigBee","volume":"2018","author":"Wu","year":"2018","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yadav, R., and Rani, P. (2020, January 5\u20137). Sensor-Based Smart Fire Detection and Fire Alarm System. Proceedings of the International Conference on Advances in Chemical Engineering (AdChE) 2020, Dehradun, India.","DOI":"10.2139\/ssrn.3724291"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Jobert, G., Fournier, M., Barritault, P., Boutami, S., Auger, J., Maillard, A., Michelot, J., Lienhard, P., Nicoletti, S., and Duraffourg, L. (2019, January 23\u201327). A Miniaturized Optical Sensor for Fire Smoke Detection. Proceedings of the 2019 20th International Conference on Solid-State Sensors, Actuators and Microsystems & Eurosensors XXXIII (TRANSDUCERS & EUROSENSORS XXXIII), Berlin, Germany.","DOI":"10.1109\/TRANSDUCERS.2019.8808611"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chowdhury, N., Mushfiq, D.R., and Chowdhury, A.E. (2019, January 3\u20135). Computer Vision and Smoke Sensor Based Fire Detection System. Proceedings of the 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT), Dhaka, Bangladesh.","DOI":"10.1109\/ICASERT.2019.8934458"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/j.firesaf.2019.03.004","article-title":"Video smoke detection based on deep saliency network","volume":"105","author":"Xu","year":"2019","journal-title":"Fire Saf. J."},{"key":"ref_16","first-page":"98","article-title":"Novel Video Surveillance-Based Fire and Smoke Classification Using Attentional Feature Map in Capsule Networks","volume":"22","author":"Muksimova","year":"2022","journal-title":"Sensors"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, R., Tao, F., Liu, X., Na, J., Leng, H., Wu, J., and Zhou, T. (2022). RAANet: A Residual ASPP with Attention Framework for Semantic Segmentation of High-Resolution Remote Sensing Images. Remote Sens., 14.","DOI":"10.3390\/rs14133109"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, X., Li, L., Di, D., Wang, J., Chen, G., Jing, W., and Emam, M. (2022). SERNet: Squeeze and Excitation Residual Network for Semantic Segmentation of High-Resolution Remote Sensing Images. Remote Sens., 14.","DOI":"10.3390\/rs14194770"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Xu, Y., Luo, W., Hu, A., Xie, Z., Xie, X., and Tao, L. (2022). TE-SAGAN: An Improved Generative Adversarial Network for Remote Sensing Super-Resolution Images. Remote Sens., 14.","DOI":"10.3390\/rs14102425"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Benjdira, B., Bazi, Y., Koubaa, A., and Ouni, K. (2019). Unsupervised domain adaptation using generative adversarial networks for semantic segmentation of aerial images. Remote Sens., 11.","DOI":"10.3390\/rs11111369"},{"key":"ref_21","unstructured":"Zhang, Q., Zhang, J., Liu, W., and Tao, D. (2019). Category anchor-guided unsupervised domain adaptation for semantic segmentation. Adv. Neural Inf. Processing Syst., 32."},{"key":"ref_22","unstructured":"Stan, S., and Rostami, M. (2021, January 2\u20139). Unsupervised model adaptation for continual semantic segmentation. Proceedings of the AAAI Conference on Artificial Intelligence 2021, Virtually."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Pan, F., Shin, I., Rameau, F., Lee, S., and Kweon, I.S. (2020, January 13\u201319). Unsupervised intra-domain adaptation for semantic segmentation through self-supervision. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00382"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Cai, Y., Yang, Y., Zheng, Q., Shen, Z., Shang, Y., Yin, J., and Shi, Z. (2022). BiFDANet: Unsupervised Bidirectional Domain Adaptation for Semantic Segmentation of Remote Sensing Images. Remote Sens., 14.","DOI":"10.3390\/rs14010190"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"108001","DOI":"10.1016\/j.comnet.2021.108001","article-title":"Aerial imagery pile burn detection using deep learning: FLAME Dataset","volume":"193","author":"Shamsoshoara","year":"2021","journal-title":"Comput. Netw."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1049\/ipr2.12046","article-title":"Convolutional neural network for smoke and fire semantic segmentation","volume":"15","author":"Frizzi","year":"2021","journal-title":"IET Image Process"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Barmpoutis, P., Stathaki, T., Dimitropoulos, K., and Grammalidis, N. (2020). Early Fire Detection Based on Aerial 360-Degree Sensors, Deep Convolution Neural Networks and Exploitation of Fire Dynamic Textures. Remote Sens., 12.","DOI":"10.3390\/rs12193177"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_31","unstructured":"Samuel, R.B., Lorenzo, P., and Peter, K. (2018, January 18\u201323). In-Place Activated BatchNorm for Memory-Optimized Training of DNNs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., Kaiming, H., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Luong, M.-T., Pham, H., and Manning, C.D. (2015). Effective approaches to attention-based neural machine translation. arXiv.","DOI":"10.18653\/v1\/D15-1166"},{"key":"ref_34","unstructured":"Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv."},{"key":"ref_35","unstructured":"Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention u-net: Learning where to look for the pancreas. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 11\u201314). Identity mappings in deep residual networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"ref_37","unstructured":"Maas, A.L., Hannun, A.Y., and Ng, A.Y. (2013, January 16\u201321). Rectifier nonlinearities improve neural network acoustic models. Proceedings of the ICML, Atlanta, GA, USA."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-CNN. Proceedings of the International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_39","unstructured":"Liu, W., Rabinovich, A., and Berg, A.C. (2015). ParseNet: Looking Wider to See Better. arXiv."},{"key":"ref_40","unstructured":"(2022, June 28). DJI Mavic 3. Available online: https:\/\/www.dji.com\/kr\/mavic-3."},{"key":"ref_41","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., and Chanan, G. (2019, January 8\u201314). PyTorch: An Imperative Style, High-Performance Deep Learning Library. Proceedings of the 33rd Conference on Neural Information Processing System, Vancouv, CA, USA."},{"key":"ref_42","unstructured":"Kingma, D.P., and Ba, J.L. (2015). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"775","DOI":"10.18280\/ts.380324","article-title":"Forest fire recognition based on feature extraction from multi-view images","volume":"38","author":"Wu","year":"2021","journal-title":"Traitement Du Signal"},{"key":"ref_44","unstructured":"(2017, December 21). Xavier-Initialization. Available online: https:\/\/mnsgrg.com\/2017\/12\/21\/xavier-initialization\/."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1007\/s11263-018-1130-2","article-title":"Face mask extraction in video sequence","volume":"127","author":"Wang","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_46","unstructured":"Bolya, D., Zhou, C., Xiao, F., and Lee, Y.J. (November, January 27). Yolact: Real-time instance segmentation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Wang, X., Kong, T., Shen, C., Jiang, Y., and Li, L. (2020, December 04). SOLO: Segmenting Objects by Locations. Available online: https:\/\/link.springer.com\/chapter\/10.1007\/978-3-030-58523-5_38.","DOI":"10.1007\/978-3-030-58523-5_38"},{"key":"ref_48","unstructured":"Wang, X., Zhang, R., Kong, T., Li, L., and Shen, C. (2020, March 23). SOLOv2: Dynamic, Faster and Stronger. Available online: https:\/\/deepai.org\/publication\/solov2-dynamic-faster-and-stronger."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Chen, H., Sun, K., Tian, Z., Shen, C., Huang, Y., and Yan, Y. (2020, January 13\u201319). Blendmask: Top-down meets bottom-up for instance segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00860"},{"key":"ref_50","unstructured":"Fu, C.-Y., Shvets, M., and Berg, A.C. (2019). Retina Mask: Learning to predict masks improves state-of-the-art single-shot detection for free. arXiv."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Li, Y., Qi, H., Dai, J., Ji, X., and Wei, Y. (2017, January 21\u201326). Fully convolutional instance aware semantic segmentation. Proceedings of the CVPR, 2017, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.472"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Huang, Z., Huang, L., Gong, Y., Huang, C., and Wang, X. (2019, January 15\u201320). Mask scoring r-cnn. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00657"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18\u201322). Path aggregation network for instance segmentation. Proceedings of the CVPR, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00913"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Bolya, D., Zhou, C., Xiao, F., and Lee, Y.J. (2020). Yolact++: Better real-time instance segmentation. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/ICCV.2019.00925"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/24\/6302\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:40:13Z","timestamp":1760146813000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/24\/6302"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,13]]},"references-count":54,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["rs14246302"],"URL":"https:\/\/doi.org\/10.3390\/rs14246302","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,13]]}}}