{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,26]],"date-time":"2025-11-26T16:44:37Z","timestamp":1764175477757,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2023,8,23]],"date-time":"2023-08-23T00:00:00Z","timestamp":1692748800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"project FIREFRONT","award":["PCIF\/SSI\/0096\/2017","UIDBP\/50009\/2020","LA\/P\/0083\/2020"],"award-info":[{"award-number":["PCIF\/SSI\/0096\/2017","UIDBP\/50009\/2020","LA\/P\/0083\/2020"]}]},{"name":"FCT Projects LARSyS","award":["PCIF\/SSI\/0096\/2017","UIDBP\/50009\/2020","LA\/P\/0083\/2020"],"award-info":[{"award-number":["PCIF\/SSI\/0096\/2017","UIDBP\/50009\/2020","LA\/P\/0083\/2020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>This work proposes an active learning (AL) methodology to create models for the segmentation of fire and smoke in video images. With this model, a model learns in an incremental manner over several AL rounds. Initially, the model is trained in a given subset of samples, and in each AL round, the model selects the most informative samples to be added to the training set in the next training session. Our approach is based on a decomposition of the task in an AL classification phase, followed by an attention-based segmentation phase with class activation mapping on the learned classifiers. The use of AL in classification and segmentation tasks resulted in a 2% improvement in accuracy and mean intersection over union. More importantly, we showed that the approach using AL achieved results similar to non-AL with fewer labeled data samples.<\/jats:p>","DOI":"10.3390\/rs15174136","type":"journal-article","created":{"date-parts":[[2023,8,23]],"date-time":"2023-08-23T08:57:39Z","timestamp":1692781059000},"page":"4136","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Fire and Smoke Segmentation Using Active Learning Methods"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1293-1147","authenticated-orcid":false,"given":"Tiago","family":"Marto","sequence":"first","affiliation":[{"name":"Portuguese Air Force Academy Research Center, 2715-021 Pero Pinheiro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3991-1269","authenticated-orcid":false,"given":"Alexandre","family":"Bernardino","sequence":"additional","affiliation":[{"name":"Institute for Systems and Robotics, Instituto Superior T\u00e9cnico, 1049-001 Lisboa, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3496-3561","authenticated-orcid":false,"given":"Gon\u00e7alo","family":"Cruz","sequence":"additional","affiliation":[{"name":"Portuguese Air Force Academy Research Center, 2715-021 Pero Pinheiro, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,23]]},"reference":[{"key":"ref_1","unstructured":"Instituto da Conserva\u00e7\u00e3o da Natureza e das Florestas (ICNF) (2021). Inc\u00eandios Rurais e \u00e1rea Ardida-Continente, ICNF."},{"key":"ref_2","unstructured":"Instituto da Conserva\u00e7\u00e3o da Natureza e das Florestas (2016). Relat\u00f3rio anual de \u00e1reas ardidas e inc\u00eandios florestais em Portugal Continental, Technical Report."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1016\/j.jarmac.2017.05.001","article-title":"See No Evil: Cognitive Challenges of Security Surveillance and Monitoring","volume":"6","author":"Hodgetts","year":"2017","journal-title":"J. Appl. Res. Mem. Cogn."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft coco: Common objects in context. Proceedings of the Computer Vision\u2013ECCV 2014: 13th European Conference, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Santana, B., Cherif, E.K., Bernardino, A., and Ribeiro, R. (2022). Real-Time Georeferencing of Fire Front Aerial Images Using Iterative Ray-Tracing and the Bearings-Range Extended Kalman Filter. Sensors, 22.","DOI":"10.3390\/s22031150"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1016\/j.proeng.2017.12.034","article-title":"Wildland forest fire smoke detection based on faster R-CNN using synthetic smoke images","volume":"211","author":"Zhang","year":"2018","journal-title":"Procedia Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.firesaf.2017.06.012","article-title":"Computer vision for wildfire research: An evolving image dataset for processing and analysis","volume":"92","author":"Toulouse","year":"2017","journal-title":"Fire Saf. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.isprsjprs.2021.01.020","article-title":"Remote sensing image segmentation advances: A meta-analysis","volume":"173","author":"Kotaridis","year":"2021","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_9","unstructured":"Settles, B. (2009). Active Learning Literature Survey, University of Wisconsin\u2013Madison. Computer Sciences Technical Report 1648."},{"key":"ref_10","unstructured":"Breck, E., Polyzotis, N., Roy, S., Whang, S., and Zinkevich, M. (April, January 31). Data Validation for Machine Learning. Proceedings of the MLSys, Palo Alto, CA, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ros, G., Sellart, L., Materzynska, J., Vazquez, D., and Lopez, A.M. (2016, January 27\u201330). The synthia dataset: A large collection of synthetic images for semantic segmentation of urban scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.352"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.ijar.2022.08.013","article-title":"Deep evidential fusion network for medical image classification","volume":"150","author":"Xu","year":"2022","journal-title":"Int. J. Approx. Reason."},{"key":"ref_13","unstructured":"Aklilu, J., and Yeung, S. (2022, January 5\u20136). ALGES: Active learning with gradient embeddings for semantic segmentation of laparoscopic surgical images. Proceedings of the Machine Learning for Healthcare Conference\u2014PMLR, Durham, NC, USA."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"W\u00f6rmann, J., Bogdoll, D., B\u00fchrle, E., Chen, H., Chuo, E.F., Cvejoski, K., van Elst, L., Gottschall, P., Griesche, S., and Hellert, C. (2022). Knowledge augmented machine learning with applications in autonomous driving: A survey. arXiv.","DOI":"10.1109\/CVPRW56347.2022.00495"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Khan, S., Muhammad, K., Hussain, T., Del Ser, J., Cuzzolin, F., Bhattacharyya, S., Akhtar, Z., and de Albuquerque, V.H.C. (2021). Deepsmoke: Deep learning model for smoke detection and segmentation in outdoor environments. Expert Syst. Appl., 182.","DOI":"10.1016\/j.eswa.2021.115125"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"15075","DOI":"10.1007\/s11042-017-5090-2","article-title":"Fire smoke detection algorithm based on motion characteristic and convolutional neural networks","volume":"77","author":"Luo","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_17","unstructured":"Amaral, B., Bernardino, A., and Barata, C. (2021). Fire and Smoke Detection in Aerial Images. [Master\u2019s Thesis, Instituto Superior T\u00e9cnico]."},{"key":"ref_18","unstructured":"Fernandes, S. (2021). Detec\u00e7\u00e3o de Inc\u00eandios Florestais Atrav\u00e9s da Aprendizagem Auto-Supervisionada. [Master\u2019s Thesis, Instituto Superior T\u00e9cnico]."},{"key":"ref_19","unstructured":"Kuhlmann, L. (2021). Semi-Supervised Semantic Segmentation of Smoke and Fire from Airborne Images with Generative Adversarial Networks to Support Firefighting Actions. [Master\u2019s Thesis, HTW Berlim]."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"121","DOI":"10.4316\/AECE.2018.04015","article-title":"An efficient deep learning algorithm for fire and smoke detection with limited data","volume":"18","author":"Namozov","year":"2018","journal-title":"Adv. Electr. Comput. Eng."},{"key":"ref_21","first-page":"171","article-title":"Deal: Deep evidential active learning for image classification","volume":"Volume 3","author":"Hemmer","year":"2022","journal-title":"Deep Learning Applications"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_23","unstructured":"Krizhevsky, A., and Hinton, G. (2009). Learning Multiple Layers of Features from Tiny Images, University of Toronto. Technical Report 0."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1016\/j.cell.2018.02.010","article-title":"Identifying medical diagnoses and treatable diseases by image-based deep learning","volume":"172","author":"Kermany","year":"2018","journal-title":"Cell"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27\u201330). Learning deep features for discriminative localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.319"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs","volume":"40","author":"Chen","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","unstructured":"Shimoda, W., and Yanai, K. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands, 11\u201314 October 2016, Springer."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2591","DOI":"10.1109\/TCSVT.2016.2589879","article-title":"Cost-effective active learning for deep image classification","volume":"27","author":"Wang","year":"2016","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_29","unstructured":"Krstinic, D., and Jakovcevic, T. (2023, February 24). Image Database. Available online: http:\/\/wildfire.fesb.hr\/."},{"key":"ref_30","unstructured":"Zhang, Q. (2023, February 24). Research Webpage about Smoke Detection for Fire Alarm: Datasets. Available online: http:\/\/smoke.ustc.edu.cn\/datasets.htm."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_32","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Chia Laguna Resort, Sardinia, Italy."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.cviu.2013.10.003","article-title":"Adaptive estimation of visual smoke detection parameters based on spatial data and fire risk index","volume":"118","year":"2014","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.firesaf.2017.08.004","article-title":"Deep domain adaptation based video smoke detection using synthetic smoke images","volume":"93","author":"Xu","year":"2017","journal-title":"Fire Saf. J."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/17\/4136\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:40:59Z","timestamp":1760128859000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/17\/4136"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,23]]},"references-count":34,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["rs15174136"],"URL":"https:\/\/doi.org\/10.3390\/rs15174136","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,8,23]]}}}