{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T11:43:24Z","timestamp":1775130204566,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,2,22]],"date-time":"2022-02-22T00:00:00Z","timestamp":1645488000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"IST-ID","award":["PTDC\/EEI-AUT\/31172\/2017,"],"award-info":[{"award-number":["PTDC\/EEI-AUT\/31172\/2017,"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Autonomous systems can help firefighting operations by detecting and locating the fire spot from surveillance images and videos. Similar to many other areas of computer vision, Convolutional Neural Networks (CNNs) have achieved state-of-the-art results for fire and smoke detection and segmentation. In practice, input images to a CNN are usually downsized to fit into the network to avoid computational complexities and restricted memory problems. Although in many applications downsizing is not an issue, in the early phases of fire ignitions downsizing may eliminate the fire regions since the incident regions are small. In this paper, we propose a novel method to segment fire and smoke regions in high resolution images based on a multi-resolution iterative quad-tree search algorithm , which manages the application of classification and segmentation CNNs to focus the attention on informative parts of the image. The proposed method is more computationally efficient compared to processing the whole high resolution input, and contains parameters that can be tuned based on the needed scale precision. The results show that the proposed method is capable of detecting and segmenting fire and smoke with higher accuracy and is useful for segmenting small regions of incident in high resolution aerial images in a computationally efficient way.<\/jats:p>","DOI":"10.3390\/s22051701","type":"journal-article","created":{"date-parts":[[2022,2,22]],"date-time":"2022-02-22T22:35:00Z","timestamp":1645569300000},"page":"1701","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Scalable Fire and Smoke Segmentation from Aerial Images Using Convolutional Neural Networks and Quad-Tree Search"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2396-549X","authenticated-orcid":false,"given":"Gon\u00e7alo","family":"Perrolas","sequence":"first","affiliation":[{"name":"Instituto de Sistemas e Rob\u00f3tica, Instituto Superior Tecnico, University of Lisbon, 1049-001 Lisbon, Portugal"}]},{"given":"Milad","family":"Niknejad","sequence":"additional","affiliation":[{"name":"Instituto de Sistemas e Rob\u00f3tica, Instituto Superior Tecnico, University of Lisbon, 1049-001 Lisbon, Portugal"}]},{"given":"Ricardo","family":"Ribeiro","sequence":"additional","affiliation":[{"name":"Instituto de Sistemas e Rob\u00f3tica, Instituto Superior Tecnico, University of Lisbon, 1049-001 Lisbon, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3991-1269","authenticated-orcid":false,"given":"Alexandre","family":"Bernardino","sequence":"additional","affiliation":[{"name":"Instituto de Sistemas e Rob\u00f3tica, Instituto Superior Tecnico, University of Lisbon, 1049-001 Lisbon, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,22]]},"reference":[{"key":"ref_1","unstructured":"Batista, M., Oliveira, B., Chaves, P., Ferreira, J.C., and Brand\u00e3o, T. (2019, January 3\u20135). Improved Real-time Wildfire Detection using a Surveillance System. Proceedings of the World Congress on Engineering, London, UK."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1108\/IR-11-2016-0297","article-title":"Exact laser beam positioning for measurement of vegetation vitality","volume":"44","author":"Lindner","year":"2017","journal-title":"Ind. Robot. Int. J."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sotnikov, O., Kartashov, V.G., Tymochko, O., Sergiyenko, O., Tyrsa, V., Mercorelli, P., and Flores-Fuentes, W. (2020). Methods for Ensuring the Accuracy of Radiometric and Optoelectronic Navigation Systems of Flying Robots in a Developed Infrastructure. Machine Vision and Navigation, Springer.","DOI":"10.1007\/978-3-030-22587-2_16"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1139\/cjfr-2014-0347","article-title":"A Survey on Technologies for Automatic Forest Fire Monitoring, Detection and Fighting Using UAVs and Remote Sensing Techniques","volume":"45","author":"Yuan","year":"2015","journal-title":"Can. J. For. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.firesaf.2008.05.005","article-title":"Fire detection in video sequences using a generic color model","volume":"44","author":"Celik","year":"2009","journal-title":"Fire Saf. J."},{"key":"ref_6","unstructured":"Chen, T.H., Wu, P.H., and Chiou, Y.C. (2004, January 24\u201327). An early fire-detection method based on image processing. Proceedings of the 2004 International Conference on Image Processing, Singapore."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1103","DOI":"10.1007\/s00138-011-0369-1","article-title":"Covariance matrix-based fire and flame detection method in video","volume":"23","year":"2012","journal-title":"Mach. Vis. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Dunnings, A.J., and Breckon, T.P. (2018, January 7\u201310). Experimentally defined convolutional neural network architecture variants for non-temporal real-time fire detection. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451657"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Barmpoutis, P., Dimitropoulos, K., Kaza, K., and Grammalidis, N. (2019, January 12\u201317). Fire Detection from Images Using Faster R-CNN and Multidimensional Texture Analysis. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.","DOI":"10.1109\/ICASSP.2019.8682647"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"58923","DOI":"10.1109\/ACCESS.2020.2982994","article-title":"Information-guided flame detection based on faster r-cnn","volume":"8","author":"Chaoxia","year":"2020","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Harkat, H., Nascimento, J.M., and Bernardino, A. (2021, January 11\u201312). Fire Detection using Residual Deeplabv3+ Model. Proceedings of the 2021 Telecoms Conference (ConfTELE), Leiria, Portugal.","DOI":"10.1109\/ConfTELE50222.2021.9435459"},{"key":"ref_12","unstructured":"Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv."},{"key":"ref_13","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/BF00288933","article-title":"Quad trees a data structure for retrieval on composite keys","volume":"4","author":"Finkel","year":"1974","journal-title":"Acta Inform."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1064","DOI":"10.1049\/iet-ipr.2014.0935","article-title":"Benchmarking of wildland fire color segmentation algorithms","volume":"9","author":"Toulouse","year":"2015","journal-title":"IET Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cruz, H., Eckert, M., Meneses, J., and Mart\u00ednez, J.F. (2016). Efficient Forest Fire Detection Index for Application in Unmanned Aerial Systems (UASs). Sensors, 16.","DOI":"10.3390\/s16060893"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Dung, N.M., and Ro, S. (2018, January 24\u201326). Algorithm for Fire Detection Using a Camera Surveillance System. Proceedings of the 2018 International Conference on Image and Graphics Processing, New York, NY, USA.","DOI":"10.1145\/3191442.3191450"},{"key":"ref_18","unstructured":"LeCun, Y., and Bengio, Y. (1998). Convolutional networks for images, speech, and time series. The Handbook of Brain Theory and Neural Networks, The MIT Press."},{"key":"ref_19","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lehr, J., Gerson, C., Ajami, M., and Kr\u00fcger, J. (2019). Development of a Fire Detection Based on the Analysis of Video Data by Means of Convolutional Neural Networks, Springer.","DOI":"10.1007\/978-3-030-31321-0_43"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Verlekar, T.T., and Bernardino, A. (2020, January 5\u20137). Video Based Fire Detection Using Xception and Conv-LSTM. Proceedings of the International Symposium on Visual Computing, San Diego, CA, USA.","DOI":"10.1007\/978-3-030-64559-5_21"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Harkat, H., Nascimento, J., and Bernardino, A. (2020, January 21\u201325). Fire segmentation using a SqueezeSegv2. Proceedings of the Image and Signal Processing for Remote Sensing XXVII, Online.","DOI":"10.1117\/12.2598566"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/j.neucom.2019.05.011","article-title":"Deep smoke segmentation","volume":"357","author":"Yuan","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1109\/83.277901","article-title":"Image compression via improved quadtree decomposition algorithms","volume":"3","author":"Shusterman","year":"1994","journal-title":"IEEE Trans. Image Process."},{"key":"ref_26","unstructured":"D\u2019Angelo, A. (2016, January 3\u20135). A Brief Introduction to Quadtrees and Their Applications. Proceedings of the 28th Canadian Conference on Computational Geometry, Vancouver, BC, Canada."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Cordonnier, J.B., Mahendran, A., Dosovitskiy, A., Weissenborn, D., Uszkoreit, J., and Unterthiner, T. (2021, January 20\u201325). Differentiable Patch Selection for Image Recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00238"},{"key":"ref_28","unstructured":"Katharopoulos, A., and Fleuret, F. (2019, January 18\u201323). Processing megapixel images with deep attention-sampling models. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_29","unstructured":"Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016, January 17\u201321). SqueezeNet: AlexNet-level accuracy with 50\u00d7 fewer parameters and <0.5 MB model size. Proceedings of the 19th International Conference Medical Image Computing and Computer-Assisted Intervention MICCAI1, Athens, Greece."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the 18th International Conference Medical Image Computing and Computer-Assisted Intervention MICCAI1, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.firesaf.2017.06.012","article-title":"Computer vision for wildfire research: An evolving image dataset for processing and analysis","volume":"92","author":"Toulouse","year":"2017","journal-title":"Fire Saf. J."},{"key":"ref_32","unstructured":"Baidya, A. (2020, November 12). Smoke Detection via Semantic Segmentation Using Baseline U-Net Model and Image Augmentation in Keras. Available online: https:\/\/github.com\/rekon\/Smoke-semantic-segmentation."},{"key":"ref_33","unstructured":"(2020, November 20). Smoke Dataset. Available online: http:\/\/smoke.ustc.edu.cn\/datasets.htm."},{"key":"ref_34","unstructured":"The MathWorks, Inc. (2020, December 27). Computer Vision Toolbox. Available online: https:\/\/www.mathworks.com\/products\/computer-vision.html."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/5\/1701\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:24:42Z","timestamp":1760135082000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/5\/1701"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,22]]},"references-count":34,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["s22051701"],"URL":"https:\/\/doi.org\/10.3390\/s22051701","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,22]]}}}