{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T12:11:49Z","timestamp":1785586309653,"version":"3.56.0"},"reference-count":44,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2020,12,15]],"date-time":"2020-12-15T00:00:00Z","timestamp":1607990400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100012331","name":"Agentschap Innoveren en Ondernemen","doi-asserted-by":"publisher","award":["AutoDrone"],"award-info":[{"award-number":["AutoDrone"]}],"id":[{"id":"10.13039\/100012331","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The detection of oil spills in water is a frequently researched area, but most of the research has been based on very large patches of crude oil on offshore areas. We present a novel framework for detecting oil spills inside a port environment, while using unmanned areal vehicles (UAV) and a thermal infrared (IR) camera. This framework is split into a training part and an operational part. In the training part, we present a process for automatically annotating RGB images and matching them with the IR images in order to create a dataset. The infrared imaging camera is crucial to be able to detect oil spills during nighttime. This dataset is then used to train on a convolutional neural network (CNN). Seven different CNN segmentation architectures and eight different feature extractors are tested in order to find the best suited combination for this task. In the operational part, we propose a method to have a real-time, onboard UAV oil spill detection using the pre-trained network and a low power interference device. A controlled experiment in the port of Antwerp showed that we are able to achieve an accuracy of 89% while only using the IR camera.<\/jats:p>","DOI":"10.3390\/rs12244090","type":"journal-article","created":{"date-parts":[[2020,12,15]],"date-time":"2020-12-15T09:12:57Z","timestamp":1608023577000},"page":"4090","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":88,"title":["Oil Spill Detection Using Machine Learning and Infrared Images"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9368-3060","authenticated-orcid":false,"given":"Thomas","family":"De Kerf","sequence":"first","affiliation":[{"name":"Op3Mech, Faculty of Applied Engineering, University of Antwerp, Groenenborgerlaan 171, 2020 Antwerp, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9306-5078","authenticated-orcid":false,"given":"Jona","family":"Gladines","sequence":"additional","affiliation":[{"name":"Op3Mech, Faculty of Applied Engineering, University of Antwerp, Groenenborgerlaan 171, 2020 Antwerp, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0590-2770","authenticated-orcid":false,"given":"Seppe","family":"Sels","sequence":"additional","affiliation":[{"name":"Op3Mech, Faculty of Applied Engineering, University of Antwerp, Groenenborgerlaan 171, 2020 Antwerp, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steve","family":"Vanlanduit","sequence":"additional","affiliation":[{"name":"Op3Mech, Faculty of Applied Engineering, University of Antwerp, Groenenborgerlaan 171, 2020 Antwerp, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.marpolbul.2016.06.027","article-title":"Environmental effects of the Deepwater Horizon oil spill: A review. Marine Pollution Bulletin Environmental effects of the Deepwater Horizon oil spill Environmental effects of the Deepwater Horizon oil spill: A review","volume":"110","author":"Beyer","year":"2016","journal-title":"Mar. Pollut. Bull."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1016\/0025-326X(95)00227-E","article-title":"Recovery of the coastal marine environment in the Gulf following the 1991 war-related oil spills","volume":"32","author":"Readman","year":"1996","journal-title":"Mar. Pollut. Bull."},{"key":"ref_3","unstructured":"ITPOF (2019). Oil Tanker Spill Statistics 2019. Technical Report, International Tanker Owners Pollution Federation, ITPOF. Available online: https:\/\/www.itopf.org\/fileadmin\/data\/Documents\/Company_Lit\/Oil_Spill_Stats_brochure_2020_for_web.pdf."},{"key":"ref_4","first-page":"399","article-title":"Artificial Neural Network Modeling for the Management of Oil Slick Transport in the Marine Environments","volume":"6","author":"Janati","year":"2020","journal-title":"Pollution"},{"key":"ref_5","first-page":"1","article-title":"Remote sensing estimation of surface oil volume during the 2010 Deepwater Horizon oil blowout in the Gulf of Mexico: Scaling up AVIRIS observations with MODIS measurements","volume":"12","author":"Hu","year":"2018","journal-title":"J. Appl. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.rse.2012.03.024","article-title":"State of the art satellite and airborne marine oil spill remote sensing: Application to the BP Deepwater Horizon oil spill","volume":"124","author":"Leifer","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"76","DOI":"10.5670\/oceanog.2016.72","article-title":"Methods of Oil Detection in Response to the Deepwater Horizon Oil Spill","volume":"29","author":"White","year":"2016","journal-title":"Oceanography"},{"key":"ref_8","first-page":"124","article-title":"Detection of Floating Oil Anomalies From the Deepwater Horizon Oil Spill With Synthetic Aperture Radar","volume":"26","author":"MacDonald","year":"2013","journal-title":"Oceanography"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.aqpro.2015.02.205","article-title":"Observation of Oil Spills through Landsat Thermal Infrared Imagery: A Case of Deepwater Horizon","volume":"3","author":"Xing","year":"2015","journal-title":"Aquat. Procedia"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1016\/j.marpolbul.2014.06.034","article-title":"A three-step model to assess shoreline and offshore susceptibility to oil spills: The South Aegean (Crete) as an analogue for confined marine basins","volume":"86","author":"Alves","year":"2014","journal-title":"Mar. Pollut. Bull."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1016\/j.envpol.2015.07.042","article-title":"Modelling of oil spills in confined maritime basins: The case for early response in the Eastern Mediterranean Sea","volume":"206","author":"Alves","year":"2015","journal-title":"Environ. Pollut."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"309","DOI":"10.5697\/oc.53-1-TI.309","article-title":"The role of the spatial resolution of a three-dimensional hydrodynamic model for marine transport risk assessment","volume":"53","author":"Andrejev","year":"2011","journal-title":"Oceanologia"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.marpolbul.2014.03.059","article-title":"Review of oil spill remote sensing","volume":"83","author":"Fingas","year":"2014","journal-title":"Mar. Pollut. Bull."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chenault, D.B., Vaden, J.P., Mitchell, D.A., and DeMicco, E.D. (2016, January 26\u201329). Infrared polarimetric sensing of oil on water. Proceedings of the Remote Sensing of the Ocean, Sea Ice, Coastal Waters, and Large Water Regions 2016, Edinburgh, UK.","DOI":"10.1117\/12.2241866"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"6642","DOI":"10.3390\/s8106642","article-title":"Oil Spill Detection by SAR Images: Dark Formation Detection, Feature Extraction and Classification Algorithms","volume":"8","author":"Topouzelis","year":"2008","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3561","DOI":"10.1080\/014311600750037589","article-title":"Oil spill detection using marine SAR images","volume":"21","author":"Fiscella","year":"2000","journal-title":"Int. J. Remote Sens."},{"key":"ref_17","unstructured":"Li, W., Zhang, H., and Osen, O.L. (2017, January 25\u201330). A UAV SAR Prototype for Marine and Arctic Application. Proceedings of the International Conference on Offshore Mechanics and Arctic Engineering, Trondheim, Norway. Available online: https:\/\/asmedigitalcollection.asme.org\/OMAE\/proceedings-pdf\/OMAE2017\/57748\/V07BT06A002\/2533852\/v07bt06a002-omae2017-61264.pdf."},{"key":"ref_18","first-page":"120","article-title":"Detection and mapping of oil slicks in the sea by comined use of hyperspectral imagery and laser induced fluorescence","volume":"5","author":"Lennon","year":"2006","journal-title":"EARSeL Eproceedings"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1007\/s00340-019-7215-y","article-title":"Aquatic environment monitoring using a drone-based fluorosensor","volume":"125","author":"Duan","year":"2019","journal-title":"Appl. Phys. B Lasers Opt."},{"key":"ref_20","first-page":"738","article-title":"Research on the ultraviolet reflectivity characteristic of simulative targets of oil spill on the ocean","volume":"30","author":"Fang","year":"2010","journal-title":"Guang Pu Xue Yu Guang Pu Fen Xi\/Spectrosc. Spectr. Anal."},{"key":"ref_21","first-page":"2377","article-title":"Research on UV Reflective Spectrum of Floating Transparent Oil","volume":"39","author":"Huang","year":"2019","journal-title":"Spectrosc. Spectr. Anal."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhan, S., Wang, C., Liu, S., Xia, K., Huang, H., Li, X., Liu, C., and Xu, R. (2019). Floating Xylene Spill Segmentation from Ultraviolet Images via Target Enhancement. Remote Sens., 11.","DOI":"10.3390\/rs11091142"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1112","DOI":"10.3390\/rs70101112","article-title":"Oil Spill Detection in Glint-Contaminated Near-Infrared MODIS Imagery","volume":"7","author":"Pisano","year":"2015","journal-title":"Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Clark, R., Swayze, G., Leifer, I., Livo, K., Kokaly, R., Hoefen, T., Lundeen, S., Eastwood, M., Green, R., and Pearson, N. (2010). A Method for Quantitative Mapping of Thick Oil Spills Using Imaging Spectroscopy, Technical Report.","DOI":"10.3133\/ofr20101167"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Allik, T., Ramboyong, L., Roberts, M., Walters, M., Soyka, T., Dixon, R., and Cho, J. (2016, January 17\u201321). Enhanced oil spill detection sensors in low-light environments. Proceedings of the Ocean Sensing and Monitoring VIII, Baltimore, MD, USA.","DOI":"10.1117\/12.2222064"},{"key":"ref_26","first-page":"123","article-title":"Remote sensing of marine oil spills using Sea-viewing Wide Field-of-View Sensor images","volume":"60","author":"Mihoub","year":"2019","journal-title":"Boll. Geofis. Teor. Appl."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhao, D., Cheng, X., Zhang, H., Niu, Y., Qi, Y., Zhang, H., Zhao, D., Cheng, X., Zhang, H., and Niu, Y. (2018). Evaluation of the Ability of Spectral Indices of Hydrocarbons and Seawater for Identifying Oil Slicks Utilizing Hyperspectral Images. Remote Sens., 10.","DOI":"10.3390\/rs10030421"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1300","DOI":"10.1016\/j.cie.2018.11.008","article-title":"A new approach to oil spill detection that combines deep learning with unmanned aerial vehicles","volume":"135","author":"Jiao","year":"2019","journal-title":"Comput. Ind. Eng."},{"key":"ref_29","unstructured":"Jung, A.B., Wada, K., Crall, J., Tanaka, S., Graving, J., Reinders, C., Yadav, S., Banerjee, J., Vecsei, G., and Kraft, A. (2020, February 01). Imgaug. Available online: https:\/\/github.com\/aleju\/imgaug."},{"key":"ref_30","unstructured":"Stockman, G., and Shapiro, L.G. (2001). Computer Vision. Computer Vision, Prentice Hall PTR. [1st ed.]."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/978-3-319-46976-8_19","article-title":"The Importance of Skip Connections in Biomedical Image Segmentation","volume":"10008 LNCS","author":"Drozdzal","year":"2016","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid Scene Parsing Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_33","unstructured":"Kendall, A., Badrinarayanan, V., and Cipolla, R. (2015). Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding. arxiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","article-title":"Fully Convolutional Networks for Semantic Segmentation","volume":"39","author":"Shelhamer","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L. (2018, January 18\u201322). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_37","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_38","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arxiv."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_40","unstructured":"Zeiler, M.D. (2012). Adadelta: An Adaptive Learning Rate Method. arXiv."},{"key":"ref_41","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_42","unstructured":"Dozat, T. (2016, January 2\u20134). Incorporating Nesterov Momentum into Adam. Workshop track ICLR. Proceedings of the International Conference on Learning Representations, San Juan, Puerto Rico."},{"key":"ref_43","unstructured":"Hinton, G.E., Srivastava, N., and Swersky, K. (2012). Neural Networks for Machine Learning Lecture 6a Overview of mini-batch gradient descent. COURSERA: Neural Networks for Machine Learning, Available online: http:\/\/www.cs.toronto.edu\/~hinton\/coursera\/lecture6\/lec6.pdf."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201313). Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/24\/4090\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:45:17Z","timestamp":1760179517000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/24\/4090"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,15]]},"references-count":44,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["rs12244090"],"URL":"https:\/\/doi.org\/10.3390\/rs12244090","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,15]]}}}