{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,8]],"date-time":"2025-11-08T13:45:50Z","timestamp":1762609550235,"version":"build-2065373602"},"reference-count":30,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,10,19]],"date-time":"2023-10-19T00:00:00Z","timestamp":1697673600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Spanish MCIN\/AEI\/10.13039\/5011000011033\/FEDER UE","award":["PAIDI 2020"],"award-info":[{"award-number":["PAIDI 2020"]}]},{"name":"Plan Andaluz de Investigaci\u00f3n, Desarrollo e Innovaci\u00f3n","award":["PAIDI 2020"],"award-info":[{"award-number":["PAIDI 2020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Due to the need to know the availability of solar resources for the solar renewable technologies in advance, this paper presents a new methodology based on computer vision and the object detection technique that uses convolutional neural networks (EfficientDet-D2 model) to detect clouds in image series. This methodology also calculates the speed and direction of cloud motion, which allows the prediction of transients in the available solar radiation due to clouds. The convolutional neural network model retraining and validation process finished successfully, which gave accurate cloud detection results in the test. Also, during the test, the estimation of the remaining time for a transient due to a cloud was accurate, mainly due to the precise cloud detection and the accuracy of the remaining time algorithm.<\/jats:p>","DOI":"10.3390\/a16100487","type":"journal-article","created":{"date-parts":[[2023,10,19]],"date-time":"2023-10-19T11:46:26Z","timestamp":1697715986000},"page":"487","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Cloud Detection and Tracking Based on Object Detection with Convolutional Neural Networks"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0529-5672","authenticated-orcid":false,"given":"Jose Antonio","family":"Carballo","sequence":"first","affiliation":[{"name":"CIEMAT, Plataforma Solar de Almer\u00eda (PSA), 04200 Almer\u00eda, Spain"},{"name":"CIESOL, Solar Energy Research Centre, Joint Institute, University of Almer\u00eda, CIEMAT, 04120 Almer\u00eda, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2322-2867","authenticated-orcid":false,"given":"Javier","family":"Bonilla","sequence":"additional","affiliation":[{"name":"CIEMAT, Plataforma Solar de Almer\u00eda (PSA), 04200 Almer\u00eda, Spain"},{"name":"CIESOL, Solar Energy Research Centre, Joint Institute, University of Almer\u00eda, CIEMAT, 04120 Almer\u00eda, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1967-7823","authenticated-orcid":false,"given":"Jes\u00fas","family":"Fern\u00e1ndez-Reche","sequence":"additional","affiliation":[{"name":"CIEMAT, Plataforma Solar de Almer\u00eda (PSA), 04200 Almer\u00eda, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9891-1974","authenticated-orcid":false,"given":"Bijan","family":"Nouri","sequence":"additional","affiliation":[{"name":"Deutsches Zentrum f\u00fcr Luft-und Raumfahrt (DLR), Institute of Solar Research, 04005 Almer\u00eda, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9523-9705","authenticated-orcid":false,"given":"Antonio","family":"Avila-Marin","sequence":"additional","affiliation":[{"name":"CIEMAT, Plataforma Solar de Almer\u00eda (PSA), 04200 Almer\u00eda, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1892-5701","authenticated-orcid":false,"given":"Yann","family":"Fabel","sequence":"additional","affiliation":[{"name":"Deutsches Zentrum f\u00fcr Luft-und Raumfahrt (DLR), Institute of Solar Research, 04005 Almer\u00eda, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8843-8511","authenticated-orcid":false,"given":"Diego-C\u00e9sar","family":"Alarc\u00f3n-Padilla","sequence":"additional","affiliation":[{"name":"CIEMAT, Plataforma Solar de Almer\u00eda (PSA), 04200 Almer\u00eda, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1016\/j.renene.2019.04.094","article-title":"Effect of short cloud shading on the performance of parabolic trough solar power plants: Motorized vs manual valves","volume":"142","author":"Abutayeh","year":"2019","journal-title":"Renew. Energy"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/j.renene.2018.01.019","article-title":"Dynamic performance of an aiming control methodology for solar central receivers due to cloud disturbances","volume":"121","author":"Too","year":"2018","journal-title":"Renew. Energy"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1221","DOI":"10.1016\/j.renene.2021.12.008","article-title":"Transient simulation of a control strategy for solar receivers based on mass flow valves adjustments and heliostats aiming","volume":"185","author":"Barraza","year":"2022","journal-title":"Renew. Energy"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1016\/j.renene.2021.04.141","article-title":"Comparative analysis of methods for cloud segmentation in ground-based infrared images","volume":"175","year":"2021","journal-title":"Renew. Energy"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.solener.2019.02.004","article-title":"Determination of cloud transmittance for all sky imager based solar nowcasting","volume":"181","author":"Nouri","year":"2019","journal-title":"Sol. Energy"},{"key":"ref_6","unstructured":"Denholm, P., and Margolis, R. (2023, October 17). Energy Storage Requirements for Achieving 50% Solar Photovoltaic Energy Penetration in California, Available online: https:\/\/www.nrel.gov\/docs\/fy16osti\/66595.pdf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/s40747-019-00128-0","article-title":"Cloud detection methodologies: Variants and development\u2014A review","volume":"6","author":"Mahajan","year":"2020","journal-title":"Complex Intell. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1007\/s11760-021-01885-7","article-title":"A review on deep learning techniques for cloud detection methodologies and challenges","volume":"15","author":"Li","year":"2021","journal-title":"Signal Image Video Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"100019","DOI":"10.1016\/j.seja.2022.100019","article-title":"Systematic Review of Nowcasting Approaches for Solar Energy Production based upon Ground-Based Cloud Imaging","volume":"2","author":"Martins","year":"2022","journal-title":"Sol. Energy Adv."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1016\/j.solener.2021.10.065","article-title":"Cloud detection using convolutional neural networks on remote sensing images","volume":"230","author":"Matsunobu","year":"2021","journal-title":"Sol. Energy"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.solener.2021.03.061","article-title":"An enhanced cloud segmentation algorithm for accurate irradiance forecasting","volume":"221","author":"Rashid","year":"2021","journal-title":"Sol. Energy"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1016\/j.renene.2015.09.058","article-title":"Quantitative evaluation of the impact of cloud transmittance and cloud velocity on the accuracy of short-term DNI forecasts","volume":"86","author":"Li","year":"2016","journal-title":"Renew. Energy"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.renene.2016.12.023","article-title":"Cloud tracking using clusters of feature points for accurate solar irradiance nowcasting","volume":"104","author":"Cheng","year":"2017","journal-title":"Renew. Energy"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Guo, Y., Cao, X., Liu, B., and Gao, M. (2020). Cloud detection for satellite imagery using attention-based U-Net convolutional neural network. Symmetry, 12.","DOI":"10.3390\/sym12061056"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1109\/TGRS.2020.2994349","article-title":"Simultaneous cloud detection and removal from bitemporal remote sensing images using cascade convolutional neural networks","volume":"59","author":"Ji","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"108177","DOI":"10.1016\/j.compeleceng.2022.108177","article-title":"Multi-feature embedded learning SVM for cloud detection in remote sensing images","volume":"102","author":"Zhang","year":"2022","journal-title":"Comput. Electr. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1953","DOI":"10.5194\/amt-13-1953-2020","article-title":"SegCloud: A novel cloud image segmentation model using a deep convolutional neural network for ground-based all-sky-view camera observation","volume":"13","author":"Xie","year":"2020","journal-title":"Atmos. Meas. Tech."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"797","DOI":"10.5194\/amt-15-797-2022","article-title":"Applying self-supervised learning for semantic cloud segmentation of all-sky images","volume":"15","author":"Fabel","year":"2021","journal-title":"Atmos. Meas. Tech. Discuss."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.renene.2018.08.101","article-title":"New approach for solar tracking systems based on computer vision, low cost hardware and deep learning","volume":"133","author":"Carballo","year":"2019","journal-title":"Renew. Energy"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"030012","DOI":"10.1063\/1.5117524","article-title":"Machine learning for solar trackers","volume":"2126","author":"Carballo","year":"2019","journal-title":"AIP Conf. Proc."},{"key":"ref_21","unstructured":"Huang, J., and Rathod, V. (2023, October 17). Supercharge your computer vision models with the TensorFlow Object Detection API. Available online: https:\/\/blog.research.google\/2017\/06\/supercharge-your-computer-vision-models.html?m=1."},{"key":"ref_22","unstructured":"(2023, October 17). Ministerio de Ciencia e Innovaci\u00f3n, Centro de Investigaciones Energ\u00e9ticas, Medioambientales y Tecnol\u00f3gicas (CIEMAT)\u2014Plataforma Solar de Almer\u00eda. Available online: http:\/\/www.psa.es."},{"key":"ref_23","unstructured":"VanRossum, G. (2023, October 17). Python Reference Manual. Department Of Computer Science [CS]. Available online: https:\/\/docs.python.org\/."},{"key":"ref_24","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G., Davis, A., Dean, J., and Devin, M. (2023, October 17). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Software Available from tensorflow.org. Available online: https:\/\/www.tensorflow.org."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tan, M., Pang, R., and Le, Q. (2020, January 13\u201319). Efficientdet: Scalable and efficient object detection. Proceedings of the IEEE\/CVF Conference On Computer Vision And Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01079"},{"key":"ref_26","first-page":"740","article-title":"Microsoft coco: Common objects in context","volume":"8693","author":"Lin","year":"2014","journal-title":"Eur. Conf. Comput. Vis."},{"key":"ref_27","unstructured":"Russell, S. (2010). Artificial Intelligence a Modern Approach, Pearson Education, Inc."},{"key":"ref_28","unstructured":"(2023, October 17). Tensorflow Model Configuration File. Available online: https:\/\/github.com\/tensorflow\/models\/blob\/master\/research\/object_detection\/g3doc\/tf2_detection_zoo.md."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1214\/aoms\/1177703732","article-title":"Robust Estimation of a Location Parameter","volume":"35","author":"Huber","year":"1964","journal-title":"Ann. Math. Stat."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lin, T., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference On Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/10\/487\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:09:56Z","timestamp":1760130596000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/10\/487"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,19]]},"references-count":30,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["a16100487"],"URL":"https:\/\/doi.org\/10.3390\/a16100487","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2023,10,19]]}}}