{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T18:59:24Z","timestamp":1775933964684,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T00:00:00Z","timestamp":1659484800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Solar energy is the fastest-growing clean and sustainable energy source, outperforming other forms of energy generation. Usually, solar panels are low maintenance and do not require permanent service. However, plenty of problems can result in a production loss of up to ~20% since a failed panel will impact the generation of a whole array. High-quality and timely maintenance of the power plant will reduce the cost of its repair and, most importantly, increase the life of the power plant and the total generation of electricity. Manual monitoring of panels is costly and time-consuming on large solar plantations; moreover, solar plantations located distantly are more complicated for humans to access. This paper presents deep learning-based photovoltaics fault detection techniques using thermal images obtained from an unmanned aerial vehicle (UAV) equipped with infrared sensors. We implemented the three most accurate segmentation models to detect defective panels on large solar plantations. The models employed in this work are DeepLabV3+, Feature Pyramid Network (FPN) and U-Net with different encoder architectures. The obtained results revealed intersection over union (IoU) of 79%, 85%, 86%, and dice coefficients of 87%, 92%, 94% for DeepLabV3+, FPN, and U-Net, respectively. The implemented models showed efficient performance and proved effective to resolve these challenges.<\/jats:p>","DOI":"10.3390\/rs14153728","type":"journal-article","created":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T23:33:01Z","timestamp":1659569581000},"page":"3728","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":56,"title":["Photovoltaics Plant Fault Detection Using Deep Learning Techniques"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6008-0434","authenticated-orcid":false,"given":"Sherozbek","family":"Jumaboev","sequence":"first","affiliation":[{"name":"Graduate School of Integrated Energy-AI, Jeonbuk National University, Jeonju 54896, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5802-422X","authenticated-orcid":false,"given":"Dadajon","family":"Jurakuziev","sequence":"additional","affiliation":[{"name":"Graduate School of Integrated Energy-AI, Jeonbuk National University, Jeonju 54896, Korea"}]},{"given":"Malrey","family":"Lee","sequence":"additional","affiliation":[{"name":"Institute for Education Innovation, Jeonbuk National University, Jeonju 54896, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"8148072","DOI":"10.1155\/2018\/8148072","article-title":"Perovskite-based solar cells: Materials, methods, and future perspectives","volume":"2018","author":"Zhou","year":"2018","journal-title":"J. Nanomater."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Dhanraj, J.A., Mostafaeipour, A., Velmurugan, K., Techato, K., Chaurasiya, P.K., Solomon, J.M., Gopalan, A., and Phoungthong, K. (2021). An effective evaluation on fault detection in solar panels. Energies, 14.","DOI":"10.3390\/en14227770"},{"key":"ref_3","unstructured":"K\u00f6ntges, M., Kurtz, S., Packard, C.E., Jahn, U., Berger, K., Kato, K., Friesen, T., Liu, H., Van Iseghem, M., and Wohlgemuth, J. (2014). Review of Failures of Photovoltaic Modules, International Energy Agency. Report EAI-PVPS T13-01:2014."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lee, D.H., and Park, J.H. (2019). Developing inspection methodology of solar energy plants by thermal infrared sensor on board unmanned aerial vehicles. Energies, 12.","DOI":"10.3390\/en12152928"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4566","DOI":"10.1016\/j.egyr.2021.07.045","article-title":"Image based surface damage detection of renewable energy installations using a unified deep learning approach","volume":"7","author":"Shihavuddin","year":"2021","journal-title":"Energy Rep."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1016\/j.solener.2019.02.067","article-title":"Automatic classification of defective photovoltaic module cells in electroluminescence images","volume":"185","author":"Deitsch","year":"2019","journal-title":"Sol. Energy"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Elmeseiry, N., Alshaer, N., and Ismail, T. (2021). A detailed survey and future directions of unmanned aerial vehicles (uavs) with potential applications. Aerospace, 8.","DOI":"10.3390\/aerospace8120363"},{"key":"ref_8","unstructured":"(2021, September 27). An Overview of Semantic Image Segmentation. Available online: https:\/\/www.jeremyjordan.me\/semantic-segmentation\/."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.patrec.2008.04.005","article-title":"Semantic object classes in video: A high-definition ground truth database","volume":"30","author":"Brostow","year":"2009","journal-title":"Pattern Recognit. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lee, M.Y., Bedia, J.S., Bhate, S.S., Barlow, G.L., Phillips, D., Fantl, W.J., Nolan, G.P., and Sch\u00fcrch, C.M. (2022). CellSeg: A robust, pre-trained nucleus segmentation and pixel quantification software for highly multiplexed fluorescence images. BMC Bioinform., 23.","DOI":"10.1186\/s12859-022-04570-9"},{"key":"ref_11","first-page":"022122","article-title":"Research and analysis of threshold segmentation algorithms in image processing","volume":"Volume 1237","author":"Niu","year":"2019","journal-title":"Journal of Physics: Conference Series"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"826967","DOI":"10.3389\/frsip.2022.826967","article-title":"Survey of Image Edge Detection","volume":"2","author":"Sun","year":"2022","journal-title":"Front. Signal Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yi, F., and Moon, I. (2012, January 19\u201320). Image segmentation: A survey of graph-cut methods. Proceedings of the 2012 International Conference on Systems and Informatics (ICSAI2012), Yantai, China.","DOI":"10.1109\/ICSAI.2012.6223428"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_15","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs","volume":"40","author":"Chen","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1016\/j.solener.2018.07.055","article-title":"Analysis of electroluminescence and infrared thermal images of monocrystalline silicon photovoltaic modules after 20 years of outdoor use in a solar vehicle","volume":"173","author":"Berardone","year":"2018","journal-title":"Sol. Energy"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1016\/j.solener.2020.03.049","article-title":"Deep learning based automatic defect identification of photovoltaic module using electroluminescence images","volume":"201","author":"Tang","year":"2020","journal-title":"Sol. Energy"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Deitsch, S., Buerhop-Lutz, C., Sovetkin, E., Steland, A., Maier, A., Gallwitz, F., and Riess, C. (2018). Segmentation of Photovoltaic Module Cells in Electroluminescence Images. arXiv.","DOI":"10.1016\/j.solener.2019.02.067"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1049\/el.2020.1542","article-title":"Automatic hotspots detection based on UAV infrared images for large-scale PV plant","volume":"56","author":"Nie","year":"2020","journal-title":"Electron. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cipriani, G., D\u2019Amico, A., Guarino, S., Manno, D., Traverso, M., and Di Dio, V. (2020). Convolutional neural network for dust and hotspot classification in PV modules. Energies, 13.","DOI":"10.3390\/en13236357"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1016\/j.solener.2019.08.061","article-title":"Improved outdoor thermography and processing of infrared images for defect detection in PV modules","volume":"190","author":"Akram","year":"2019","journal-title":"Sol. Energy"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Balasubramani, G., Thangavelu, V., Chinnusamy, M., Subramaniam, U., Padmanaban, S., and Mihet-Popa, L. (2020). Infrared thermography based defects testing of solar photovoltaic panel with fuzzy rule-based evaluation. Energies, 13.","DOI":"10.3390\/en13061343"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Seferbekov, S., Iglovikov, V., Buslaev, A., and Shvets, A. (2018, January 18\u201322). Feature pyramid network for multi-class land segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00051"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_28","unstructured":"Tan, M., and Le, Q. (2019, January 9\u201315). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Doll\u00e1r, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201323). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"020018","DOI":"10.1063\/1.4992835","article-title":"Research on the deep learning of the small sample data based on transfer learning","volume":"Volume 1864","author":"Zhao","year":"2017","journal-title":"AIP Conference Proceedings"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Pierdicca, R., Paolanti, M., Felicetti, A., Piccinini, F., and Zingaretti, P. (2020). Automatic Faults Detection of Photovoltaic Farms: solAIr, a Deep Learning-Based System for Thermal Images. Energies, 13.","DOI":"10.3390\/en13246496"},{"key":"ref_33","unstructured":"(2022, March 12). The Drone Life. Available online: https:\/\/thedronelifenj.com\/."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Buslaev, A., Iglovikov, V.I., Khvedchenya, E., Parinov, A., Druzhinin, M., and Kalinin, A.A. (2020). Albumentations: Fast and flexible image augmentations. Information, 11.","DOI":"10.3390\/info11020125"},{"key":"ref_35","unstructured":"Northcutt, C.G., Athalye, A., and Mueller, J. (2021). Pervasive label errors in test sets destabilize machine learning benchmarks. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/s11263-007-0090-8","article-title":"LabelMe: A database and web-based tool for image annotation","volume":"77","author":"Russell","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"65347","DOI":"10.1109\/ACCESS.2019.2917952","article-title":"DenseU-net-based semantic segmentation of small objects in urban remote sensing images","volume":"7","author":"Dong","year":"2019","journal-title":"IEEE Access"},{"key":"ref_38","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning, Lille, France."},{"key":"ref_39","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel."},{"key":"ref_40","unstructured":"Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Sudre, C.H., Li, W., Vercauteren, T., Ourselin, S., and Jorge Cardoso, M. (2017). Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Springer.","DOI":"10.1007\/978-3-319-67558-9_28"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3728\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:03:50Z","timestamp":1760141030000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3728"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,3]]},"references-count":41,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["rs14153728"],"URL":"https:\/\/doi.org\/10.3390\/rs14153728","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,3]]}}}