{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T03:06:12Z","timestamp":1778814372371,"version":"3.51.4"},"reference-count":41,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2023,11,30]],"date-time":"2023-11-30T00:00:00Z","timestamp":1701302400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004961","name":"Tecnol\u00f3gico de Monterrey","doi-asserted-by":"publisher","award":["I016-IAMSM006-C3-T3-E"],"award-info":[{"award-number":["I016-IAMSM006-C3-T3-E"]}],"id":[{"id":"10.13039\/501100004961","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Berry production is increasing worldwide each year; however, high production leads to labor shortages and an increase in wasted fruit during harvest seasons. This problem opened new research opportunities in computer vision as one main challenge to address is the uncontrolled light conditions in greenhouses and open fields. The high light variations between zones can lead to underexposure of the regions of interest, making it difficult to classify between vegetation, ripe, and unripe blackberries due to their black color. Therefore, the aim of this work is to automate the process of classifying the ripeness stages of blackberries in normal and low-light conditions by exploring the use of image fusion methods to improve the quality of the input image before the inference process. The proposed algorithm adds information from three sources: visible, an improved version of the visible, and a sensor that captures images in the near-infrared spectra, obtaining a mean F1 score of 0.909\u00b10.074 and 0.962\u00b10.028 in underexposed images, without and with model fine-tuning, respectively, which in some cases is an increase of up to 12% in the classification rates. Furthermore, the analysis of the fusion metrics showed that the method could be used in outdoor images to enhance their quality; the weighted fusion helps to improve only underexposed vegetation, improving the contrast of objects in the image without significant changes in saturation and colorfulness.<\/jats:p>","DOI":"10.3390\/s23239543","type":"journal-article","created":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T04:12:56Z","timestamp":1701403976000},"page":"9543","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Blackberry Fruit Classification in Underexposed Images Combining Deep Learning and Image Fusion Methods"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5799-0955","authenticated-orcid":false,"given":"Eduardo","family":"Morales-Vargas","sequence":"first","affiliation":[{"name":"Tecnologico de Monterrey, Institute of Advanced Materials for Sustainable Manufacturing, Av. Gral Ram\u00f3n Corona No 2514, Colonia Nuevo M\u00e9xico, Zapopan 45201, Jalisco, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2559-539X","authenticated-orcid":false,"given":"Rita Q.","family":"Fuentes-Aguilar","sequence":"additional","affiliation":[{"name":"Tecnologico de Monterrey, Institute of Advanced Materials for Sustainable Manufacturing, Av. Gral Ram\u00f3n Corona No 2514, Colonia Nuevo M\u00e9xico, Zapopan 45201, Jalisco, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5904-0088","authenticated-orcid":false,"given":"Emanuel","family":"de-la-Cruz-Espinosa","sequence":"additional","affiliation":[{"name":"Tecnologico de Monterrey, Escuela de Ingenier\u00eda y Ciencias, Av. Gral Ram\u00f3n Corona No 2514, Colonia Nuevo M\u00e9xico, Zapopan 45201, Jalisco, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1430-7567","authenticated-orcid":false,"given":"Gustavo","family":"Hern\u00e1ndez-Melgarejo","sequence":"additional","affiliation":[{"name":"Tecnologico de Monterrey, Institute of Advanced Materials for Sustainable Manufacturing, Av. Gral Ram\u00f3n Corona No 2514, Colonia Nuevo M\u00e9xico, Zapopan 45201, Jalisco, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,11,30]]},"reference":[{"key":"ref_1","unstructured":"(2023, May 18). Secretaria de Agricultura, Ganaderia y Pesca. Planeaci\u00f3n Agr\u00edcola Nacional 2017\u20132030, Available online: https:\/\/www.gob.mx\/cms\/uploads\/attachment\/file\/257076\/Potencial-Frutas_del_Bosque.pdf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.biosystemseng.2011.07.005","article-title":"Design and control of an apple harvesting robot","volume":"110","author":"Jidong","year":"2011","journal-title":"Biosyst. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"709","DOI":"10.3233\/JBR-190421","article-title":"Recent advances in postharvest technologies to extend the shelf life of blueberries (Vaccinium sp.), raspberries (Rubus idaeus L.) and blackberries (Rubus sp.)","volume":"9","author":"Huynh","year":"2019","journal-title":"J. Berry Res."},{"key":"ref_4","first-page":"203","article-title":"Fruit Detection System and an End Effector for Robotic Harvesting of Fuji Apples. Technical Report 1","volume":"12","author":"Bulanon","year":"2010","journal-title":"Agric. Eng. Int. CIGR J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1177\/1035304617703933","article-title":"US farm workers: What drives their job retention and work time allocation decisions?","volume":"28","author":"Luo","year":"2017","journal-title":"Econ. Labour Relations Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103097","DOI":"10.1016\/j.agsy.2021.103097","article-title":"Impact of the COVID-19 pandemic on apple orchards in Europe","volume":"190","author":"Tougeron","year":"2021","journal-title":"Agric. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1038\/s43016-021-00287-9","article-title":"Responsible development of autonomous robotics in agriculture","volume":"2","author":"Rose","year":"2021","journal-title":"Nat. Food"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"103152","DOI":"10.1016\/j.agsy.2021.103152","article-title":"Impact of COVID-19 on farming systems in Europe through the lens of resilience thinking","volume":"191","author":"Meuwissen","year":"2021","journal-title":"Agric. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"57","DOI":"10.3733\/ca.2021a0009","article-title":"Robotic strawberry harvest is promising but will need improved technology and higher wages to be economically viable","volume":"75","author":"Delbridge","year":"2021","journal-title":"Calif. Agric."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s43154-020-00034-1","article-title":"Selective Harvesting Robotics: Current Research, Trends, and Future Directions","volume":"2","author":"Kootstra","year":"2021","journal-title":"Curr. Robot. Rep."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"881904","DOI":"10.3389\/fpls.2022.881904","article-title":"Development of a dual-arm rapid grape-harvesting robot for horizontal trellis cultivation","volume":"13","author":"Jiang","year":"2022","journal-title":"Front. Plant Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1856","DOI":"10.1007\/s11119-022-09913-3","article-title":"Intelligent robots for fruit harvesting: Recent developments and future challenges","volume":"23","author":"Zhou","year":"2022","journal-title":"Precis. Agric."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.compag.2016.06.022","article-title":"A review of key techniques of vision-based control for harvesting robot","volume":"127","author":"Zhao","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"510","DOI":"10.3389\/fpls.2020.00510","article-title":"Recognition and Localization Methods for Vision-Based Fruit Picking Robots: A Review","volume":"11","author":"Tang","year":"2020","journal-title":"Front. Plant Sci."},{"key":"ref_15","unstructured":"Kader, A.A. (1997, January 3\u20137). Fruit maturity, ripening, and quality relationships. Proceedings of the International Symposium Effect of Pre-Postharvest Factors in Fruit Storage, Warsaw, Poland."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"106562","DOI":"10.1016\/j.compag.2021.106562","article-title":"Vision systems for harvesting robots: Produce detection and localization","volume":"192","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"L\u00f3pez-Barrios, J.D., Escobedo Cabello, J.A., G\u00f3mez-Espinosa, A., and Montoya-Cavero, L.E. (2023). Green Sweet Pepper Fruit and Peduncle Detection Using Mask R-CNN in Greenhouses. Appl. Sci., 13.","DOI":"10.3390\/app13106296"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fan, Y., Zhang, S., Feng, K., Qian, K., Wang, Y., and Qin, S. (2022). Strawberry Maturity Recognition Algorithm Combining Dark Channel Enhancement and YOLOv5. Sensors, 22.","DOI":"10.3390\/s22020419"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Vanmali, A.V., Kelkar, S.G., and Gadre, V.M. (2015, January 16\u201319). A novel approach for image dehazing combining visible-NIR images. Proceedings of the 2015 5th National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), Patna, India.","DOI":"10.1109\/NCVPRIPG.2015.7489945"},{"key":"ref_20","unstructured":"Dong, X., Wang, G., Pang, Y., Li, W., Wen, J., Meng, W., and Lu, Y. (2011, January 11\u201315). Fast efficient algorithm for enhancement of low lighting video. Proceedings of the 2011 IEEE International Conference on Multimedia and Expo, Barcelona, Spain."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Herrera-Arellano, M.A., Peregrina-Barreto, H., and Terol-Villalobos, I. (2019, January 13\u201315). Color outdoor image enhancement by V-NIR fusion and weighted luminance. Proceedings of the 2019 IEEE International Autumn Meeting on Power, Electronics and Computing (ROPEC), Ixtapa, Mexico.","DOI":"10.1109\/ROPEC48299.2019.9057064"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1109\/TIP.2006.888340","article-title":"Novel cooperative neural fusion algorithms for image restoration and image fusion","volume":"16","author":"Xia","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1109\/TIM.2009.2026612","article-title":"Multifocus image fusion and restoration with sparse representation","volume":"59","author":"Yang","year":"2010","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"8029","DOI":"10.1364\/OE.15.008029","article-title":"Multi-view image fusion improves resolution in three-dimensional microscopy","volume":"15","author":"Huisken","year":"2007","journal-title":"Optics Express"},{"key":"ref_25","unstructured":"Ngo, H., Tao, L., Zhang, M., Livingston, A., and Asari, V. (2005, January 20\u201325). A visibility improvement system for low vision drivers by nonlinear enhancement of fused visible and infrared video. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905)\u2014Workshops, San Diego, CA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1185","DOI":"10.1109\/TIP.2007.894236","article-title":"Multispectral Bilateral Video Fusion","volume":"16","author":"Bennett","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","first-page":"1063","article-title":"Visible and NIR image fusion using weight-map-guided Laplacian\u2013Gaussian pyramid for improving scene visibility","volume":"42","author":"Vanmali","year":"2017","journal-title":"Sadhana-Acad. Proc. Eng. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4962","DOI":"10.1109\/TIP.2021.3077310","article-title":"Visible-NIR Image Fusion Based on Top-Hat Transform","volume":"30","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1109\/TCI.2019.2956873","article-title":"Adaptive Near-Infrared and Visible Fusion for Fast Image Enhancement","volume":"6","author":"Awad","year":"2020","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1117\/12.597618","article-title":"A review of image fusion technology in 2005","volume":"Volume 5782","author":"Peacock","year":"2005","journal-title":"Proceedings of the Thermosense XXVII"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1729881417711683","DOI":"10.1177\/1729881417711683","article-title":"Gradient-guided color image contrast and saturation enhancement","volume":"14","author":"Shi","year":"2017","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.inffus.2018.02.004","article-title":"Infrared and visible image fusion methods and applications: A survey","volume":"45","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"5381","DOI":"10.1109\/TIP.2017.2724241","article-title":"Near-Infrared Coloring via a Contrast-Preserving Mapping Model","volume":"26","author":"Son","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1117\/12.477378","article-title":"Measuring colorfulness in natural images","volume":"5007","author":"Hasler","year":"2003","journal-title":"Proc. Hum. Vis. Electron. Imaging"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3111","DOI":"10.1109\/TCSVT.2017.2748150","article-title":"Near-infrared fusion via color regularization for haze and color distortion removals","volume":"28","author":"Son","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/38.946629","article-title":"Color transfer between images","volume":"21","author":"Reinhard","year":"2001","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2036","DOI":"10.1364\/JOSAA.15.002036","article-title":"Statistics of cone responses to natural images: Implications for visual coding","volume":"15","author":"Ruderman","year":"1998","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_38","unstructured":"Dong, X., Pang, Y., and Wen, J. (2010). ACM SIGGRAPH 2010 Posters, Association for Computing Machinery."},{"key":"ref_39","first-page":"31","article-title":"Real-time hyperspectral imaging for the in-field estimation of strawberry ripeness with deep learning","volume":"4","author":"Gao","year":"2020","journal-title":"Artif. Intell. Agric."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1007\/s12393-022-09322-2","article-title":"Advances in Machine Learning and Hyperspectral Imaging in the Food Supply Chain","volume":"14","author":"Kang","year":"2022","journal-title":"Food Eng. Rev."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.1080\/00032719.2020.1812622","article-title":"Assessment of Strawberry Ripeness Using Hyperspectral Imaging","volume":"54","author":"Shao","year":"2020","journal-title":"Anal. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/23\/9543\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:35:22Z","timestamp":1760132122000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/23\/9543"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,30]]},"references-count":41,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["s23239543"],"URL":"https:\/\/doi.org\/10.3390\/s23239543","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,30]]}}}