{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T10:51:51Z","timestamp":1782471111614,"version":"3.54.5"},"reference-count":46,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2022,9,24]],"date-time":"2022-09-24T00:00:00Z","timestamp":1663977600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Institute for Food and Agriculture (NIFA)","award":["1011741"],"award-info":[{"award-number":["1011741"]}]},{"name":"National Institute for Food and Agriculture (NIFA)","award":["1014919"],"award-info":[{"award-number":["1014919"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Aphanomyces root rot (ARR) is a devastating disease that affects the production of pea. The plants are prone to infection at any growth stage, and there are no chemical or cultural controls. Thus, the development of resistant pea cultivars is important. Phenomics technologies to support the selection of resistant cultivars through phenotyping can be valuable. One such approach is to couple imaging technologies with deep learning algorithms that are considered efficient for the assessment of disease resistance across a large number of plant genotypes. In this study, the resistance to ARR was evaluated through a CNN-based assessment of pea root images. The proposed model, DeepARRNet, was designed to classify the pea root images into three classes based on ARR severity scores, namely, resistant, intermediate, and susceptible classes. The dataset consisted of 1581 pea root images with a skewed distribution. Hence, three effective data-balancing techniques were identified to solve the prevalent problem of unbalanced datasets. Random oversampling with image transformations, generative adversarial network (GAN)-based image synthesis, and loss function with class-weighted ratio were implemented during the training process. The result indicated that the classification F1-score was 0.92 \u00b1 0.03 when GAN-synthesized images were added, 0.91 \u00b1 0.04 for random resampling, and 0.88 \u00b1 0.05 when class-weighted loss function was implemented, which was higher than when an unbalanced dataset without these techniques were used (0.83 \u00b1 0.03). The systematic approaches evaluated in this study can be applied to other image-based phenotyping datasets, which can aid the development of deep-learning models with improved performance.<\/jats:p>","DOI":"10.3390\/s22197237","type":"journal-article","created":{"date-parts":[[2022,9,26]],"date-time":"2022-09-26T03:34:17Z","timestamp":1664163257000},"page":"7237","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Evaluation of Effective Class-Balancing Techniques for CNN-Based Assessment of Aphanomyces Root Rot Resistance in Pea (Pisum sativum L.)"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1121-1642","authenticated-orcid":false,"given":"L. G.","family":"Divyanth","sequence":"first","affiliation":[{"name":"Department of Biological Systems Engineering, Washington State University, Pullman, WA 99164, USA"},{"name":"Department of Agricultural and Food Engineering, Indian Institute of Technology Kharagpur, Kharagpur 721302, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Afef","family":"Marzougui","sequence":"additional","affiliation":[{"name":"Department of Biological Systems Engineering, Washington State University, Pullman, WA 99164, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria Jose","family":"Gonz\u00e1lez-Bernal","sequence":"additional","affiliation":[{"name":"The Institute for Sustainable Agriculture, Spanish National Research Council, 14001 Cordova, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rebecca J.","family":"McGee","sequence":"additional","affiliation":[{"name":"Grain Legume Genetics and Physiology Research Unit, US Department of Agriculture-Agricultural Research Service (USDA-ARS), Pullman, WA 99164, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9644-8616","authenticated-orcid":false,"given":"Diego","family":"Rubiales","sequence":"additional","affiliation":[{"name":"The Institute for Sustainable Agriculture, Spanish National Research Council, 14001 Cordova, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sindhuja","family":"Sankaran","sequence":"additional","affiliation":[{"name":"Department of Biological Systems Engineering, Washington State University, Pullman, WA 99164, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,24]]},"reference":[{"key":"ref_1","first-page":"477","article-title":"Aphanomyces Pea Root Rot Disease and Control with Special Reference to Impact of Brassicaceae Cover Crops","volume":"62","author":"Hossain","year":"2012","journal-title":"Acta Agric. Scand. Sect. B Soil Plant Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"919","DOI":"10.1023\/A:1013171217610","article-title":"Specific Behaviour of French Aphanomyces euteiches Drechs. Populations For Virulence and Aggressiveness on Pea, Related to Isolates from Europe, America and New Zealand","volume":"107","author":"Wicker","year":"2001","journal-title":"Eur. J. Plant Pathol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1094\/PDIS-09-14-0905-PDN","article-title":"First Report of Root Rot of Field Pea Caused by Aphanomyces euteiches in Alberta, Canada","volume":"99","author":"Chatterton","year":"2015","journal-title":"Plant Dis."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.cj.2018.07.005","article-title":"Evaluation of Host Resistance and Fungicide Application as Tools for the Management of Root Rot of Field Pea Caused by Aphanomyces euteiches","volume":"7","author":"Wu","year":"2019","journal-title":"Crop J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1007\/s00122-002-0985-2","article-title":"Quantitative Trait Loci for Partial Resistance to Aphanomyces Root Rot in Pea","volume":"106","author":"Muehlbauer","year":"2002","journal-title":"Theor. Appl. Genet."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"203","DOI":"10.3198\/jpr2011.03.0139crg","article-title":"Registration of Pea Germplasm Lines Partially Resistant to Aphanomyces Root Rot for Breeding Fresh or Freezer Pea and Dry Pea Types","volume":"6","author":"McGee","year":"2012","journal-title":"J. Plant Regist."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"449","DOI":"10.3389\/fpls.2019.00449","article-title":"High-Throughput Field Imaging and Basic Image Analysis in a Wheat Breeding Programme","volume":"10","author":"Walter","year":"2019","journal-title":"Front. Plant Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"508","DOI":"10.3389\/fpls.2019.00508","article-title":"Leveraging Image Analysis for High-Throughput Plant Phenotyping","volume":"10","author":"Samal","year":"2019","journal-title":"Front. Plant Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1109\/MGRS.2020.2998816","article-title":"High-Throughput Estimation of Crop Traits: A Review of Ground and Aerial Phenotyping Platforms","volume":"9","author":"Jin","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1016\/j.tplants.2011.09.005","article-title":"Phenomics\u2013Technologies to Relieve the Phenotyping Bottleneck","volume":"16","author":"Furbank","year":"2011","journal-title":"Trends Plant Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.plantsci.2018.06.017","article-title":"Review: High-Throughput Phenotyping to Enhance the Use of Crop Genetic Resources","volume":"282","author":"Rebetzke","year":"2019","journal-title":"Plant Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"714","DOI":"10.3389\/fpls.2019.00714","article-title":"Crop Phenomics: Current Status and Perspectives","volume":"10","author":"Zhao","year":"2019","journal-title":"Front. Plant Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1016\/j.cj.2021.03.015","article-title":"High-Throughput Phenotyping: Breaking through the Bottleneck in Future Crop Breeding","volume":"9","author":"Song","year":"2021","journal-title":"Crop J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"128837","DOI":"10.1109\/ACCESS.2019.2939201","article-title":"A Survey of Deep Learning-Based Object Detection","volume":"7","author":"Jiao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1016\/j.neucom.2019.11.118","article-title":"A Brief Survey on Semantic Segmentation with Deep Learning","volume":"406","author":"Hao","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sapkota, B., Singh, V., Neely, C., Rajan, N., and Bagavathiannan, M. (2020). Detection of Italian Ryegrass in Wheat and Prediction of Competitive Interactions Using Remote-Sensing and Machine-Learning Techniques. Remote Sens., 12.","DOI":"10.3390\/rs12182977"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"100108","DOI":"10.1016\/j.atech.2022.100108","article-title":"A Two-Stage Deep-Learning Based Segmentation Model for Crop Disease Quantification Based on Corn Field Imagery","volume":"3","author":"Divyanth","year":"2022","journal-title":"Smart Agric. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.biosystemseng.2020.07.007","article-title":"Faster R\u2013CNN\u2013Based Apple Detection in Dense-Foliage Fruiting-Wall Trees Using RGB and Depth Features for Robotic Harvesting","volume":"197","author":"Fu","year":"2020","journal-title":"Biosyst. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1007\/s42853-022-00147-9","article-title":"Identification of Green Gram (Vigna radiata) Grains Infested by Callosobruchus maculatus Through X-Ray Imaging and GAN-Based Image Augmentation","volume":"47","author":"Divyanth","year":"2022","journal-title":"J. Biosyst. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.compag.2018.05.012","article-title":"Machine Learning Approaches for Crop Yield Prediction and Nitrogen Status Estimation in Precision Agriculture: A Review","volume":"151","author":"Chlingaryan","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"106723","DOI":"10.1016\/j.knosys.2020.106723","article-title":"Automatic Late Blight Lesion Recognition and Severity Quantification Based on Field Imagery of Diverse Potato Genotypes by Deep Learning","volume":"214","author":"Gao","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4613","DOI":"10.1073\/pnas.1716999115","article-title":"An Explainable Deep Machine Vision Framework for Plant Stress Phenotyping","volume":"115","author":"Ghosal","year":"2018","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1190","DOI":"10.3389\/fpls.2017.01190","article-title":"Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks","volume":"8","author":"Ubbens","year":"2017","journal-title":"Front. Plant Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"108650","DOI":"10.1016\/j.measurement.2020.108650","article-title":"A Deep Learning Approach to Measure Stress Level in Plants Due to Nitrogen Deficiency","volume":"173","author":"Azimi","year":"2021","journal-title":"Measurement"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"104373","DOI":"10.1016\/j.chemolab.2021.104373","article-title":"A Generic Workflow Combining Deep Learning and Chemometrics for Processing Close-Range Spectral Images to Detect Drought Stress in Arabidopsis Thaliana to Support Digital Phenotyping","volume":"216","author":"Mishra","year":"2021","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.biosystemseng.2016.08.024","article-title":"Plant Species Classification Using Deep Convolutional Neural Network","volume":"151","author":"Dyrmann","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"100178","DOI":"10.1016\/j.comtox.2021.100178","article-title":"Effective Data-Balancing Methods for Class-Imbalanced Genotoxicity Datasets Using Machine Learning Algorithms and Molecular Fingerprints","volume":"20","author":"Bae","year":"2021","journal-title":"Comput. Toxicol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1016\/j.copbio.2011.04.015","article-title":"Systems Analysis of Adaptive Immunity by Utilization of High-Throughput Technologies","volume":"22","author":"Reddy","year":"2011","journal-title":"Curr. Opin. Biotechnol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4180","DOI":"10.1021\/acs.jcim.9b01162","article-title":"Deep Learning-Based Imbalanced Data Classification for Drug Discovery","volume":"60","author":"Korkmaz","year":"2020","journal-title":"J. Chem. Inf. Model."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"106279","DOI":"10.1016\/j.compag.2021.106279","article-title":"Tomato Plant Disease Detection Using Transfer Learning with C-GAN Synthetic Images","volume":"187","author":"Abbas","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative Adversarial Nets","volume":"63","author":"Goodfellow","year":"2020","journal-title":"Commun. ACM"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Giuffrida, M.V., Scharr, H., and Tsaftaris, S.A. (2017, January 22\u201329). ARIGAN: Synthetic Arabidopsis Plants Using Generative Adversarial Network. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1101\/184259"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.biosystemseng.2021.01.014","article-title":"Combining Generative Adversarial Networks and Agricultural Transfer Learning for Weeds Identification","volume":"204","author":"Mylonas","year":"2021","journal-title":"Biosyst. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Arsenovic, M., Karanovic, M., Sladojevic, S., Anderla, A., and Stefanovic, D. (2019). Solving Current Limitations of Deep Learning Based Approaches for Plant Disease Detection. Symmetry, 11.","DOI":"10.3390\/sym11070939"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.biosystemseng.2019.09.005","article-title":"Generating Artificial Images of Plant Seedlings Using Generative Adversarial Networks","volume":"187","author":"Madsen","year":"2019","journal-title":"Biosyst. Eng."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1046\/j.1365-3059.2001.00590.x","article-title":"Pathogenic Characteristics of Isolates of Aphanomyces euteiches from Pea in France","volume":"50","author":"Wicker","year":"2001","journal-title":"Plant Pathol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"383","DOI":"10.3389\/fpls.2019.00383","article-title":"Advanced Imaging for Quantitative Evaluation of Aphanomyces Root Rot Resistance in Lentil","volume":"10","author":"Marzougui","year":"2019","journal-title":"Front. Plant Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"11","DOI":"10.34133\/2020\/2393062","article-title":"Generalized Linear Model with Elastic Net Regularization and Convolutional Neural Network for Evaluating Aphanomyces Root Rot Severity in Lentil","volume":"2020","author":"Marzougui","year":"2020","journal-title":"Plant Phenomics"},{"key":"ref_40","unstructured":"Tan, M., and Le, Q.V. (2019, January 9\u201315). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. Proceedings of the 36th International Conference on Machine Learning PMLR, Long Beach, CA, USA."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"20410","DOI":"10.1038\/srep20410","article-title":"Localization and Classification of Paddy Field Pests Using a Saliency Map and Deep Convolutional Neural Network","volume":"6","author":"Liu","year":"2016","journal-title":"Sci. Rep."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Stewart, E.L., Wiesner-Hanks, T., Kaczmar, N., DeChant, C., Wu, H., Lipson, H., Nelson, R.J., and Gore, M.A. (2019). Quantitative Phenotyping of Northern Leaf Blight in UAV Images Using Deep Learning. Remote Sens., 11.","DOI":"10.3390\/rs11192209"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1186\/s13007-020-00570-z","article-title":"Deep Convolutional Neural Networks for Image-Based Convolvulus Sepium Detection in Sugar Beet Fields","volume":"16","author":"Gao","year":"2020","journal-title":"Plant Methods"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1186\/s13007-019-0479-8","article-title":"Plant Disease Identification Using Explainable 3D Deep Learning on Hyperspectral Images","volume":"15","author":"Nagasubramanian","year":"2019","journal-title":"Plant Methods"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1016\/j.compag.2019.05.015","article-title":"A Low-Resolution Image Restoration Classifier Network to Identify Stored-Grain Insects from Images of Sticky Boards","volume":"162","author":"Zhou","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"105117","DOI":"10.1016\/j.compag.2019.105117","article-title":"Unsupervised Image Translation Using Adversarial Networks for Improved Plant Disease Recognition","volume":"168","author":"Nazki","year":"2020","journal-title":"Comput. Electron. Agric."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7237\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:38:36Z","timestamp":1760143116000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7237"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,24]]},"references-count":46,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22197237"],"URL":"https:\/\/doi.org\/10.3390\/s22197237","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,24]]}}}