{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,5]],"date-time":"2026-04-05T04:16:16Z","timestamp":1775362576958,"version":"3.50.1"},"reference-count":58,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,7,2]],"date-time":"2021-07-02T00:00:00Z","timestamp":1625184000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the increase in the digitization efforts of herbarium collections worldwide, dataset repositories such as iDigBio and GBIF now have hundreds of thousands of herbarium sheet images ready for exploration. Although this serves as a new source of plant leaves data, herbarium datasets have an inherent challenge to deal with the sheets containing other non-plant objects such as color charts, barcodes, and labels. Even for the plant part itself, a combination of different overlapping, damaged, and intact individual leaves exist together with other plant organs such as stems and fruits, which increases the complexity of leaf trait extraction and analysis. Focusing on segmentation and trait extraction on individual intact herbarium leaves, this study proposes a pipeline consisting of deep learning semantic segmentation model (DeepLabv3+), connected component analysis, and a single-leaf classifier trained on binary images to automate the extraction of an intact individual leaf with phenotypic traits. The proposed method achieved a higher F1-score for both the in-house dataset (96%) and on a publicly available herbarium dataset (93%) compared to object detection-based approaches including Faster R-CNN and YOLOv5. Furthermore, using the proposed approach, the phenotypic measurements extracted from the segmented individual leaves were closer to the ground truth measurements, which suggests the importance of the segmentation process in handling background noise. Compared to the object detection-based approaches, the proposed method showed a promising direction toward an autonomous tool for the extraction of individual leaves together with their trait data directly from herbarium specimen images.<\/jats:p>","DOI":"10.3390\/s21134549","type":"journal-article","created":{"date-parts":[[2021,7,2]],"date-time":"2021-07-02T10:06:34Z","timestamp":1625220394000},"page":"4549","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Automated Extraction of Phenotypic Leaf Traits of Individual Intact Herbarium Leaves from Herbarium Specimen Images Using Deep Learning Based Semantic Segmentation"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9683-8689","authenticated-orcid":false,"given":"Burhan Rashid","family":"Hussein","sequence":"first","affiliation":[{"name":"Digital Science, Faculty of Science, Universiti Brunei Darussalam, Tungku Link, Gadong BE1410, Brunei"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4888-5448","authenticated-orcid":false,"given":"Owais Ahmed","family":"Malik","sequence":"additional","affiliation":[{"name":"Digital Science, Faculty of Science, Universiti Brunei Darussalam, Tungku Link, Gadong BE1410, Brunei"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wee-Hong","family":"Ong","sequence":"additional","affiliation":[{"name":"Digital Science, Faculty of Science, Universiti Brunei Darussalam, Tungku Link, Gadong BE1410, Brunei"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johan Willem Frederik","family":"Slik","sequence":"additional","affiliation":[{"name":"Department of Environmental Life Sciences, Faculty of Science, Universiti Brunei Darussalam, Tungku Link, Gadong BE1410, Brunei"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"22169","DOI":"10.1073\/pnas.1011841108","article-title":"Herbaria are a major frontier for species discovery","volume":"107","author":"Bebber","year":"2010","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1016\/j.tree.2017.03.015","article-title":"Old Plants, New Tricks: Phenological Research Using Herbarium Specimens","volume":"32","author":"Willis","year":"2017","journal-title":"Trends Ecol. Evol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1002\/ecm.1307","article-title":"The unrealized potential of herbaria for global change biology","volume":"88","author":"Meineke","year":"2018","journal-title":"Ecol. Monogr."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Tomaszewski, D., and G\u00f3rzkowska, A. (2016). Is shape of a fresh and dried leaf the same?. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0153071"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hussein, B.R., Malik, O.A., Ong, W.-H.H., and Slik, J.W.F. (2020). Automated Classification of Tropical Plant Species Data Based on Machine Learning Techniques and Leaf Trait Measurements. Computational Science and Technology, Proceedings of the 6th ICCST 2019, Kota Kinabalu, Malaysia, 29\u201330 August 2019, Springer.","DOI":"10.1007\/978-981-15-0058-9_9"},{"key":"ref_6","first-page":"e37161","article-title":"Use of Semantic Segmentation for Increasing the Throughput of Digitisation Workflows for Natural History Collections","volume":"3","author":"Owen","year":"2019","journal-title":"Biodivers. Inf. Sci. Stand."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Hussein, B.R., Malik, O.A., Ong, W.-H.H., and Slik, J.W.F. (2020). Semantic Segmentation of Herbarium Specimens Using Deep Learning Techniques. Computational Science and Technology, Proceedings of the 6th ICCST 2019, Kota Kinabalu, Malaysia, 29\u201330 August 2019, Springer.","DOI":"10.1007\/978-981-15-0058-9_31"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Carranza-Rojas, J., Goeau, H., Bonnet, P., Mata-Montero, E., and Joly, A. (2017). Going deeper in the automated identification of Herbarium specimens. BMC Evol. Biol., 17.","DOI":"10.1186\/s12862-017-1014-z"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1111\/nph.15401","article-title":"Using herbaria to study global environmental change","volume":"221","author":"Lang","year":"2019","journal-title":"New Phytol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"101243","DOI":"10.1016\/j.ecoinf.2021.101243","article-title":"Reconstruction of damaged herbarium leaves using deep learning techniques for improving classification accuracy","volume":"61","author":"Hussein","year":"2021","journal-title":"Ecol. Inform."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jones, C.A., and Daehler, C.C. (2018). Herbarium specimens can reveal impacts of climate change on plant phenology; A review of methods and applications. PeerJ, 2018.","DOI":"10.7287\/peerj.preprints.3425v1"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ott, T., Palm, C., Vogt, R., and Oberprieler, C. (2020). GinJinn: An object-detection pipeline for automated feature extraction from herbarium specimens. Appl. Plant Sci., 8.","DOI":"10.1002\/aps3.11351"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e11367","DOI":"10.1002\/aps3.11367","article-title":"LeafMachine: Using machine learning to automate leaf trait extraction from digitized herbarium specimens","volume":"8","author":"Weaver","year":"2020","journal-title":"Appl. Plant Sci."},{"key":"ref_14","first-page":"10","article-title":"Measuring Morphological Functional Leaf Traits from Digitized Herbarium Specimens Using TraitEx Software, Biodivers","volume":"3","author":"Gaikwad","year":"2019","journal-title":"Inf. Sci. Stand."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1281","DOI":"10.3732\/ajb.1700281","article-title":"Digitization of herbaria enables novel research","volume":"104","author":"Soltis","year":"2017","journal-title":"Am. J. Bot."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Waldchen, J., Rzanny, M., Seeland, M., and Mader, P. (2018). Automated plant species identification\u2014Trends and future directions. PLoS Comput. Biol., 14.","DOI":"10.1371\/journal.pcbi.1005993"},{"key":"ref_17","unstructured":"Jocher, G., Stoken, A., Borovec, J., Chaurasia, A., Xie, T., Liu, C.Y., Abhiram, V. (2021, May 01). Ultralytics\/yolov5: v5.0\u2014YOLOv5-P6 1280 Models, AWS, Supervise.ly and YouTube Integrations. Available online: https:\/\/zenodo.org\/record\/4679653#.YNMJNegzbIU."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster r-cnn: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","unstructured":"Tan, K.C., Liu, Y., Ambrose, B., Tulig, M., and Belongie, S. (2019). The Herbarium Challenge 2019 Dataset. arXiv, Available online: http:\/\/arxiv.org\/abs\/1906.05372."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mata-Montero, E., and Carranza-Rojas, J. (2016). Automated Plant Species Identification: Challenges and Opportunities. ICT for Promoting Human Development and Protecting the Environment, Proceedings of the 6th IFIP World Information Technology Forum, WITFOR 2016, San Jos\u00e9, Costa Rica, 12\u201314 September 2016, Springer.","DOI":"10.1007\/978-3-319-44447-5"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1017\/S1089332600002618","article-title":"Climate Reconstruction from Leaf Size and Shape: New Developments and Challenges","volume":"18","author":"Royer","year":"2012","journal-title":"Paleontol. Soc. Pap."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Joly, A., Goeau, H., Botella, C., Kahl, S., Servajean, M., Glotin, H., Bonnet, P., Planqu\u00e9, R., Robert-St\u00f6ter, F., and Vellinga, W.-P.P. (2019). Overview of LifeCLEF 2019: Identification of Amazonian plants, South & North American birds, and niche prediction. Lect. Notes Comput. Sci., 387\u2013401.","DOI":"10.1007\/978-3-030-28577-7_29"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1296","DOI":"10.1111\/2041-210X.13450","article-title":"Schr\u00f6dinger\u2019s phenotypes: Herbarium specimens show two-dimensional images are both good and (not so) bad sources of morphological data","volume":"11","author":"Borges","year":"2020","journal-title":"Methods Ecol. Evol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e11352","DOI":"10.1002\/aps3.11352","article-title":"Generating segmentation masks of herbarium specimens and a data set for training segmentation models using deep learning","volume":"8","author":"White","year":"2020","journal-title":"Appl. Plant Sci."},{"key":"ref_25","first-page":"63","article-title":"Segmentation of Leaf Images Based on the Active Contours","volume":"8","author":"Wu","year":"2015","journal-title":"Int. J. e-Serv. Sci. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.14214\/sf.7740","article-title":"A flexible geometric model for leaf shape descriptions with high accuracy","volume":"52","author":"Coussement","year":"2018","journal-title":"Silva Fenn."},{"key":"ref_27","first-page":"147","article-title":"Plant Leaves Image Segmentation Techniques: A Review","volume":"5","author":"Janwale","year":"2017","journal-title":"Int. J. Comput. Sci. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1002\/tax.611016","article-title":"Automatic extraction of leaf characters from herbarium specimens","volume":"61","author":"Corney","year":"2012","journal-title":"Taxonomy"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Henries, D.G., and Tashakkori, R. (2012, January 6\u20138). Extraction of Leaves from Herbarium Images. Proceedings of the IEEE International Conference on Electro-Information Technology, Indianapolis, IN, USA.","DOI":"10.1109\/EIT.2012.6220752"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3897\/BDJ.8.e57090","article-title":"Detection and annotation of plant organs from digitised herbarium scans using deep learning","volume":"8","author":"Younis","year":"2020","journal-title":"Biodivers. Data J."},{"key":"ref_31","first-page":"4","article-title":"Accelerating the Automated Detection, Counting and Measurements of Reproductive Organs in Herbarium Collections in the Era of Deep Learning","volume":"3","author":"Goeau","year":"2019","journal-title":"Biodivers. Inf. Sci. Stand."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Pereira, C.S., Morais, R., and Reis, M.J.C.S. (2019). Deep learning techniques for grape plant species identification in natural images. Sensors, 19.","DOI":"10.3390\/s19224850"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Yao, X., Yang, H., Wu, Y., Wu, P., Wang, B., Zhou, X., and Wang, S. (2019). Land use classification of the deep convolutional neural network method reducing the loss of spatial features. Sensors, 19.","DOI":"10.3390\/s19122792"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Torres, D.L., Feitosa, R.Q., Happ, P.N., la Rosa, L.E.C., Marcato, J., Martins, J., Bressan, P.O., Gon\u00e7alves, W.N., and Liesenberg, V. (2019). Applying fully convolutional architectures for semantic segmentation of a single tree species in urban environment on high resolution UAV optical imagery. Sensors, 20.","DOI":"10.3390\/s20020563"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bai, R., Jiang, S., Sun, H., Yang, Y., and Li, G. (2019). Deep neural network-based semantic segmentation of microvascular decompression images. Sensors, 21.","DOI":"10.3390\/s21041167"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hussein, B.R., Malik, O.A., Ong, W., and Slik, J.W.F. (2021). Application of Computer Vision and Machine Learning for Digitized Herbarium Specimens: A Systematic Literature Review. arXiv, Available online: http:\/\/arxiv.org\/abs\/2104.08732.","DOI":"10.1016\/j.ecoinf.2022.101641"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1007\/s11263-014-0733-5","article-title":"The pascal visual object classes challenge: A retrospective","volume":"111","author":"Everingham","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid Scene Parsing Network. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_39","unstructured":"Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, L.A. (2015). Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs. arXiv, Available online: http:\/\/arxiv.org\/abs\/1412.7062."},{"key":"ref_40","unstructured":"Chen, L.-C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv, Available online: https:\/\/arxiv.org\/abs\/1706.05587."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018). Encoder-decoder with atrous separable convolution for semantic image segmentation. Lect. Notes Comput. Sci., 833\u2013851.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1145\/321356.321357","article-title":"Sequential operations in digital picture processing","volume":"13","author":"Rosenfeld","year":"1966","journal-title":"J. ACM"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Bailey, D., and Klaiber, M. (2019). Zig-Zag Based Single-Pass Connected Components Analysis. J. Imaging, 5.","DOI":"10.3390\/jimaging5040045"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Spagnolo, F., Perri, S., and Corsonello, P. (2019). An Efficient Hardware-Oriented Single-Pass Approach for Connected Component Analysis. Sensors, 19.","DOI":"10.3390\/s19143055"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Li, Y., Chi, Z., and Feng, D.D. (2006, January 8\u201311). Leaf vein extraction using independent component analysis. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Taipei, Taiwan.","DOI":"10.1109\/ICSMC.2006.384738"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Chen, Y., Wu, Z., Zhao, B., Fan, C., and Shi, S. (2021). Weed and corn seedling detection in field based on multi feature fusion and support vector machine. Sensors, 21.","DOI":"10.3390\/s21010212"},{"key":"ref_47","first-page":"27","article-title":"A Novel Algorithm to Extract Connected Components in a Binary Image of Vehicle License Plates","volume":"2","author":"Kumar","year":"2012","journal-title":"Int. J. Electron. Commun. Comput. Technol."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Wu, S.G., Bao, F.S., Xu, E.Y., Wang, Y.-X., Chang, Y.-F., Xiang4, Q.-L., and Xiang, Q.-L. (August, January 30). A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network. Proceedings of the 2007 International Symposium on Signals, Systems and Electronics, Montreal, QC, Canada.","DOI":"10.1109\/ISSPIT.2007.4458016"},{"key":"ref_49","first-page":"2560","article-title":"How transferable are features in deep neural networks?","volume":"27","author":"Yosinski","year":"2014","journal-title":"Adv. Neural Inf. Process."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man. Cybern."},{"key":"ref_51","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv, Available online: http:\/\/arxiv.org\/abs\/1409.1556."},{"key":"ref_52","unstructured":"Dignam, J.D., Martin, P.L., Shastry, B.S., and Roeder, R.G. (2016, January 2\u20134). TensorFlow: A System for Large-Scale Machine Learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation, Savannah, GA, USA."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Gong, B., Ergu, D., Cai, Y., and Ma, B. (2021). Real-time detection for wheat head applying deep neural network. Sensors, 21.","DOI":"10.3390\/s21010191"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Deng, R., Tao, M., Huang, X., Bangura, K., Jiang, Q., Jiang, Y., and Qi, L. (2021). Automated counting grains on the rice panicle based on deep learning method. Sensors, 21.","DOI":"10.3390\/s21010281"},{"key":"ref_55","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv, Available online: https:\/\/arxiv.org\/abs\/2004.10934."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.neucom.2019.02.003","article-title":"Survey on semantic segmentation using deep learning techniques","volume":"338","author":"Lateef","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Clark, J.Y., Corney, D.P.A., Notley, S., and Wilkin, P. (2015). Image Processing and Artificial Neural Networks for Automated Plant Species Identification from Leaf Outlines. Biological Shape Analysis, Proceedings of the 3rd International Symposium, Tokyo, Japan, 14\u201317 June 2013, World Scientific Publishing.","DOI":"10.1142\/9789814704199_0003"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1007\/s11831-016-9206-z","article-title":"Plant Species Identification Using Computer Vision Techniques: A Systematic Literature Review","volume":"25","year":"2018","journal-title":"Arch. Comput. Methods Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4549\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:25:14Z","timestamp":1760163914000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4549"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,2]]},"references-count":58,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["s21134549"],"URL":"https:\/\/doi.org\/10.3390\/s21134549","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,2]]}}}