{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T06:04:43Z","timestamp":1778825083621,"version":"3.51.4"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2022,3,21]],"date-time":"2022-03-21T00:00:00Z","timestamp":1647820800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,3,21]],"date-time":"2022-03-21T00:00:00Z","timestamp":1647820800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"crossref","award":["777483"],"award-info":[{"award-number":["777483"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Machine Vision and Applications"],"published-print":{"date-parts":[[2022,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Semantic segmentation has been proposed as a tool to accelerate the processing of natural history collection images. However, developing a flexible and resilient segmentation network requires an approach for adaptation which allows processing different datasets with minimal training and validation. This paper presents a cross-validation approach designed to determine whether a semantic segmentation network possesses the flexibility required for application across different collections and institutions. Consequently, the specific objectives of cross-validating the semantic segmentation network are to (a) evaluate the effectiveness of the network for segmenting image sets derived from collections different from the one in which the network was initially trained on; and (b) test the adaptability of the segmentation network for use in other types of collections. The resilience to data variations from different institutions and the portability of the network across different types of collections are required to confirm its general applicability. The proposed validation method is tested on the Natural History Museum semantic segmentation network, designed to process entomological microscope slides. The proposed semantic segmentation network is evaluated through a series of cross-validation experiments designed to test using data from two types of collections: microscope slides (from three institutions) and herbarium sheets (from seven institutions). The main contribution of this work is the method, software and ground truth sets created for this cross-validation as they can be reused in testing similar segmentation proposals in the context of digitization of natural history collections. The cross-validation of segmentation methods should be a required step in the integration of such methods into image processing workflows for natural history collections.<\/jats:p>","DOI":"10.1007\/s00138-022-01276-z","type":"journal-article","created":{"date-parts":[[2022,3,21]],"date-time":"2022-03-21T12:03:48Z","timestamp":1647864228000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Cross-validation of a semantic segmentation network for natural history collection specimens"],"prefix":"10.1007","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7348-7612","authenticated-orcid":false,"given":"Abraham Nieva","family":"de la Hidalga","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4965-3884","authenticated-orcid":false,"given":"Paul L.","family":"Rosin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6114-0766","authenticated-orcid":false,"given":"Xianfang","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7341-1842","authenticated-orcid":false,"given":"Laurence","family":"Livermore","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Durrant","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2411-7396","authenticated-orcid":false,"given":"James","family":"Turner","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3973-1252","authenticated-orcid":false,"given":"Mathias","family":"Dillen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alicia","family":"Musson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9155-8573","authenticated-orcid":false,"given":"Sarah","family":"Phillips","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0596-5376","authenticated-orcid":false,"given":"Quentin","family":"Groom","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0767-4310","authenticated-orcid":false,"given":"Alex","family":"Hardisty","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,3,21]]},"reference":[{"key":"1276_CR1","doi-asserted-by":"publisher","DOI":"10.3897\/biss.3.37337","volume":"3","author":"E Allan","year":"2019","unstructured":"Allan, E., Dupont, S., Hardy, H., Livermore, L., Price, B., Smith, V.: High-throughput digitization of natural history specimens. Biodiversity Information Science and Standards 3, e37337 (2019). https:\/\/doi.org\/10.3897\/biss.3.37337","journal-title":"Biodiversity Information Science and Standards"},{"key":"1276_CR2","doi-asserted-by":"publisher","DOI":"10.3897\/BDJ.7.e32342","volume":"7","author":"E Allan","year":"2019","unstructured":"Allan, E., Livermore, L., Price, B., Shchedrina, O., Smith, V.: A Novel Automated Mass Digitization Workflow for Natural History Microscope Slides. Biodiversity Data Journal 7, e32342 (2019). https:\/\/doi.org\/10.3897\/BDJ.7.e32342","journal-title":"Biodiversity Data Journal"},{"key":"1276_CR3","doi-asserted-by":"publisher","unstructured":"Bisong E. (2019) Google Colaboratory. In: Building Machine Learning and Deep Learning Models on Google Cloud Platform. Apress, Berkeley, CA. https:\/\/doi.org\/10.1007\/978-1-4842-4470-8_7","DOI":"10.1007\/978-1-4842-4470-8_7"},{"key":"1276_CR4","unstructured":"Brown, P. A. (1997). A Review of Techniques Used in the Preparation, Curation and Conservation of Microscope Slides at the Natural History Museum, London. The Biology Curator, 10 \u2010 Supplement, 1 \u2010 4. URL: http:\/\/www.natsca.org\/article\/455"},{"issue":"5","key":"1276_CR5","doi-asserted-by":"publisher","first-page":"32","DOI":"10.3390\/jimaging6050032","volume":"6","author":"YS Can","year":"2020","unstructured":"Can, Y.S., Kabaday\u0131, M.E.: CNN-Based Page Segmentation and Object Classification for Counting Population in Ottoman Archival Documentation. Journal of Imaging 6(5), 32 (2020)","journal-title":"Journal of Imaging"},{"key":"1276_CR6","doi-asserted-by":"publisher","unstructured":"Carranza-Rojas, J., Goeau, H., Bonnet, P., Mata-Montero, E., & Joly, A. (2017). Going deeper in the automated identification of Herbarium specimens. BMC Evolutionary Biology, 17(1), 181. https:\/\/bmcevolbiol.biomedcentral.com\/articles\/https:\/\/doi.org\/10.1186\/s12862-017-1014-z","DOI":"10.1186\/s12862-017-1014-z"},{"key":"1276_CR7","unstructured":"Chen, L. C., Papandreou, G., Schroff, F., & Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:1706.05587."},{"key":"1276_CR8","doi-asserted-by":"crossref","unstructured":"De Brabandere, B., Neven, D., & Van Gool, L. (2017). Semantic instance segmentation with a discriminative loss function. arXiv preprint arXiv:1708.02551.","DOI":"10.1109\/CVPRW.2017.66"},{"key":"1276_CR9","doi-asserted-by":"publisher","DOI":"10.3897\/BDJ.7.e31817","volume":"7","author":"M Dillen","year":"2019","unstructured":"Dillen, M., Groom, Q., Chagnoux, S., G\u00fcntsch, A., Hardisty, A., Haston, E., Livermore, L., Runnel, V., Schulman, L., Willemse, L., Wu, Z., Phillips, S.: A benchmark dataset of herbarium specimen images with label data. Biodiversity Data Journal 7, e31817 (2019). https:\/\/doi.org\/10.3897\/BDJ.7.e31817","journal-title":"Biodiversity Data Journal"},{"key":"1276_CR10","unstructured":"Durrant, J., Livermore, L. (2018) Semi-supervised semantic and instance segmentation, Labelling Training Data. Retrieved on 2018\u201302\u201313, from: https:\/\/github.com\/NaturalHistoryMuseum\/semantic-segmentation\/wiki\/Labelling-training-data"},{"key":"1276_CR11","doi-asserted-by":"publisher","DOI":"10.3897\/biss.3.37091","volume":"3","author":"J Gaikwad","year":"2019","unstructured":"Gaikwad, J., Triki, A., Bouaziz, B.: Measuring Morphological Functional Leaf Traits From Digitized Herbarium Specimens Using TraitEx Software. Biodiversity Information Science and Standards 3, e37091 (2019). https:\/\/doi.org\/10.3897\/biss.3.37091","journal-title":"Biodiversity Information Science and Standards"},{"key":"1276_CR12","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770\u2013778). https:\/\/arxiv.org\/abs\/1512.03385","DOI":"10.1109\/CVPR.2016.90"},{"key":"1276_CR13","doi-asserted-by":"crossref","unstructured":"Hudson, L. N., Blagoderov, V., Heaton, A., Holtzhausen, P., Livermore, L., Price, B. W., ... & Smith, V. S. (2015). Inselect: automating the digitization of natural history collections. PLoS one, 10(11), e0143402.","DOI":"10.1371\/journal.pone.0143402"},{"key":"1276_CR14","unstructured":"JSTOR (2018). JSTOR Global Plants: Guidelines for Scanning Specimens. From: https:\/\/guides.jstor.org\/ld.php?content_id=31764146"},{"key":"1276_CR15","unstructured":"JSTOR (2018). JSTOR Plants Handbook. From http:\/\/www.snsb.info\/SNSBInfoOpenWiki\/attach\/Attachments\/JSTOR-Plants-Handbook.pdf"},{"key":"1276_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/database\/bay103","volume":"2018","author":"A Kirchhoff","year":"2018","unstructured":"Kirchhoff, A., et al.: Toward a service-based workflow for automated information extraction from herbarium specimens. Databese 2018, 1\u201311 (2018). https:\/\/doi.org\/10.1093\/database\/bay103","journal-title":"Databese"},{"key":"1276_CR17","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1016\/j.procs.2016.07.235","volume":"93","author":"SS Kumar","year":"2016","unstructured":"Kumar, S.S., Rajendran, P., Prabaharan, P., Soman, K.P.: Text\/Image Region Separation for Document Layout Detection of Old Document Images Using Non-linear Diffusion and Level Set. Procedia Computer Science 93, 469\u2013477 (2016)","journal-title":"Procedia Computer Science"},{"key":"1276_CR18","unstructured":"Livermore, L., et.al. (2017) Digitising Louse Slides. NERC \/ Natural History Museum pilot project. http:\/\/www.nhm.ac.uk\/our-science\/our-work\/digital-museum\/digital-collections-programme\/digitising-slide-collections.html"},{"issue":"3","key":"1276_CR19","doi-asserted-by":"publisher","DOI":"10.1002\/aps3.1233","volume":"7","author":"T Lorieul","year":"2019","unstructured":"Lorieul, T., Pearson, K.D., Ellwood, E.R., Go\u00ebau, H., Molino, J.F., Sweeney, P.W., Soltis, P.S.: Toward a large-scale and deep phenological stage annotation of herbarium specimens: Case studies from temperate, tropical, and equatorial floras. Applications in plant sciences 7(3), e01233 (2019). https:\/\/doi.org\/10.1002\/aps3.1233","journal-title":"Applications in plant sciences"},{"key":"1276_CR20","doi-asserted-by":"crossref","unstructured":"Ma, K., Shu, Z., Bai, X., Wang, J., & Samaras, D. (2018). DocUNet: document image unwarping via a stacked U-Net. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 4700\u20134709).","DOI":"10.1109\/CVPR.2018.00494"},{"key":"1276_CR21","doi-asserted-by":"crossref","unstructured":"Mehri, M., Gomez-Kr\u00e4mer, P., H\u00e9roux, P., & Mullot, R. (2013). Old document image segmentation using the autocorrelation function and multiresolution analysis. In Document Recognition and Retrieval XX (Vol. 8658, p. 86580K). International Society for Optics and Photonics.","DOI":"10.1117\/12.2002365"},{"key":"1276_CR22","unstructured":"Meise Botanic Garden (2018) Botanical Collections Virtual Herbarium digital specimens cited where used."},{"key":"1276_CR23","unstructured":"Natural History Museum (2018) The Natural History Museum Data Portal, digital specimens cited where used."},{"key":"1276_CR24","unstructured":"Naturalis Biodiversity Center (2018) BioPortal, the Data Portal of the Naturalis Biodiversity Center, digital specimens cited where used."},{"key":"1276_CR25","doi-asserted-by":"publisher","DOI":"10.3897\/biss.3.37161","volume":"3","author":"A Nieva de la Hidalga","year":"2019","unstructured":"Nieva de la Hidalga, A., Owen, D., Spasic, I., Rosin, P., Sun, X.: Use of Semantic Segmentation for Increasing the Throughput of Digitization Workflows for Natural History Collections. Biodiversity Information Science and Standards 3, e37161 (2019). https:\/\/doi.org\/10.3897\/biss.3.37161","journal-title":"Biodiversity Information Science and Standards"},{"key":"1276_CR26","doi-asserted-by":"crossref","unstructured":"Okun, O., D\u0153rmann, D., & Pietikainen, M. (1999). Page segmentation and zone classification: the state of the art. OULU UNIV (FINLAND) DEPT OF ELECTRICAL ENGINEERING.","DOI":"10.21236\/ADA458676"},{"key":"1276_CR27","doi-asserted-by":"publisher","unstructured":"Owen, D., Groom, Q., Hardisty, A., Leegwater, T., van Walsum, M., Wijkamp, N., Spasi\u0107, I.: Methods for Automated Text Digitisation. Zenodo (2019). https:\/\/doi.org\/10.5281\/zenodo.3364501","DOI":"10.5281\/zenodo.3364501"},{"key":"1276_CR28","unstructured":"Rasmus, A., Berglund, M., Honkala, M., Valpola, H., & Raiko, T. (2015). Semi-supervised learning with ladder networks. In Advances in neural information processing systems (NIPS 2015). pp. 3546\u20133554. http:\/\/papers.nips.cc\/paper\/5947-semi-supervised-learning-with-ladder-networks.pdf"},{"key":"1276_CR29","unstructured":"Rouhan, G., Chagnoux, S., Denneti\u00e8re, B., Shch\u00e4fer, V., & Pignal, M. (2016). The herbonauts website: Recruiting the general public to acquire the data from herbarium labels. Botanists of the Twenty-First Century: Roles, Challenges and Opportunities. United Nations Educational, Scientific and Cultural Organisation, 143\u2013148."},{"issue":"4","key":"1276_CR30","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1007\/s00138-015-0737-3","volume":"27","author":"H Scharr","year":"2016","unstructured":"Scharr, H., Minervini, M., French, A.P., Klukas, C., Kramer, D.M., Liu, X., Yin, X.: Leaf segmentation in plant phenotyping: a collation study. Mach. Vis. Appl. 27(4), 585\u2013606 (2016). https:\/\/doi.org\/10.1007\/s00138-015-0737-3","journal-title":"Mach. Vis. Appl."},{"key":"1276_CR31","unstructured":"Shafait, F. (2008). Geometric Layout Analysis of scanned documents.Doctoral Thesis, Technical University of Kaiserslautern."},{"key":"1276_CR32","doi-asserted-by":"publisher","DOI":"10.3897\/rio.5.e46404","volume":"5","author":"VS Smith","year":"2019","unstructured":"Smith, V.S., Gorman, K., Addink, W., Arvanitidis, C., Casino, A., Dixey, K., Dr\u00f6ge, G., Groom, Q., Haston, E.M., Hobern, D., Knapp, S., Koureas, D., Livermore, L., Seberg, O.: SYNTHESYS+ Abridged Grant Proposal. Research Ideas and Outcomes 5, e46404 (2019). https:\/\/doi.org\/10.3897\/rio.5.e46404","journal-title":"Research Ideas and Outcomes"},{"issue":"2","key":"1276_CR33","doi-asserted-by":"publisher","DOI":"10.1002\/aps3.1028","volume":"6","author":"PS Soltis","year":"2018","unstructured":"Soltis, P.S., Nelson, G., James, S.A.: Green digitization: Online botanical collections data answering real-world questions. Applications in Plant Sciences 6(2), e1028 (2018). https:\/\/doi.org\/10.1002\/aps3.1028","journal-title":"Applications in Plant Sciences"},{"issue":"3","key":"1276_CR34","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0118432","volume":"10","author":"T Saito","year":"2015","unstructured":"Saito, T., Rehmsmeier, M.: (2015) The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets. PLoS ONE 10(3), e0118432 (2015). https:\/\/doi.org\/10.1371\/journal.pone.0118432","journal-title":"PLoS ONE"},{"key":"1276_CR35","unstructured":"Triki, A., Bouaziz, B., & Gaikwad, J. (2018) Refined Methodology for Accurately Detecting Objects from Digitized Herbarium Specimens. In ICEI 2018: 10th International Conference on Ecological Informatics-Translating Ecological Data into Knowledge and Decisions in a Rapidly Changing World. https:\/\/www.db-thueringen.de\/receive\/dbt_mods_00037908"},{"key":"1276_CR36","doi-asserted-by":"publisher","unstructured":"Triki, A.; Bouaziz, B.; Mahdi, W. and Gaikwad, J. (2020). Objects Detection from Digitized Herbarium Specimen based on Improved YOLO V3.In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, ISBN 978\u2013989\u2013758\u2013402\u20132, pages 523\u2013529. DOI: https:\/\/doi.org\/10.5220\/0009170005230529","DOI":"10.5220\/0009170005230529"},{"key":"1276_CR37","doi-asserted-by":"publisher","DOI":"10.3897\/biss.3.37559","volume":"3","author":"A White","year":"2019","unstructured":"White, A., Trizna, M., Frandsen, P., Dorr, L., Dikow, R., Schuettpelz, E.: Evaluating Geographic Patterns of Morphological Diversity in Ferns and Lycophytes Using Deep Neural Networks. Biodiversity Information Science and Standards 3, e37559 (2019). https:\/\/doi.org\/10.3897\/biss.3.37559","journal-title":"Biodiversity Information Science and Standards"},{"key":"1276_CR38","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1016\/j.tree.2017.03.015","volume":"32","author":"CG Willis","year":"2017","unstructured":"Willis, C.G., Ellwood, E.R., Primack, R.B., Davis, C.C., Pearson, K.D., Gallinat, A.S., Yost, J.M., et al.: Old plants, new tricks: Phenological research using herbarium specimens. Trends Ecol. Evol. 32, 531\u2013546 (2017)","journal-title":"Trends Ecol. Evol."}],"container-title":["Machine Vision and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00138-022-01276-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00138-022-01276-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00138-022-01276-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T03:40:22Z","timestamp":1652154022000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00138-022-01276-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,21]]},"references-count":38,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,5]]}},"alternative-id":["1276"],"URL":"https:\/\/doi.org\/10.1007\/s00138-022-01276-z","relation":{},"ISSN":["0932-8092","1432-1769"],"issn-type":[{"value":"0932-8092","type":"print"},{"value":"1432-1769","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,21]]},"assertion":[{"value":"14 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 October 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 December 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 March 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All authors declare no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"39"}}