{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"medRxiv"}],"indexed":{"date-parts":[[2026,10,28]],"date-time":"2026-10-28T14:51:06Z","timestamp":1793199066196,"version":"4.5.0"},"posted":{"date-parts":[[2025,3,20]]},"group-title":"Pathology","reference-count":73,"publisher":"openRxiv","license":[{"start":{"date-parts":[[2025,3,20]],"date-time":"2025-03-20T00:00:00Z","timestamp":1742428800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2025,3,20]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                <jats:p>Machine learning (ML) applications within diagnostic histopathology have been extremely successful. While many successful models have been built using general-purpose models trained largely on everyday objects, there is a recent trend toward pathology-specific foundation models, trained using histopathology images. Pathology foundation models show strong performance on cancer detection and subtyping, grading, and predicting molecular diagnoses. However, we have noticed lacunae in the testing of foundation models. Nearly all the benchmarks used to test them are focused on cancer. Neoplasia is an important pathologic mechanism and key concern in much of clinical pathology, but it represents one of many pathologic bases of disease. Non-neoplastic pathology dominates findings in the placenta, a critical organ in human development, as well as a specimen commonly encountered in clinical practice. Very little to none of the data used in training pathology foundation models is placenta. Thus, placental pathology is doubly out of distribution, representing a useful challenge for foundation models.<\/jats:p>\n                <jats:p>We developed benchmarks for estimation of gestational age, classifying normal tissue, identifying inflammation in the umbilical cord and membranes, and in classification of macroscopic lesions including villous infarction, intervillous thrombus, and perivillous fibrin deposition. We tested 5 pathology foundation models and 4 non-pathology models for each benchmark in tasks including zero-shot K-nearest neighbor classification and regression, content-based image retrieval, supervised regression, and whole-slide attention-based multiple instance learning. In each task, the best performing model was a pathology foundation model. However, the gap between pathology and non-pathology models was diminished in tasks related to inflammation or those in which a supervised task was performed using model embeddings. Performance was comparable among pathology foundation models. Among non-pathology models, ResNet consistently performed worse, while models from the present decade showed better performance. Future work could examine the impact of incorporating placental data into foundation model training.<\/jats:p>","DOI":"10.1101\/2025.03.19.25324282","type":"posted-content","created":{"date-parts":[[2025,3,23]],"date-time":"2025-03-23T01:49:13Z","timestamp":1742694553000},"source":"Crossref","is-referenced-by-count":6,"title":["Benchmarking pathology foundation models for non-neoplastic pathology in the placenta"],"prefix":"10.64898","author":[{"given":"Zehao","family":"Peng","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marina A.","family":"Ayad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yaxing","family":"Jing","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Teresa","family":"Chou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3504-4965","authenticated-orcid":false,"given":"Lee A.D.","family":"Cooper","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4086-057X","authenticated-orcid":false,"given":"Jeffery A.","family":"Goldstein","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"54368","reference":[{"key":"2025032400450557000_2025.03.19.25324282v1.1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2022.104828"},{"key":"2025032400450557000_2025.03.19.25324282v1.2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-019-0508-1"},{"key":"2025032400450557000_2025.03.19.25324282v1.3","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102559"},{"key":"2025032400450557000_2025.03.19.25324282v1.4","doi-asserted-by":"publisher","DOI":"10.1101\/2023.07.21.23292757"},{"key":"2025032400450557000_2025.03.19.25324282v1.5","unstructured":"releases\/models\/h-optimus\/v0 at main \u00b7 bioptimus\/releases. GitHub. Accessed September 13, 2024. https:\/\/github.com\/bioptimus\/releases\/tree\/main\/models\/h-optimus\/v0"},{"key":"2025032400450557000_2025.03.19.25324282v1.6","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-024-02857-3"},{"key":"2025032400450557000_2025.03.19.25324282v1.7","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2406.05074"},{"key":"2025032400450557000_2025.03.19.25324282v1.8","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-024-07441-w"},{"key":"2025032400450557000_2025.03.19.25324282v1.9","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2408.00738"},{"key":"2025032400450557000_2025.03.19.25324282v1.10","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2304.07193"},{"key":"2025032400450557000_2025.03.19.25324282v1.11","unstructured":"Xie Z , Zhang Z , Cao Y , et al. On Data Scaling in Masked Image Modeling. arXiv.org. June 9, 2022. Accessed September 24, 2024. https:\/\/arxiv.org\/abs\/2206.04664v1"},{"key":"2025032400450557000_2025.03.19.25324282v1.12","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2405.09990"},{"key":"2025032400450557000_2025.03.19.25324282v1.13","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2408.15823"},{"key":"2025032400450557000_2025.03.19.25324282v1.14","unstructured":"Kumar V , Abbas AK , Aster JC , eds. Robbins & Cotran Pathologic Basis of Disease. Tenth edition. Elsevier; 2021."},{"key":"2025032400450557000_2025.03.19.25324282v1.15","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-024-02856-4"},{"key":"2025032400450557000_2025.03.19.25324282v1.16","doi-asserted-by":"publisher","DOI":"10.1158\/2159-8290.CD-21-1059"},{"key":"2025032400450557000_2025.03.19.25324282v1.17","doi-asserted-by":"publisher","DOI":"10.1016\/S0092-8674(00)81683-9"},{"key":"2025032400450557000_2025.03.19.25324282v1.18","doi-asserted-by":"publisher","DOI":"10.1038\/s43018-020-0085-8"},{"key":"2025032400450557000_2025.03.19.25324282v1.19","doi-asserted-by":"publisher","DOI":"10.1016\/j.ccell.2022.07.004"},{"key":"2025032400450557000_2025.03.19.25324282v1.20","doi-asserted-by":"publisher","DOI":"10.1016\/j.celrep.2022.110424"},{"key":"2025032400450557000_2025.03.19.25324282v1.21","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2024.15563"},{"key":"2025032400450557000_2025.03.19.25324282v1.22","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajog.2015.07.050"},{"key":"2025032400450557000_2025.03.19.25324282v1.23","doi-asserted-by":"publisher","DOI":"10.1111\/apm.12796"},{"issue":"5","key":"2025032400450557000_2025.03.19.25324282v1.24","first-page":"449","article-title":"Practice guideline for examination of the placenta: developed by the Placental Pathology Practice Guideline Development Task Force of the College of American Pathologists","volume":"121","year":"1997","journal-title":"Arch Pathol Lab Med"},{"key":"2025032400450557000_2025.03.19.25324282v1.25","doi-asserted-by":"publisher","DOI":"10.5858\/arpa.2015-0225-CC"},{"key":"2025032400450557000_2025.03.19.25324282v1.26","doi-asserted-by":"publisher","DOI":"10.1515\/jpm-2018-0055"},{"key":"2025032400450557000_2025.03.19.25324282v1.27","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajpath.2020.06.014"},{"key":"2025032400450557000_2025.03.19.25324282v1.28","doi-asserted-by":"publisher","DOI":"10.1101\/2022.11.21.517353"},{"key":"2025032400450557000_2025.03.19.25324282v1.29","doi-asserted-by":"publisher","DOI":"10.1016\/j.placenta.2023.11.005"},{"key":"2025032400450557000_2025.03.19.25324282v1.30","doi-asserted-by":"publisher","DOI":"10.1038\/s41374-021-00579-5"},{"key":"2025032400450557000_2025.03.19.25324282v1.31","doi-asserted-by":"publisher","DOI":"10.1016\/j.placenta.2023.03.003"},{"key":"2025032400450557000_2025.03.19.25324282v1.32","doi-asserted-by":"publisher","DOI":"10.1016\/j.modpat.2024.100422"},{"key":"2025032400450557000_2025.03.19.25324282v1.33","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2411.02354"},{"key":"2025032400450557000_2025.03.19.25324282v1.34","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2411.09767"},{"key":"2025032400450557000_2025.03.19.25324282v1.35","doi-asserted-by":"crossref","unstructured":"Baergen RN , Benirschke K. Manual of Benirschke and Kaufmann\u2019s Pathology of the Human Placenta. Springer; 2005.","DOI":"10.1007\/b138589"},{"key":"2025032400450557000_2025.03.19.25324282v1.36","unstructured":"Heerema-McKenney A , Popek EJ , De Paepe ME , Ernst LM , eds. Placenta. 2. edition. Elsevier; 2019."},{"key":"2025032400450557000_2025.03.19.25324282v1.37","doi-asserted-by":"publisher","DOI":"10.1111\/apm.12858"},{"key":"2025032400450557000_2025.03.19.25324282v1.38","doi-asserted-by":"publisher","DOI":"10.1016\/j.jri.2023.103951"},{"key":"2025032400450557000_2025.03.19.25324282v1.39","doi-asserted-by":"publisher","DOI":"10.3390\/jcm11061576"},{"key":"2025032400450557000_2025.03.19.25324282v1.40","doi-asserted-by":"publisher","DOI":"10.1111\/1471-0528.15040"},{"key":"2025032400450557000_2025.03.19.25324282v1.41","doi-asserted-by":"publisher","DOI":"10.2350\/10-07-0872-OA.1"},{"key":"2025032400450557000_2025.03.19.25324282v1.42","doi-asserted-by":"publisher","DOI":"10.2350\/12-02-1604-OA.1"},{"key":"2025032400450557000_2025.03.19.25324282v1.43","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajog.2025.02.038"},{"key":"2025032400450557000_2025.03.19.25324282v1.44","doi-asserted-by":"publisher","DOI":"10.1007\/s00428-015-1899-0"},{"key":"2025032400450557000_2025.03.19.25324282v1.45","doi-asserted-by":"publisher","DOI":"10.1067\/mob.2000.109035"},{"key":"2025032400450557000_2025.03.19.25324282v1.46","doi-asserted-by":"publisher","DOI":"10.1111\/aji.13944"},{"key":"2025032400450557000_2025.03.19.25324282v1.47","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajog.2011.05.022"},{"key":"2025032400450557000_2025.03.19.25324282v1.48","doi-asserted-by":"publisher","DOI":"10.1111\/aogs.12688"},{"key":"2025032400450557000_2025.03.19.25324282v1.49","doi-asserted-by":"publisher","DOI":"10.1111\/j.1600-0412.2010.01012.x"},{"key":"2025032400450557000_2025.03.19.25324282v1.50","doi-asserted-by":"publisher","DOI":"10.1016\/j.placenta.2016.04.020"},{"key":"2025032400450557000_2025.03.19.25324282v1.51","doi-asserted-by":"publisher","DOI":"10.1136\/jcp.2008.055236"},{"key":"2025032400450557000_2025.03.19.25324282v1.52","doi-asserted-by":"publisher","DOI":"10.1016\/j.path.2012.10.002"},{"key":"2025032400450557000_2025.03.19.25324282v1.53","doi-asserted-by":"publisher","DOI":"10.1007\/s10024001-0195-y"},{"key":"2025032400450557000_2025.03.19.25324282v1.54","doi-asserted-by":"publisher","DOI":"10.1111\/aji.12143"},{"key":"2025032400450557000_2025.03.19.25324282v1.55","doi-asserted-by":"publisher","DOI":"10.1007\/s10024-003-4032-3"},{"key":"2025032400450557000_2025.03.19.25324282v1.56","doi-asserted-by":"publisher","DOI":"10.1177\/1093526620964353"},{"key":"2025032400450557000_2025.03.19.25324282v1.57","unstructured":"Goldstein JA , Nateghi R , Irmakci I , Cooper LAD . Machine learning classification of placental villous infarction, perivillous fibrin deposition, and intervillous thrombus. Placenta. In revisions."},{"key":"2025032400450557000_2025.03.19.25324282v1.58","doi-asserted-by":"publisher","DOI":"10.1109\/38.946629"},{"issue":"85","key":"2025032400450557000_2025.03.19.25324282v1.59","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"2025032400450557000_2025.03.19.25324282v1.60","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1979.4310076"},{"key":"2025032400450557000_2025.03.19.25324282v1.61","unstructured":"Gadermayr M , Tschuchnig M. Multiple Instance Learning for Digital Pathology: A Review on the State-of-the-Art, Limitations & Future Potential. Published online June 9, 2022. Accessed September 28, 2022. http:\/\/arxiv.org\/abs\/2206.04425"},{"key":"2025032400450557000_2025.03.19.25324282v1.62","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1807.05118"},{"key":"2025032400450557000_2025.03.19.25324282v1.63","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-019-0686-2"},{"key":"2025032400450557000_2025.03.19.25324282v1.64","doi-asserted-by":"crossref","unstructured":"Goldstein JA , Nateghi R , Cooper LAD . Machine learning assessment of gestational age in accelerated maturation, delayed maturation, villous edema, chorangiosis, and intrauterine fetal demise. Arch Pathol Lab Med. 2024;Accepted.","DOI":"10.5858\/arpa.2024-0274-OA"},{"key":"2025032400450557000_2025.03.19.25324282v1.65","doi-asserted-by":"publisher","DOI":"10.1136\/jcp.48.5.420"},{"key":"2025032400450557000_2025.03.19.25324282v1.66","doi-asserted-by":"publisher","DOI":"10.1016\/j.compmedimag.2022.102053"},{"key":"2025032400450557000_2025.03.19.25324282v1.67","doi-asserted-by":"publisher","DOI":"10.1097\/PAP.0000000000000264"},{"key":"2025032400450557000_2025.03.19.25324282v1.68","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0048-x"},{"key":"2025032400450557000_2025.03.19.25324282v1.69","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2022.03.009"},{"key":"2025032400450557000_2025.03.19.25324282v1.70","doi-asserted-by":"publisher","DOI":"10.1109\/WACV51458.2022.00161"},{"key":"2025032400450557000_2025.03.19.25324282v1.71","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2407.06508"},{"key":"2025032400450557000_2025.03.19.25324282v1.72","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2212.04690"},{"key":"2025032400450557000_2025.03.19.25324282v1.73","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2409.09173"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1101\/2025.03.19.25324282","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T20:31:31Z","timestamp":1768509091000},"score":1,"resource":{"primary":{"URL":"http:\/\/medrxiv.org\/lookup\/doi\/10.1101\/2025.03.19.25324282"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,20]]},"references-count":73,"URL":"https:\/\/doi.org\/10.1101\/2025.03.19.25324282","relation":{},"subject":[],"published":{"date-parts":[[2025,3,20]]},"subtype":"preprint"}}