{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"medRxiv"}],"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T08:04:35Z","timestamp":1780301075194,"version":"3.54.0"},"posted":{"date-parts":[[2026,5,28]]},"group-title":"Health Informatics","reference-count":45,"publisher":"openRxiv","license":[{"start":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T00:00:00Z","timestamp":1779926400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Library of Medicine (NLM), National Institutes of Health","award":["R00 LM014308"],"award-info":[{"award-number":["R00 LM014308"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2026,5,28]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Biomedical knowledge graphs (KGs) such as PrimeKG, Hetionet, UMLS, and PharmGKB are increasingly used as the substrate for downstream machine-learning, retrieval-augmented generation, drug-repurposing, and electronic health record (EHR) augmentation pipelines. The dominant assumption in published work is that integrating two or more such KGs is a tractable engineering step solved by identifier (ID) matching. This paper interrogates that assumption empirically. We quantify how much concept overlap survives realistic alignment, and we characterize the new failure modes introduced by the methods that practitioners reach for when ID matching is insufficient.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We compared four widely used biomedical KGs (PrimeKG, Hetionet v1.0, the full UMLS Metathesaurus, and PharmGKB) across eleven node types using a tiered alignment pipeline: (1) direct ID matching for nodes sharing a primary vocabulary; (2) cross-ontology bridging using standard mappings (e.g., MONDO\u2194DOID, HPO\u2194UMLS, HPO\u2194UMLS\u2194MeSH for side effects, NCBI Gene\u2194HGNC\u2194UMLS, UBERON\u2194FMA\/SNOMEDCT_US\/NCI\/MeSH for anatomy); (3) ClinicalBERT cosine-similarity grouping at threshold \u2265 0.98 for over-segmented disease nodes, with a deterministic suffix-stripping canonicalizer; (4) exact name matching for ontology-poor types (anatomy, REACTOME pathways); and (5) embedding-based fuzzy matching with UMLS lookup (SapBERT and ClinicalBERT) for free-text microbiome concepts. We applied the pipeline to a 698-concept gut-microbiome benchmark spanning taxa, pathways, and disease labels, validated grouping decisions against the curated SSSOM mappings released by the MONDO project, and audited the ClinicalBERT consolidation against five clinical-genetics case studies drawn from the literature.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Per-type pairwise coverage was strikingly asymmetric. Genes\/proteins and the three Gene Ontology categories aligned cleanly across PrimeKG and Hetionet (mutual coverage 94\u201399%), but disease overlap was sparse: only 0.7% of PrimeKG individual disease nodes mapped to Hetionet, rising to 2.0% after MONDO grouping (versus 78.7% and 18.4% from the Hetionet side). PrimeKG-to-UMLS coverage spanned 100% (effect\/phenotype via HPO) down to 20.8% (REACTOME pathways), with drugs at 73.7% and anatomy at 58.8%. PrimeKG-to-PharmGKB drug coverage required up to two bridging hops (DrugBank \u2192 UMLS \u2192 RxNorm\/ATC\/MeSH). Bigger was not uniformly more complete: on a 698-concept microbiome drug benchmark, Hetionet missed 0 concepts while PrimeKG missed 16. ClinicalBERT-based grouping consolidated 22,205 raw MONDO disease nodes into 17,080 groups but introduced three reproducible failure modes documented in case studies: (i) peer over-merging: for example, all 22 osteogenesis imperfecta subtypes collapsed into a single node despite distinct severity classes; (ii) parent-child collapse: e.g. acute myeloid leukemia merged with myeloid leukemia, erasing the acute\/chronic distinction that drives clinical management; and (iii) lexical false positives: neurofibromatosis and schwannomatosis grouped together despite cellular-pathology differences.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Identifier matching alone is a weak baseline for biomedical KG integration. Cross-ontology bridges and embedding-based consolidation expand coverage but do so at the cost of clinically meaningful resolution, and the resulting failures are systematic rather than random. Reporting only aggregate coverage statistics obscures these losses, which propagate silently into downstream tasks.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>We provide reusable per-type coverage tables, a taxonomy of three integration failure modes, and concrete recommendations for downstream studies that depend on a unified biomedical KG. We argue that future KG integration work should report per-type coverage and per-cluster confidence rather than aggregate match rates.<\/jats:p>\n                <\/jats:sec>","DOI":"10.64898\/2026.05.26.26354182","type":"posted-content","created":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T20:45:17Z","timestamp":1780001117000},"source":"Crossref","is-referenced-by-count":0,"title":["Beyond Identifier Matching: An Empirical Characterization of Failure Modes in Biomedical Knowledge Graph Integration"],"prefix":"10.64898","author":[{"given":"Shiyue","family":"Hu","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"He","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucas","family":"Gillenwater","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9891-3283","authenticated-orcid":false,"given":"Keenan","family":"Manpearl","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aishwarya","family":"Mandava","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yifan","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Hawaii at Manoa"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Milton","family":"Pividori","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Barbara","family":"Stranger","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arjun","family":"Krishnan","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Casey S.","family":"Greene","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9341-7360","authenticated-orcid":false,"given":"Yanjun","family":"Gao","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"54368","reference":[{"key":"2026060100351351000_2026.05.26.26354182v1.1","doi-asserted-by":"crossref","unstructured":"Emily Alsentzer , John R Murphy , Willie Boag , Wei-Hung Weng , Di Jin , Tristan Naumann , and Matthew McDermott . 2019. Publicly available Clinical BERT embeddings. In Proceedings of the 2nd Clinical Natural Language Processing Workshop (NAACL), pages 72\u201378.","DOI":"10.18653\/v1\/W19-1909"},{"key":"2026060100351351000_2026.05.26.26354182v1.2","doi-asserted-by":"publisher","DOI":"10.1182\/blood-2016-03-643544"},{"key":"2026060100351351000_2026.05.26.26354182v1.3","doi-asserted-by":"publisher","DOI":"10.1038\/75556"},{"key":"2026060100351351000_2026.05.26.26354182v1.4","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkh061"},{"issue":"9","key":"2026060100351351000_2026.05.26.26354182v1.5","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1038\/nrendo.2015.112","article-title":"Expert consensus document: European Consensus Statement on congenital hypogonadotropic hypogonadism \u2013 pathogenesis, diagnosis and treatment","volume":"11","year":"2015","journal-title":"Nature Reviews Endocrinology"},{"key":"2026060100351351000_2026.05.26.26354182v1.6","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gku1055"},{"key":"2026060100351351000_2026.05.26.26354182v1.7","first-page":"133","article-title":"Owl-nets: Transforming owl representations for improved network inference","volume":"23","year":"2018","journal-title":"Pacific Symposium on Biocomputing"},{"key":"2026060100351351000_2026.05.26.26354182v1.8","doi-asserted-by":"crossref","unstructured":"Ron Caspi , Richard Billington , Ingrid M Keseler , Anamika Kothari , Markus Krummenacker , Peter E Midford , Wai Kit Ong , Suzanne Paley , Pallavi Subhraveti , and Peter D Karp . 2020. The MetaCyc database of metabolic pathways and enzymes \u2013 a 2019 update. Nucleic Acids Research, 48(D1):D445\u2013D453.","DOI":"10.1093\/nar\/gkz862"},{"issue":"1","key":"2026060100351351000_2026.05.26.26354182v1.9","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1038\/s41597-023-01960-3","article-title":"Building a knowledge graph to enable precision medicine","volume":"10","year":"2023","journal-title":"Scientific Data"},{"key":"2026060100351351000_2026.05.26.26354182v1.10","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkac833"},{"key":"2026060100351351000_2026.05.26.26354182v1.11","first-page":"279","article-title":"SNOMED-CT: The advanced terminology and coding system for eHealth","volume":"121","year":"2006","journal-title":"Studies in Health Technology and Informatics"},{"issue":"8","key":"2026060100351351000_2026.05.26.26354182v1.12","doi-asserted-by":"crossref","first-page":"1838","DOI":"10.1111\/cts.13301","article-title":"Progress toward a universal biomedical data translator","volume":"15","author":"1 others","year":"2022","journal-title":"Clinical and Translational Science"},{"key":"2026060100351351000_2026.05.26.26354182v1.13","doi-asserted-by":"publisher","DOI":"10.1515\/jib-2020-0033"},{"key":"2026060100351351000_2026.05.26.26354182v1.14","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra020552"},{"key":"2026060100351351000_2026.05.26.26354182v1.15","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkab1028"},{"key":"2026060100351351000_2026.05.26.26354182v1.16","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.26726"},{"key":"2026060100351351000_2026.05.26.26354182v1.17","unstructured":"Marcin P Joachimiak , Justin T Reese , Harshad Hegde , Luca Cappelletti , and Christopher J Mungall . 2024. KG-Microbe: A reference knowledge graph and platform for harmonized microbial information. https:\/\/github.com\/Knowledge-Graph-Hub\/kg-microbe. Verify preferred citation (preprint vs. published)."},{"key":"2026060100351351000_2026.05.26.26354182v1.18","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkaa1043"},{"key":"2026060100351351000_2026.05.26.26354182v1.19","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz682"},{"issue":"3","key":"2026060100351351000_2026.05.26.26354182v1.20","first-page":"265","article-title":"Medical subject headings (MeSH)","volume":"88","year":"2000","journal-title":"Bulletin of the Medical Library Association"},{"key":"2026060100351351000_2026.05.26.26354182v1.21","doi-asserted-by":"crossref","unstructured":"Fangyu Liu , Ehsan Shareghi , Zaiqiao Meng , Marco Basaldella , and Nigel Collier . 2021. Self-alignment pretraining for biomedical entity representations. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), pages 4228\u20134238.","DOI":"10.18653\/v1\/2021.naacl-main.334"},{"key":"2026060100351351000_2026.05.26.26354182v1.22","doi-asserted-by":"crossref","unstructured":"Nicolas Matentzoglu , James P Balhoff , Susan M Bello , Chris Bizon , Matthew Brush , Tiffany J Callahan , Christopher G Chute , William D Duncan , Chris T Evelo , Davera Gabriel , John Graybeal , Alasdair Gray , Benjamin M Gyori , Melissa Haendel , Henriette Harmse , Nomi L Harris , Ian Harrow , Harshad B Hegde , Charles T Hoyt , and 2 others. 2022. A Simple Standard for Sharing Ontological Mappings (SSSOM). Database (Oxford), 2022:baac035.","DOI":"10.1093\/database\/baac035"},{"key":"2026060100351351000_2026.05.26.26354182v1.23","first-page":"417217","article-title":"An update on the genetics of Usher syndrome","volume":"2011","year":"2011","journal-title":"Journal of Ophthalmology"},{"key":"2026060100351351000_2026.05.26.26354182v1.24","doi-asserted-by":"publisher","DOI":"10.1093\/rheumatology\/ker394"},{"key":"2026060100351351000_2026.05.26.26354182v1.25","unstructured":"Christopher J Mungall , Nicolas Matentzoglu , Harshad Hegde , and Damien Goutte-Gattat . 2024. The Ontology Access Kit: A Python toolkit for interacting with biomedical ontologies. https:\/\/github.com\/INCATools\/ontology-access-kit. Verify preferred citation."},{"key":"2026060100351351000_2026.05.26.26354182v1.26","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2012-13-1-r5"},{"key":"2026060100351351000_2026.05.26.26354182v1.27","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000116"},{"issue":"11","key":"2026060100351351000_2026.05.26.26354182v1.28","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1038\/nmeth.4468","article-title":"Accessible, curated metagenomic data through experimenthub","volume":"14","author":"1 others","year":"2017","journal-title":"Nature methods"},{"key":"2026060100351351000_2026.05.26.26354182v1.29","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2003.11.007"},{"key":"2026060100351351000_2026.05.26.26354182v1.30","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkab1063"},{"key":"2026060100351351000_2026.05.26.26354182v1.31","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkac888"},{"key":"2026060100351351000_2026.05.26.26354182v1.32","doi-asserted-by":"publisher","DOI":"10.1038\/nrc.2016.37"},{"key":"2026060100351351000_2026.05.26.26354182v1.33","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2006.02.013"},{"key":"2026060100351351000_2026.05.26.26354182v1.34","doi-asserted-by":"publisher","DOI":"10.1016\/j.nmd.2018.05.007"},{"key":"2026060100351351000_2026.05.26.26354182v1.35","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymgme.2020.01.006"},{"key":"2026060100351351000_2026.05.26.26354182v1.36","doi-asserted-by":"publisher","DOI":"10.1093\/genetics\/iyad031"},{"issue":"4","key":"2026060100351351000_2026.05.26.26354182v1.37","doi-asserted-by":"crossref","first-page":"255","DOI":"10.4103\/0974-7753.111215","article-title":"Keratosis pilaris revisited: is it more than just a follicular keratosis?","volume":"4","year":"2012","journal-title":"International Journal of Trichology"},{"issue":"8","key":"2026060100351351000_2026.05.26.26354182v1.38","doi-asserted-by":"crossref","first-page":"1848","DOI":"10.1111\/cts.13302","article-title":"Biolink model: A universal schema for knowledge graphs in clinical, biomedical, and translational science","volume":"15","author":"14 others","year":"2022","journal-title":"Clinical and Translational Science"},{"key":"2026060100351351000_2026.05.26.26354182v1.39","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.2147\/DMSO.S179793","article-title":"Maturity-onset diabetes of the young (MODY): current perspectives on diagnosis and treatment","volume":"12","year":"2019","journal-title":"Diabetes, Metabolic Syndrome and Obesity"},{"key":"2026060100351351000_2026.05.26.26354182v1.40","doi-asserted-by":"publisher","DOI":"10.1002\/ajmg.a.36545"},{"key":"2026060100351351000_2026.05.26.26354182v1.41","doi-asserted-by":"crossref","unstructured":"Nicole A Vasilevsky , Nicolas A Matentzoglu , Sabrina Toro , Joe E Flack , Harshad Hegde , Deepak R Unni , Gioconda Alyea , Joanna S Amberger , Larry Babb , James P Balhoff , Taylor I Bingaman , Gully A Burns , Orion J Buske , Tiffany J Callahan , Leigh C Carmody , Paula Cordo , Alexander D Diehl , Melissa A Haendel , Henriette H Hansen , and 3 others. 2022. Mondo: Unifying diseases for the world, by the world. medRxiv.","DOI":"10.1101\/2022.04.13.22273750"},{"key":"2026060100351351000_2026.05.26.26354182v1.42","doi-asserted-by":"publisher","DOI":"10.1002\/cpt.2350"},{"key":"2026060100351351000_2026.05.26.26354182v1.43","unstructured":"WHO Collaborating Centre for Drug Statistics Methodology. 2024. ATC\/DDD Index. https:\/\/www.who.int\/tools\/atc-ddd-toolkit. Cite current online release."},{"key":"2026060100351351000_2026.05.26.26354182v1.44","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkx1037"},{"key":"2026060100351351000_2026.05.26.26354182v1.45","doi-asserted-by":"publisher","DOI":"10.1126\/science.1068452"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.64898\/2026.05.26.26354182","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T07:35:27Z","timestamp":1780299327000},"score":1,"resource":{"primary":{"URL":"http:\/\/medrxiv.org\/lookup\/doi\/10.64898\/2026.05.26.26354182"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,28]]},"references-count":45,"URL":"https:\/\/doi.org\/10.64898\/2026.05.26.26354182","relation":{},"subject":[],"published":{"date-parts":[[2026,5,28]]},"subtype":"preprint"}}