{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T01:05:12Z","timestamp":1790039112509,"version":"4.0.1"},"reference-count":16,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,3,22]],"date-time":"2025-03-22T00:00:00Z","timestamp":1742601600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,3,22]],"date-time":"2025-03-22T00:00:00Z","timestamp":1742601600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Biomed Semant"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>\n                      While unstructured data, such as free text, constitutes a large amount of publicly available biomedical data, it is underutilized in automated analyses due to the difficulty of extracting meaning from it. Normalizing free-text data,\n                      <jats:italic>i.e.<\/jats:italic>\n                      , removing inessential variance, enables the use of structured vocabularies like ontologies to represent the data and allow for harmonized queries over it. This paper presents an adaptable tool for free-text normalization and an evaluation of the application of this tool to two different fields curated from the literature in the Immune Epitope Database (IEDB): \u201cage\u201d and \u201cdata-location\u201d (the part of a paper in which data was found).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Free text entries for the database fields for subject age (4095 distinct values) and publication data-location (251,810 distinct values) in the IEDB were analyzed. Normalization was performed in three steps, namely character normalization, word normalization, and phrase normalization, using generalizable rules developed and applied with the tool presented in this manuscript. For the age dataset, in the character stage, the application of 21 rules resulted in 99.97% output validity; in the word stage, the application of 94 rules resulted in 98.06% output validity; and in the phrase stage, the application of 16 rules resulted in 83.81% output validity. For the data-location dataset, in the character stage, the application of 39 rules resulted in 99.99% output validity; in the word stage, the application of 187 rules resulted in 98.46% output validity; and in the phrase stage, the application of 12 rules resulted in 97.95% output validity.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>We developed a generalizable approach for normalization of free text as found in database fields with content on a specific topic. Creating and testing the rules took a one-time effort for a given field that can now be applied to data as it is being curated. The standardization achieved in two datasets tested produces significantly reduced variance in the content which enhances the findability and usability of that data, chiefly by improving search functionality and enabling linkages with formal ontologies.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13326-025-00324-7","type":"journal-article","created":{"date-parts":[[2025,3,22]],"date-time":"2025-03-22T07:48:46Z","timestamp":1742629726000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Standardizing free-text data exemplified by two fields from the Immune Epitope Database"],"prefix":"10.1186","volume":"16","author":[{"given":"Sebastian","family":"Duesing","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Bennett","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James A.","family":"Overton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Randi","family":"Vita","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bjoern","family":"Peters","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,3,22]]},"reference":[{"issue":"2","key":"324_CR1","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/j.ijinfomgt.2014.10.007","volume":"35","author":"A Gandomi","year":"2015","unstructured":"Gandomi A, Haider M. Beyond the hype: big data concepts, methods, and analytics. Int J Inf Manag. 2015;35(2):137\u201344.","journal-title":"Int J Inf Manag"},{"issue":"Database issue","key":"324_CR2","doi-asserted-by":"publisher","first-page":"D339","DOI":"10.1093\/nar\/gky1006","volume":"47","author":"R Vita","year":"2019","unstructured":"Vita R, Mahajan S, Overton JA, Dhanda SK, Martini S, Cantrell JR, et al. The Immune Epitope Database (IEDB): 2018 update. Nucleic Acids Res. 2019;47(Database issue):D339-43.","journal-title":"Nucleic Acids Res"},{"issue":"2018","key":"324_CR3","first-page":"bax105","volume":"1","author":"R Vita","year":"2018","unstructured":"Vita R, Overton JA, Mungall CJ, Sette A, Peters B. FAIR principles and the IEDB: short-term improvements and a long-term vision of OBO-foundry mediated machine-actionable interoperability. Database. 2018;1(2018):bax105.","journal-title":"Database"},{"issue":"27","key":"324_CR4","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1016\/j.sbspro.2011.10.577","volume":"1","author":"E Clark","year":"2011","unstructured":"Clark E, Araki K. Text normalization in social media: progress, problems and applications for a pre-processing system of casual english. Procedia - Soc Behav Sci. 2011;1(27):2\u201311.","journal-title":"Procedia - Soc Behav Sci"},{"key":"324_CR5","unstructured":"Duesing S. sebastianduesing\/adp. 2024. Available from: https:\/\/github.com\/sebastianduesing\/adp. Cited 2024 Jul 1."},{"issue":"3","key":"324_CR6","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1006\/csla.2001.0169","volume":"15","author":"R Sproat","year":"2001","unstructured":"Sproat R, Black AW, Chen S, Kumar S, Ostendorf M, Richards CD. Normalization of non-standard words. Comput Speech Lang. 2001;15(3):287\u2013333.","journal-title":"Comput Speech Lang"},{"key":"324_CR7","unstructured":"Qi D, Wang J. CleanAgent: Automating Data Standardization with LLM-based Agents. arXiv; 2024. Available from: http:\/\/arxiv.org\/abs\/2403.08291. Cited 2024 Sep 30."},{"issue":"1","key":"324_CR8","doi-asserted-by":"publisher","first-page":"e56614","DOI":"10.2196\/56614","volume":"26","author":"D Yoon","year":"2024","unstructured":"Yoon D, Han C, Kim DW, Kim S, Bae S, Ryu JA, et al. Redefining health care data interoperability: empirical exploration of large language models in information exchange. J Med Internet Res. 2024;26(1):e56614.","journal-title":"J Med Internet Res"},{"issue":"Database issue","key":"324_CR9","doi-asserted-by":"publisher","first-page":"D405","DOI":"10.1093\/nar\/gku938","volume":"43","author":"R Vita","year":"2015","unstructured":"GO FAIR. F4: (Meta)data are registered or indexed in a searchable resource. Available from: https:\/\/www.go-fair.org\/fair-principles\/f4-metadata-registered-indexed-searchable-resource\/. Cited 2024 Jun 7.","journal-title":"Nucleic Acids Res"},{"key":"324_CR10","doi-asserted-by":"crossref","unstructured":"Vita R, Overton JA, Greenbaum JA, Ponomarenko J, Clark JD, Cantrell JR, et al. The immune epitope database (IEDB) 3.0. Nucleic Acids Res. 2015;43(Database issue):D405\u201312.","DOI":"10.1093\/nar\/gku938"},{"issue":"2017","key":"324_CR11","first-page":"bax014","volume":"18","author":"R Vita","year":"2017","unstructured":"Vita R, Overton JA, Sette A, Peters B. Better living through ontologies at the Immune Epitope Database. Database J Biol Databases Curation. 2017;18(2017):bax014.","journal-title":"Database J Biol Databases Curation"},{"key":"324_CR12","doi-asserted-by":"crossref","unstructured":"NCBI Resource Coordinators. Database Resources of the National Center for Biotechnology Information. Nucleic Acids Res. 2017;45(Database issue):D12\u20137.\u00a0https:\/\/academic.oup.com\/nar\/article\/45\/D1\/D12\/2605705.","DOI":"10.1093\/nar\/gkw1071"},{"key":"324_CR13","first-page":"bau075","volume":"2014","author":"MC Chibucos","year":"2014","unstructured":"Chibucos MC, Mungall CJ, Balakrishnan R, Christie KR, Huntley RP, White O, et al. Standardized description of scientific evidence using the Evidence Ontology (ECO). Database J Biol Databases Curation. 2014;2014:bau075.","journal-title":"Database J Biol Databases Curation"},{"key":"324_CR14","first-page":"bay005","volume":"2018","author":"R Vita","year":"2018","unstructured":"Vita R, Overton JA, Peters B. Identification of errors in the IEDB using ontologies. Database J Biol Databases Curation. 2018;2018:bay005.","journal-title":"Database J Biol Databases Curation"},{"issue":"2012","key":"324_CR15","first-page":"bas033","volume":"5","author":"GV Gkoutos","year":"2012","unstructured":"Gkoutos GV, Schofield PN, Hoehndorf R. The Units Ontology: a tool for integrating units of measurement in science. Database J Biol Databases Curation. 2012;5(2012):bas033.","journal-title":"Database J Biol Databases Curation"},{"issue":"4","key":"324_CR16","doi-asserted-by":"publisher","first-page":"e0154556","DOI":"10.1371\/journal.pone.0154556","volume":"11","author":"A Bandrowski","year":"2016","unstructured":"Bandrowski A, Brinkman R, Brochhausen M, Brush MH, Bug B, Chibucos MC, et al. The ontology for biomedical investigations. PLoS ONE. 2016;11(4):e0154556.","journal-title":"PLoS ONE"}],"container-title":["Journal of Biomedical Semantics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-025-00324-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13326-025-00324-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-025-00324-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T00:25:28Z","timestamp":1790036728000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s13326-025-00324-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,22]]},"references-count":16,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["324"],"URL":"https:\/\/doi.org\/10.1186\/s13326-025-00324-7","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-5363542\/v1","asserted-by":"object"}]},"ISSN":["2041-1480"],"issn-type":[{"value":"2041-1480","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,22]]},"assertion":[{"value":"30 October 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 February 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 March 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","label":"Ethics approval and consent to participate","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","label":"Consent for publication","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"5"}}