{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T21:21:55Z","timestamp":1762377715401,"version":"3.44.0"},"reference-count":43,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T00:00:00Z","timestamp":1758758400000},"content-version":"vor","delay-in-days":267,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000071","name":"National Institute of Child Health and Human Development","doi-asserted-by":"publisher","award":["R01LM011176"],"award-info":[{"award-number":["R01LM011176"]}],"id":[{"id":"10.13039\/100000071","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","award":["R01AI164481"],"award-info":[{"award-number":["R01AI164481"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,1,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>We present here an overview of the BioCreative VIII Task 3 competition, which called for the development of state-of-the-art approaches to automatic normalization of observations noted by physicians in dysmorphology physical examinations to the Human Phenotype Ontology (HPO). We made available for the task 3136 deidentified and manually annotated observations extracted from electronic health records of 1652 paediatric patients at the Children\u2019s Hospital of Philadelphia. This task is challenging due to the discontinuous, overlapping, and descriptive mentions of the observations corresponding to HPO terms, severely limiting the performance of straightforward strict matching approaches. Ultimately, an effective automated solution to the task will facilitate computational analysis that could uncover novel correlations and patterns of observations in patients with rare genetic diseases, enhance our understanding of known genetic conditions, and even identify previously unrecognized conditions. A total of 20 teams registered, and 5 teams submitted their predictions. We summarize the corpus, the competing systems approaches, and their results. The top system used a pre-trained large language model and achieved a 0.82 F1 score, which is close to human performance, confirming the impact that recent advances in natural language processing can have on tasks such as this. The post-evaluation period of the challenge, at https:\/\/codalab.lisn.upsaclay.fr\/competitions\/11351, will be open for submissions for at least 18 months past the end of the competition. Database URL: \u00a0https:\/\/codalab.lisn.upsaclay.fr\/competitions\/11351<\/jats:p>","DOI":"10.1093\/database\/baaf051","type":"journal-article","created":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T14:25:48Z","timestamp":1758810348000},"source":"Crossref","is-referenced-by-count":1,"title":["Automatic genetic phenotype normalization from dysmorphology physical examinations: an overview of the BioCreative VIII\u2014Task 3 competition"],"prefix":"10.1093","volume":"2025","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8331-3675","authenticated-orcid":false,"given":"Davy","family":"Weissenbacher","sequence":"first","affiliation":[{"name":"Cedars-Sinai Medical Center , 700 N. San Vicente Blvd. Pacific Design Center, West Hollywood, CA 90069 ,","place":["United States"]}]},{"given":"Xinwei","family":"Zhao","sequence":"additional","affiliation":[{"name":"Children\u2019s Hospital of Philadelphia , 3401 Civic Center Blvd. Philadelphia, PA 19104 ,","place":["United States"]}]},{"given":"Jessica R C","family":"Priestley","sequence":"additional","affiliation":[{"name":"Children\u2019s Hospital of Philadelphia , 3401 Civic Center Blvd. Philadelphia, PA 19104 ,","place":["United States"]}]},{"given":"Katherine M","family":"Szigety","sequence":"additional","affiliation":[{"name":"Children\u2019s Hospital of Philadelphia , 3401 Civic Center Blvd. Philadelphia, PA 19104 ,","place":["United States"]}]},{"given":"Sarah F","family":"Schmidt","sequence":"additional","affiliation":[{"name":"Children\u2019s Hospital of Philadelphia , 3401 Civic Center Blvd. Philadelphia, PA 19104 ,","place":["United States"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7709-3813","authenticated-orcid":false,"given":"Karen","family":"O'Connor","sequence":"additional","affiliation":[{"name":"University of Pennsylvania , 3400 Civic Center Boulevard Building 421, Philadelphia, PA 19104 ,","place":["United States"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4534-0055","authenticated-orcid":false,"given":"Ekin","family":"Soysal","sequence":"additional","affiliation":[{"name":"University of Texas Health Science Center at Houston , 7000 Fannin St. Houston, TX 77030 ,","place":["United States"]}]},{"given":"Kirk","family":"Roberts","sequence":"additional","affiliation":[{"name":"University of Texas Health Science Center at Houston , 7000 Fannin St. Houston, TX 77030 ,","place":["United States"]}]},{"given":"Jiewei","family":"Qi","sequence":"additional","affiliation":[{"name":"Dalian University of Technology , No. 2 Linggong Road, Ganjingzi District, Dalian, 116024 ,","place":["China"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5141-0259","authenticated-orcid":false,"given":"Ling","family":"Luo","sequence":"additional","affiliation":[{"name":"Dalian University of Technology , No. 2 Linggong Road, Ganjingzi District, Dalian, 116024 ,","place":["China"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6186-2024","authenticated-orcid":false,"given":"Zhihao","family":"Yang","sequence":"additional","affiliation":[{"name":"Dalian University of Technology , No. 2 Linggong Road, Ganjingzi District, Dalian, 116024 ,","place":["China"]}]},{"given":"Hongfei","family":"Lin","sequence":"additional","affiliation":[{"name":"Dalian University of Technology , No. 2 Linggong Road, Ganjingzi District, Dalian, 116024 ,","place":["China"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3209-3494","authenticated-orcid":false,"given":"Hajung","family":"Kim","sequence":"additional","affiliation":[{"name":"Korea University Department of Computer Science and Engineering, , 102 Woojung Hall of Informatics, 145 Anam-ro, Seongbuk-gu, Seoul, 02841 ,","place":["Republic of Korea"]}]},{"given":"Chanhwi","family":"Kim","sequence":"additional","affiliation":[{"name":"Korea University Department of Computer Science and Engineering, , 102 Woojung Hall of Informatics, 145 Anam-ro, Seongbuk-gu, Seoul, 02841 ,","place":["Republic of Korea"]}]},{"given":"Jiwoong","family":"Sohn","sequence":"additional","affiliation":[{"name":"Korea University Department of Computer Science and Engineering, , 102 Woojung Hall of Informatics, 145 Anam-ro, Seongbuk-gu, Seoul, 02841 ,","place":["Republic of Korea"]}]},{"given":"Tim","family":"Beck","sequence":"additional","affiliation":[{"name":"University of Nottingham , Nottingham NG7 2RD ,","place":["United Kingdom"]}]},{"given":"Marek","family":"Rei","sequence":"additional","affiliation":[{"name":"Imperial College London , Huxley Building, 180 Queen's Gate, South Kensington, London SW7 2AZ ,","place":["United Kingdom"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0240-6210","authenticated-orcid":false,"given":"Sunkyu","family":"Kim","sequence":"additional","affiliation":[{"name":"AIGEN Sciences , Office 507, 25 Ttukseom-ro 1-gil, Seongdong-gu, Seoul 04778 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0495-7187","authenticated-orcid":false,"given":"T Ian","family":"Simpson","sequence":"additional","affiliation":[{"name":"University of Edinburgh , 10 Crichton Street, Edinburgh, Scotland EH8 9AB ,","place":["United Kingdom"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4971-9003","authenticated-orcid":false,"given":"Joram M","family":"Posma","sequence":"additional","affiliation":[{"name":"Imperial College London , Huxley Building, 180 Queen's Gate, South Kensington, London SW7 2AZ ,","place":["United Kingdom"]}]},{"given":"Antoine","family":"Lain","sequence":"additional","affiliation":[{"name":"Imperial College London , Huxley Building, 180 Queen's Gate, South Kensington, London SW7 2AZ ,","place":["United Kingdom"]},{"name":"University of Edinburgh , 10 Crichton Street, Edinburgh, Scotland EH8 9AB ,","place":["United Kingdom"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7978-8114","authenticated-orcid":false,"given":"Mujeen","family":"Sung","sequence":"additional","affiliation":[{"name":"Korea University Department of Computer Science and Engineering, , 102 Woojung Hall of Informatics, 145 Anam-ro, Seongbuk-gu, Seoul, 02841 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6798-9106","authenticated-orcid":false,"given":"Jaewoo","family":"Kang","sequence":"additional","affiliation":[{"name":"Korea University Department of Computer Science and Engineering, , 102 Woojung Hall of Informatics, 145 Anam-ro, Seongbuk-gu, Seoul, 02841 ,","place":["Republic of Korea"]},{"name":"AIGEN Sciences , Office 507, 25 Ttukseom-ro 1-gil, Seongdong-gu, Seoul 04778 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7780-9463","authenticated-orcid":false,"given":"Areej","family":"Alhassan","sequence":"additional","affiliation":[{"name":"University of Manchester , 131 Princess Street, Manchester M1 7DN ,","place":["United Kingdom"]},{"name":"King Saud University , Riyadh 12371 ,","place":["Saudi Arabia"]}]},{"given":"Viktor","family":"Schlegel","sequence":"additional","affiliation":[{"name":"University of Manchester , 131 Princess Street, Manchester M1 7DN ,","place":["United Kingdom"]},{"name":"ASUS Intelligent Cloud Services , 10 Changi Business Park Central 2, #02-01 Hansapoint, Singapour 486030 ,","place":["Singapour"]}]},{"given":"Monira","family":"Aloud","sequence":"additional","affiliation":[{"name":"King Saud University , Riyadh 12371 ,","place":["Saudi Arabia"]}]},{"given":"Riza","family":"Batista-Navarro","sequence":"additional","affiliation":[{"name":"University of Manchester , 131 Princess Street, Manchester M1 7DN ,","place":["United Kingdom"]}]},{"given":"Goran","family":"Nenadic","sequence":"additional","affiliation":[{"name":"University of Manchester , 131 Princess Street, Manchester M1 7DN ,","place":["United Kingdom"]}]},{"given":"Ying-Jia","family":"Lin","sequence":"additional","affiliation":[{"name":"National Cheng Kung University , No. 1 Dasyue Road, East District, Tainan City, Ta\u00efwan 701 ,","place":["Taiwan"]}]},{"given":"Zhi-Quan","family":"Feng","sequence":"additional","affiliation":[{"name":"National Cheng Kung University , No. 1 Dasyue Road, East District, Tainan City, Ta\u00efwan 701 ,","place":["Taiwan"]}]},{"given":"Hung-Yu","family":"Kao","sequence":"additional","affiliation":[{"name":"National Cheng Kung University , No. 1 Dasyue Road, East District, Tainan City, Ta\u00efwan 701 ,","place":["Taiwan"]}]},{"given":"Ian M","family":"Campbell","sequence":"additional","affiliation":[{"name":"Children\u2019s Hospital of Philadelphia , 3401 Civic Center Blvd. Philadelphia, PA 19104 ,","place":["United States"]},{"name":"University of Pennsylvania , 3400 Civic Center Boulevard Building 421, Philadelphia, PA 19104 ,","place":["United States"]}]},{"given":"Graciela","family":"Gonzalez-Hernandez","sequence":"additional","affiliation":[{"name":"Cedars-Sinai Medical Center , 700 N. San Vicente Blvd. Pacific Design Center, West Hollywood, CA 90069 ,","place":["United States"]}]}],"member":"286","published-online":{"date-parts":[[2025,9,24]]},"reference":[{"key":"2025092510254186400_bib1","doi-asserted-by":"publisher","first-page":"D1207","DOI":"10.1093\/nar\/gkaa1043","article-title":"The Human Phenotype Ontology in 2021","volume":"49","author":"K\u00f6hler","year":"2021","journal-title":"Nucleic Acids Res"},{"key":"2025092510254186400_bib2","doi-asserted-by":"publisher","first-page":"W566","DOI":"10.1093\/nar\/gkz386","article-title":"Doc2Hpo: a web application for efficient and accurate HPO concept curation","volume":"47","author":"Liu","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2025092510254186400_bib3","doi-asserted-by":"publisher","first-page":"e12596","DOI":"10.2196\/12596","article-title":"Identifying clinical terms in medical text using ontology-guided machine learning","volume":"7","author":"Arbabi","year":"2019","journal-title":"JMIR Med Inform"},{"key":"2025092510254186400_bib4","doi-asserted-by":"publisher","first-page":"1884","DOI":"10.1093\/bioinformatics\/btab019","article-title":"PhenoTagger: a hybrid method for phenotype concept recognition using human phenotype ontology","volume":"37","author":"Luo","year":"2021","journal-title":"Bioinformatics"},{"key":"2025092510254186400_bib5","doi-asserted-by":"publisher","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee","year":"2020","journal-title":"Bioinformatics"},{"key":"2025092510254186400_bib6","doi-asserted-by":"publisher","first-page":"1269","DOI":"10.1109\/TCBB.2022.3170301","article-title":"PhenoBERT: a combined deep learning method for automated recognition of Human Phenotype Ontology","volume":"20","author":"Feng","year":"2023","journal-title":"IEEE\/ACM Trans Comput Biol and Bioinf"},{"key":"2025092510254186400_bib7","volume-title":"BioCreative","author":"US National Library of Medicine\u2014National Center for Biotechnology Information"},{"key":"2025092510254186400_bib8","doi-asserted-by":"publisher","first-page":"186357","DOI":"10.1007\/s11704-024-40555-y","article-title":"Large language models for generative information extraction: a survey","volume":"18","author":"Xu","year":"2024","journal-title":"Front Comput Sci"},{"key":"2025092510254186400_bib9"},{"key":"2025092510254186400_bib10","doi-asserted-by":"crossref","DOI":"10.1101\/2023.10.16.23296894","article-title":"PhenoID, a language model normalizer of physical examinations from genetics clinical notes","author":"Weissenbacher","year":"2023"},{"key":"2025092510254186400_bib11","doi-asserted-by":"crossref","first-page":"3061","DOI":"10.18653\/v1\/2022.emnlp-main.199","article-title":"Generative entity typing with curriculum learning","volume-title":"Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing","author":"Yuan","year":"2022"},{"key":"2025092510254186400_bib12","first-page":"1","article-title":"CodaLab Competitions: an open source platform to organize scientific challenges","volume":"24","author":"Pavao","year":"2023","journal-title":"J Mach Learn Res"},{"key":"2025092510254186400_bib13","unstructured":"Soysal E, Roberts K. 2023. UTH-Olympia@BC8 Track 3: Adapting GPT-4 for Entity Extraction and Normalizing Responses to Detect Key Findings in Dysmorphology Physical Examination Observations. Proceedings of the BioCreative VIII Challenge and Workshop: Curation and Evaluation in the era of Generative Models. 12 November.https:\/\/zenodo.org\/records\/10104725 \u00a0(13 May 2024, date last accessed)."},{"key":"2025092510254186400_bib14","unstructured":"Qi J, Luo L, Yang Z \u00a0et al. \u00a02023. DUTIR-BioNLP@BC8 Track 3: Genetic Phenotype Extraction and Normalization with Biomedical Pre-trained Language Models. Proceedings of the BioCreative VIII Challenge and Workshop: Curation and Evaluation in the era of Generative Models. 12 November.https:\/\/zenodo.org\/records\/10104756 \u00a0(13 May 2024, date last accessed)."},{"key":"2025092510254186400_bib15","unstructured":"Kim H, Kim C, Sohn J \u00a0et al. \u00a02023. KU AIGEN ICL EDI@BC8 Track 3: Advancing Phenotype Named Entity Recognition and Normalization for Dysmorphology Physical Examination Reports. Proceedings of the BioCreative VIII Challenge and Workshop: Curation and Evaluation in the era of Generative Models. 12 November. https:\/\/zenodo.org\/records\/10104804 \u00a0(13 May 2024, date last accessed)."},{"key":"2025092510254186400_bib16","unstructured":"Alhassan A, Schlegel V, Aloud M \u00a0et al. \u00a02023. DiscHPO@BC8 Track 3: Recognising and Normalising Continuous and Discontinuous Genetic Phenotypes Using T5 Variants and Sentence-Transformers Models. Proceedings of the BioCreative VIII Challenge and Workshop: Curation and Evaluation in the era of Generative Models. 12 November. https:\/\/zenodo.org\/records\/10104869 \u00a0(13 May 2024, date last accessed)."},{"key":"2025092510254186400_bib17","unstructured":"Lin YJ, Feng ZQ, Kao HY. 2023. IKMLab@BC8 Track 3: Sequence Tagging for Position-Aware Human Phenotype Extraction with Pre-trained Language Models. Proceedings of the BioCreative VIII Challenge and Workshop: Curation and Evaluation in the era of Generative Models. 12 November. https:\/\/zenodo.org\/records\/10104936 \u00a0(13 May 2024, date last accessed)."},{"key":"2025092510254186400_bib18","volume-title":"GPT-4 Technical Report","author":"OpenAI","year":"2024"},{"key":"2025092510254186400_bib19","article-title":"spaCy 2: natural language understanding with Bloom embeddings, convolutional neural networks and incremental parsing","author":"Honnibal","year":"2017","journal-title":"Sentometrics Research"},{"key":"2025092510254186400_bib20","doi-asserted-by":"publisher","first-page":"10965","DOI":"10.1609\/aaai.v36i10.21344","article-title":"Unified named entity recognition as word-word relation classification","volume":"36","author":"Li","year":"2022","journal-title":"AAAI"},{"key":"2025092510254186400_bib21","volume-title":"Bioformer: an efficient transformer language model for biomedical text mining","author":"Fang","year":"2023"},{"key":"2025092510254186400_bib22","doi-asserted-by":"crossref","first-page":"8003","DOI":"10.18653\/v1\/2022.acl-long.551","article-title":"LinkBERT: Pretraining Language Models with Document Links","volume-title":"Proceedings ofthe 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Yasunaga","year":"2022"},{"key":"2025092510254186400_bib23","doi-asserted-by":"crossref","first-page":"221","DOI":"10.18653\/v1\/2021.bionlp-1.24","article-title":"BioM-Transformers: building large biomedical language models with BERT, ALBERT and ELECTRA","volume-title":"Proceedings of the 20th Workshop on Biomedical Language Processing","author":"Alrowili","year":"2021"},{"key":"2025092510254186400_bib24","doi-asserted-by":"crossref","first-page":"2","DOI":"10.18653\/v1\/W19-1909","article-title":"Publicly available clinical BERT embeddings","volume-title":"Proceedings of the 2nd Clinical Natural Language Processing Workshop","author":"Alsentzer","year":"2019"},{"key":"2025092510254186400_bib25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3458754","article-title":"Domain-specific language model pretraining for biomedical Natural Language Processing","volume":"3","author":"Gu","year":"2022","journal-title":"ACM Trans Comput Healthcare"},{"key":"2025092510254186400_bib26","first-page":"1","article-title":"Clinical prompt learning with frozen language models","author":"Taylor","year":"2024","journal-title":"IEEE Trans Neural Netw Learning Syst"},{"key":"2025092510254186400_bib27","doi-asserted-by":"crossref","first-page":"3615","DOI":"10.18653\/v1\/D19-1371","article-title":"SciBERT: a pretrained language model for scientific text","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Beltagy","year":"2019"},{"key":"2025092510254186400_bib28","volume-title":"ClinicalBERT: modeling clinical notes and predicting hospital readmission","author":"Huang","year":"2020"},{"key":"2025092510254186400_bib29","first-page":"4228","article-title":"Self-alignment pretraining for biomedical entity representations","volume-title":"Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies [Internet]. Online: Association for Computational Linguistics","author":"Liu","year":"2021"},{"key":"2025092510254186400_bib30","doi-asserted-by":"crossref","first-page":"3641","DOI":"10.18653\/v1\/2020.acl-main.335","article-title":"Biomedical entity representations with synonym marginalization","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Sung","year":"2020"},{"key":"2025092510254186400_bib31","volume-title":"Sequence to sequence learning with neural networks","author":"Sutskever","year":"2014"},{"key":"2025092510254186400_bib32","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"J Mach Learn Res"},{"key":"2025092510254186400_bib33","first-page":"1","article-title":"Scaling instruction-finetuned language models","volume":"25","author":"Chung","year":"2024","journal-title":"J Mach Learn Res"},{"key":"2025092510254186400_bib34","volume-title":"SciFive: a text-to-text transformer model for biomedical literature","author":"Phan","year":"2021"},{"key":"2025092510254186400_bib35","volume-title":"LoRA: low-rank adaptation of large language models","author":"Hu","year":"2021"},{"key":"2025092510254186400_bib36","first-page":"506","volume-title":"Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit","author":"Bird","year":"2009"},{"key":"2025092510254186400_bib37","doi-asserted-by":"publisher","first-page":"2184","DOI":"10.1093\/jamia\/ocab114","article-title":"DeepADEMiner: a deep learning pharmacovigilance pipeline for extraction and normalization of adverse drug event mentions on Twitter","volume":"28","author":"Magge","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2025092510254186400_bib38","first-page":"5485","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"J Mach Learn Res"},{"key":"2025092510254186400_bib39","article-title":"On the role of entity and event level conceptualization in generalizable reasoning: a survey of tasks, methods, applications, and future directions","author":"Wang","year":"2024"},{"key":"2025092510254186400_bib40","doi-asserted-by":"publisher","first-page":"15550","DOI":"10.18653\/v1\/2023.findings-emnlp.1040","article-title":"Calibrated seq2seq models for efficient and generalizable ultra-fine entity typing","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2023","author":"Feng","year":"2023"},{"key":"2025092510254186400_bib41","first-page":"1738","article-title":"A comprehensive survey of sentence representations: from the BERT epoch to the ChatGPT era and beyond","volume-title":"Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Kashyap","year":"2024"},{"key":"2025092510254186400_bib42","article-title":"Espejo Morales I. interleaving text and number embeddings to solve mathemathics problems","volume-title":"Proceedings of The 4th Workshop on Mathematical Reasoning and AI at NeurIPS'24","author":"Alberts","year":"2024"},{"key":"2025092510254186400_bib43","article-title":"Language models represent space and time","volume-title":"Proceedings of The Twelfth International Conference on Learning Representations","author":"Gurnee","year":"2024"}],"container-title":["Database"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/database\/article-pdf\/doi\/10.1093\/database\/baaf051\/64394779\/baaf051.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/database\/article-pdf\/doi\/10.1093\/database\/baaf051\/64394779\/baaf051.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T14:25:54Z","timestamp":1758810354000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/database\/article\/doi\/10.1093\/database\/baaf051\/8263853"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025]]},"references-count":43,"URL":"https:\/\/doi.org\/10.1093\/database\/baaf051","relation":{},"ISSN":["1758-0463"],"issn-type":[{"value":"1758-0463","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025]]},"published":{"date-parts":[[2025]]},"article-number":"baaf051"}}