{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"medRxiv"}],"indexed":{"date-parts":[[2026,9,26]],"date-time":"2026-09-26T11:00:37Z","timestamp":1790420437452,"version":"4.1.0"},"posted":{"date-parts":[[2026,9,23]]},"group-title":"Genetic and Genomic Medicine","reference-count":45,"publisher":"openRxiv","license":[{"start":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T00:00:00Z","timestamp":1790121600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"name":"NIH\/NCATS","award":["RC2TR004391"],"award-info":[{"award-number":["RC2TR004391"]}]},{"name":"NIH\/NHGRI","award":["K08HG013111"],"award-info":[{"award-number":["K08HG013111"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2026,9,23]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>To evaluate usability and workflow implications of Pheno+, an electronic health record- (EHR) embedded natural language processing tool that extracts patient phenotypes and maps them to Human Phenotype Ontology (HPO) terms.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>This study performed a mixed-methods formative evaluation of Pheno+ in the context of rapid genome sequencing in the neonatal intensive care unit. Two rounds of think-aloud interviews and surveys were conducted with neonatologists, advanced practice providers, medical geneticists, genetic counselors, non-genetics pediatric subspecialists and laboratory molecular geneticists. Usability was assessed using the System Usability Scale (SUS). Structured data were analyzed descriptively. Qualitative data underwent hybrid deductive-inductive thematic analysis.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Twenty-eight interviewees participated in two rounds of data collection. Users retained an average of 24.2 HPO terms from an average of 45.6 terms per patient. Mean time curating terms was 8:59 per patient. Final SUS score was 76 (above scale mean). Qualitative themes included: burden of curating terms; interpretation of phenotypes; adding information to phenotypes; role of genetics expertise; and tool uses beyond the original core use case for Pheno+.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Pheno+ demonstrated positive usability but required curation effort to reduce erroneous terms. Participant responses indicate that effective use may depend on knowledge of HPO structure and laboratory workflows. Automated phenotyping seems likely to reduce net clinician workload, while also reshaping clinical responsibilities, expertise requirements, and communication in genetic testing.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Tools like Pheno+ can support scalable genomic medicine. Design and implementation may benefit from addressing curation burden, phenotype contextualization, expertise requirements, and other workflow needs.<\/jats:p>\n                <\/jats:sec>","DOI":"10.64898\/2026.09.22.26363702","type":"posted-content","created":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T03:50:18Z","timestamp":1790221818000},"source":"Crossref","is-referenced-by-count":0,"title":["Usability and workflow implications of an electronic health record-integrated tool for automated phenotyping: Formative evaluation of Pheno+"],"prefix":"10.64898","author":[{"given":"Peter","family":"Taber","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"L","family":"Weaver","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tony","family":"Di Sera","sequence":"additional","affiliation":[{"name":"Utah Center for Genetic Discovery, University of Utah, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chelsea","family":"Solorzano","sequence":"additional","affiliation":[{"name":"Division of Neonatology, Department of Pediatrics, University of Utah School of Medicine, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emerson","family":"Lebleu","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mickey","family":"Bolyard","sequence":"additional","affiliation":[{"name":"Department of Health and Kinesiology, University of Utah, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jorie","family":"Butler","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT"},{"name":"IDEAS Center of Innovation, VA Salt Lake City, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tanner","family":"Ellsworth","sequence":"additional","affiliation":[{"name":"Division of Neonatology, Department of Pediatrics, University of Utah School of Medicine, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9080-4077","authenticated-orcid":false,"given":"Isabelle","family":"Cooperstein","sequence":"additional","affiliation":[{"name":"Utah Center for Genetic Discovery, University of Utah, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Estabrooks","sequence":"additional","affiliation":[{"name":"Department of Health and Kinesiology, University of Utah, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kensaku","family":"Kawamoto","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Phillip B.","family":"Warner","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7031-4270","authenticated-orcid":false,"given":"Kelsey","family":"Simek","sequence":"additional","affiliation":[{"name":"Division of Neonatology, Department of Pediatrics, University of Utah School of Medicine, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"Tristani-Firouzi","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Department of Pediatrics, University of Utah School of Medicine, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alistair","family":"Ward","sequence":"additional","affiliation":[{"name":"Utah Center for Genetic Discovery, University of Utah, Salt Lake City, UT"},{"name":"Frameshift Genomics, Boston, MA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Douglas","family":"Martin","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sabrina","family":"Malone Jenkins","sequence":"additional","affiliation":[{"name":"Division of Neonatology, Department of Pediatrics, University of Utah School of Medicine, Salt Lake City, UT"},{"name":"Center for Personalized Medicine, Primary Children\u2019s Hospital, Intermountain Healthcare, Salt Lake City, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"54368","reference":[{"key":"2026092603101151000_2026.09.22.26363702v1.1","doi-asserted-by":"publisher","DOI":"10.1002\/humu.22048"},{"key":"2026092603101151000_2026.09.22.26363702v1.2","doi-asserted-by":"publisher","DOI":"10.1111\/jpc.12705"},{"key":"2026092603101151000_2026.09.22.26363702v1.3","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkad1005"},{"key":"2026092603101151000_2026.09.22.26363702v1.4","doi-asserted-by":"publisher","DOI":"10.1186\/s13073-021-00965-0"},{"key":"2026092603101151000_2026.09.22.26363702v1.5","first-page":"581","article-title":"Phenotypic Analysis of Clinical Narratives Using Human Phenotype Ontology","volume":"245","year":"2017","journal-title":"Studies in health technology and informatics"},{"key":"2026092603101151000_2026.09.22.26363702v1.6","doi-asserted-by":"publisher","DOI":"10.1038\/gim.2016.22"},{"key":"2026092603101151000_2026.09.22.26363702v1.7","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocy153"},{"key":"2026092603101151000_2026.09.22.26363702v1.8","doi-asserted-by":"publisher","DOI":"10.1007\/s00439-022-02449-6"},{"key":"2026092603101151000_2026.09.22.26363702v1.9","doi-asserted-by":"publisher","DOI":"10.1002\/ajmg.a.62779"},{"key":"2026092603101151000_2026.09.22.26363702v1.10","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocag045"},{"key":"2026092603101151000_2026.09.22.26363702v1.11","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocac057"},{"issue":"3","key":"2026092603101151000_2026.09.22.26363702v1.12","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1109\/MIS.2013.70","article-title":"The seven deadly myths of\" autonomous systems\"","volume":"28","year":"2013","journal-title":"IEEE Intelligent Systems"},{"issue":"4","key":"2026092603101151000_2026.09.22.26363702v1.13","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1007\/s101110200022","article-title":"MABA-MABA or abracadabra? Progress on human\u2013automation co-ordination","volume":"4","year":"2002","journal-title":"Cognition, Technology & Work"},{"key":"2026092603101151000_2026.09.22.26363702v1.14","doi-asserted-by":"crossref","unstructured":"Hollnagel E . Flight decks and free flight: Where are the system boundaries? Decision making in aviation. Routledge; 2017:321\u2013328.","DOI":"10.4324\/9781315095080-20"},{"issue":"2","key":"2026092603101151000_2026.09.22.26363702v1.15","doi-asserted-by":"crossref","first-page":"1535","DOI":"10.1007\/s43681-024-00489-4","article-title":"Human control of AI systems: from supervision to teaming","volume":"5","year":"2025","journal-title":"AI and Ethics"},{"key":"2026092603101151000_2026.09.22.26363702v1.16","doi-asserted-by":"publisher","DOI":"10.1080\/14639220110037452"},{"key":"2026092603101151000_2026.09.22.26363702v1.17","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocv189"},{"key":"2026092603101151000_2026.09.22.26363702v1.18","doi-asserted-by":"publisher","DOI":"10.2196\/35724"},{"key":"2026092603101151000_2026.09.22.26363702v1.19","unstructured":"19. HL7. Resource DocumentReference. Accessed September 16, 2026. https:\/\/www.hl7.org\/fhir\/documentreference.html"},{"key":"2026092603101151000_2026.09.22.26363702v1.20","doi-asserted-by":"publisher","DOI":"10.1038\/s41436-018-0381-1"},{"key":"2026092603101151000_2026.09.22.26363702v1.21","doi-asserted-by":"publisher","DOI":"10.1186\/s13073-025-01521-w"},{"key":"2026092603101151000_2026.09.22.26363702v1.22","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btae406"},{"key":"2026092603101151000_2026.09.22.26363702v1.23","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btab019"},{"key":"2026092603101151000_2026.09.22.26363702v1.24","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2023.100887"},{"issue":"2","key":"2026092603101151000_2026.09.22.26363702v1.25","first-page":"29","article-title":"SUS: a retrospective","volume":"8","year":"2013","journal-title":"Journal of usability studies"},{"key":"2026092603101151000_2026.09.22.26363702v1.26","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"2026092603101151000_2026.09.22.26363702v1.27","doi-asserted-by":"publisher","DOI":"10.1186\/s13012-016-0398-2"},{"issue":"7","key":"2026092603101151000_2026.09.22.26363702v1.28","doi-asserted-by":"crossref","first-page":"1585","DOI":"10.1038\/s41436-018-0381-1","article-title":"ClinPhen extracts and prioritizes patient phenotypes directly from medical records to expedite genetic disease diagnosis","volume":"21","year":"2019","journal-title":"Genetics in Medicine"},{"key":"2026092603101151000_2026.09.22.26363702v1.29","doi-asserted-by":"publisher","DOI":"10.1016\/j.nedt.2026.107119"},{"key":"2026092603101151000_2026.09.22.26363702v1.30","doi-asserted-by":"publisher","DOI":"10.1080\/02813432.2026.2667990"},{"key":"2026092603101151000_2026.09.22.26363702v1.31","doi-asserted-by":"publisher","DOI":"10.1093\/geront\/gnac098"},{"issue":"3","key":"2026092603101151000_2026.09.22.26363702v1.32","doi-asserted-by":"crossref","first-page":"425","DOI":"10.2307\/30036540","article-title":"User acceptance of information technology: Toward a unified view1","volume":"27","year":"2003","journal-title":"MIS quarterly"},{"key":"2026092603101151000_2026.09.22.26363702v1.33","doi-asserted-by":"publisher","DOI":"10.1002\/ggn2.202200016"},{"key":"2026092603101151000_2026.09.22.26363702v1.34","doi-asserted-by":"publisher","DOI":"10.1515\/dx-2022-0095"},{"issue":"3","key":"2026092603101151000_2026.09.22.26363702v1.35","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1207\/s15516709cog1903_1","article-title":"How a cockpit remembers its speeds","volume":"19","year":"1995","journal-title":"Cognitive science"},{"key":"2026092603101151000_2026.09.22.26363702v1.36","doi-asserted-by":"crossref","unstructured":"Goodwin C . Co-operative action. Cambridge University Press; 2018.","DOI":"10.1017\/9781139016735"},{"issue":"1","key":"2026092603101151000_2026.09.22.26363702v1.37","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1159\/000542274","article-title":"The Biggest Struggle: Navigating Trust and Uncertainty in Genetic Variant Interpretation","volume":"27","year":"2024","journal-title":"Public health genomics"},{"key":"2026092603101151000_2026.09.22.26363702v1.38","doi-asserted-by":"publisher","DOI":"10.1080\/23294515.2017.1405095"},{"key":"2026092603101151000_2026.09.22.26363702v1.39","doi-asserted-by":"publisher","DOI":"10.1016\/j.landig.2025.100880"},{"key":"2026092603101151000_2026.09.22.26363702v1.40","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocae112"},{"key":"2026092603101151000_2026.09.22.26363702v1.41","doi-asserted-by":"publisher","DOI":"10.1111\/j.1553-2712.2000.tb00468.x"},{"key":"2026092603101151000_2026.09.22.26363702v1.42","doi-asserted-by":"publisher","DOI":"10.3233\/SHTI190123"},{"key":"2026092603101151000_2026.09.22.26363702v1.43","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.8775"},{"issue":"4","key":"2026092603101151000_2026.09.22.26363702v1.44","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1177\/15553434231189375","article-title":"The failure to grasp automation failure","volume":"18","year":"2024","journal-title":"Journal of Cognitive Engineering and Decision Making"},{"key":"2026092603101151000_2026.09.22.26363702v1.45","doi-asserted-by":"crossref","unstructured":"Bainbridge L. Ironies of automation. Analysis, design and evaluation of man\u2013 machine systems. Elsevier; 1983:129\u2013135.","DOI":"10.1016\/B978-0-08-029348-6.50026-9"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.64898\/2026.09.22.26363702","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,26]],"date-time":"2026-09-26T10:10:18Z","timestamp":1790417418000},"score":1,"resource":{"primary":{"URL":"http:\/\/medrxiv.org\/lookup\/doi\/10.64898\/2026.09.22.26363702"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,23]]},"references-count":45,"URL":"https:\/\/doi.org\/10.64898\/2026.09.22.26363702","relation":{},"subject":[],"published":{"date-parts":[[2026,9,23]]},"subtype":"preprint"}}