{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,31]],"date-time":"2026-08-31T10:23:07Z","timestamp":1788171787358,"version":"build-2803163510"},"reference-count":51,"publisher":"Wiley","issue":"10","license":[{"start":{"date-parts":[[2024,10,14]],"date-time":"2024-10-14T00:00:00Z","timestamp":1728864000000},"content-version":"vor","delay-in-days":13,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS\u20102041339"],"award-info":[{"award-number":["IIS\u20102041339"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["ascpt.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Clinical Translational Sci"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Pharmacogenomic (PGx) biomarkers integrated using machine learning can be embedded within the electronic health record (EHR) to provide clinicians with individualized predictions of drug treatment outcomes. Currently, however, drug alerts in the EHR are largely generic (not patient\u2010specific) and contribute to increased clinician stress and burnout. Improving the usability of PGx alerts is an urgent need. Therefore, this work aimed to identify principles for optimal PGx alert design through a health\u2010system\u2010wide, mixed\u2010methods study. Clinicians representing multiple practices and care settings (\n                    <jats:italic>N<\/jats:italic>\n                    \u2009=\u20091062) in urban, rural, and underserved regions were invited to complete an electronic survey comparing the usability of three drug alerts for citalopram, as a case study. Alert 1 contained a generic warning of pharmacogenomic effects on citalopram metabolism. Alerts 2 and 3 provided patient\u2010specific predictions of citalopram efficacy with varying depth of information. Primary outcomes included the System's Usability Scale score (0\u2013100 points) of each alert, the perceived impact of each alert on stress and decision\u2010making, and clinicians' suggestions for alert improvement. Secondary outcomes included the assessment of alert preference by clinician age, practice type, and geographic setting. Qualitative information was captured to provide context to quantitative information. The final cohort comprised 305 geographically and clinically diverse clinicians. A simplified, individualized alert (Alert 2) was perceived as beneficial for decision\u2010making and stress compared with a more detailed version (Alert 3) and the generic alert (Alert 1) regardless of age, practice type, or geographic setting. Findings emphasize the need for clinician\u2010guided design of PGx alerts in the era of digital medicine.\n                  <\/jats:p>","DOI":"10.1111\/cts.70044","type":"journal-article","created":{"date-parts":[[2024,10,15]],"date-time":"2024-10-15T02:40:34Z","timestamp":1728960034000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Pharmacogenomic augmented machine learning in electronic health record alerts: A health system\u2010wide usability survey of clinicians"],"prefix":"10.1111","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9342-2138","authenticated-orcid":false,"given":"Caroline W.","family":"Grant","sequence":"first","affiliation":[{"name":"Department of Molecular Pharmacology and Experimental Therapeutics Mayo Clinic  Rochester Minnesota USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2232-0788","authenticated-orcid":false,"given":"Jean","family":"Marrero\u2010Polanco","sequence":"additional","affiliation":[{"name":"Department of Molecular Pharmacology and Experimental Therapeutics Mayo Clinic  Rochester Minnesota USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4367-6380","authenticated-orcid":false,"given":"Jeremiah B.","family":"Joyce","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Psychology Mayo Clinic  Rochester Minnesota USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0755-6939","authenticated-orcid":false,"given":"Barbara","family":"Barry","sequence":"additional","affiliation":[{"name":"Division of Health Care Delivery Research Mayo Clinic  Rochester Minnesota USA"},{"name":"Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery Mayo Clinic  Rochester Minnesota USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0409-8618","authenticated-orcid":false,"given":"Ashley","family":"Stillwell","sequence":"additional","affiliation":[{"name":"Department of Family Medicine Mayo Clinic  Scottsdale Arizona USA"},{"name":"Department of Psychiatry and Psychology Mayo Clinic  Scottsdale Arizona USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kellie","family":"Kruger","sequence":"additional","affiliation":[{"name":"Department of Family Medicine Mayo Clinic  Scottsdale Arizona USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3228-0388","authenticated-orcid":false,"given":"Therese","family":"Anderson","sequence":"additional","affiliation":[{"name":"Department of Family Medicine Mayo Clinic  Jacksonville Florida USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heather","family":"Talley","sequence":"additional","affiliation":[{"name":"Department of Family Medicine Mayo Clinic  Rochester Minnesota USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3487-916X","authenticated-orcid":false,"given":"Mary","family":"Hedges","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine Mayo Clinic  Jacksonville Florida USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2671-7854","authenticated-orcid":false,"given":"Jose","family":"Valery","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine Mayo Clinic  Jacksonville Florida USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1133-7819","authenticated-orcid":false,"given":"Richard","family":"White","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine Mayo Clinic  Jacksonville Florida USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5441-2084","authenticated-orcid":false,"given":"Richard R.","family":"Sharp","sequence":"additional","affiliation":[{"name":"Biomedical Ethics Research Program Mayo Clinic  Rochester Minnesota USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6843-6503","authenticated-orcid":false,"given":"Paul E.","family":"Croarkin","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Psychology Mayo Clinic  Rochester Minnesota USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7820-704X","authenticated-orcid":false,"given":"Liselotte N.","family":"Dyrbye","sequence":"additional","affiliation":[{"name":"Department of Medicine University of Colorado School of Medicine  Denver Colorado USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5674-3079","authenticated-orcid":false,"given":"William V.","family":"Bobo","sequence":"additional","affiliation":[{"name":"Department of Behavioral Science &amp; Social Medicine Florida State University College of Medicine  Tallahassee Florida USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9764-1768","authenticated-orcid":false,"given":"Arjun P.","family":"Athreya","sequence":"additional","affiliation":[{"name":"Department of Molecular Pharmacology and Experimental Therapeutics Mayo Clinic  Rochester Minnesota USA"},{"name":"Department of Psychiatry and Psychology Mayo Clinic  Rochester Minnesota USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,10,14]]},"reference":[{"key":"e_1_2_12_2_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-0040-1701986"},{"key":"e_1_2_12_3_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-0042-1748856"},{"key":"e_1_2_12_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/bcp.15234"},{"key":"e_1_2_12_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gim.2022.01.022"},{"key":"e_1_2_12_6_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-0221-y"},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.4338\/ACI-2017-01-RA-0003"},{"key":"e_1_2_12_8_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocy145"},{"key":"e_1_2_12_9_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocaa098"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.2196\/medinform.7170"},{"key":"e_1_2_12_11_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2020.7374"},{"key":"e_1_2_12_12_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-0919-4"},{"key":"e_1_2_12_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjmed.2016.04.009"},{"key":"e_1_2_12_14_1","doi-asserted-by":"publisher","DOI":"10.3233\/SHTI210962"},{"key":"e_1_2_12_15_1","first-page":"237","article-title":"Design recommendations for pharmacogenomics clinical decision support systems","volume":"2017","author":"Khelifi M","year":"2017","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"key":"e_1_2_12_16_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz021"},{"key":"e_1_2_12_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2015.11.004"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2014.04.008"},{"key":"e_1_2_12_19_1","doi-asserted-by":"publisher","DOI":"10.1038\/gim.2016.120"},{"key":"e_1_2_12_20_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocy156"},{"key":"e_1_2_12_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2016.08.727"},{"key":"e_1_2_12_22_1","doi-asserted-by":"publisher","DOI":"10.1038\/clpt.2011.306"},{"key":"e_1_2_12_23_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12991-019-0237-3"},{"key":"e_1_2_12_24_1","doi-asserted-by":"publisher","DOI":"10.2147\/PGPM.S63715"},{"key":"e_1_2_12_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41386-023-01667-4"},{"key":"e_1_2_12_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2018.2840660"},{"key":"e_1_2_12_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpt.1482"},{"key":"e_1_2_12_28_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41398-021-01632-z"},{"key":"e_1_2_12_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2020.113017"},{"key":"e_1_2_12_30_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.5345"},{"key":"e_1_2_12_31_1","unstructured":"US Food and Drug Administration.FDA Drug Safety Communication: Abnormal heart rhythms associated with high doses of Celexa (citalopram hydrobromide).2017.https:\/\/www.fda.gov\/drugs\/drug\u2010safety\u2010and\u2010availability\/fda\u2010drug\u2010safety\u2010communication\u2010abnormal\u2010heart\u2010rhythms\u2010associated\u2010high\u2010doses\u2010celexa\u2010citalopram."},{"key":"e_1_2_12_32_1","doi-asserted-by":"publisher","DOI":"10.1097\/00115514-201105000-00007"},{"key":"e_1_2_12_33_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2012.681221"},{"key":"e_1_2_12_34_1","doi-asserted-by":"publisher","DOI":"10.1053\/j.ajkd.2006.10.012"},{"key":"e_1_2_12_35_1","doi-asserted-by":"publisher","DOI":"10.1093\/intqhc\/mzm042"},{"key":"e_1_2_12_36_1","doi-asserted-by":"publisher","DOI":"10.2217\/pgs-2019-0119"},{"key":"e_1_2_12_37_1","first-page":"189","volume-title":"Usability Evaluation in Industry","author":"Brooke J","year":"1996"},{"key":"e_1_2_12_38_1","doi-asserted-by":"publisher","DOI":"10.1162\/jmlr.2003.3.4-5.993"},{"key":"e_1_2_12_39_1","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_2_12_40_1","volume-title":"R: A Language and Environment for Statistical","year":"2021"},{"key":"e_1_2_12_41_1","volume-title":"RStudio: Integrated Development for R RStudio","year":"2022"},{"key":"e_1_2_12_42_1","volume-title":"Python 3 Reference Manual","year":"2009"},{"key":"e_1_2_12_43_1","unstructured":"Health Resources & Service Administration.Find Shortage Areas.https:\/\/data.hrsa.gov\/tools\/shortage\u2010area"},{"key":"e_1_2_12_44_1","unstructured":"Health Resources & Service Administration.Rural Health Grants Eligibility Analyzer.https:\/\/data.hrsa.gov\/tools\/rural\u2010health"},{"key":"e_1_2_12_45_1","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M1370"},{"key":"e_1_2_12_46_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-23584-z"},{"key":"e_1_2_12_47_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpt.1651"},{"key":"e_1_2_12_48_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpt.2903"},{"key":"e_1_2_12_49_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2022.9805"},{"key":"e_1_2_12_50_1","first-page":"195","article-title":"Clinical decision support alert appropriateness: a review and proposal for improvement","volume":"14","author":"McCoy AB","year":"2014","journal-title":"Ochsner J"},{"key":"e_1_2_12_51_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocab292"},{"key":"e_1_2_12_52_1","doi-asserted-by":"publisher","DOI":"10.4338\/ACI-2016-10-RA-0168"}],"container-title":["Clinical and Translational Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ascpt.onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cts.70044","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,25]],"date-time":"2024-10-25T09:34:16Z","timestamp":1729848856000},"score":1,"resource":{"primary":{"URL":"https:\/\/ascpt.onlinelibrary.wiley.com\/doi\/10.1111\/cts.70044"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10]]},"references-count":51,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["10.1111\/cts.70044"],"URL":"https:\/\/doi.org\/10.1111\/cts.70044","archive":["Portico"],"relation":{},"ISSN":["1752-8054","1752-8062"],"issn-type":[{"value":"1752-8054","type":"print"},{"value":"1752-8062","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10]]},"assertion":[{"value":"2024-08-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-20","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70044"}}