{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T11:08:43Z","timestamp":1740136123626,"version":"3.37.3"},"reference-count":81,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2024,3,6]],"date-time":"2024-03-06T00:00:00Z","timestamp":1709683200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000133","name":"Agency for Healthcare Research and Quality","doi-asserted-by":"publisher","award":["R36HS028752"],"award-info":[{"award-number":["R36HS028752"]}],"id":[{"id":"10.13039\/100000133","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000056","name":"National Institute of Nursing Research","doi-asserted-by":"publisher","award":["T32NR007969","P30NR016587","K24NR018621"],"award-info":[{"award-number":["T32NR007969","P30NR016587","K24NR018621"]}],"id":[{"id":"10.13039\/100000056","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","award":["R01LM009886","T15LM007079"],"award-info":[{"award-number":["R01LM009886","T15LM007079"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Center for Advancing Clinical and Translational Science","award":["UL1TR001873","OT2TR003434"],"award-info":[{"award-number":["UL1TR001873","OT2TR003434"]}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,4,19]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Alzheimer\u2019s disease and related dementias (ADRD) affect over 55 million globally. Current clinical trials suffer from low recruitment rates, a challenge potentially addressable via natural language processing (NLP) technologies for researchers to effectively identify eligible clinical trial participants.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>This study investigates the sociotechnical feasibility of NLP-driven tools for ADRD research prescreening and analyzes the tools\u2019 cognitive complexity's effect on usability to identify cognitive support strategies.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>A randomized experiment was conducted with 60 clinical research staff using three prescreening tools (Criteria2Query, Informatics for Integrating Biology and the Bedside [i2b2], and Leaf). Cognitive task analysis was employed to analyze the usability of each tool using the Health Information Technology Usability Evaluation Scale. Data analysis involved calculating descriptive statistics, interrater agreement via intraclass correlation coefficient, cognitive complexity, and Generalized Estimating Equations models.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Leaf scored highest for usability followed by Criteria2Query and i2b2. Cognitive complexity was found to be affected by age, computer literacy, and number of criteria, but was not significantly associated with usability.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Adopting NLP for ADRD prescreening demands careful task delegation, comprehensive training, precise translation of eligibility criteria, and increased research accessibility. The study highlights the relevance of these factors in enhancing NLP-driven tools\u2019 usability and efficacy in clinical research prescreening.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>User-modifiable NLP-driven prescreening tools were favorably received, with system type, evaluation sequence, and user's computer literacy influencing usability more than cognitive complexity. The study emphasizes NLP's potential in improving recruitment for clinical trials, endorsing a mixed-methods approach for future system evaluation and enhancements.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae032","type":"journal-article","created":{"date-parts":[[2024,3,6]],"date-time":"2024-03-06T23:41:50Z","timestamp":1709768510000},"page":"1062-1073","source":"Crossref","is-referenced-by-count":0,"title":["Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer\u2019s disease and related dementias"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4318-5987","authenticated-orcid":false,"given":"Betina","family":"Idnay","sequence":"first","affiliation":[{"name":"School of Nursing, Columbia University Irving Medical Center , New York, NY 10032, United States"},{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"given":"Jianfang","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Nursing, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2681-1931","authenticated-orcid":false,"given":"Yilu","family":"Fang","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"given":"Alex","family":"Hernandez","sequence":"additional","affiliation":[{"name":"School of Nursing, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"given":"Shivani","family":"Kaw","sequence":"additional","affiliation":[{"name":"School of Nursing, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"given":"Alicia","family":"Etwaru","sequence":"additional","affiliation":[{"name":"School of Nursing, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"given":"Janeth","family":"Juarez Padilla","sequence":"additional","affiliation":[{"name":"School of Nursing, Columbia University Irving Medical Center , New York, NY 10032, United States"},{"name":"New York University Grossman School of Medicine , New York, NY 10016, United States"}]},{"given":"Sergio Ozoria","family":"Ram\u00edrez","sequence":"additional","affiliation":[{"name":"School of Nursing, Columbia University Irving Medical Center , New York, NY 10032, United States"},{"name":"New York University Steinhardt School of Culture, Education, and Human Development , New York, NY 10003, United States"}]},{"given":"Karen","family":"Marder","sequence":"additional","affiliation":[{"name":"Department of Neurology, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9624-0214","authenticated-orcid":false,"given":"Chunhua","family":"Weng","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2184-4045","authenticated-orcid":false,"given":"Rebecca","family":"Schnall","sequence":"additional","affiliation":[{"name":"School of Nursing, Columbia University Irving Medical Center , New York, NY 10032, United States"},{"name":"Mailman School of Public Health, Columbia University , New York, NY 10032, United States"}]}],"member":"286","published-online":{"date-parts":[[2024,3,6]]},"reference":[{"year":"2022","author":"World Health Organization","key":"2024041923354327500_ocae032-B1"},{"issue":"4","key":"2024041923354327500_ocae032-B2","doi-asserted-by":"crossref","first-page":"700","DOI":"10.1002\/alz.12638","article-title":"2022 Alzheimer's disease facts and figures","volume":"18","author":"Alzheimer\u2019s Association","year":"2022","journal-title":"Alzheimers Dement"},{"issue":"2","key":"2024041923354327500_ocae032-B3","first-page":"1","article-title":"Dementia mortality in the United States, 2000-2017","volume":"68","author":"Kramarow","year":"2019","journal-title":"Natl Vital Stat Rep"},{"issue":"14","key":"2024041923354327500_ocae032-B4","doi-asserted-by":"crossref","first-page":"1444","DOI":"10.1001\/jama.2018.0158","article-title":"The state of US health, 1990-2016: burden of diseases, injuries, and risk factors among US states","volume":"319","author":"Mokdad","year":"2018","journal-title":"JAMA"},{"year":"2019","author":"Alzheimer\u2019s Disease International","key":"2024041923354327500_ocae032-B5"},{"year":"2021","key":"2024041923354327500_ocae032-B6"},{"year":"2020","author":"World Health Organization","key":"2024041923354327500_ocae032-B7"},{"key":"2024041923354327500_ocae032-B8","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.conctc.2018.08.001","article-title":"Factors associated with clinical trials that fail and opportunities for improving the likelihood of success: a review","volume":"11","author":"Fogel","year":"2018","journal-title":"Contemp Clin Trials Commun"},{"issue":"1","key":"2024041923354327500_ocae032-B9","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1177\/1740774514558307","article-title":"Unsuccessful trial accrual and human subjects protections: an empirical analysis of recently closed trials","volume":"12","author":"Carlisle","year":"2016","journal-title":"Clin Trials"},{"issue":"s1","key":"2024041923354327500_ocae032-B10","doi-asserted-by":"crossref","first-page":"S3","DOI":"10.3233\/JAD-179901","article-title":"Clinical trials for disease-modifying therapies in Alzheimer's disease: a primer, lessons learned, and a blueprint for the future","volume":"64","author":"Cummings","year":"2018","journal-title":"J Alzheimers Dis"},{"issue":"1","key":"2024041923354327500_ocae032-B11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1097\/WAD.0000000000000016","article-title":"Facilitating Alzheimer's disease research recruitment","volume":"28","author":"Grill","year":"2014","journal-title":"Alzheimer Dis Assoc Disord"},{"issue":"5","key":"2024041923354327500_ocae032-B12","doi-asserted-by":"crossref","first-page":"458","DOI":"10.2174\/1567205016666190321161901","article-title":"Strategies for the recruitment and retention of racial\/ethnic minorities in Alzheimer disease and dementia clinical research","volume":"16","author":"Wong","year":"2019","journal-title":"Curr Alzheimer Res"},{"issue":"1","key":"2024041923354327500_ocae032-B13","first-page":"751","article-title":"Recruitment and retention of underrepresented populations in Alzheimer's disease research: a systematic review [published correction appears in Alzheimers Dement (NY). 2022;6(1):e12051]","volume":"5","author":"Gilmore-Bykovskyi","year":"2019","journal-title":"Alzheimers Dement (N Y)"},{"issue":"1","key":"2024041923354327500_ocae032-B14","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/s13195-019-0576-y","article-title":"Prescreening for European Prevention of Alzheimer Dementia (EPAD) trial-ready cohort: impact of AD risk factors and recruitment settings","volume":"12","author":"Vermunt","year":"2020","journal-title":"Alzheimers Res Ther"},{"issue":"7","key":"2024041923354327500_ocae032-B15","doi-asserted-by":"crossref","first-page":"e161","DOI":"10.2196\/jmir.3446","article-title":"Employing computers for the recruitment into clinical trials: a comprehensive systematic review","volume":"16","author":"K\u00f6pcke","year":"2014","journal-title":"J Med Internet Res"},{"issue":"3","key":"2024041923354327500_ocae032-B16","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1016\/j.jalz.2011.03.003","article-title":"Toward defining the preclinical stages of Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease","volume":"7","author":"Sperling","year":"2011","journal-title":"Alzheimers Dement"},{"issue":"2","key":"2024041923354327500_ocae032-B17","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1097\/WAD.0000000000000303","article-title":"Which MCI patients should be included in prodromal Alzheimer disease clinical trials?","volume":"33","author":"Grill","year":"2019","journal-title":"Alzheimer Dis Assoc Disord"},{"issue":"3","key":"2024041923354327500_ocae032-B18","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1197\/jamia.M3005","article-title":"Clinical research informatics: challenges, opportunities and definition for an emerging domain","volume":"16","author":"Embi","year":"2009","journal-title":"J Am Med Inform Assoc"},{"key":"2024041923354327500_ocae032-B19","first-page":"218","article-title":"How essential are unstructured clinical narratives and information fusion to clinical trial recruitment?","volume":"2014","author":"Raghavan","year":"2014","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"issue":"1","key":"2024041923354327500_ocae032-B20","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1093\/jamia\/ocab228","article-title":"A systematic review on natural language processing systems for eligibility prescreening in clinical research","volume":"29","author":"Idnay","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2024041923354327500_ocae032-B21","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1136\/amiajnl-2011-000464","article-title":"Natural language processing: an introduction","volume":"18","author":"Nadkarni","year":"2011","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2024041923354327500_ocae032-B22","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1177\/1740774519829709","article-title":"A review of the impact of utilising electronic medical records for clinical research recruitment","volume":"16","author":"Lai","year":"2019","journal-title":"Clin Trials"},{"key":"2024041923354327500_ocae032-B23","first-page":"5178","article-title":"Improving the efficiency of clinical trial recruitment using electronic health record data, natural language processing, and machine learning","volume":"71(S10)","author":"Cai","year":"2019","journal-title":"Arthritis Rheum"},{"issue":"4","key":"2024041923354327500_ocae032-B24","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1097\/WNN.0b013e318190cf75","article-title":"Clinical trial design issues in mild to moderate Alzheimer's disease","volume":"21","author":"Knopman","year":"2008","journal-title":"Cogn Behav Neurol"},{"issue":"4","key":"2024041923354327500_ocae032-B25","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1093\/jamia\/ocy178","article-title":"Criteria2Query: a natural language interface to clinical databases for cohort definition","volume":"26","author":"Yuan","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2024041923354327500_ocae032-B26","first-page":"1149","article-title":"Automatic data source identification for clinical trial eligibility criteria resolution","volume":"2016","author":"Shivade","year":"2016","journal-title":"AMIA Annu Symp Proc"},{"issue":"1","key":"2024041923354327500_ocae032-B27","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/001872675100400101","article-title":"Some social and psychological consequences of the longwall method of coal-getting: an examination of the psychological situation and defences of a work group in relation to the social structure and technological content of the work system","volume":"4","author":"Trist","year":"1951","journal-title":"Hum Relat"},{"issue":"1","key":"2024041923354327500_ocae032-B28","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.intcom.2010.07.003","article-title":"Socio-technical systems: from design methods to systems engineering","volume":"23","author":"Baxter","year":"2010","journal-title":"Interact Comput"},{"issue":"1","key":"2024041923354327500_ocae032-B29","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1186\/1472-6947-12-47","article-title":"Computational challenges and human factors influencing the design and use of clinical research participant eligibility pre-screening tools","volume":"12","author":"Pressler","year":"2012","journal-title":"BMC Med Inform Decis Mak"},{"issue":"2","key":"2024041923354327500_ocae032-B30","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/s10209-017-0534-z","article-title":"Information technology adoption: a review of the literature and classification","volume":"17","author":"Salahshour Rad","year":"2018","journal-title":"Univ Access Inf Soc"},{"issue":"1","key":"2024041923354327500_ocae032-B31","doi-asserted-by":"crossref","first-page":"40","DOI":"10.2307\/258353","article-title":"Task complexity: a review and analysis","volume":"13","author":"Campbell","year":"1988","journal-title":"Acad Manag Rev"},{"issue":"2","key":"2024041923354327500_ocae032-B32","doi-asserted-by":"crossref","first-page":"2787","DOI":"10.1109\/JSYST.2020.3000499","article-title":"Task complexity measurement framework for human systems integration","volume":"15","author":"Efatmaneshnik","year":"2021","journal-title":"IEEE Syst J"},{"year":"2005","author":"Metzker","key":"2024041923354327500_ocae032-B33"},{"year":"2013","author":"Nielsen","key":"2024041923354327500_ocae032-B34"},{"issue":"7","key":"2024041923354327500_ocae032-B35","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1093\/jamia\/ocac051","article-title":"Combining human and machine intelligence for clinical trial eligibility querying","volume":"29","author":"Fang","year":"2022","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2024041923354327500_ocae032-B36","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1136\/jamia.2009.000893","article-title":"Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2)","volume":"17","author":"Murphy","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2024041923354327500_ocae032-B37","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1093\/jamia\/ocz165","article-title":"Leaf: an open-source, model-agnostic, data-driven web application for cohort discovery and translational biomedical research","volume":"27","author":"Dobbins","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2024041923354327500_ocae032-B38","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1186\/1471-2288-13-104","article-title":"An audit of sample sizes for pilot and feasibility trials being undertaken in the United Kingdom registered in the United Kingdom Clinical Research Network database","volume":"13","author":"Billingham","year":"2013","journal-title":"BMC Med Res Methodol"},{"issue":"3","key":"2024041923354327500_ocae032-B39","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1027\/1614-2241.1.3.85","article-title":"Sufficient sample sizes for multilevel modeling","volume":"1","author":"Maas","year":"2005","journal-title":"Methodology"},{"key":"2024041923354327500_ocae032-B40","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/B978-0-12-802308-2.00007-2","volume-title":"Quantifying the User Experience","author":"Sauro","year":"2016","edition":"2nd ed"},{"year":"2003","author":"Hinderer","key":"2024041923354327500_ocae032-B41"},{"issue":"6","key":"2024041923354327500_ocae032-B42","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1037\/a0016755","article-title":"Conditions for intuitive expertise: a failure to disagree","volume":"64","author":"Kahneman","year":"2009","journal-title":"Am Psychol"},{"issue":"1","key":"2024041923354327500_ocae032-B43","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1186\/s40814-022-01002-6","article-title":"The use of cognitive task analysis in clinical and health services research\u2014a systematic review","volume":"8","author":"Swaby","year":"2022","journal-title":"Pilot Feasibility Stud"},{"issue":"1","key":"2024041923354327500_ocae032-B44","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.ijmedinf.2018.11.012","article-title":"A multi-step usability evaluation of a self-management app to support medication adherence in persons living with HIV","volume":"122","author":"Beauchemin","year":"2019","journal-title":"Int J Med Inform"},{"volume-title":"The Psychology of Human-Computer Interaction","year":"1983","author":"Card","key":"2024041923354327500_ocae032-B45"},{"key":"2024041923354327500_ocae032-B46","first-page":"295","volume-title":"Human-Computer Interaction: Tasks and Organisation","author":"Rauterberg","year":"1992"},{"year":"1993","author":"Lewis","key":"2024041923354327500_ocae032-B47"},{"key":"2024041923354327500_ocae032-B48","first-page":"917","article-title":"Development of a customizable health IT usability evaluation scale","volume":"2010","author":"Yen","year":"2010","journal-title":"AMIA Annu Symp Proc"},{"issue":"e2","key":"2024041923354327500_ocae032-B49","doi-asserted-by":"crossref","first-page":"e241","DOI":"10.1136\/amiajnl-2013-001811","article-title":"Examining construct and predictive validity of the Health-IT Usability Evaluation Scale: confirmatory factor analysis and structural equation modeling results","volume":"21","author":"Yen","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2024041923354327500_ocae032-B50","doi-asserted-by":"crossref","first-page":"104713","DOI":"10.1016\/j.ijmedinf.2022.104713","article-title":"Establishing a usability cut-point for the health information technology usability evaluation scale (Health-ITUES)","volume":"160","author":"Loh","year":"2022","journal-title":"Int J Med Inform"},{"issue":"4","key":"2024041923354327500_ocae032-B51","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1097\/JNR.0b013e318236d03f","article-title":"A computer literacy scale for newly enrolled nursing college students: development and validation","volume":"19","author":"Lin","year":"2011","journal-title":"J Nurs Res"},{"issue":"5","key":"2024041923354327500_ocae032-B52","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.3758\/s13414-019-01726-3","article-title":"A note on detecting statistical outliers in psychophysical data","volume":"81","author":"Jones","year":"2019","journal-title":"Atten Percept Psychophys"},{"year":"2007","author":"Tiwari","key":"2024041923354327500_ocae032-B53"},{"issue":"1","key":"2024041923354327500_ocae032-B54","first-page":"291","article-title":"The influence of age in usability testing","volume":"52","author":"Sonderegger","year":"2015","journal-title":"Appl Ergon"},{"issue":"1-2","key":"2024041923354327500_ocae032-B55","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/S1532-0464(03)00056-X","article-title":"Usability in the real world: assessing medical information technologies in patients\u2019 homes","volume":"36","author":"Kaufman","year":"2003","journal-title":"J Biomed Inform"},{"issue":"5","key":"2024041923354327500_ocae032-B56","doi-asserted-by":"crossref","first-page":"28","DOI":"10.7748\/nr.21.5.28.e1232","article-title":"Conducting qualitative research in the context of pre-existing peer and collegial relationships","volume":"21","author":"McDermid","year":"2014","journal-title":"Nurse Res"},{"issue":"1","key":"2024041923354327500_ocae032-B57","doi-asserted-by":"crossref","first-page":"3","DOI":"10.2466\/pr0.1966.19.1.3","article-title":"The intraclass correlation coefficient as a measure of reliability","volume":"19","author":"Bartko","year":"1966","journal-title":"Psychol Rep"},{"issue":"1","key":"2024041923354327500_ocae032-B58","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1093\/biomet\/73.1.13","article-title":"Longitudinal data analysis using generalized linear models","volume":"73","author":"Liang","year":"1986","journal-title":"Biometrika"},{"first-page":"143","year":"2000","author":"Hosmer","key":"2024041923354327500_ocae032-B59"},{"issue":"1-2","key":"2024041923354327500_ocae032-B60","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/S1532-0464(03)00062-5","article-title":"A framework for analyzing the cognitive complexity of computer-assisted clinical ordering","volume":"36","author":"Horsky","year":"2003","journal-title":"J Biomed Inform"},{"issue":"1","key":"2024041923354327500_ocae032-B61","first-page":"772356","article-title":"Saving time for patient care by optimizing physician note templates: a pilot study","volume":"3","author":"Alissa","year":"2021","journal-title":"Front Digit Health"},{"issue":"1","key":"2024041923354327500_ocae032-B62","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.mayocpiqo.2020.09.012","article-title":"Usability of a digital registry to promote secondary prevention for peripheral artery disease patients","volume":"5","author":"Chaudhry","year":"2021","journal-title":"Mayo Clin Proc Innov Qual Outcomes"},{"issue":"1","key":"2024041923354327500_ocae032-B63","first-page":"984","article-title":"Participatory design of a clinical trial eligibility criteria simplification method","volume":"281","author":"Fang","year":"2021","journal-title":"Stud Health Technol Inform"},{"issue":"Suppl 3","key":"2024041923354327500_ocae032-B64","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1186\/s12911-019-0784-1","article-title":"Complexities, variations, and errors of numbering within clinical notes: the potential impact on information extraction and cohort-identification","volume":"19","author":"Hanauer","year":"2019","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"2024041923354327500_ocae032-B65","doi-asserted-by":"crossref","first-page":"104985","DOI":"10.1016\/j.ijmedinf.2023.104985","article-title":"Clinical research staff perceptions on a natural language processing-driven tool for eligibility prescreening: an iterative usability assessment","volume":"171","author":"Idnay","year":"2023","journal-title":"Int J Med Inform"},{"year":"2006","author":"Nagappan","key":"2024041923354327500_ocae032-B66"},{"issue":"1","key":"2024041923354327500_ocae032-B67","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.3389\/fphar.2018.01148","article-title":"Joint task force for clinical trial competency and clinical research professional workforce development","volume":"9","author":"Sonstein","year":"2018","journal-title":"Front Pharmacol"},{"issue":"4","key":"2024041923354327500_ocae032-B68","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1590\/1516-4446-2019-0735","article-title":"Early diagnosis and treatment of Alzheimer\u2019s disease: new definitions and challenges","volume":"42","author":"Pais","year":"2020","journal-title":"Braz J Psychiatry"},{"issue":"6","key":"2024041923354327500_ocae032-B69","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1007\/s11606-014-3102-8","article-title":"Accuracy of race, ethnicity, and language preference in an electronic health record","volume":"30","author":"Klinger","year":"2015","journal-title":"J Gen Intern Med"},{"issue":"8","key":"2024041923354327500_ocae032-B70","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1016\/j.jamda.2018.09.008","article-title":"The impact of incomplete nursing home transfer documentation on emergency department care","volume":"20","author":"Gettel","year":"2019","journal-title":"J Am Med Dir Assoc"},{"issue":"2","key":"2024041923354327500_ocae032-B71","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1136\/bmjqs-2012-001301","article-title":"Medication discrepancies in integrated electronic health records","volume":"22","author":"Linsky","year":"2013","journal-title":"BMJ Qual Saf"},{"issue":"2","key":"2024041923354327500_ocae032-B72","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1192\/bjb.2019.77","article-title":"Mild cognitive impairment: narrative review of taxonomies and systematic review of their prediction of incident Alzheimer's disease dementia","volume":"44","author":"Bradfield","year":"2020","journal-title":"BJPsych Bull"},{"key":"2024041923354327500_ocae032-B73","first-page":"433","volume-title":"AIDS: Society, Ethics and Law","author":"Delaney","year":"2018"},{"issue":"1","key":"2024041923354327500_ocae032-B74","doi-asserted-by":"crossref","first-page":"103822","DOI":"10.1016\/j.jbi.2021.103822","article-title":"Clinical comparison between trial participants and potentially eligible patients using electronic health record data: a generalizability assessment method","volume":"119","author":"Rogers","year":"2021","journal-title":"J Biomed Inform"},{"issue":"Suppl(s2)","key":"2024041923354327500_ocae032-B75","doi-asserted-by":"crossref","first-page":"45","DOI":"10.2345\/0899-8205-47.s2.45","article-title":"A review: healthcare usability evaluation methods","author":"Bhutkar","year":"2013","journal-title":"Biomed Instrum Technol"},{"issue":"1","key":"2024041923354327500_ocae032-B76","doi-asserted-by":"crossref","DOI":"10.1136\/bmjhci-2019-000014","article-title":"Potential impact of data source and interoperability messaging on health information technology (HIT) users: a study series from the United States Department of Veterans Affairs","volume":"26","author":"Herout","year":"2019","journal-title":"BMJ Health Care Inform"},{"issue":"3","key":"2024041923354327500_ocae032-B77","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1057\/ejis.2008.15","article-title":"Measuring information systems success: models, dimensions, measures, and interrelationships","volume":"17","author":"Petter","year":"2017","journal-title":"Eur J Inf Syst"},{"volume-title":"WorkingmMinds: A Practitioner's Guide to Cognitive Task Analysis","year":"2006","author":"Beth","key":"2024041923354327500_ocae032-B78"},{"issue":"11","key":"2024041923354327500_ocae032-B79","doi-asserted-by":"crossref","first-page":"1618","DOI":"10.1080\/001401398186108","article-title":"Applied cognitive task analysis (ACTA): a practitioner's toolkit for understanding cognitive task demands","volume":"41","author":"Militello","year":"1998","journal-title":"Ergonomics"},{"issue":"6","key":"2024041923354327500_ocae032-B80","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1197\/jamia.M3119","article-title":"Electronic screening improves efficiency in clinical trial recruitment","volume":"16","author":"Thadani","year":"2009","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2024041923354327500_ocae032-B81","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1007\/s40271-021-00528-w","article-title":"Conducting qualitative research online: challenges and solutions","volume":"14","author":"Carter","year":"2021","journal-title":"Patient"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/5\/1062\/57286300\/ocae032.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/5\/1062\/57286300\/ocae032.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,19]],"date-time":"2024-04-19T23:36:43Z","timestamp":1713569803000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/5\/1062\/7623453"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,6]]},"references-count":81,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,3,6]]},"published-print":{"date-parts":[[2024,4,19]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae032","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2024,5,1]]},"published":{"date-parts":[[2024,3,6]]}}}