{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T12:21:55Z","timestamp":1761394915037,"version":"3.37.3"},"reference-count":42,"publisher":"Georg Thieme Verlag KG","issue":"04","funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["P60 AR064172"],"award-info":[{"award-number":["P60 AR064172"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2016,10]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Background RhEumAtic Disease activitY (READY) is a mobile health (mHealth) application that aims to create a shared platform integrating data from both patients and physicians, with a particular emphasis on arthritis disease activity.<\/jats:p><jats:p>Methods We made READY available on an iPad and pilot implemented it at a rheumatology outpatient clinic. We conducted 1) a usability evaluation study to explore patients\u2019 and physicians\u2019 interactions with READY, and 2) a time motion study (TMS) to observe the clinical workflow before and after the implementation.<\/jats:p><jats:p>Results A total of 33 patients and 15 physicians participated in the usability evaluation. We found usability problems in navigation, data entry, pain assessment, documentation, and instructions along with error messages. Despite these issues, 25 (75,76%) patients reported they liked READY. Physicians provided mixed feedback because they were concerned about the impact of READY on clinical workflow. Six physicians participated in the TMS. We observed 47 patient visits (44.72 hours) in the pre-implementation phase, and 42 patient visits (37.82 hours) in the post-implementation phase. We found that patients spent more time on READY than paper (4.39mins vs. 2.26mins), but overall, READY did not delay the workflow (pre = 52.08 mins vs. post = 45.46 mins). This time difference may be compensated with READY eliminating a workflow step for the staff.<\/jats:p><jats:p>Conclusion Patients preferred READY to paper documents. Many found it easier to input information because of the larger font size and the ease of \u2018tapping\u2019 rather than writing-out or circling answers. Even though patients spent more time on READY than using paper documents, the longer usage of READY was mainly due to when troubleshooting was needed. Most patients did not have problems after receiving initial support from the staff. This study not only enabled improvements to the software but also serves as good reference for other researchers or institutional decision makers who are interested in implementing such a technology.<\/jats:p><jats:p>Citation: Yen P, Lara B, Lopetegui M, Bharat A, Ardoin S, Johnson B, Mathur P, Embi P, Curtis J. Usability and workflow evaluation of \u201cRhEumAtic Disease activitY\u201d (READY).<\/jats:p>","DOI":"10.4338\/aci-2016-03-ra-0036","type":"journal-article","created":{"date-parts":[[2016,11,2]],"date-time":"2016-11-02T04:40:04Z","timestamp":1478061604000},"page":"1007-1024","source":"Crossref","is-referenced-by-count":18,"title":["Usability and Workflow Evaluation of \u201cRhEumAtic Disease activitY\u201d (READY)"],"prefix":"10.4338","volume":"07","author":[{"given":"Po-Yin","family":"Yen","sequence":"first","affiliation":[]},{"given":"Barbara","family":"Lara","sequence":"first","affiliation":[]},{"given":"Marcelo","family":"Lopetegui","sequence":"first","affiliation":[]},{"given":"Aseem","family":"Bharat","sequence":"first","affiliation":[]},{"given":"Stacy","family":"Ardoin","sequence":"first","affiliation":[]},{"given":"Bernadette","family":"Johnson","sequence":"first","affiliation":[]},{"given":"Puneet","family":"Mathur","sequence":"first","affiliation":[]},{"given":"Peter","family":"Embi","sequence":"first","affiliation":[]},{"given":"Jeffrey","family":"Curtis","sequence":"additional","affiliation":[]}],"member":"194","published-online":{"date-parts":[[2017,12,18]]},"reference":[{"issue":"1","key":"10.4338\/ACI-2016-03-RA-0036-1","first-page":"1018","volume":"1","author":"Hersh","year":"2013","journal-title":"EGEMS (Wash DC)"},{"key":"10.4338\/ACI-2016-03-RA-0036-2","first-page":"889","volume":"2013","author":"Lopetegui","year":"2013","journal-title":"AMIA Annu Symp Proc"},{"issue":"1","key":"10.4338\/ACI-2016-03-RA-0036-3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/art.39480","volume":"68","author":"Singh","year":"2016","journal-title":"Arthritis Rheumatol"},{"key":"10.4338\/ACI-2016-03-RA-0036-4","doi-asserted-by":"publisher","DOI":"10.3899\/jrheum.080182"},{"issue":"4","key":"10.4338\/ACI-2016-03-RA-0036-5","first-page":"603","volume":"35","author":"Yazici","year":"2008","journal-title":"J Rheumatol"},{"key":"10.4338\/ACI-2016-03-RA-0036-6","doi-asserted-by":"publisher","DOI":"10.1186\/ar1740"},{"key":"10.4338\/ACI-2016-03-RA-0036-7","doi-asserted-by":"crossref","unstructured":"Blake H. Innovation in practice: mobile phone technology in patient care. Br J Community Nurs 2008; 13(4): 160, 2-5","DOI":"10.12968\/bjcn.2008.13.4.29024"},{"key":"10.4338\/ACI-2016-03-RA-0036-8","doi-asserted-by":"publisher","DOI":"10.1016\/j.amepre.2008.05.001"},{"key":"10.4338\/ACI-2016-03-RA-0036-9","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.2733"},{"key":"10.4338\/ACI-2016-03-RA-0036-10","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1994"},{"key":"10.4338\/ACI-2016-03-RA-0036-11","unstructured":"Mathur P, Southern L, Wang S, Heckler C, Lele O, Embi P, Curtis JR. High Level Architecture and Evaluation of Patient Linkages for READY - An Electronic Measurement Tool for Rheumatoid Arthritis. Proceedings of the American Medical Informatics Association Annual Symposium 2015"},{"key":"10.4338\/ACI-2016-03-RA-0036-12","unstructured":"Curtis JR. RhEumAtic Disease activitY 2014. Available from: https:\/\/itunes.apple.com\/us\/app\/rheumatic-disease-activity\/id657411562?mt=8"},{"key":"10.4338\/ACI-2016-03-RA-0036-13","doi-asserted-by":"publisher","DOI":"10.1016\/j.ygyno.2014.11.071"},{"key":"10.4338\/ACI-2016-03-RA-0036-14","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0000000000000289"},{"key":"10.4338\/ACI-2016-03-RA-0036-15","doi-asserted-by":"publisher","DOI":"10.1186\/s12955-014-0205-1"},{"key":"10.4338\/ACI-2016-03-RA-0036-16","doi-asserted-by":"publisher","DOI":"10.1136\/jamia.2010.004440"},{"key":"10.4338\/ACI-2016-03-RA-0036-17","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2014.08.007"},{"key":"10.4338\/ACI-2016-03-RA-0036-18","first-page":"402","volume":"192","author":"Koldby","year":"2013","journal-title":"Stud Health Technol Inform"},{"key":"10.4338\/ACI-2016-03-RA-0036-19","doi-asserted-by":"crossref","first-page":"25756","DOI":"10.3402\/gha.v8.25756","volume":"8","author":"Mensah","year":"2015","journal-title":"Glob Health Action"},{"key":"10.4338\/ACI-2016-03-RA-0036-20","doi-asserted-by":"publisher","DOI":"10.1177\/1460458213476968"},{"key":"10.4338\/ACI-2016-03-RA-0036-21","unstructured":"Lewis C. Using the \u201cthink aloud\u201d method in cognitive interface design. New York: IBM 1982"},{"key":"10.4338\/ACI-2016-03-RA-0036-22","doi-asserted-by":"publisher","DOI":"10.1145\/1039539.1039541"},{"issue":"Pt 2","key":"10.4338\/ACI-2016-03-RA-0036-23","first-page":"1295","volume":"107","author":"Cohen","year":"2004","journal-title":"Studies in Health Technology & Informatics"},{"key":"10.4338\/ACI-2016-03-RA-0036-24","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2006.06.003"},{"key":"10.4338\/ACI-2016-03-RA-0036-25","unstructured":"Elhadad N, McKeown K, Kaufman D, Jordan D. Facilitating physicians\u2018 access to information via tailored text summarization. AMIA Annu Symp Proc 2005; Annual Symposium Proceedings\/AMIA Symposium.: 226-30"},{"key":"10.4338\/ACI-2016-03-RA-0036-26","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2007.03.002"},{"key":"10.4338\/ACI-2016-03-RA-0036-27","unstructured":"Horsky J, Kaufman DR, Patel VL. The cognitive complexity of a provider order entry interface. AMIA Annu Symp Proc 2003;Annual Symposium Proceedings\/AMIA Symposium.: 294-8"},{"key":"10.4338\/ACI-2016-03-RA-0036-28","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2014.02.017"},{"key":"10.4338\/ACI-2016-03-RA-0036-29","unstructured":"Medicine NLo. MeSH: Time and Motion Studies 1991. Available from: http:\/\/www.ncbi.nlm.nih.gov\/mesh?term=Time+and+Motion+Studies"},{"key":"10.4338\/ACI-2016-03-RA-0036-30","first-page":"596","volume":"2012","author":"Lopetegui","year":"2012","journal-title":"AMIA Annu Symp Proc"},{"key":"10.4338\/ACI-2016-03-RA-0036-31","unstructured":"Chen JW. Developing a process for reducing functional discrepancies. Doctoral dissertation: School of Health Information Sciences, University of Texas Health Sciene Center at Houston 2008"},{"key":"10.4338\/ACI-2016-03-RA-0036-32","doi-asserted-by":"publisher","DOI":"10.1186\/s12888-015-0500-3"},{"key":"10.4338\/ACI-2016-03-RA-0036-33","doi-asserted-by":"publisher","DOI":"10.1037\/prj0000114"},{"key":"10.4338\/ACI-2016-03-RA-0036-34","doi-asserted-by":"publisher","DOI":"10.1111\/j.1553-2712.2012.01414.x"},{"key":"10.4338\/ACI-2016-03-RA-0036-35","doi-asserted-by":"publisher","DOI":"10.1111\/jep.12182"},{"key":"10.4338\/ACI-2016-03-RA-0036-36","doi-asserted-by":"publisher","DOI":"10.2196\/resprot.3806"},{"key":"10.4338\/ACI-2016-03-RA-0036-37","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2015.05.006"},{"key":"10.4338\/ACI-2016-03-RA-0036-38","doi-asserted-by":"publisher","DOI":"10.1097\/QMH.0000000000000075"},{"key":"10.4338\/ACI-2016-03-RA-0036-39","unstructured":"eHealth Observatory and School of Health Information Science University of Victoria. Canada Health Infoway Benefits Evaluation Indicators, technical report 2012. Available from: https:\/\/www.infoway-inforoute.ca\/index.php\/programs-services\/benefits-evaluation"},{"key":"10.4338\/ACI-2016-03-RA-0036-40","unstructured":"Agency for Healthcare Research and Quality. Health IT Evaluation Measures 2014. Available from: http:\/\/healthit.ahrq.gov\/health-it-tools-and-resources\/health-it-evaluation-toolkit-and-evaluation-measures-quick-reference"},{"key":"10.4338\/ACI-2016-03-RA-0036-41","doi-asserted-by":"publisher","DOI":"10.1016\/j.hjdsi.2013.12.009"},{"key":"10.4338\/ACI-2016-03-RA-0036-42","unstructured":"PROMIS: Dynamic Tools to Measure Health Outcomes from the Patient Perspective. Available from: http:\/\/www.nihpromis.org\/"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.4338\/ACI-2016-03-RA-0036.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,9,15]],"date-time":"2019-09-15T02:26:37Z","timestamp":1568514397000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.4338\/ACI-2016-03-RA-0036"}},"subtitle":["A Mobile Application for Rheumatology Patients and Providers"],"short-title":[],"issued":{"date-parts":[[2016,10]]},"references-count":42,"journal-issue":{"issue":"04","published-online":{"date-parts":[[2017,12,18]]},"published-print":{"date-parts":[[2016]]}},"URL":"https:\/\/doi.org\/10.4338\/aci-2016-03-ra-0036","relation":{},"ISSN":["1869-0327"],"issn-type":[{"type":"electronic","value":"1869-0327"}],"subject":[],"published":{"date-parts":[[2016,10]]}}}