{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T11:31:29Z","timestamp":1749036689322,"version":"3.37.3"},"reference-count":44,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T00:00:00Z","timestamp":1692921600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R21CA265961"],"award-info":[{"award-number":["R21CA265961"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,1,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Importance<\/jats:title>\n                  <jats:p>Due to insufficient smoking cessation apps for persons living with HIV, our study focused on designing and testing the Sense2Quit app, a patient-facing mHealth tool which integrated visualizations of patient information, specifically smoking use.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>The purpose of this paper is to detail rigorous human-centered design methods to develop and refine visualizations of smoking data and the contents and user interface of the Sense2Quit app. The Sense2Quit app was created to support tobacco cessation and relapse prevention for people living with HIV.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Twenty people living with HIV who are current or former smokers and 5 informaticians trained in human-computer interaction participated in 5 rounds of usability testing. Participants tested the Sense2Quit app with use cases and provided feedback and then completed a survey.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Visualization of smoking behaviors was refined through each round of usability testing. Further, additional features such as daily tips, games, and a homescreen were added to improve the usability of the app. A total of 66 changes were made to the Sense2Quit app based on end-user and expert recommendations.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>While many themes overlapped between usability testing with end-users and heuristic evaluations, there were also discrepancies. End-users and experts approached the app evaluation from different perspectives which ultimately allowed us to fill knowledge gaps and make improvements to the app.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Findings from our study illustrate the best practices for usability testing for development and refinement of an mHealth-delivered consumer informatics tool for improving tobacco cessation yet further research is needed to fully evaluate how tools informed by target user needs improve health outcomes.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad162","type":"journal-article","created":{"date-parts":[[2023,8,26]],"date-time":"2023-08-26T07:10:51Z","timestamp":1693033851000},"page":"354-362","source":"Crossref","is-referenced-by-count":7,"title":["Development and evaluation of visualizations of smoking data for integration into the Sense2Quit app for tobacco cessation"],"prefix":"10.1093","volume":"31","author":[{"given":"Maeve","family":"Brin","sequence":"first","affiliation":[{"name":"School of Nursing, Columbia University , New York, NY, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Trujillo","sequence":"additional","affiliation":[{"name":"School of Nursing, Columbia University , New York, NY, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ming-Chun","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Engineering, Case Western Reserve University , Cleveland, OH, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patricia","family":"Cioe","sequence":"additional","affiliation":[{"name":"School of Public Health, Brown University , Providence, RI, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huan","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Engineering, Case Western Reserve University , Cleveland, OH, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenyao","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Computer Science & Engineering, University at Buffalo, the State University of New York , Buffalo, NY, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebecca","family":"Schnall","sequence":"additional","affiliation":[{"name":"School of Nursing, Columbia University , New York, NY, United States"},{"name":"Columbia University School of Public Health , New York, NY, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,8,25]]},"reference":[{"year":"2022","author":"CDC","key":"2024011907285343400_ocad162-B1"},{"issue":"8","key":"2024011907285343400_ocad162-B2","doi-asserted-by":"crossref","first-page":"1722","DOI":"10.1007\/s10461-015-1273-x","article-title":"Recent tobacco smoking is associated with poor HIV medical outcomes among HIV-infected individuals in New York","volume":"20","author":"Hile","year":"2016","journal-title":"AIDS Behav"},{"author":"CDC","key":"2024011907285343400_ocad162-B3"},{"issue":"3 Suppl","key":"2024011907285343400_ocad162-B4","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1521\/aeap.2009.21.3_supp.3","article-title":"Cigarette smoking and HIV\/AIDS: health implications, smoker characteristics and cessation strategies","volume":"21","author":"Vidrine","year":"2009","journal-title":"AIDS Educ Prev"},{"year":"2023","author":"hiv.gov","key":"2024011907285343400_ocad162-B5"},{"issue":"1","key":"2024011907285343400_ocad162-B6","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/s13104-020-05417-3","article-title":"A pilot randomized controlled trial of a tailored smoking cessation program for people living with HIV in the Washington, D.C. metropolitan area","volume":"14","author":"Kierstead","year":"2021","journal-title":"BMC Res Notes"},{"issue":"3","key":"2024011907285343400_ocad162-B7","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/s11904-012-0121-0","article-title":"Smoking and HIV: prevalence, health risks, and cessation strategies","volume":"9","author":"Lifson","year":"2012","journal-title":"Curr HIV\/AIDS Rep"},{"issue":"10","key":"2024011907285343400_ocad162-B8","doi-asserted-by":"crossref","first-page":"3373","DOI":"10.1007\/s10461-017-2014-0","article-title":"Mobile health technology for improving symptom management in low income persons living with HIV","volume":"22","author":"Schnall","year":"2018","journal-title":"AIDS Behav"},{"issue":"6","key":"2024011907285343400_ocad162-B9","doi-asserted-by":"crossref","first-page":"1699","DOI":"10.1007\/s10461-020-03096-6","article-title":"Efficacy, use, and usability of the VIP-HANA app for symptom self-management in PLWH with HANA conditions","volume":"25","author":"Schnall","year":"2021","journal-title":"AIDS Behav"},{"issue":"3","key":"2024011907285343400_ocad162-B10","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1093\/jamia\/ocac233","article-title":"Efficacy of an mHealth self-management intervention for persons living with HIV: the WiseApp randomized clinical trial","volume":"30","author":"Schnall","year":"2023","journal-title":"J Am Med Inform Assoc"},{"key":"2024011907285343400_ocad162-B11","doi-asserted-by":"crossref","first-page":"e41911","DOI":"10.2196\/41911","article-title":"A personalized mobile cessation intervention to promote smokers from the preparation stage to the action stage: double-blind randomized controlled trial","volume":"25","author":"Lin","year":"2023","journal-title":"J Med Internet Res"},{"key":"2024011907285343400_ocad162-B12","doi-asserted-by":"crossref","first-page":"105069","DOI":"10.1016\/j.ijmedinf.2023.105069","article-title":"Smokers' user experience of smoking cessation apps: A systematic review","volume":"175","author":"Zhang","year":"2023","journal-title":"Int J Med Inform"},{"issue":"6","key":"2024011907285343400_ocad162-B13","doi-asserted-by":"crossref","first-page":"4826","DOI":"10.3390\/ijerph20064826","article-title":"App-delivered mindfulness training to reduce anxiety in people with HIV who smoke: a one-armed feasibility trial","volume":"20","author":"Cioe","year":"2023","journal-title":"IJERPH"},{"issue":"3","key":"2024011907285343400_ocad162-B14","doi-asserted-by":"crossref","first-page":"e230301","DOI":"10.1001\/jamanetworkopen.2023.0301","article-title":"Assessment of a text message-based smoking cessation intervention for adult smokers in China: a randomized clinical trial","volume":"6","author":"Lin","year":"2023","journal-title":"JAMA Netw Open"},{"key":"2024011907285343400_ocad162-B15","doi-asserted-by":"crossref","first-page":"1179173x231152316","DOI":"10.1177\/1179173X231152316","article-title":"Appagalo\u201d a customized mobile health intervention (mHealth) for smoking cessation in women: a randomized controlled trial","volume":"16","author":"Martinez-Gutierrez","year":"2023","journal-title":"Tob Use Insights"},{"issue":"1","key":"2024011907285343400_ocad162-B16","doi-asserted-by":"crossref","first-page":"3096","DOI":"10.1080\/07853890.2022.2140451","article-title":"Augmented reality as a novel approach for addiction treatment: development of a smoking cessation app","volume":"54","author":"Yang","year":"2022","journal-title":"Ann Med"},{"issue":"11","key":"2024011907285343400_ocad162-B17","doi-asserted-by":"crossref","first-page":"e41658","DOI":"10.2196\/41658","article-title":"Outcomes of a comprehensive mobile smoking cessation program with nicotine replacement therapy in adult smokers: pilot randomized controlled trial","volume":"10","author":"Marler","year":"2022","journal-title":"JMIR Mhealth Uhealth"},{"issue":"8","key":"2024011907285343400_ocad162-B18","doi-asserted-by":"crossref","first-page":"e39208","DOI":"10.2196\/39208","article-title":"Smoking cessation smartphone app use over time: predicting 12-month cessation outcomes in a 2-arm randomized trial","volume":"24","author":"Bricker","year":"2022","journal-title":"J Med Internet Res"},{"issue":"8","key":"2024011907285343400_ocad162-B19","doi-asserted-by":"crossref","first-page":"e28626","DOI":"10.2196\/28626","article-title":"A smoking cessation mobile app for persons living with HIV: preliminary efficacy and feasibility study","volume":"6","author":"Schnall","year":"2022","journal-title":"JMIR Form Res"},{"key":"2024011907285343400_ocad162-B20","doi-asserted-by":"crossref","first-page":"e41182","DOI":"10.2196\/41182","article-title":"The impact of digital health on smoking cessation","volume":"12","author":"Cobos-Campos","year":"2023","journal-title":"Interact J Med Res"},{"issue":"4","key":"2024011907285343400_ocad162-B21","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1055\/s-0039-1697592","article-title":"A systematic review of patient-facing visualizations of personal health data","volume":"10","author":"Turchioe","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"2","key":"2024011907285343400_ocad162-B22","first-page":"87","article-title":"A three cycle view of design science research","volume":"19","author":"Hevner","year":"2007","journal-title":"Scand J Inf Syst"},{"issue":"5","key":"2024011907285343400_ocad162-B23","doi-asserted-by":"crossref","DOI":"10.3390\/ijerph20054219","article-title":"Theoretically guided iterative design of the Sense2Quit app for tobacco cessation in persons living with HIV","volume":"20","author":"Schnall","year":"2023","journal-title":"Int J Environ Res Public Health"},{"issue":"1","key":"2024011907285343400_ocad162-B24","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1214\/aoms\/1177705148","article-title":"Snowball sampling","volume":"32","author":"Goodman","year":"1961","journal-title":"Ann Math Statist"},{"issue":"3","key":"2024011907285343400_ocad162-B25","doi-asserted-by":"crossref","first-page":"379","DOI":"10.3758\/BF03195514","article-title":"Beyond the five-user assumption: benefits of increased sample sizes in usability testing","volume":"35","author":"Faulkner","year":"2003","journal-title":"Behav Res Methods Instrum Comput"},{"issue":"1","key":"2024011907285343400_ocad162-B26","doi-asserted-by":"crossref","first-page":"e4","DOI":"10.2196\/mhealth.8851","article-title":"Health Information Technology Usability Evaluation Scale (Health-ITUES) for usability assessment of mobile health technology: validation study","volume":"6","author":"Schnall","year":"2018","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"2024011907285343400_ocad162-B27","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1080\/10447319509526110","article-title":"IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use","volume":"7","author":"Lewis","year":"1995","journal-title":"International Journal of Human-Computer Interaction"},{"author":"Nielsen","key":"2024011907285343400_ocad162-B28"},{"journal-title":"8th International Congress in Nursing Informatics","article-title":"The usability factor: more than just a pretty interface","year":"2003","key":"2024011907285343400_ocad162-B29"},{"year":"2006","key":"2024011907285343400_ocad162-B30"},{"author":"Nielsen","key":"2024011907285343400_ocad162-B31"},{"key":"2024011907285343400_ocad162-B32","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.jbi.2018.08.012","article-title":"A multi-level usability evaluation of mobile health applications: a case study","volume":"86","author":"Cho","year":"2018","journal-title":"J Biomed Inform"},{"volume-title":"Human-Computer Interaction","year":"2003","author":"Dix","key":"2024011907285343400_ocad162-B33"},{"issue":"10","key":"2024011907285343400_ocad162-B34","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1038\/nmeth1010-775a","article-title":"Color blindness","volume":"7","author":"Albrecht","year":"2010","journal-title":"Nat Methods"},{"issue":"2","key":"2024011907285343400_ocad162-B35","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1093\/jamia\/ocz189","article-title":"Patient preferences for visualization of longitudinal patient-reported outcomes data","volume":"27","author":"Stonbraker","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2024011907285343400_ocad162-B36","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1521\/aeap.2018.30.6.449","article-title":"Adaptation of a group-based, HIV risk reduction intervention to a mobile app for young sexual minority men","volume":"30","author":"Schnall","year":"2018","journal-title":"AIDS Educ Prev"},{"issue":"2","key":"2024011907285343400_ocad162-B37","doi-asserted-by":"crossref","first-page":"e17268","DOI":"10.2196\/17268","article-title":"Classification of smoking cessation apps: quality review and content analysis","volume":"10","author":"Seo","year":"2022","journal-title":"JMIR Mhealth Uhealth"},{"year":"2023","key":"2024011907285343400_ocad162-B38"},{"year":"2017","key":"2024011907285343400_ocad162-B39"},{"year":"2016","author":"Cole","key":"2024011907285343400_ocad162-B40"},{"year":"2023","author":"Health","key":"2024011907285343400_ocad162-B41"},{"issue":"3","key":"2024011907285343400_ocad162-B42","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1017\/jsc.2018.33","article-title":"Using \u2018Smart\u2019 technology to aid in cigarette smoking cessation: examining an innovative way to monitor and improve quit attempt outcomes","volume":"14","author":"Morriscey","year":"2019","journal-title":"J Smok Cessat"},{"key":"2024011907285343400_ocad162-B43","article-title":"stopWatch \u2013 a smartwatch system that could help people quit smoking","author":"Skinner","year":"2019","journal-title":"Ieureka"},{"issue":"9","key":"2024011907285343400_ocad162-B44","doi-asserted-by":"crossref","first-page":"e2231853","DOI":"10.1001\/jamanetworkopen.2022.31853","article-title":"Efficacy of MyPEEPS mobile, an HIV prevention intervention using mobile technology, on reducing sexual risk among same-sex attracted adolescent males: a randomized clinical trial","volume":"5","author":"Schnall","year":"2022","journal-title":"JAMA Netw Open"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/2\/354\/56209415\/ocad162.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/2\/354\/56209415\/ocad162.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,19]],"date-time":"2024-01-19T07:31:36Z","timestamp":1705649496000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/2\/354\/7251530"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,25]]},"references-count":44,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,8,25]]},"published-print":{"date-parts":[[2024,1,18]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad162","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2024,2,1]]},"published":{"date-parts":[[2023,8,25]]}}}