{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:47:05Z","timestamp":1776113225015,"version":"3.50.1"},"reference-count":77,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,12,27]],"date-time":"2018-12-27T00:00:00Z","timestamp":1545868800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100011755","name":"Northwestern University","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100011755","id-type":"DOI","asserted-by":"publisher"}]},{"name":"AHA","award":["AHA14SFRN20740001"],"award-info":[{"award-number":["AHA14SFRN20740001"]}]},{"name":"JR Albert Foundation"},{"DOI":"10.13039\/100000062","name":"NIDDK","doi-asserted-by":"crossref","award":["K25DK113242"],"award-info":[{"award-number":["K25DK113242"]}],"id":[{"id":"10.13039\/100000062","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2018,12,27]]},"abstract":"<jats:p>Behavioral medicine is devoting increasing attention to the topic of participant engagement and its role in effective mobile health (mHealth) behavioral interventions. Several definitions of the term \"engagement\" have been proposed and discussed, especially in the context of digital health behavioral interventions. We consider that engagement refers to specific interaction and use patterns with the mHealth tools such as smartphone applications for intervention, whereas adherence refers to compliance with the directives of the health intervention, independent of the mHealth tools. Through our analysis of participant interaction and self-reported behavioral data in a college student health study with incentives, we demonstrate an example of measuring \"effective engagement\" as engagement behaviors that can be linked to the goals of the desired intervention. We demonstrate how clustering of one year of weekly health behavior self-reports generate four interpretable clusters related to participants' adherence to the desired health behaviors: healthy and steady, unhealthy and steady, decliners, and improvers. Based on the intervention goals of this study (health promotion and behavioral change), we show that not all app usage metrics are indicative of the desired outcomes that create effective engagement. As such, mHealth intervention design might consider eliciting not just more engagement or use overall, but rather, effective engagement defined by use patterns related to the desired behavioral outcome.<\/jats:p>","DOI":"10.1145\/3287031","type":"journal-article","created":{"date-parts":[[2018,12,27]],"date-time":"2018-12-27T19:28:03Z","timestamp":1545938883000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Is More Always Better?"],"prefix":"10.1145","volume":"2","author":[{"given":"Nabil","family":"Alshurafa","sequence":"first","affiliation":[{"name":"Northwestern University, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jayalakshmi","family":"Jain","sequence":"additional","affiliation":[{"name":"Northwestern University, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rawan","family":"Alharbi","sequence":"additional","affiliation":[{"name":"Northwestern University, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gleb","family":"Iakovlev","sequence":"additional","affiliation":[{"name":"Northwestern University, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bonnie","family":"Spring","sequence":"additional","affiliation":[{"name":"Northwestern University, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Angela","family":"Pfammatter","sequence":"additional","affiliation":[{"name":"Northwestern University, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,12,27]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"American Heart Association. 2018. My Life Check - Life's Simple 7. http:\/\/www.heart.org\/en\/healthy-living\/healthy-lifestyle\/my-life-check--lifes-simple-7 {Accessed: 15-Nov-2018}.  American Heart Association. 2018. My Life Check - Life's Simple 7. http:\/\/www.heart.org\/en\/healthy-living\/healthy-lifestyle\/my-life-check--lifes-simple-7 {Accessed: 15-Nov-2018}."},{"key":"e_1_2_1_2_1","volume-title":"Human agency in social cognitive theory. American psychologist 44, 9","author":"Bandura Albert","year":"1989"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2598510.2598598"},{"key":"e_1_2_1_4_1","unstructured":"Marshall H Becker. 1990. Theoretical models of adherence and strategies for improving adherence. (1990).  Marshall H Becker. 1990. Theoretical models of adherence and strategies for improving adherence. (1990)."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1037\/0278-6133.23.5.443"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Dror Ben-Zeev Emily A Scherer Jennifer D Gottlieb Armando J Rotondi Mary F Brunette Eric D Achtyes Kim T Mueser Susan Gingerich Christopher J Brenner Mark Begale etal 2016. mHealth for schizophrenia: patient engagement with a mobile phone intervention following hospital discharge. JMIR mental health 3 3 (2016).  Dror Ben-Zeev Emily A Scherer Jennifer D Gottlieb Armando J Rotondi Mary F Brunette Eric D Achtyes Kim T Mueser Susan Gingerich Christopher J Brenner Mark Begale et al. 2016. mHealth for schizophrenia: patient engagement with a mobile phone intervention following hospital discharge. JMIR mental health 3 3 (2016).","DOI":"10.2196\/mental.6348"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.3109\/09638288.2014.933899"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2014.09.002"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1509\/jmkr.42.2.129.62286"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/0092-6566(81)90003-9"},{"key":"e_1_2_1_11_1","article-title":"Engagement Within a Mobile Phone--Based Smoking Cessation Intervention for Adolescents and its Association With Participant Characteristics and Outcomes","volume":"19","author":"Castro Raquel Paz","year":"2017","journal-title":"Journal of Medical Internet Research"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Kate Cavanagh et al. 2010. Turn on tune in and (don't) drop out: engagement adherence attrition and alliance with internet-based interventions. Oxford guide to low intensity CBT interventions (2010) 227--233.  Kate Cavanagh et al. 2010. Turn on tune in and (don't) drop out: engagement adherence attrition and alliance with internet-based interventions. Oxford guide to low intensity CBT interventions (2010) 227--233.","DOI":"10.1093\/med:psych\/9780199590117.003.0021"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1177\/1090198114550822"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3154862.3154881"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000732"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1430"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.8.3.e15"},{"key":"e_1_2_1_18_1","volume-title":"C. Kraaikamp, H. P. Lopuhaa, and L. E. Meester. J. Amer. Statist. Assoc. 101 (02","author":"Devore Jay","year":"2006"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.2015.0568"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804250"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1111\/jocn.12988"},{"key":"e_1_2_1_22_1","unstructured":"Center for Disease Control and Prevention. 2018. How much physical activity do adults need? https:\/\/www.cdc.gov\/physicalactivity\/basics\/adults\/ {Accessed: 15-Nov-2018}.  Center for Disease Control and Prevention. 2018. How much physical activity do adults need? https:\/\/www.cdc.gov\/physicalactivity\/basics\/adults\/ {Accessed: 15-Nov-2018}."},{"key":"e_1_2_1_23_1","volume-title":"The effectiveness of mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. PLoS medicine 10, 1","author":"Free Caroline","year":"2013"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.3895"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1391"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jadohealth.2015.09.011"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804290"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901790.2901803"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1414293"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2015.05.001"},{"key":"e_1_2_1_31_1","volume-title":"Marjolein Dieleman, Azucena Bardaj\u00ed, Jacqueline EW Broerse, and Sara Van Belle.","author":"Ilozumba Onaedo","year":"2018"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2008.04.004"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1080\/00330124.2012.700499"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-010-1628-y"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1111\/wvn.12030"},{"key":"e_1_2_1_36_1","volume-title":"understanding adherence to medication in ulcerative colitis--innovative thinking and evolving concepts. Alimentary pharmacology & therapeutics 32, 9","author":"Kane Sunanda V","year":"2010"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1177\/1474515114521910"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.9745\/GHSP-D-13-00031"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.4172\/2165-7904.C1.029"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030112.2030166"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1982.1056489"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-006X.76.2.341"},{"key":"e_1_2_1_43_1","volume-title":"Smartloss: a personalized mobile health intervention for weight management and health promotion. JMIR mHealth and uHealth 4, 1","author":"Martin Corby K","year":"2016"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2508"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0016136"},{"key":"e_1_2_1_46_1","volume-title":"Supporting Systematic Assessment of Digital Interventions: A Framework for Analysing and Measuring Usage and Engagement Data (AMUsED). Journal of Medical Internet Research","author":"Miller S","year":"2018"},{"key":"e_1_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Leanne Morrison Rona Moss-Morris Susan Michie and Lucy Yardley. 2014. Optimizing engagement with internet-based health behaviour change interventions: Comparison of self-assessment with and without tailored feedback using a mixed methods approach. British journal of health psychology 19 4 (2014) 839--855.  Leanne Morrison Rona Moss-Morris Susan Michie and Lucy Yardley. 2014. Optimizing engagement with internet-based health behaviour change interventions: Comparison of self-assessment with and without tailored feedback using a mixed methods approach. British journal of health psychology 19 4 (2014) 839--855.","DOI":"10.1111\/bjhp.12083"},{"key":"e_1_2_1_48_1","volume-title":"Increasing physical activity through mobile device interventions: A systematic review. Health informatics journal 22, 3","author":"Muntaner Adri\u00e0","year":"2016"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1002\/widm.53"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1161\/JAHA.116.003934"},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","volume-title":"Why Engagement Matters: Cross-Disciplinary Perspectives of User Engagement in Digital Media","author":"O'Brien Heather","DOI":"10.1007\/978-3-319-27446-1"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/1358262.1358271"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jadohealth.2014.10.055"},{"key":"e_1_2_1_54_1","volume-title":"A text messaging intervention to promote medication adherence for patients with coronary heart disease: a randomized controlled trial. Patient education and counseling 94, 2","author":"Park Linda G","year":"2014"},{"key":"e_1_2_1_55_1","volume-title":"Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Translational Behavioral Medicine","author":"Perski Olga","year":"2016"},{"key":"e_1_2_1_56_1","volume-title":"Susan Hammett Hood, and Bonnie","author":"Pfammatter Angela Fidler","year":"2017"},{"key":"e_1_2_1_57_1","volume-title":"Jean-Louis Bonnet, Marie-Christine Alessi, Patrizia Carrieri, and Thomas Cuisset.","author":"Quilici Jacques","year":"2013"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.7871"},{"key":"e_1_2_1_59_1","volume-title":"Health behavior models in the age of mobile interventions: are our theories up to the task? Translational behavioral medicine 1, 1","author":"Riley William T","year":"2011"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12160-009-9133-4"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/0377-0427(87)90125-7"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-002610"},{"key":"e_1_2_1_63_1","first-page":"32","article-title":"Designing engaging online behaviour change interventions: A proposed model of user engagement","volume":"17","author":"Short Camille E","year":"2015","journal-title":"European Health Psychologist"},{"key":"e_1_2_1_64_1","doi-asserted-by":"crossref","unstructured":"Camille E Short Corneel Vandelanotte Marcus W Dixon Richard Rosenkranz Cristina Caperchione Cindy Hooker Mohan Karunanithi Gregory S Kolt Anthony Maeder Hang Ding etal 2014. Examining participant engagement in an information technology-based physical activity and nutrition intervention for men: the manup randomized controlled trial. JMIR research protocols 3 1 (2014).  Camille E Short Corneel Vandelanotte Marcus W Dixon Richard Rosenkranz Cristina Caperchione Cindy Hooker Mohan Karunanithi Gregory S Kolt Anthony Maeder Hang Ding et al. 2014. Examining participant engagement in an information technology-based physical activity and nutrition intervention for men: the manup randomized controlled trial. JMIR research protocols 3 1 (2014).","DOI":"10.2196\/resprot.2776"},{"key":"e_1_2_1_65_1","first-page":"11","article-title":"Developing a framework for evaluating the patient engagement, quality, and safety of mobile health applications","volume":"5","author":"Singh Karandeep","year":"2016","journal-title":"Issue Brief (Commonw Fund)"},{"key":"e_1_2_1_66_1","volume-title":"Improving patient health engagement with mobile texting: A pilot study in the head and neck postoperative setting. Head & neck 39, 5","author":"Sosa Alan","year":"2017"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCULATIONAHA.113.005445"},{"key":"e_1_2_1_68_1","volume-title":"Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth and uHealth 3, 1","author":"Stoyanov Stoyan R","year":"2015"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.7236"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.7236"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.2307\/2937956"},{"key":"e_1_2_1_72_1","unstructured":"William M Vollmer Ashil A Owen-Smith Jeffrey O Tom Reesa Laws Diane G Ditmer David H Smith Amy C Waterbury Jennifer L Schneider Cyndee H Yonehara Andrew Williams etal 2014. Improving adherence to cardiovascular disease medications with information technology. The American journal of managed care 20 11 Spec No. 17 (2014) SP502--10.  William M Vollmer Ashil A Owen-Smith Jeffrey O Tom Reesa Laws Diane G Ditmer David H Smith Amy C Waterbury Jennifer L Schneider Cyndee H Yonehara Andrew Williams et al. 2014. Improving adherence to cardiovascular disease medications with information technology. The American journal of managed care 20 11 Spec No. 17 (2014) SP502--10."},{"key":"e_1_2_1_73_1","volume-title":"Olav W Bertelsen, et al.","author":"Wagner S","year":"2013"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0114268"},{"key":"e_1_2_1_75_1","volume-title":"Controlling your \"App\" etite: how diet and nutrition-related mobile apps lead to behavior change. JMIR mHealth and uHealth 5, 7","author":"West Joshua H","year":"2017"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.14236\/ewic\/hci2014.16"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amepre.2016.06.015"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3287031","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3287031","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:02:08Z","timestamp":1750208528000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3287031"}},"subtitle":["Discovering Incentivized mHealth Intervention Engagement Related to Health Behavior Trends"],"short-title":[],"issued":{"date-parts":[[2018,12,27]]},"references-count":77,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,12,27]]}},"alternative-id":["10.1145\/3287031"],"URL":"https:\/\/doi.org\/10.1145\/3287031","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,12,27]]},"assertion":[{"value":"2018-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-12-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}