{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T01:31:00Z","timestamp":1780623060858,"version":"3.54.1"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T00:00:00Z","timestamp":1710201600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T00:00:00Z","timestamp":1710201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000272","name":"DH | National Institute for Health Research","doi-asserted-by":"publisher","award":["AI_AWARD02200"],"award-info":[{"award-number":["AI_AWARD02200"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000272","name":"DH | National Institute for Health Research","doi-asserted-by":"publisher","award":["AI_AWARD02200"],"award-info":[{"award-number":["AI_AWARD02200"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000272","name":"DH | National Institute for Health Research","doi-asserted-by":"publisher","award":["AI_AWARD02200"],"award-info":[{"award-number":["AI_AWARD02200"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000272","name":"DH | National Institute for Health Research","doi-asserted-by":"publisher","award":["AI_AWARD02200"],"award-info":[{"award-number":["AI_AWARD02200"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000272","name":"DH | National Institute for Health Research","doi-asserted-by":"publisher","award":["AI_AWARD02200"],"award-info":[{"award-number":["AI_AWARD02200"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000272","name":"DH | National Institute for Health Research","doi-asserted-by":"publisher","award":["AI_AWARD02200"],"award-info":[{"award-number":["AI_AWARD02200"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000272","name":"DH | National Institute for Health Research","doi-asserted-by":"publisher","award":["AI_AWARD02200"],"award-info":[{"award-number":["AI_AWARD02200"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Mobile Health (mHealth) has the potential to be transformative in the management of chronic conditions. Machine learning can leverage self-reported data collected with apps to predict periods of increased health risk, alert users, and signpost interventions. Despite this, mHealth must balance the treatment burden of frequent self-reporting and predictive performance and safety. Here we report how user engagement with a widely used and clinically validated mHealth app, myCOPD (designed for the self-management of Chronic Obstructive Pulmonary Disease), directly impacts the performance of a machine learning model predicting an acute worsening of condition (i.e., exacerbations). We classify how users typically engage with myCOPD, finding that 60.3% of users engage frequently, however, less frequent users can show transitional engagement (18.4%), becoming more engaged immediately (\u2009&lt;\u200921 days) before exacerbating. Machine learning performed better for users who engaged the most, however, this performance decrease can be mostly offset for less frequent users who engage more near exacerbation. We conduct interviews and focus groups with myCOPD users, highlighting digital diaries and disease acuity as key factors for engagement. Users of mHealth can feel overburdened when self-reporting data necessary for predictive modelling and confidence of recognising exacerbations is a significant barrier to accurate self-reported data. We demonstrate that users of mHealth should be encouraged to engage when they notice changes to their condition (rather than clinically defined symptoms) to achieve data that is still predictive for machine learning, while reducing the likelihood of disengagement through desensitisation.<\/jats:p>","DOI":"10.1038\/s41746-024-01063-2","type":"journal-article","created":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T00:02:14Z","timestamp":1710288134000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Characterising user engagement with mHealth for chronic disease self-management and impact on machine learning performance"],"prefix":"10.1038","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0659-2177","authenticated-orcid":false,"given":"Christopher","family":"Duckworth","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bethany","family":"Cliffe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Pickering","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5098-1092","authenticated-orcid":false,"given":"Ben","family":"Ainsworth","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6080-0120","authenticated-orcid":false,"given":"Alison","family":"Blythin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam","family":"Kirk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1771-3851","authenticated-orcid":false,"given":"Thomas M. A.","family":"Wilkinson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael J.","family":"Boniface","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,3,12]]},"reference":[{"key":"1063_CR1","unstructured":"Murphy S. L., et al. Deaths: final data for 2018. (2021)."},{"key":"1063_CR2","first-page":"8","volume":"3","author":"TK Kim","year":"2013","unstructured":"Kim, T. K. & Lane, S. R. Government health expenditure and public health outcomes: a comparative study among 17 countries and implications for US health care reform. Am. Int. J. Contemp. Res. 3, 8\u201313 (2013).","journal-title":"Am. Int. J. Contemp. Res."},{"key":"1063_CR3","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1016\/S0140-6736(08)61078-8","volume":"372","author":"D De Ridder","year":"2008","unstructured":"De Ridder, D., Geenen, R., Kuijer, R. & van Middendorp, H. Psychological adjustment to chronic disease. Lancet 372, 246\u201355 (2008).","journal-title":"Lancet"},{"key":"1063_CR4","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1136\/ewjm.172.2.124","volume":"172","author":"J Turner","year":"2000","unstructured":"Turner, J. & Kelly, B. Emotional dimensions of chronic disease. West. J. Med. 172, 124 (2000).","journal-title":"West. J. Med."},{"key":"1063_CR5","unstructured":"Organization W. H. Global diffusion of eHealth: making universal health coverage achievable: report of the third global survey on eHealth: World Health Organization; 2017."},{"key":"1063_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-019-0206-x","volume":"3","author":"SP Rowland","year":"2020","unstructured":"Rowland, S. P. et al. What is the clinical value of mHealth for patients? NPJ Digital Med. 3, 1\u20136 (2020).","journal-title":"NPJ Digital Med."},{"key":"1063_CR7","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1007\/s13142-016-0453-1","volume":"7","author":"O Perski","year":"2017","unstructured":"Perski, O., Blandford, A., West, R. & Michie, S. Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Transl. Behav. Med. 7, 254\u201367 (2017).","journal-title":"Transl. Behav. Med."},{"key":"1063_CR8","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1007\/s12160-016-9830-8","volume":"52","author":"I Nahum-Shani","year":"2018","unstructured":"Nahum-Shani, I. et al. Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Ann. Behav. Med. 52, 446\u201362 (2018).","journal-title":"Ann. Behav. Med."},{"key":"1063_CR9","doi-asserted-by":"publisher","first-page":"1531","DOI":"10.1080\/10410236.2019.1652388","volume":"35","author":"L Wang","year":"2020","unstructured":"Wang, L. & Miller, L. C. Just-in-the-moment adaptive interventions (JITAI): a meta-analytical review. Health Commun. 35, 1531\u201344 (2020).","journal-title":"Health Commun."},{"key":"1063_CR10","doi-asserted-by":"publisher","first-page":"e26499","DOI":"10.2196\/26499","volume":"10","author":"FP Chmiel","year":"2022","unstructured":"Chmiel, F. P. et al. Prediction of chronic obstructive pulmonary disease exacerbation events by using patient self-reported data in a digital health app: statistical evaluation and machine learning approach. JMIR Med. Inform. 10, e26499 (2022).","journal-title":"JMIR Med. Inform."},{"key":"1063_CR11","doi-asserted-by":"publisher","first-page":"e10966","DOI":"10.2196\/10966","volume":"21","author":"S Miller","year":"2019","unstructured":"Miller, S. et al. A framework for analyzing and measuring usage and engagement data (AMUsED) in digital interventions. J. Med. Internet Res. 21, e10966 (2019).","journal-title":"J. Med. Internet Res."},{"key":"1063_CR12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-019-0211-0","volume":"3","author":"M North","year":"2020","unstructured":"North, M. et al. A randomised controlled feasibility trial of E-health application supported care vs usual care after exacerbation of COPD: the RESCUE trial. NPJ Digital Med. 3, 1\u20138 (2020).","journal-title":"NPJ Digital Med."},{"key":"1063_CR13","doi-asserted-by":"crossref","unstructured":"Crooks M. G., et al. Evidence generation for the clinical impact of myCOPD in patients with mild, moderate and newly diagnosed COPD: a randomised controlled trial. ERJ Open Res. 6 (2020).","DOI":"10.1183\/23120541.00460-2020"},{"key":"1063_CR14","doi-asserted-by":"publisher","first-page":"e30782","DOI":"10.2196\/30782","volume":"10","author":"R Cooper","year":"2022","unstructured":"Cooper, R. et al. Evaluation of myCOPD digital self-management technology in a remote and rural population: real-world feasibility study. JMIR mHealth uHealth 10, e30782 (2022).","journal-title":"JMIR mHealth uHealth"},{"key":"1063_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/srep31893","volume":"6","author":"S McLean","year":"2016","unstructured":"McLean, S. et al. Projecting the COPD population and costs in England and Scotland: 2011 to 2030. Sci. Rep. 6, 1\u201310 (2016).","journal-title":"Sci. Rep."},{"key":"1063_CR16","doi-asserted-by":"publisher","first-page":"398S","DOI":"10.1378\/chest.117.5_suppl_2.398S","volume":"117","author":"R Rodriguez-Roisin","year":"2000","unstructured":"Rodriguez-Roisin, R. Toward a consensus definition for COPD exacerbations. Chest 117, 398S\u2013401S (2000).","journal-title":"Chest"},{"key":"1063_CR17","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1007\/s10209-014-0348-1","volume":"14","author":"N Maranguni\u0107","year":"2015","unstructured":"Maranguni\u0107, N. & Grani\u0107, A. Technology acceptance model: a literature review from 1986 to 2013. Univers. Access Inf. Soc. 14, 81\u201395 (2015).","journal-title":"Univers. Access Inf. Soc."},{"key":"1063_CR18","doi-asserted-by":"publisher","first-page":"e004782","DOI":"10.1136\/bmjopen-2013-004782","volume":"4","author":"C Ratneswaran","year":"2014","unstructured":"Ratneswaran, C. et al. A cross-sectional survey investigating the desensitisation of graphic health warning labels and their impact on smokers, non-smokers and patients with COPD in a London cohort. BMJ Open 4, e004782 (2014).","journal-title":"BMJ Open"},{"key":"1063_CR19","doi-asserted-by":"crossref","unstructured":"Walters J. A., Turnock A. C., Walters E. H., Wood\u2010Baker R. Action plans with limited patient education only for exacerbations of chronic obstructive pulmonary disease. Cochrane Database of Systematic Reviews (2010).","DOI":"10.1002\/14651858.CD005074.pub3"},{"key":"1063_CR20","doi-asserted-by":"publisher","first-page":"1298","DOI":"10.1164\/rccm.200310-1443OC","volume":"169","author":"TM Wilkinson","year":"2004","unstructured":"Wilkinson, T. M. et al. Early therapy improves outcomes of exacerbations of chronic obstructive pulmonary disease. Am. J. Resp. Crit. Care Med. 169, 1298\u2013303 (2004).","journal-title":"Am. J. Resp. Crit. Care Med."},{"key":"1063_CR21","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1136\/thx.2010.156372","volume":"66","author":"JW Dodd","year":"2011","unstructured":"Dodd, J. W. et al. The COPD assessment test (CAT): response to pulmonary rehabilitation. A multicentre, prospective study. Thorax 66, 425\u201329 (2011).","journal-title":"Thorax"},{"key":"1063_CR22","doi-asserted-by":"publisher","first-page":"873","DOI":"10.1183\/09031936.00025214","volume":"44","author":"N Gupta","year":"2014","unstructured":"Gupta, N., Pinto, L. M., Morogan, A. & Bourbeau, J. The COPD assessment test: a systematic review. Eur. Resp. J. 44, 873\u201384 (2014).","journal-title":"Eur. Resp. J."},{"key":"1063_CR23","doi-asserted-by":"publisher","first-page":"648","DOI":"10.1183\/09031936.00102509","volume":"34","author":"P Jones","year":"2009","unstructured":"Jones, P. et al. Development and first validation of the COPD assessment test. Eur. Resp. J. 34, 648\u201354 (2009).","journal-title":"Eur. Resp. J."},{"key":"1063_CR24","unstructured":"GOLD. Global strategy for the diagnosis, management and prevention of COPD. Global Initiative for Chronic Obstructive Lung Disease (GOLD). https:\/\/goldcopd.org\/."},{"key":"1063_CR25","doi-asserted-by":"crossref","unstructured":"Hopkinson N. S., Molyneux A., Pink J., Harrisingh M. C. Chronic obstructive pulmonary disease: diagnosis and management: summary of updated NICE guidance. Bmj 366 (2019).","DOI":"10.1136\/bmj.l4486"},{"key":"1063_CR26","doi-asserted-by":"crossref","unstructured":"Chen T., Guestrin C. Xgboost: a scalable tree boosting system. Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining:785\u201394 (2016).","DOI":"10.1145\/2939672.2939785"},{"key":"1063_CR27","unstructured":"Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining."},{"key":"1063_CR28","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1080\/2159676X.2019.1628806","volume":"11","author":"V Braun","year":"2019","unstructured":"Braun, V. & Clarke, V. Reflecting on reflexive thematic analysis. Qualitative Res. Sport Exerc. Health 11, 589\u201397 (2019).","journal-title":"Qualitative Res. Sport Exerc. Health"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01063-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01063-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01063-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T18:48:29Z","timestamp":1713898109000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01063-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,12]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["1063"],"URL":"https:\/\/doi.org\/10.1038\/s41746-024-01063-2","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,12]]},"assertion":[{"value":"29 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"All authors were supported by the National Institute for Health Research (NIHR). TMAW is Chief Science Officer and cofounder of my mHealth, the developer of the myCOPD app. A.B. is a Senior Research Nurse and Clinical Trial Manager at my mHealth. A.K. is the Medical Director and Data Protection Officer at my mHealth. All other authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"66"}}