{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T08:35:35Z","timestamp":1774686935584,"version":"3.50.1"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2018,9,13]],"date-time":"2018-09-13T00:00:00Z","timestamp":1536796800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2018,9,13]],"date-time":"2018-09-13T00:00:00Z","timestamp":1536796800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digital Med"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Mobile health (mHealth) technology is increasingly being used, but academic evaluations supporting its use are not keeping pace. This is partly due to the disconnect between the traditional pharmaceutical approach to product evaluation, with its incremental approach, and the flexible way in which mHealth products are developed. An important step to addressing these problems lies in establishing agile research methods that complement the agile development methodologies used to create modern digital health applications. We describe an mHealth research model that mirrors traditional clinical research methods in its attention to safety and efficacy, while also accommodating the rapid and iterative development and evaluation required to produce effective, evidence-based, and sustainable digital products. This approach consists of a project identification stage followed by four phases of clinical evaluation: Phase 1: User Experience Design, Development, &amp; Alpha Testing; Phase 2: Beta testing; Phase 3: Clinical Trial Evaluation; and Phase 4: Post-Market Surveillance. These phases include sample gating questions and are adapted to accommodate the unique nature of digital product development.<\/jats:p>","DOI":"10.1038\/s41746-018-0053-1","type":"journal-article","created":{"date-parts":[[2018,9,6]],"date-time":"2018-09-06T15:07:01Z","timestamp":1536246421000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":102,"title":["Agile research to complement agile development: a proposal for an mHealth research lifecycle"],"prefix":"10.1038","volume":"1","author":[{"given":"Kumanan","family":"Wilson","sequence":"first","affiliation":[]},{"given":"Cameron","family":"Bell","sequence":"additional","affiliation":[]},{"given":"Lindsay","family":"Wilson","sequence":"additional","affiliation":[]},{"given":"Holly","family":"Witteman","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2018,9,13]]},"reference":[{"key":"53_CR1","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.7832","volume":"5","author":"R Robbins","year":"2017","unstructured":"Robbins, R., Krebs, P., Jagannathan, R., Jean-Louis, G. & Duncan, D. T. Health app use among US mobile phone users: analysis of trends by chronic disease status. JMIR mHealth uHealth 5, e197 (2017).","journal-title":"JMIR mHealth uHealth"},{"key":"53_CR2","volume-title":"J. Med. Internet Res.","author":"JK Carroll","year":"2017","unstructured":"Carroll, J. K. et al. Who uses mobile phone health apps and does use matter? a secondary data analytics approach. J. Med. Internet Res. 19, e125 (2017)."},{"key":"53_CR3","unstructured":"Market Research Reports. Digital Health Market Revenue of US$536. 6 bn by the end of 2025: Technology Advancement and Innovation - Press Release \u2013 Digital Journal. Market Research Reports (2017). http:\/\/www.digitaljournal.com\/pr\/3518555. (Accessed 20 Dec 2017)."},{"key":"53_CR4","doi-asserted-by":"publisher","first-page":"2010","DOI":"10.1056\/NEJMp1713180","volume":"377","author":"A Roess","year":"2017","unstructured":"Roess, A. The promise, growth, and reality of mobile health \u2014 another data-free zone. N. Engl. J. Med. 377, 2010\u20132011 (2017).","journal-title":"N. Engl. J. Med."},{"key":"53_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pmed.1001382","volume":"10","author":"M Tomlinson","year":"2013","unstructured":"Tomlinson, M., Rotheram-Borus, M. J., Swartz, L. & Tsai, A. C. Scaling up mHealth: where is the evidence? PLoS Med. 10, 1\u20135 (2013).","journal-title":"PLoS Med."},{"key":"53_CR6","doi-asserted-by":"publisher","DOI":"10.2196\/medinform.8207","volume":"5","author":"L Desveaux","year":"2017","unstructured":"Desveaux, L. et al. Examining tensions that affect the evaluation of technology in health care: considerations for system decision makers from the perspective of industry and evaluators. JMIR Med. Inform. 5, e50 (2017).","journal-title":"JMIR Med. Inform."},{"key":"53_CR7","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.5927","volume":"18","author":"SA Mummah","year":"2016","unstructured":"Mummah, S. A., Robinson, T. N., King, A. C., Gardner, C. D. & Sutton, S. IDEAS (integrate, design, assess, and share): a framework and toolkit of strategies for the development of more effective digital interventions to change health behavior. J. Med. Internet Res. 18, e317 (2016).","journal-title":"J. Med. Internet Res."},{"key":"53_CR8","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1923","volume":"13","author":"G Eysenbach","year":"2011","unstructured":"Eysenbach, G., CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J. Med. Internet Res. 13, e126 (2011).","journal-title":"J. Med. Internet Res."},{"key":"53_CR9","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.7291","volume":"5","author":"M Bradway","year":"2017","unstructured":"Bradway, M. et al. mHealth assessment: conceptualization of a global framework. JMIR mHealth uHealth 5, e60 (2017).","journal-title":"JMIR mHealth uHealth"},{"key":"53_CR10","unstructured":"FDA. Mobile medical applications: guidance for industry and food and drug administration staff. Food Drug Adm. 1\u20137 (2015)."},{"key":"53_CR11","unstructured":"U.S. Food and Drug Administration. Changes to Existing Medical Software Policies Resulting from Section 3060 of the 21 st Century Cures Act: Draft Guidance for Industry and Food and Drug Administration Staff. 1\u201314 (2017)."},{"key":"53_CR12","unstructured":"US Food and Drug Administration. Digital health innovation action plan. (2017)."},{"key":"53_CR13","unstructured":"Health Canada. Notice: Health Canada\u2019s Approach to Digital Health Technologies - Canada.ca. (2018). https:\/\/www.canada.ca\/en\/health-canada\/services\/drugs-health-products\/medical-devices\/activities\/announcements\/notice-digital-health-technologies.html..html. (Accessed 30 Apr 2018)."},{"key":"53_CR14","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1056\/NEJMhle1403384","volume":"371","author":"NG Cortez","year":"2014","unstructured":"Cortez, N. G., Cohen, I. G. & Kesselheim, A. S. FDA regulation of mobile health technologies. N. Engl. J. Med. 371, 372\u2013379 (2014).","journal-title":"N. Engl. J. Med."},{"key":"53_CR15","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1001\/jama.2018.8832","volume":"320","author":"J Shuren","year":"2018","unstructured":"Shuren, J., Patel, B. & Gottlieb, S. FDA regulation of mobile medical apps. JAMA 320, 337 (2018).","journal-title":"JAMA"},{"key":"53_CR16","unstructured":"US Food and Drug Administration. CDRH Reports - National Evaluation System for HealthTechnology (NEST). (2018). https:\/\/www.fda.gov\/aboutfda\/centersoffices\/officeofmedicalproductsandtobacco\/cdrh\/cdrhreports\/ucm301912.htm. (Accessed 30 Apr 2018)."},{"key":"53_CR17","doi-asserted-by":"crossref","unstructured":"Pocock, S. J. Clinical Trials: A Practical Approach. (John Wiley and Sons Inc.: Chichester, UK 2013).","DOI":"10.1002\/9781118793916"},{"key":"53_CR18","doi-asserted-by":"publisher","first-page":"1213","DOI":"10.1016\/j.jss.2012.02.033","volume":"85","author":"T Dings\u00f8yr","year":"2012","unstructured":"Dings\u00f8yr, T., Nerur, S., Balijepally, V. & Moe, N. B. A decade of agile methodologies: towards explaining agile software development. J. Syst. Softw. 85, 1213\u20131221 (2012).","journal-title":"J. Syst. Softw."},{"key":"53_CR19","unstructured":"Beck, K. et al. Principles behind the Agile Manifesto. The Agile Manifesto (2001). http:\/\/agilemanifesto.org\/iso\/en\/principles.html. (Accessed 20 Dec 2017)."},{"key":"53_CR20","unstructured":"US Food and Drug Administration. The Device Development Process. Learn about Drug and Device Approvals (2018). https:\/\/www.fda.gov\/ForPatients\/Approvals\/Devices\/default.htm. (Accessed 30 Apr 2018)."},{"key":"53_CR21","unstructured":"Apple Developer. App Store Review Guidelines. https:\/\/developer.apple.com\/app-store\/review\/guidelines\/. (Accessed 12 June 2018)."},{"key":"53_CR22","doi-asserted-by":"publisher","DOI":"10.1186\/2046-4053-4-11","volume":"4","author":"HO Witteman","year":"2015","unstructured":"Witteman, H. O. et al. User-centered design and the development of patient decision aids: protocol for a systematic review. Syst. Rev. 4, 11 (2015).","journal-title":"Syst. Rev."},{"key":"53_CR23","unstructured":"Caldwell, B., Cooper, M., Reid, L. & Vanderheiden, G. Web Content Accessibility Guidelines (WCAG) 2.0. W3C Recommendation (2008). https:\/\/www.w3. org\/TR\/WCAG20\/. (Accessed 20 Dec 2017)."},{"key":"53_CR24","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1177\/109467050024001","volume":"2","author":"A Parasuraman","year":"2000","unstructured":"Parasuraman, A. Technology Readiness Index (TRI): a multiple-item scale to measure readiness to embrace new technologies. J. Serv. Res. 2, 307\u2013320 (2000).","journal-title":"J. Serv. Res."},{"key":"53_CR25","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1177\/1094670514539730","volume":"18","author":"A Parasuraman","year":"2015","unstructured":"Parasuraman, A. & Colby, C. L. An updated and streamlined technology readiness index. J. Serv. Res. 18, 59\u201374 (2015).","journal-title":"J. Serv. Res."},{"key":"53_CR26","unstructured":"World Health Organization. WHO | Medical Device \u2013 Full Definition. WHO (2013). http:\/\/www.who.int\/medical_devices\/full_deffinition\/en\/. (Accessed 20 Dec 2017)."},{"key":"53_CR27","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1038\/s41746-018-0021-9","volume":"1","author":"O Byambasuren","year":"2018","unstructured":"Byambasuren, O., Sanders, S., Beller, E. & Glasziou, P. Prescribable mHealth apps identified from an overview of systematic reviews. npj Digit. Med. 1, 12 (2018).","journal-title":"npj Digit. Med."},{"key":"53_CR28","unstructured":"Kohavi, R. & Thomke, S. The Surprising Power of Online Experiments. Harvard Business Review (2017). https:\/\/hbr.org\/2017\/09\/the-surprising-power-of-online-experiments. (Accessed 26 July 2018)."},{"key":"53_CR29","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1056\/NEJMra1510061","volume":"375","author":"DL Bhatt","year":"2016","unstructured":"Bhatt, D. L. & Mehta, C. Adaptive designs for clinical trials. N. Engl. J. Med. 375, 65\u201374 (2016).","journal-title":"N. Engl. J. Med."},{"key":"53_CR30","doi-asserted-by":"publisher","first-page":"634","DOI":"10.1177\/1740774515597222","volume":"12","author":"PH Lin","year":"2015","unstructured":"Lin, P.-H. et al. Adaptive intervention design in mobile health: intervention design and development in the Cell Phone Intervention for You trial. Clin. Trials J. Soc. Clin. Trials 12, 634\u2013645 (2015).","journal-title":"Clin. Trials J. Soc. Clin. Trials"},{"key":"53_CR31","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-018-1017-7","volume":"16","author":"P Pallmann","year":"2018","unstructured":"Pallmann, P. et al. Adaptive designs in clinical trials: why use them, and how to run and report them. BMC Med. 16, 29 (2018).","journal-title":"BMC Med."},{"key":"53_CR32","doi-asserted-by":"crossref","unstructured":"Ambler S.W. Agile Software Development at Scale. In: Meyer B., Nawrocki J.R., Walter B. (eds) Balancing Agility and Formalismin Software Engineering. CEE-SET 2007. Lecture Notes in Computer Science, vol 5082. Springer, Berlin, Heidelberg (2008).","DOI":"10.1007\/978-3-540-85279-7_1"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0053-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0053-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0053-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,21]],"date-time":"2022-12-21T12:42:31Z","timestamp":1671626551000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0053-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,13]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,12]]}},"alternative-id":["53"],"URL":"https:\/\/doi.org\/10.1038\/s41746-018-0053-1","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,9,13]]},"assertion":[{"value":"17 January 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 August 2018","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 August 2018","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 September 2018","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"46"}}