{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T02:13:09Z","timestamp":1792462389043,"version":"4.5.0"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,6,23]],"date-time":"2021-06-23T00:00:00Z","timestamp":1624406400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000026","name":"National Institute on Drug Abuse","doi-asserted-by":"publisher","award":["P30DA029926"],"award-info":[{"award-number":["P30DA029926"]}],"id":[{"id":"10.13039\/100000026","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,6,23]]},"abstract":"<jats:p>Just-In-Time Adaptive Intervention (JITAI) is an emerging technique with great potential to support health behavior by providing the right type and amount of support at the right time. A crucial aspect of JITAIs is properly timing the delivery of interventions, to ensure that a user is receptive and ready to process and use the support provided. Some prior works have explored the association of context and some user-specific traits on receptivity, and have built post-study machine-learning models to detect receptivity. For effective intervention delivery, however, a JITAI system needs to make in-the-moment decisions about a user's receptivity. To this end, we conducted a study in which we deployed machine-learning models to detect receptivity in the natural environment, i.e., in free-living conditions.<\/jats:p>\n                  <jats:p>We leveraged prior work regarding receptivity to JITAIs and deployed a chatbot-based digital coach - Ally - that provided physical-activity interventions and motivated participants to achieve their step goals. We extended the original Ally app to include two types of machine-learning model that used contextual information about a person to predict when a person is receptive: a static model that was built before the study started and remained constant for all participants and an adaptive model that continuously learned the receptivity of individual participants and updated itself as the study progressed. For comparison, we included a control model that sent intervention messages at random times. The app randomly selected a delivery model for each intervention message. We observed that the machine-learning models led up to a 40% improvement in receptivity as compared to the control model. Further, we evaluated the temporal dynamics of the different models and observed that receptivity to messages from the adaptive model increased over the course of the study.<\/jats:p>","DOI":"10.1145\/3463492","type":"journal-article","created":{"date-parts":[[2021,6,24]],"date-time":"2021-06-24T12:29:19Z","timestamp":1624537759000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":80,"title":["Detecting Receptivity for mHealth Interventions in the Natural Environment"],"prefix":"10.1145","volume":"5","author":[{"given":"Varun","family":"Mishra","sequence":"first","affiliation":[{"name":"Dartmouth College"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Florian","family":"K\u00fcnzler","sequence":"additional","affiliation":[{"name":"ETH Z\u00fcrich"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan-Niklas","family":"Kramer","sequence":"additional","affiliation":[{"name":"University of St. Gallen"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elgar","family":"Fleisch","sequence":"additional","affiliation":[{"name":"ETH Z\u00fcrich, University of St. Gallen"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tobias","family":"Kowatsch","sequence":"additional","affiliation":[{"name":"ETH Z\u00fcrich, University of St. Gallen, National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Kotz","sequence":"additional","affiliation":[{"name":"Dartmouth College"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,6,24]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"https:\/\/developer.apple.com\/documentation\/coreml. [Online","author":"ML.","year":"2020","unstructured":"Apple. 2020. Core ML. https:\/\/developer.apple.com\/documentation\/coreml. [Online ; accessed 04- February - 2020 ]. Apple. 2020. CoreML. https:\/\/developer.apple.com\/documentation\/coreml. [Online; accessed 04-February-2020]."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124881"},{"key":"e_1_2_1_3_1","volume-title":"Enhancement of care through self-monitoring and tailored feedback via text messaging and their use in the treatment of childhood overweight. Patient education and counseling 79, 3","author":"Bauer Stephanie","year":"2010","unstructured":"Stephanie Bauer , Judith de Niet , Reinier Timman , and Hans Kordy . 2010. Enhancement of care through self-monitoring and tailored feedback via text messaging and their use in the treatment of childhood overweight. Patient education and counseling 79, 3 ( 2010 ), 315--319. Stephanie Bauer, Judith de Niet, Reinier Timman, and Hans Kordy. 2010. Enhancement of care through self-monitoring and tailored feedback via text messaging and their use in the treatment of childhood overweight. Patient education and counseling 79, 3 (2010), 315--319."},{"key":"e_1_2_1_4_1","volume-title":"acceptability, and preliminary efficacy of a smartphone intervention for schizophrenia. Schizophrenia bulletin 40, 6","author":"Ben-Zeev Dror","year":"2014","unstructured":"Dror Ben-Zeev , Christopher J Brenner , Mark Begale , Jennifer Duffecy , David C Mohr , and Kim T Mueser . 2014. Feasibility , acceptability, and preliminary efficacy of a smartphone intervention for schizophrenia. Schizophrenia bulletin 40, 6 ( 2014 ), 1244--1253. Dror Ben-Zeev, Christopher J Brenner, Mark Begale, Jennifer Duffecy, David C Mohr, and Kim T Mueser. 2014. Feasibility, acceptability, and preliminary efficacy of a smartphone intervention for schizophrenia. Schizophrenia bulletin 40, 6 (2014), 1244--1253."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328910"},{"key":"e_1_2_1_7_1","volume-title":"https:\/\/github.com\/KevinCoble\/AIToolbox. [Online","author":"Coble Kevin","year":"2020","unstructured":"Kevin Coble . 2020. AIToolBox. https:\/\/github.com\/KevinCoble\/AIToolbox. [Online ; accessed 04- February - 2020 ; Git commit bada633]. Kevin Coble. 2020. AIToolBox. https:\/\/github.com\/KevinCoble\/AIToolbox. [Online; accessed 04-February-2020; Git commit bada633]."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357335"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098279.3098565"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/WTS.2015.7117255"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2037373.2037402"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.3390\/jpm4030412"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2013.4642"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055100"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807526"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/10810730.2017.1303556"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 5, 1, Article 19 (March","author":"Koch Kevin","year":"2021","unstructured":"Kevin Koch , Varun Mishra , Shu Liu , Thomas Berger , Elgar Fleisch , David Kotz , and Felix Wortmann . 2021 . When Do Drivers Interact with In-vehicle Well-being Interventions? An Exploratory Analysis of a Longitudinal Study on Public Roads . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 5, 1, Article 19 (March 2021), 30 pages. https:\/\/doi.org\/10.1145\/3448116 10.1145\/3448116 Kevin Koch, Varun Mishra, Shu Liu, Thomas Berger, Elgar Fleisch, David Kotz, and Felix Wortmann. 2021. When Do Drivers Interact with In-vehicle Well-being Interventions? An Exploratory Analysis of a Longitudinal Study on Public Roads. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 5, 1, Article 19 (March 2021), 30 pages. https:\/\/doi.org\/10.1145\/3448116"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-59144-5_36"},{"key":"e_1_2_1_19_1","volume-title":"Investigating intervention components and exploring states of receptivity for a smartphone app to promote physical activity: protocol of a microrandomized trial. JMIR research protocols 8, 1","author":"Kramer Jan-Niklas","year":"2019","unstructured":"Jan-Niklas Kramer , Florian K\u00fcnzler , Varun Mishra , Bastien Presset , David Kotz , Shawna Smith , Urte Scholz , and Tobias Kowatsch . 2019. Investigating intervention components and exploring states of receptivity for a smartphone app to promote physical activity: protocol of a microrandomized trial. JMIR research protocols 8, 1 ( 2019 ), e11540. Jan-Niklas Kramer, Florian K\u00fcnzler, Varun Mishra, Bastien Presset, David Kotz, Shawna Smith, Urte Scholz, and Tobias Kowatsch. 2019. Investigating intervention components and exploring states of receptivity for a smartphone app to promote physical activity: protocol of a microrandomized trial. JMIR research protocols 8, 1 (2019), e11540."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1093\/abm\/kaaa002"},{"key":"e_1_2_1_21_1","volume-title":"Wireless and Mobile Computing, Networking and Communications (WiMob)","author":"K\u00fcnzler Florian","unstructured":"Florian K\u00fcnzler , Jan-Niklas Kramer , and Tobias Kowatsch . 2017. Efficacy of mobile context-aware notification management systems: A systematic literature review and meta-analysis . In Wireless and Mobile Computing, Networking and Communications (WiMob) . IEEE , 131--138. Florian K\u00fcnzler, Jan-Niklas Kramer, and Tobias Kowatsch. 2017. Efficacy of mobile context-aware notification management systems: A systematic literature review and meta-analysis. In Wireless and Mobile Computing, Networking and Communications (WiMob). IEEE, 131--138."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369805"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1161\/JAHA.115.002239"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2638728.2638759"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3131901","article-title":"Understanding the role of places and activities on mobile phone interaction and usage patterns","volume":"1","author":"Mehrotra Abhinav","year":"2017","unstructured":"Abhinav Mehrotra , Sandrine R M\u00fcller , Gabriella M Harari , Samuel D Gosling , Cecilia Mascolo , Mirco Musolesi , and Peter J Rentfrow . 2017 . Understanding the role of places and activities on mobile phone interaction and usage patterns . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1 , 3 (2017), 1 -- 22 . Abhinav Mehrotra, Sandrine R M\u00fcller, Gabriella M Harari, Samuel D Gosling, Cecilia Mascolo, Mirco Musolesi, and Peter J Rentfrow. 2017. Understanding the role of places and activities on mobile phone interaction and usage patterns. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1--22.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807544"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858566"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123024.3124571"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432220"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0169162"},{"key":"e_1_2_1_31_1","volume-title":"S","author":"Nahum-Shani Inbal","year":"2015","unstructured":"Inbal Nahum-Shani , Eric B Hekler , and Donna Spruijt-Metz . 2015. Building health behavior models to guide the development of just-in-time adaptive interventions: A pragmatic framework. Health Psychology 34 , S ( 2015 ), 1209. Inbal Nahum-Shani, Eric B Hekler, and Donna Spruijt-Metz. 2015. Building health behavior models to guide the development of just-in-time adaptive interventions: A pragmatic framework. Health Psychology 34, S (2015), 1209."},{"key":"e_1_2_1_32_1","volume-title":"Just-in-Time Adaptive Interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine","author":"Nahum-Shani Inbal","year":"2016","unstructured":"Inbal Nahum-Shani , Shawna N Smith , Bonnie J Spring , Linda M Collins , Katie Witkiewitz , Ambuj Tewari , and Susan A Murphy . 2016. Just-in-Time Adaptive Interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine ( 2016 ), 1-17 Inbal Nahum-Shani, Shawna N Smith, Bonnie J Spring, Linda M Collins, Katie Witkiewitz, Ambuj Tewari, and Susan A Murphy. 2016. Just-in-Time Adaptive Interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine (2016), 1-17"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807517"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOM.2017.7917856"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2632062"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130956"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804252"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.3200\/JACH.57.2.245-248"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2636082"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369835"},{"key":"e_1_2_1_41_1","volume-title":"An instance level analysis of data complexity. Machine Learning 95, 2 (01","author":"Smith Michael R.","year":"2014","unstructured":"Michael R. Smith , Tony Martinez , and Christophe Giraud-Carrier . 2014. An instance level analysis of data complexity. Machine Learning 95, 2 (01 May 2014 ), 225--256. https:\/\/doi.org\/10.1007\/s10994-013-5422-z 10.1007\/s10994-013-5422-z Michael R. Smith, Tony Martinez, and Christophe Giraud-Carrier. 2014. An instance level analysis of data complexity. Machine Learning 95, 2 (01 May 2014), 225--256. https:\/\/doi.org\/10.1007\/s10994-013-5422-z"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968308"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2019.03.001"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing","author":"Wang Rui","unstructured":"Rui Wang , Min S. H. Aung , Saeed Abdullah , Rachel Brian , Andrew T. Campbell , Tanzeem Choudhury , Marta Hauser , John Kane , Michael Merrill , Emily A. Scherer, and et al. 2016. CrossCheck: Toward Passive Sensing and Detection of Mental Health Changes in People with Schizophrenia . In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing ( Heidelberg, Germany) (UbiComp '16). ACM, New York, NY, USA, 886--897. https:\/\/doi.org\/10.1145\/2971648.2971740 10.1145\/2971648.2971740 Rui Wang, Min S. H. Aung, Saeed Abdullah, Rachel Brian, Andrew T. Campbell, Tanzeem Choudhury, Marta Hauser, John Kane, Michael Merrill, Emily A. Scherer, and et al. 2016. CrossCheck: Toward Passive Sensing and Detection of Mental Health Changes in People with Schizophrenia. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Heidelberg, Germany) (UbiComp '16). ACM, New York, NY, USA, 886--897. https:\/\/doi.org\/10.1145\/2971648.2971740"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing","author":"Wang Rui","year":"2048","unstructured":"Rui Wang , Fanglin Chen , Zhenyu Chen , Tianxing Li , Gabriella Harari , Stefanie Tignor , Xia Zhou , Dror Ben-Zeev , and Andrew T. Campbell . 2014. StudentLife: Assessing Mental Health, Academic Performance and Behavioral Trends of College Students Using Smartphones . In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing ( Seattle, Washington) (UbiComp '14). ACM, New York, NY, USA, 3--14. https:\/\/doi.org\/10.1145\/263 2048 .2632054 10.1145\/2632048.2632054 Rui Wang, Fanglin Chen, Zhenyu Chen, Tianxing Li, Gabriella Harari, Stefanie Tignor, Xia Zhou, Dror Ben-Zeev, and Andrew T. Campbell. 2014. StudentLife: Assessing Mental Health, Academic Performance and Behavioral Trends of College Students Using Smartphones. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Seattle, Washington) (UbiComp '14). ACM, New York, NY, USA, 3--14. https:\/\/doi.org\/10.1145\/2632048.2632054"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2892383"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3463492","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3463492","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:31:28Z","timestamp":1750181488000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3463492"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,23]]},"references-count":46,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,6,23]]}},"alternative-id":["10.1145\/3463492"],"URL":"https:\/\/doi.org\/10.1145\/3463492","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,23]]},"assertion":[{"value":"2021-06-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}