{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:34:56Z","timestamp":1750221296516,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":34,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,8,15]],"date-time":"2018-08-15T00:00:00Z","timestamp":1534291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["CMMI-1434401","IIS-1423056","CNS-1405985","IIS-1718853"],"award-info":[{"award-number":["CMMI-1434401","IIS-1423056","CNS-1405985","IIS-1718853"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"NSF CAREER grant","award":["IIS-1553687"],"award-info":[{"award-number":["IIS-1553687"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,8,15]]},"DOI":"10.1145\/3233547.3233553","type":"proceedings-article","created":{"date-parts":[[2018,8,24]],"date-time":"2018-08-24T12:05:17Z","timestamp":1535112317000},"page":"482-491","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Cohesion-driven Online Actor-Critic Reinforcement Learning for mHealth Intervention"],"prefix":"10.1145","author":[{"given":"Feiyun","family":"Zhu","sequence":"first","affiliation":[{"name":"The University of Texas at Arlington, Arlington, TX, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peng","family":"Liao","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinliang","family":"Zhu","sequence":"additional","affiliation":[{"name":"The University of Texas at Arlington, Arlington, TX, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiawen","family":"Yao","sequence":"additional","affiliation":[{"name":"The University of Texas at Arlington, Arlington, TX, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junzhou","family":"Huang","sequence":"additional","affiliation":[{"name":"The University of Texas at Arlington; Tencent AI Lab, Arlington, TX, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,8,15]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Harnessing different motivational frames via mobile phones to promote daily physical activity and reduce sedentary behavior in aging adults. Plos ONE","author":"Abby King","year":"2013","unstructured":"King Abby , Hekler Eric , Grieco Lauren , Winter Sandra , Sheats Jylana , Buman Matthew , ..., and Cirimele Jesse . 2013. Harnessing different motivational frames via mobile phones to promote daily physical activity and reduce sedentary behavior in aging adults. Plos ONE Vol. 8 ( 2013 ). King Abby, Hekler Eric, Grieco Lauren, Winter Sandra, Sheats Jylana, Buman Matthew, ..., and Cirimele Jesse . 2013. Harnessing different motivational frames via mobile phones to promote daily physical activity and reduce sedentary behavior in aging adults. Plos ONE Vol. 8 (2013)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_2_1","DOI":"10.1145\/1835804.1835817"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_3_1","DOI":"10.1145\/1014052.1016912"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_4_1","DOI":"10.1037\/a0028030"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_5_1","DOI":"10.1007\/s10488-012-0424-x"},{"unstructured":"Alexandra Carpentier and Michal Valko . 2016. Revealing Graph Bandits for Maximizing Local Influence AISTATS. 10--18.  Alexandra Carpentier and Michal Valko . 2016. Revealing Graph Bandits for Maximizing Local Influence AISTATS. 10--18.","key":"e_1_3_2_1_6_1"},{"unstructured":"Nicol\u00f2 Cesa-Bianchi Claudio Gentile and Giovanni Zappella . 2013. A Gang of Bandits NIPS. 737--745.   Nicol\u00f2 Cesa-Bianchi Claudio Gentile and Giovanni Zappella . 2013. A Gang of Bandits NIPS. 737--745.","key":"e_1_3_2_1_7_1"},{"key":"e_1_3_2_1_8_1","first-page":"6","article-title":"Randomised trials for the Fitbit generation","volume":"12","author":"Dempsey Walter","year":"2016","unstructured":"Walter Dempsey , Peng Liao , Pedja Klasnja , Inbal Nahum-Shani , and Susan A. Murphy . 2016 . Randomised trials for the Fitbit generation . Significance , Vol. 12 , 6 (Dec . 2016), 20 -- 23. Walter Dempsey, Peng Liao, Pedja Klasnja, Inbal Nahum-Shani, and Susan A. Murphy . 2016. Randomised trials for the Fitbit generation. Significance, Vol. 12, 6 (Dec . 2016), 20 -- 23.","journal-title":"Significance"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_9_1","DOI":"10.1097\/NMD.0b013e3181f49ea3"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_10_1","DOI":"10.3945\/ajcn.2008.26911"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_11_1","DOI":"10.1016\/j.socscimed.2012.02.009"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_12_1","DOI":"10.1109\/TNNLS.2013.2247418"},{"unstructured":"Claudio Gentile Shuai Li and Giovanni Zappella . 2014. Online Clustering of Bandits. In ICML. 757--765.   Claudio Gentile Shuai Li and Giovanni Zappella . 2014. Online Clustering of Bandits. In ICML. 757--765.","key":"e_1_3_2_1_13_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_14_1","DOI":"10.1109\/TSMCC.2012.2218595"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_15_1","DOI":"10.1001\/jamapsychiatry.2013.4642"},{"key":"e_1_3_2_1_16_1","volume-title":"Delinquent peers revisited: Does network structure matter? American journal of sociology","author":"Haynie D. L.","year":"2001","unstructured":"D. L. Haynie . 2001. Delinquent peers revisited: Does network structure matter? American journal of sociology Vol. 106 , 4 ( 2001 ), 1013 -- 1057. D. L. Haynie . 2001. Delinquent peers revisited: Does network structure matter? American journal of sociology Vol. 106, 4 (2001), 1013 -- 1057."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_17_1","DOI":"10.1007\/978-3-642-29946-9_13"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_18_1","DOI":"10.1145\/1553374.1553442"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_19_1","DOI":"10.5555\/945365.964290"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_20_1","DOI":"10.1016\/j.cam.2003.10.010"},{"unstructured":"Huitian Lei A. Tewari and Susan Murphy . 2014. An Actor-Critic Contextual Bandit Algorithm for Personalized Interventions using Mobile Devices NIPS 2014 Workshop: Personalization: Methods and Applications. 1--9.  Huitian Lei A. Tewari and Susan Murphy . 2014. An Actor-Critic Contextual Bandit Algorithm for Personalized Interventions using Mobile Devices NIPS 2014 Workshop: Personalization: Methods and Applications. 1--9.","key":"e_1_3_2_1_21_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_22_1","DOI":"10.1145\/1772690.1772758"},{"key":"e_1_3_2_1_23_1","volume-title":"Prediction models for network-linked data. CoRR","author":"Li Tianxi","year":"2016","unstructured":"Tianxi Li , Elizaveta Levina , and Ji Zhu . 2016. Prediction models for network-linked data. CoRR Vol. abs\/ 1602 .01192 (February . 2016 ). Tianxi Li, Elizaveta Levina, and Ji Zhu . 2016. Prediction models for network-linked data. CoRR Vol. abs\/1602.01192 (February . 2016)."},{"key":"e_1_3_2_1_24_1","volume-title":"Constructing Just-in-Time Adaptive Interventions. Phd Section Proposal","author":"Liao Peng","year":"2015","unstructured":"Peng Liao , A. Tewari , and Susan Murphy . 2015. Constructing Just-in-Time Adaptive Interventions. Phd Section Proposal ( 2015 ), 1--49. Peng Liao, A. Tewari, and Susan Murphy . 2015. Constructing Just-in-Time Adaptive Interventions. Phd Section Proposal (2015), 1--49."},{"key":"e_1_3_2_1_25_1","volume-title":"Richard S. Sutton, and Katie Witkiewitz .","author":"Murphy Susan A.","year":"2016","unstructured":"Susan A. Murphy , Yanzhen Deng , Eric B. Laber , Hamid Reza Maei , Richard S. Sutton, and Katie Witkiewitz . 2016 . A Batch, Off- Policy , Actor-Critic Algorithm for Optimizing the Average Reward. CoRR Vol . abs\/1607.05047 (2016). Susan A. Murphy, Yanzhen Deng, Eric B. Laber, Hamid Reza Maei, Richard S. Sutton, and Katie Witkiewitz . 2016. A Batch, Off-Policy, Actor-Critic Algorithm for Optimizing the Average Reward. CoRR Vol. abs\/1607.05047 (2016)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_26_1","DOI":"10.2196\/jmir.1100"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_27_1","DOI":"10.1145\/775047.775086"},{"key":"e_1_3_2_1_28_1","volume-title":"Pedersen","author":"Petersen Kaare B.","year":"2012","unstructured":"Kaare B. Petersen and Michael S . Pedersen . 2012 . The Matrix Cookbook . Kaare B. Petersen and Michael S. Pedersen . 2012. The Matrix Cookbook."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_29_1","DOI":"10.1145\/1390156.1390265"},{"key":"e_1_3_2_1_30_1","volume-title":"Barto","author":"Sutton Richard S.","year":"2012","unstructured":"Richard S. Sutton and Andrew G . Barto . 2012 . Reinforcement Learning : An Introduction (bibinfoedition2nd ed.). MIT Press , Cambridge, MA, USA. Richard S. Sutton and Andrew G. Barto . 2012. Reinforcement Learning: An Introduction (bibinfoedition2nd ed.). MIT Press, Cambridge, MA, USA."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_31_1","DOI":"10.1007\/s11222-007-9033-z"},{"key":"e_1_3_2_1_32_1","volume-title":"Development and evaluation of a mobile intervention for heavy drinking and smoking among college studen. Psychology of Addictive Behaviors","author":"Witkiewitz K.","year":"2014","unstructured":"K. Witkiewitz , S.A. Desai , S. Bowen , ... B.C. Leigh , and M.E. Larimer . 2014. Development and evaluation of a mobile intervention for heavy drinking and smoking among college studen. Psychology of Addictive Behaviors Vol. 28 , 3 ( 2014 ). K. Witkiewitz, S.A. Desai, S. Bowen, ... B.C. Leigh, and M.E. Larimer . 2014. Development and evaluation of a mobile intervention for heavy drinking and smoking among college studen. Psychology of Addictive Behaviors Vol. 28, 3 (2014)."},{"unstructured":"Feiyun Zhu Jun Guo Zheng Xu Peng Liao and Junzhou Huang . 2018. Group-driven Reinforcement Learning for Personalized mHealth Intervention International Conference on Medical Image Computing and Computer Assisted Intervention.  Feiyun Zhu Jun Guo Zheng Xu Peng Liao and Junzhou Huang . 2018. Group-driven Reinforcement Learning for Personalized mHealth Intervention International Conference on Medical Image Computing and Computer Assisted Intervention.","key":"e_1_3_2_1_33_1"},{"key":"e_1_3_2_1_34_1","volume-title":"The Multidisciplinary Conference on. Reinforcement Learning and Decision Making.","author":"Zhu Feiyun","year":"2017","unstructured":"Feiyun Zhu and Peng Liao . 2017 . Effective warm start for the online actor-critic reinforcement learning based mhealth intervention . In The Multidisciplinary Conference on. Reinforcement Learning and Decision Making. Feiyun Zhu and Peng Liao . 2017. Effective warm start for the online actor-critic reinforcement learning based mhealth intervention. In The Multidisciplinary Conference on. Reinforcement Learning and Decision Making."}],"event":{"sponsor":["SIGBio ACM Special Interest Group on Bioinformatics"],"acronym":"BCB '18","name":"BCB '18: 9th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics","location":"Washington DC USA"},"container-title":["Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3233547.3233553","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3233547.3233553","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3233547.3233553","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:13:12Z","timestamp":1750212792000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3233547.3233553"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,15]]},"references-count":34,"alternative-id":["10.1145\/3233547.3233553","10.1145\/3233547"],"URL":"https:\/\/doi.org\/10.1145\/3233547.3233553","relation":{},"subject":[],"published":{"date-parts":[[2018,8,15]]},"assertion":[{"value":"2018-08-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}