{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T06:37:08Z","timestamp":1781591828904,"version":"3.54.5"},"reference-count":48,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2019,11,13]],"date-time":"2019-11-13T00:00:00Z","timestamp":1573603200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Data Science"],"published-print":{"date-parts":[[2020,11,11]]},"abstract":"<jats:p>The mobile ecosystem is dramatically growing towards an unprecedented scale, with an extremely crowded market and fierce competition among app developers. Today, keeping users engaged with a mobile app is key for its success since users can remain active consumers of services and\/or producers of new contents. However, users may abandon a mobile app at any time due to various reasons, e.g., the success of competing apps, decrease of interest in the provided services, etc. In this context, predicting when a user may get disengaged from an app is an invaluable resource for developers, creating the opportunity to apply intervention strategies aiming at recovering from disengagement (e.g., sending push notifications with new contents).In this study, we aim at providing evidence that predicting when mobile app users get disengaged is possible with a good level of accuracy. Specifically, we propose, apply, and evaluate a framework to model and predict User Engagement (UE) in mobile applications via different numerical models. The proposed framework is composed of an optimized agglomerative hierarchical clustering model coupled to (i) a Cox proportional hazards, (ii) a negative binomial, (iii) a random forest, and (iv) a boosted-tree model. The proposed framework is empirically validated by means of a year-long observational dataset collected from a real deployment of a waste recycling app. Our results show that in this context the optimized clustering model classifies users adequately and improves UE predictability for all numerical models. Also, the highest levels of prediction accuracy and robustness are obtained by applying either the random forest classifier or the boosted-tree algorithm.<\/jats:p>","DOI":"10.3233\/ds-190027","type":"journal-article","created":{"date-parts":[[2019,11,13]],"date-time":"2019-11-13T08:14:56Z","timestamp":1573632896000},"page":"61-77","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":17,"title":["Modelling and predicting User Engagement in mobile applications"],"prefix":"10.1177","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7878-2514","authenticated-orcid":false,"given":"Eduardo","family":"Barbaro","sequence":"first","affiliation":[{"name":"IBM, Cognitive and Analytics Benelux \u2013 Global Business Services, The Netherlands"},{"name":"Mobiquity Inc., Global Analytics Group, The Netherlands."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5471-4338","authenticated-orcid":false,"given":"Eoin Martino","family":"Grua","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Vrije Universiteit Amsterdam, The Netherlands."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5773-8346","authenticated-orcid":false,"given":"Ivano","family":"Malavolta","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Vrije Universiteit Amsterdam, The Netherlands."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9847-2959","authenticated-orcid":false,"given":"Mirjana","family":"Stercevic","sequence":"additional","affiliation":[{"name":"Mobiquity Inc., Global Analytics Group, The Netherlands."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1940-0800","authenticated-orcid":false,"given":"Esther","family":"Weusthof","sequence":"additional","affiliation":[{"name":"Mobiquity Inc., Global Analytics Group, The Netherlands."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4529-137X","authenticated-orcid":false,"given":"Jeroen","family":"van den Hoven","sequence":"additional","affiliation":[{"name":"Mobiquity Inc., Global Analytics Group, The Netherlands."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2019,11,13]]},"reference":[{"key":"ref001","unstructured":"L.Anderlucci, Comparing different approaches for clustering categorical data, PhD thesis, University of Bologna, 2012. http:\/\/amsdottorato.unibo.it\/id\/eprint\/4302."},{"key":"ref002","unstructured":"Android, Android developer portal, 2017. http:\/\/developer.android.com\/about\/index.html."},{"key":"ref003","doi-asserted-by":"publisher","DOI":"10.3390\/informatics4010005"},{"key":"ref004","unstructured":"S.Attfield, M.Lalmas and B.Piwowarski, Towards a science of user engagement (Position Paper), in: WSDM Workshop on User Modelling for Web Applications, 2011. https:\/\/eprints.mdx.ac.uk\/id\/eprint\/8642."},{"key":"ref005","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-10-20"},{"key":"ref006","doi-asserted-by":"publisher","DOI":"10.1109\/SpliTech.2016.7555951"},{"key":"ref007","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"ref008","doi-asserted-by":"publisher","DOI":"10.1214\/009053606000000092"},{"key":"ref009","doi-asserted-by":"publisher","DOI":"10.1214\/07-STS242"},{"key":"ref010","doi-asserted-by":"publisher","DOI":"10.1198\/016214503000125"},{"key":"ref011","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2058"},{"key":"ref012","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2018.06.032"},{"key":"ref013","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"ref014","unstructured":"T.Chen and T.He, Higgs boson discovery with boosted trees, in: NIPS 2014 Workshop on High-Energy Physics and Machine Learning, 2015, pp. 69\u201380. http:\/\/proceedings.mlr.press\/v42\/chen14.html."},{"key":"ref015","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1972.tb00899.x"},{"key":"ref016","doi-asserted-by":"publisher","DOI":"10.1201\/9781315137438"},{"key":"ref017","doi-asserted-by":"publisher","DOI":"10.1007\/BF01890115"},{"key":"ref018","doi-asserted-by":"publisher","DOI":"10.13140\/RG.2.2.15294.48968"},{"key":"ref019","doi-asserted-by":"publisher","DOI":"10.1145\/2347736.2347755"},{"key":"ref020","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2005.10.010"},{"key":"ref021","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31865-1_25"},{"key":"ref022","doi-asserted-by":"publisher","DOI":"10.2307\/2528823"},{"key":"ref023","doi-asserted-by":"publisher","DOI":"10.1111\/j.0006-341X.2000.00337.x"},{"key":"ref024","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9876.2012.01066.x"},{"key":"ref025","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2013.07.002"},{"key":"ref026","doi-asserted-by":"publisher","DOI":"10.1504\/IJGENVI.2003.003935"},{"key":"ref027","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31454-4_14"},{"key":"ref028","unstructured":"A.Lella and A.Lipsman, The 2016 U.S. mobile app report, comsCore white paper, 2016. https:\/\/www.comscore.com\/Insights\/Presentations-and-Whitepapers\/2016\/The-2016-US-Mobile-App-Report."},{"issue":"3","key":"ref029","first-page":"18","volume":"2","author":"Liaw A.","year":"2002","journal-title":"R News"},{"key":"ref030","doi-asserted-by":"publisher","DOI":"10.1890\/10-1831.1"},{"key":"ref031","doi-asserted-by":"publisher","DOI":"10.4236\/jcc.2015.36009"},{"key":"ref032","doi-asserted-by":"publisher","DOI":"10.1007\/s12649-012-9119-5"},{"key":"ref033","doi-asserted-by":"publisher","DOI":"10.1145\/2371574.2371576"},{"key":"ref034","doi-asserted-by":"publisher","DOI":"10.1145\/3185153"},{"key":"ref035","doi-asserted-by":"publisher","DOI":"10.1007\/b98874"},{"key":"ref036","doi-asserted-by":"crossref","unstructured":"H.L.O\u2019Brien and R.Bassett, Exploring engagement in the qualitative research process, in: American Society for Information Science and Technology Annual Meeting, Vancouver, BC, October 2009, 2009. https:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.719.2140&rep=rep1&type=pdf.","DOI":"10.1002\/meet.2009.1450460347"},{"key":"ref037","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20801"},{"key":"ref038","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.2187056"},{"key":"ref039","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v28i1.8920"},{"key":"ref040","doi-asserted-by":"publisher","DOI":"10.1186\/1029-242x-2013-203"},{"key":"ref041","doi-asserted-by":"publisher","DOI":"10.1007\/s11116-008-9173-9"},{"key":"ref042","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557189"},{"key":"ref043","unstructured":"S.Snyder, The New World of Wireless: How to Compete in the 4G Revolution, FT Press, 2009. ISBN: 978-0132618175."},{"key":"ref044","unstructured":"Statista, Number of available applications in the Google Play Store from December 2009 to June 2018, 2018. https:\/\/www.statista.com\/statistics\/266210\/number-of-available-applications-in-the-google-play-store\/."},{"key":"ref045","doi-asserted-by":"publisher","DOI":"10.1111\/bjhp.12114"},{"key":"ref046","doi-asserted-by":"publisher","DOI":"10.1007\/s40708-017-0065-7"},{"key":"ref047","unstructured":"J.van den Hoven, Clustering with optimised weights for Gower\u2019s metric, Master\u2019s thesis, Vrij University, Amsterdam, The Netherlands, 2016. https:\/\/science.vu.nl\/en\/Images\/stageverslag-hoven_tcm296-777817.pdf."},{"key":"ref048","doi-asserted-by":"publisher","DOI":"10.5848\/APBJ.2012.00002"}],"container-title":["Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/DS-190027","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/DS-190027","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/DS-190027","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T18:10:04Z","timestamp":1777399804000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/DS-190027"}},"subtitle":[],"editor":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5098-5667","authenticated-orcid":false,"given":"Jodi","family":"Schneider","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2019,11,13]]},"references-count":48,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,11,11]]}},"alternative-id":["10.3233\/DS-190027"],"URL":"https:\/\/doi.org\/10.3233\/ds-190027","relation":{},"ISSN":["2451-8484","2451-8492"],"issn-type":[{"value":"2451-8484","type":"print"},{"value":"2451-8492","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,13]]}}}