{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T18:11:12Z","timestamp":1791915072124,"version":"4.3.4"},"reference-count":69,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2024,1,1]],"date-time":"2024-01-01T00:00:00Z","timestamp":1704067200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004359","name":"Vetenskapsr\u00e5det","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Avtal om L\u00e4karutbildning och Forskning Agreement"},{"DOI":"10.13039\/100007436","name":"Familjen Erling-Perssons Stiftelse","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100007436","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003186","name":"Fredrik och Ingrid Thurings Stiftelse","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003186","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["DIGITAL HEALTH"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study proposes a way of increasing dataset sizes for machine learning tasks in Internet-based Cognitive Behavioral Therapy through pooling interventions. To this end, it (1) examines similarities in user behavior and symptom data among online interventions for patients with depression, social anxiety, and panic disorder and (2) explores whether these similarities suffice to allow for pooling the data together, resulting in more training data when prediction intervention dropout.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A total of 6418 routine care patients from the Internet Psychiatry in Stockholm are analyzed using (1) clustering and (2) dropout prediction models. For the latter, prediction models trained on each individual intervention's data are compared to those trained on all three interventions pooled into one dataset. To investigate if results vary with dataset size, the prediction is repeated using small and medium dataset sizes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The clustering analysis identified three distinct groups that are almost equally spread across interventions and are instead characterized by different activity levels. In eight out of nine settings investigated, pooling the data improves prediction results compared to models trained on a single intervention dataset. It is further confirmed that models trained on small datasets are more likely to overestimate prediction results.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The study reveals similar patterns of patients with depression, social anxiety, and panic disorder regarding online activity and intervention dropout. As such, this work offers pooling different interventions\u2019 data as a possible approach to counter the problem of small dataset sizes in psychological research.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/20552076241248920","type":"journal-article","created":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T10:49:26Z","timestamp":1715770166000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":18,"title":["Dataset size versus homogeneity: A machine learning study on pooling intervention data in  e-mental health dropout predictions"],"prefix":"10.1177","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9876-054X","authenticated-orcid":false,"given":"Kirsten","family":"Zantvoort","sequence":"first","affiliation":[{"name":"Institute of Information Systems, Leuphana University, Lueneburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nils","family":"Hentati Isacsson","sequence":"additional","affiliation":[{"name":"Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, & Stockholm Health Care Services, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Burkhardt","family":"Funk","sequence":"additional","affiliation":[{"name":"Institute of Information Systems, Leuphana University, Lueneburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Viktor","family":"Kaldo","sequence":"additional","affiliation":[{"name":"Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, & Stockholm Health Care Services, Stockholm, Sweden"},{"name":"Department of Psychology, Faculty of Health and Life Sciences, Linnaeus University, V\u00e4xj\u00f6, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2024,5,15]]},"reference":[{"key":"bibr1-20552076241248920","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1007\/978-981-32-9721-0_29","volume-title":"Frontiers in psychiatry","author":"Ebert DD","year":"2019"},{"key":"bibr2-20552076241248920","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.invent.2018.03.002","volume":"12","author":"Becker D","year":"2018","journal-title":"Internet Interv"},{"key":"bibr3-20552076241248920","volume-title":"Mental health matters [Internet]","author":"The Lancet Global Health","year":"2020"},{"key":"bibr4-20552076241248920","doi-asserted-by":"crossref","DOI":"10.1177\/20552076221128678","volume":"8","author":"Lamo Y","year":"2022","journal-title":"Digital Health"},{"key":"bibr5-20552076241248920","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.jad.2014.02.026","volume":"159","author":"Cuijpers P","year":"2014","journal-title":"J Affect Disord"},{"key":"bibr6-20552076241248920","doi-asserted-by":"crossref","DOI":"10.2196\/17738","volume":"22","author":"Bremer V","year":"2020","journal-title":"J Med Internet Res"},{"key":"bibr7-20552076241248920","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0184604","volume":"12","author":"DeMasi O","year":"2017","journal-title":"PLoS ONE"},{"key":"bibr8-20552076241248920","doi-asserted-by":"crossref","DOI":"10.3389\/fdgth.2023.1170002","volume":"5","author":"Hornstein S","year":"2023","journal-title":"Front Digital Health"},{"key":"bibr9-20552076241248920","doi-asserted-by":"crossref","DOI":"10.2196\/jmir.1772","volume":"13","author":"Donkin L","year":"2011","journal-title":"J Med Internet Res"},{"key":"bibr10-20552076241248920","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1017\/S0033291707002607","volume":"38","author":"Kaltenthaler E","year":"2008","journal-title":"Psychol Med"},{"key":"bibr11-20552076241248920","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/j.invent.2014.08.003","volume":"1","author":"Baumeister H","year":"2014","journal-title":"Internet Interv"},{"key":"bibr12-20552076241248920","doi-asserted-by":"crossref","first-page":"100554","DOI":"10.1016\/j.invent.2022.100554","volume":"29","author":"Forsell E","year":"2022","journal-title":"Internet Interv"},{"key":"bibr13-20552076241248920","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1176\/appi.ajp.2018.18060699","volume":"176","author":"Forsell E","year":"2019","journal-title":"Am J Psychiatry"},{"key":"bibr14-20552076241248920","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1037\/0033-3204.45.2.247","volume":"45","author":"Barrett MS","year":"2008","journal-title":"Psychother Theory Res Pract Train"},{"key":"bibr15-20552076241248920","volume":"8","author":"Wu MS","year":"2022","journal-title":"Digital Health"},{"key":"bibr16-20552076241248920","doi-asserted-by":"crossref","DOI":"10.2196\/13617","volume":"21","author":"Pedersen DH","year":"2019","journal-title":"J Med Internet Res"},{"key":"bibr17-20552076241248920","doi-asserted-by":"crossref","DOI":"10.2196\/10754","volume":"20","author":"Wallert J","year":"2018","journal-title":"J Med Internet Res"},{"key":"bibr18-20552076241248920","first-page":"1","volume":"27","author":"Cote-Allard U","year":"2022","journal-title":"IEEE J Biomed Health Inform"},{"key":"bibr19-20552076241248920","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1002\/eat.23733","volume":"55","author":"Linardon J","year":"2022","journal-title":"Int J Eat Disord"},{"key":"bibr20-20552076241248920","volume":"12","author":"Smink WAC","year":"2021","journal-title":"Front Psychiatry"},{"key":"bibr21-20552076241248920","doi-asserted-by":"crossref","DOI":"10.2196\/38261","volume":"24","author":"Moshe I","year":"2022","journal-title":"J Med Internet Res"},{"key":"bibr22-20552076241248920","first-page":"01643933","volume":"3","author":"Bzdok D","year":"2018","journal-title":"Biol Psychiatry Cogn Neurosci Neuroimaging"},{"key":"bibr23-20552076241248920","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.jsat.2019.01.020","volume":"99","author":"Symons M","year":"2019","journal-title":"J Subst Abuse Treat"},{"key":"bibr24-20552076241248920","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1016\/j.jad.2018.08.073","volume":"241","author":"Lee Y","year":"2018","journal-title":"J Affect Disord"},{"key":"bibr25-20552076241248920","first-page":"223","volume":"3","author":"Bzdok D","year":"2018","journal-title":"Biol Psychiatry Cogn Neurosci Neuroimaging"},{"key":"bibr26-20552076241248920","first-page":"012016","volume":"892","author":"Lateh MA","year":"2017","journal-title":"J Phys"},{"key":"bibr27-20552076241248920","doi-asserted-by":"crossref","first-page":"2455","DOI":"10.1177\/0962280218784726","volume":"28","author":"van Smeden M","year":"2019","journal-title":"Stat Methods Med Res"},{"key":"bibr28-20552076241248920","doi-asserted-by":"crossref","first-page":"1895","DOI":"10.1162\/089976698300017197","volume":"10","author":"Dietterich TG","year":"1998","journal-title":"Neural Comput"},{"key":"bibr29-20552076241248920","first-page":"953","volume":"7","author":"Pasini A","year":"2015","journal-title":"J Thorac Dis"},{"key":"bibr30-20552076241248920","doi-asserted-by":"crossref","first-page":"2742","DOI":"10.1017\/S0033291721003871","volume":"51","author":"Sajjadian M","year":"2021","journal-title":"Psychol Med"},{"key":"bibr31-20552076241248920","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1080\/10503307.2020.1808729","volume":"31","author":"Aafjes-van Doorn K","year":"2021","journal-title":"Psychother Res"},{"key":"bibr32-20552076241248920","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/16506073.2017.1401115","volume":"47","author":"Carlbring P","year":"2018","journal-title":"Cogn Behav Ther"},{"key":"bibr33-20552076241248920","doi-asserted-by":"crossref","first-page":"205520762211344","DOI":"10.1177\/20552076221134455","volume":"8","author":"Loftus TJ","year":"2022","journal-title":"Digital Health"},{"key":"bibr34-20552076241248920","doi-asserted-by":"crossref","first-page":"3359","DOI":"10.1017\/S0033291716002300","volume":"46","author":"Beard C","year":"2016","journal-title":"Psychol Med"},{"key":"bibr35-20552076241248920","doi-asserted-by":"crossref","first-page":"205520762311521","DOI":"10.1177\/20552076231152175","volume":"9","author":"Aziz M","year":"2023","journal-title":"Digital Health"},{"key":"bibr36-20552076241248920","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2020.10791","volume":"3","author":"Chien I","year":"2020","journal-title":"JAMA Netw Open"},{"key":"bibr37-20552076241248920","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.invent.2018.07.006","volume":"13","author":"Titov N","year":"2018","journal-title":"Internet Interv"},{"key":"bibr38-20552076241248920","doi-asserted-by":"crossref","first-page":"902","DOI":"10.1037\/a0039198","volume":"83","author":"El Alaoui S","year":"2015","journal-title":"J Consult Clin Psychol"},{"key":"bibr39-20552076241248920","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.jad.2013.10.023","volume":"155","author":"Hedman E","year":"2014","journal-title":"J Affect Disord"},{"key":"bibr40-20552076241248920","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1111\/acps.12079","volume":"128","author":"Hedman E","year":"2013","journal-title":"Acta Psychiatr Scand"},{"key":"bibr41-20552076241248920","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1002\/da.10049","volume":"15","author":"Houck PR","year":"2002","journal-title":"Depress Anxiety"},{"key":"bibr42-20552076241248920","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1016\/S0005-7967(01)00060-2","volume":"40","author":"Baker SL","year":"2002","journal-title":"Behav Res Ther"},{"key":"bibr43-20552076241248920","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1192\/bjp.134.4.382","volume":"134","author":"Montgomery SA","year":"1979","journal-title":"Br J Psychiatry J Ment Sci"},{"key":"bibr44-20552076241248920","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1111\/j.1600-0447.1994.tb01480.x","volume":"89","author":"Svanborg P","year":"1994","journal-title":"Acta Psychiatr Scand"},{"key":"bibr45-20552076241248920","first-page":"22","volume":"59","author":"Sheehan DV","year":"1998","journal-title":"J Clin Psychiatry"},{"key":"bibr46-20552076241248920","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1007\/s41666-023-00148-z","volume":"7","author":"Zantvoort K","year":"2023","journal-title":"J Healthc Inform Res"},{"key":"bibr47-20552076241248920","doi-asserted-by":"crossref","DOI":"10.2196\/14181","volume":"21","author":"Beintner I","year":"2019","journal-title":"J Med Internet Res"},{"key":"bibr48-20552076241248920","doi-asserted-by":"crossref","first-page":"922","DOI":"10.1002\/da.20532","volume":"26","author":"Furukawa TA","year":"2009","journal-title":"Depress Anxiety"},{"key":"bibr49-20552076241248920","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1002\/cpp.2179","volume":"25","author":"von Glischinski M","year":"2018","journal-title":"Clin Psychol Psychother"},{"key":"bibr50-20552076241248920","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1186\/1471-244X-9-26","volume":"9","author":"Fantino B","year":"2009","journal-title":"BMC Psychiatry"},{"key":"bibr51-20552076241248920","volume":"5","author":"Karin E","year":"2018","journal-title":"JMIR Ment Health"},{"key":"bibr52-20552076241248920","doi-asserted-by":"crossref","DOI":"10.2196\/jmir.2771","volume":"15","author":"Donkin L","year":"2013","journal-title":"J Med Internet Res"},{"key":"bibr53-20552076241248920","doi-asserted-by":"crossref","first-page":"2717","DOI":"10.1017\/S0033291715000665","volume":"45","author":"Karyotaki E","year":"2015","journal-title":"Psychol Med"},{"key":"bibr54-20552076241248920","doi-asserted-by":"crossref","DOI":"10.25080\/Majora-92bf1922-00a","volume-title":"Data structures for statistical computing in Python","author":"McKinney W","year":"2010"},{"key":"bibr55-20552076241248920","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","volume":"585","author":"Harris CR","year":"2020","journal-title":"Nature"},{"key":"bibr56-20552076241248920","first-page":"166","volume-title":"2011 31st International conference on distributed computing systems workshops","author":"Satopaa V"},{"key":"bibr57-20552076241248920","first-page":"2825","volume":"12","author":"Pedregosa F","year":"2011","journal-title":"J Mach Learn Res"},{"key":"bibr58-20552076241248920","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1145\/331499.331504","volume":"31","author":"Jain AK","year":"1999","journal-title":"ACM Comput Surv"},{"key":"bibr59-20552076241248920","doi-asserted-by":"crossref","first-page":"80716","DOI":"10.1109\/ACCESS.2020.2988796","volume":"8","author":"Sinaga KP","year":"2020","journal-title":"IEEE Access"},{"key":"bibr60-20552076241248920","volume-title":"The elements of statistical learning: data mining, inference, and prediction","author":"Hastie T","year":"2017","edition":"2"},{"key":"bibr61-20552076241248920","first-page":"17","volume":"105","author":"Bholowalia P","year":"2014","journal-title":"Int J Comput Appl"},{"key":"bibr62-20552076241248920","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-0716-1418-1","volume-title":"An introduction to statistical learning: with applications in R","author":"James G","year":"2021"},{"key":"bibr63-20552076241248920","doi-asserted-by":"crossref","first-page":"104510","DOI":"10.1016\/j.ijmedinf.2021.104510","volume":"153","author":"Cabitza F","year":"2021","journal-title":"Int J Med Inf"},{"key":"bibr64-20552076241248920","first-page":"273","volume":"20","author":"Cortes C","year":"1995","journal-title":"Mach Learn"},{"key":"bibr65-20552076241248920","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/978-3-642-41136-6_5","volume-title":"Empirical inference","author":"Schapire RE","year":"2013"},{"key":"bibr66-20552076241248920","first-page":"2079","volume":"11","author":"Cawley GC","year":"2017","journal-title":"J Mach Learn Res"},{"key":"bibr67-20552076241248920","unstructured":"Bates S, Hastie T, Tibshirani R. Cross-validation: what does it estimate and how well does it do it? [Internet]. arXiv; 2022 [cited 2023 Feb 14]. Available from: http:\/\/arxiv.org\/abs\/2104.00673"},{"key":"bibr68-20552076241248920","first-page":"1871","volume":"9","author":"Fan RE","year":"2008","journal-title":"J Mach Learn Res"},{"key":"bibr69-20552076241248920","volume-title":"Predictive analytics and data mining: concepts and practice with RapidMiner","author":"Kotu V","year":"2014","edition":"1"}],"container-title":["DIGITAL HEALTH"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20552076241248920","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/20552076241248920","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20552076241248920","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T17:51:00Z","timestamp":1777398660000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/20552076241248920"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1]]},"references-count":69,"alternative-id":["10.1177\/20552076241248920"],"URL":"https:\/\/doi.org\/10.1177\/20552076241248920","relation":{},"ISSN":["2055-2076","2055-2076"],"issn-type":[{"value":"2055-2076","type":"print"},{"value":"2055-2076","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1]]},"article-number":"20552076241248920"}}