{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T08:47:52Z","timestamp":1783068472907,"version":"3.54.6"},"reference-count":25,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2021,11,22]],"date-time":"2021-11-22T00:00:00Z","timestamp":1637539200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"ZonMw\u2014the Netherlands Organization for Health Research and Development","award":["555003022"],"award-info":[{"award-number":["555003022"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,8,1]]},"abstract":"<jats:title>Summary<\/jats:title>\n               <jats:p>With the current increase in web-based interventions, the question of how to measure, and consequently improve engagement in such interventions is gaining more importance. Modern day web analytics tools make it easy to monitor use of web-based interventions. However, in this article, we propose that it would be more meaningful to first examine how the developers envisioned the use of the intervention to establish behavior change (i.e. intended use), before looking into how the intervention is ultimately used with web analytics (i.e. actual use). Such an approach responds to the regularly expressed concern that behavioral interventions are often poorly described, leading to less meaningful evaluations as it is not clear what exactly is being evaluated. Using a page on chlamydia prevention (104 557 pageviews in 2020) from a Dutch sexual health intervention (Sense), we demonstrate the value of acyclic behavior change diagrams (ABCDs) as a method to visualize intended use of an intervention. ABCDs show at a glance how behavior change principles are applied in an intervention and target determinants of behavior. Based on this ABCD, we investigate actual use of the intervention, using web analytics tool Matomo. Despite being intended to stimulate STI-testing, only 14% of the 35 347 transfers from this page led to the STI-testing page and a high bounce rate (79%) and relatively high exit rate were reported (69%). Recommendations to further interpret the data are given. This real-life example demonstrates the potential of combining ABCDs and Matomo as methods to gain insight into use of web-based interventions.<\/jats:p>","DOI":"10.1093\/heapro\/daab190","type":"journal-article","created":{"date-parts":[[2021,11,10]],"date-time":"2021-11-10T20:52:51Z","timestamp":1636577571000},"source":"Crossref","is-referenced-by-count":5,"title":["Evaluating use of web-based interventions: an example of a Dutch sexual health intervention"],"prefix":"10.1093","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1093-0311","authenticated-orcid":false,"given":"Gido","family":"Metz","sequence":"first","affiliation":[{"name":"Department of Health Promotion, Maastricht University\/CAPHRI , The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hanneke","family":"Roosjen","sequence":"additional","affiliation":[{"name":"Soa Aids Nederland , Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wessel","family":"Zweers","sequence":"additional","affiliation":[{"name":"Soa Aids Nederland , Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rik","family":"Crutzen","sequence":"additional","affiliation":[{"name":"Department of Health Promotion, Maastricht University\/CAPHRI , The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,11,22]]},"reference":[{"key":"2023081910144279500_daab190-B1","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1097\/QAI.0000000000000231","article-title":"Enhancing reporting of behavior change intervention evaluations","volume":"66","author":"Abraham","year":"2014","journal-title":"Journal of Acquired Immune Deficiency Syndromes"},{"key":"2023081910144279500_daab190-B2","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1186\/1748-5908-8-52","article-title":"Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations","volume":"8","author":"Albrecht","year":"2013","journal-title":"Implementation Science: IS"},{"key":"2023081910144279500_daab190-B3","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1258\/ijsa.2011.011221","article-title":"Computer-based interventions for sexual health promotion: systematic review and meta-analyses","volume":"23","author":"Bailey","year":"2012","journal-title":"International Journal of STD & AIDS"},{"key":"2023081910144279500_daab190-B4","volume-title":"Planning Health Promotion Programs: An Intervention Mapping Approach","author":"Bartholomew Eldredge","year":"2016","edition":"4th edition"},{"key":"2023081910144279500_daab190-B5","doi-asserted-by":"crossref","first-page":"1100","DOI":"10.1093\/her\/cyq046","article-title":"Towards evidence-based, quality-controlled health promotion: the Dutch recognition system for health promotion interventions","volume":"25","author":"Brug","year":"2010","journal-title":"Health Education Research"},{"key":"2023081910144279500_daab190-B6","doi-asserted-by":"publisher","author":"Crutzen","year":"2019","DOI":"10.5281\/zenodo.3570967"},{"key":"2023081910144279500_daab190-B7","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.1080\/08870446.2019.1606222","article-title":"Why and how we should care about the General Data Protection Regulation","volume":"34","author":"Crutzen","year":"2019","journal-title":"Psychology & Health"},{"key":"2023081910144279500_daab190-B8","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1093\/heapro\/das008","article-title":"Using Google Analytics as a process evaluation method for Internet-delivered interventions: an example on sexual health","volume":"28","author":"Crutzen","year":"2013","journal-title":"Health Promotion International"},{"key":"2023081910144279500_daab190-B9","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1016\/j.jadohealth.2016.01.002","article-title":"Sexually transmitted infection testing among adolescents and young adults in the United States","volume":"58","author":"Cuffe","year":"2016","journal-title":"Journal of Adolescent Health"},{"key":"2023081910144279500_daab190-B10","doi-asserted-by":"crossref","first-page":"1361","DOI":"10.1016\/j.procs.2011.01.016","article-title":"Psychophysiological measures of human cognitive states applied in human computer interaction","volume":"3","author":"Dirican","year":"2011","journal-title":"Procedia Computer Science"},{"key":"2023081910144279500_daab190-B11","doi-asserted-by":"crossref","first-page":"64","DOI":"10.3389\/fpubh.2019.00064","article-title":"RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review","volume":"7","author":"Glasgow","year":"2019","journal-title":"Frontiers in Public Health"},{"key":"2023081910144279500_daab190-B12","doi-asserted-by":"crossref","first-page":"e146","DOI":"10.2196\/jmir.2665","article-title":"Online prevention aimed at lifestyle behaviors: a systematic review of reviews","volume":"15","author":"Kohl","year":"2013","journal-title":"Journal of Medical Internet Research"},{"key":"2023081910144279500_daab190-B13","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1080\/17437199.2015.1077155","article-title":"A taxonomy of behaviour change methods: an Intervention Mapping approach","volume":"10","author":"Kok","year":"2016","journal-title":"Health Psychology Review"},{"key":"2023081910144279500_daab190-B14","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1177\/1742395311403013","article-title":"Getting inside the black box of health promotion programmes using intervention Mapping","volume":"7","author":"Kok","year":"2011","journal-title":"Chronic Illness"},{"key":"2023081910144279500_daab190-B15","author":"Matomo","year":"2021"},{"key":"2023081910144279500_daab190-B16","doi-asserted-by":"crossref","first-page":"e11242","DOI":"10.2196\/11242","article-title":"An intervention to increase condom use among users of chlamydia self-sampling websites (Wrapped): intervention mapping and think-aloud study","volume":"3","author":"Newby","year":"2019","journal-title":"JMIR Formative Research"},{"key":"2023081910144279500_daab190-B17","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1186\/s12911-017-0422-8","article-title":"Smokers\u2019 and drinkers\u2019 choice of smartphone applications and expectations of engagement: a think aloud and interview study","volume":"17","author":"Perski","year":"2017","journal-title":"BMC Medical Informatics and Decision Making"},{"key":"2023081910144279500_daab190-B18","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1007\/s13142-016-0453-1","article-title":"Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis","volume":"7","author":"Perski","year":"2017","journal-title":"Translational Behavioral Medicine"},{"key":"2023081910144279500_daab190-B19","doi-asserted-by":"publisher","author":"Peters","year":"2021","DOI":"10.31234\/osf.io\/w85va"},{"key":"2023081910144279500_daab190-B20","doi-asserted-by":"publisher","DOI":"10.1111\/exsy.12502","article-title":"Assessing stationarity in web analytics: a study of bounce rates","volume":"37, e12502","author":"Poulos","year":"2020","journal-title":"Expert Systems"},{"key":"2023081910144279500_daab190-B21","doi-asserted-by":"publisher","DOI":"10.6017\/ital.v39i3.12219","article-title":"Analytics and privacy","volume":"39, 1-11","author":"Quintel","year":"2020","journal-title":"Information Technology and Libraries"},{"key":"2023081910144279500_daab190-B25","first-page":"87","article-title":"Analyzing user behaviour with Matomo in the online information system Grammis","author":"Ripp","year":"2018","journal-title":"Proceedings of the XVIII EURALEX international congress lexicography in global contexts"},{"key":"2023081910144279500_daab190-B22","doi-asserted-by":"crossref","first-page":"e292","DOI":"10.2196\/jmir.9397","article-title":"Measuring engagement in eHealth and mHealth behavior change interventions: viewpoint of methodologies","volume":"20","author":"Short","year":"2018","journal-title":"Journal of Medical Internet Research"},{"key":"2023081910144279500_daab190-B23","first-page":"131","volume-title":"Health Behavior: Theory, Research, and Practice","author":"Skinner","year":"2015","edition":"5th edition"},{"key":"2023081910144279500_daab190-B24","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1007\/978-1-61779-555-8_27","volume-title":"Statistical Human Genetics. Methods in Molecular Biology (Methods and Protocols)","author":"Stein","year":"2012"}],"container-title":["Health Promotion International"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/heapro\/article-pdf\/38\/4\/daab190\/51174082\/daab190.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/heapro\/article-pdf\/38\/4\/daab190\/51174082\/daab190.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,19]],"date-time":"2023-08-19T10:18:45Z","timestamp":1692440325000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/heapro\/article\/doi\/10.1093\/heapro\/daab190\/6433101"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,22]]},"references-count":25,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,8,1]]}},"URL":"https:\/\/doi.org\/10.1093\/heapro\/daab190","relation":{},"ISSN":["0957-4824","1460-2245"],"issn-type":[{"value":"0957-4824","type":"print"},{"value":"1460-2245","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,8,1]]},"published":{"date-parts":[[2021,11,22]]},"article-number":"daab190"}}