{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T10:52:22Z","timestamp":1740135142492,"version":"3.37.3"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"S2","license":[{"start":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T00:00:00Z","timestamp":1630454400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T00:00:00Z","timestamp":1631491200000},"content-version":"vor","delay-in-days":12,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Third Health Programme of the European Union","award":["761319"],"award-info":[{"award-number":["761319"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Infect Dis"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>The HIV pandemic impacts the lives of millions and despite the global coordinated response, innovative actions are still needed to end it. A major challenge is the added burden of coinfections such as viral hepatitis, tuberculosis and various sexually transmitted infections in terms of prevention, treatment and increased morbidity in individuals with HIV infection. A need for combination prevention strategies, tailored to high-risk key populations arises and technology-based interventions can be a valuable asset. The COVID-19 pandemic challenged the delivery of existing services and added stress to existing public health and clinical structures but also highlighted the potential of exploiting technical solutions for interventions regarding infectious diseases. In this paper we report the design process, results and evaluation findings from the pilots of \u2018RiskRadar\u2019\u2014a web and mobile application aiming to support combination prevention, testing and linkage to care for HIV, viral hepatitis, various sexually transmitted infections and tuberculosis.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>RiskRadar was developed for the INTEGRATE Joint Action\u2019s aim to improve, adapt and pilot innovative digital tools for combination prevention. RiskRadar was designed iteratively using informed end-user-oriented approaches. Emphasis was placed on the Risk Calculator that enables users to assess their risk of exposure to one or more of the four disease areas, make informed decisions to seek testing or care and adjust their behaviours ultimately aiming to harm\/risk reduction. RiskRadar has been piloted in three countries, namely Croatia, Italy and Lithuania.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>RiskRadar has been used 1347 times across all platforms so far. More than 90% of users have found RiskRadar useful and would use it again, especially the Risk Calculator component. Almost 49.25% are men and 29.85% are in the age group of 25\u201334. The application has scored 5.2\/7 in the User Experience Questionnaire, where it is mainly described as \u201csupportive\u201d and \u201ceasy-to-use\u201d. The qualitative evaluation of RiskRadar also yielded positive feedback.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Pilot results demonstrate above average satisfaction with RiskRadar and high user-reported usability scores, supporting the idea that technical interventions could significantly support combination prevention actions on Sexually Transmitted Infections.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12879-021-06501-0","type":"journal-article","created":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T15:03:30Z","timestamp":1631545410000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["RiskRadar: development and pilot results of a technical intervention targeting combination prevention regarding HIV, viral hepatitis, sexually transmitted infections and tuberculosis"],"prefix":"10.1186","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9272-410X","authenticated-orcid":false,"given":"Christine","family":"Kakalou","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eleftheria","family":"Polychronidou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vicky","family":"Drosou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vlasios K.","family":"Dimitriadis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Dermaris","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rafael","family":"Kordonias","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aris","family":"Papaprodromou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Triantafillos","family":"Tsirelis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christos","family":"Maramis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Konstantinos","family":"Votis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dimitrios","family":"Tzovaras","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Domenico","family":"Savarino","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manuel","family":"Maffeo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nedim","family":"Jasic","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tatjana","family":"Nemeth-Bla\u017ei\u0107","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zoran","family":"Dominkovi\u0107","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dubravko","family":"Pogledi\u0107","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Iva","family":"Jovovic","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Agne","family":"Simkunaite-Zazecke","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Loreta","family":"Stoniene","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antonella","family":"Sammut","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lella","family":"Cosmaro","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pantelis","family":"Natsiavas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,9,13]]},"reference":[{"unstructured":"Unaids. 90\u201390\u201390: An ambitious treatment target to help end the AIDS epidemic. 2020.","key":"6501_CR1"},{"unstructured":"Fast-Track strategy to end the AIDS epidemic by 2030|UNAIDS. 2018 (cited 2018 Feb 27). http:\/\/www.unaids.org\/en\/resources\/campaigns\/World-AIDS-Day-Report-2014.","key":"6501_CR2"},{"unstructured":"Hayes R, Brown A, Azad Y, Delpech V. HIV Combination prevention Monitoring implementation of the Dublin Declaration on partnership to fight HIV\/AIDS in Europe and Central Asia: 2018 progress report HIV: Combination prevention (cited 2020 Sep 17); www.ecdc.europa.eu.","key":"6501_CR3"},{"unstructured":"Singh A, Gibbs J, Estcourt C, Sonnenberg P, Blandford A. Are HIV smartphone apps and online interventions fit for purpose? ACM Int Conf Proceeding Ser. New York, New York, USA: Association for Computing Machinery; 2017 (cited 2020 Aug 31). p. 6\u201315. http:\/\/dl.acm.org\/citation.cfm?doid=3079452.3079469.","key":"6501_CR4"},{"doi-asserted-by":"crossref","unstructured":"Macdonald V, Verster A, Baggaley R. A call for differentiated approaches to delivering HIV services to key populations. J Int AIDS Soc. 2017 (cited 2020 Sep 17). p. 28\u201331.","key":"6501_CR5","DOI":"10.7448\/IAS.20.5.21658"},{"key":"6501_CR6","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1007\/s11904-010-0063-3","volume":"8","author":"AE Kurth","year":"2011","unstructured":"Kurth AE, Celum C, Baeten JM, Vermund SH, Wasserheit JN. Combination HIV prevention: significance, challenges, and opportunities. Curr HIV\/AIDS Rep. 2011;8:62\u201372.","journal-title":"Curr HIV\/AIDS Rep."},{"key":"6501_CR7","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1101\/cshperspect.a007435","volume":"2","author":"L-G Bekker","year":"2012","unstructured":"Bekker L-G, Beyrer C, Quinn TC. Behavioral and biomedical combination strategies for HIV prevention. Cold Spring Harb Perspect Med. 2012;2:8.","journal-title":"Cold Spring Harb Perspect Med."},{"key":"6501_CR8","doi-asserted-by":"publisher","first-page":"e005717","DOI":"10.1136\/bmjopen-2014-005717","volume":"4","author":"I Young","year":"2014","unstructured":"Young I, Flowers P, McDaid LM. Barriers to uptake and use of pre-exposure prophylaxis (PrEP) among communities most affected by HIV in the UK: findings from a qualitative study in Scotland. BMJ Open. 2014;4:e005717.","journal-title":"BMJ Open."},{"unstructured":"avac.org. Multipurpose prevention technologies\u2014an introductory factsheet. https:\/\/www.avac.org\/sites\/default\/files\/resource-files\/mpt_product_dev.pdf","key":"6501_CR9"},{"doi-asserted-by":"crossref","unstructured":"Gannon B, Davis R, Kuhns LM, Rodriguez RG, Garofalo R, Schnall R. A mobile sexual health app on empowerment, education, and prevention for young adult men (MyPEEPS Mobile): Acceptability and usability evaluation. JMIR Form Res. 2020;4.","key":"6501_CR10","DOI":"10.2196\/preprints.17901"},{"key":"6501_CR11","doi-asserted-by":"publisher","first-page":"e26","DOI":"10.2196\/mhealth.7199","volume":"5","author":"PS Sullivan","year":"2017","unstructured":"Sullivan PS, Driggers R, Stekler JD, Siegler A, Goldenberg T, McDougal SJ, et al. Usability and acceptability of a mobile comprehensive HIV prevention app for men who have sex with men: a pilot study. JMIR mHealth uHealth. 2017;5:e26.","journal-title":"JMIR mHealth uHealth."},{"key":"6501_CR12","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1097\/OLQ.0000000000000738","volume":"45","author":"MS van Rooijen","year":"2018","unstructured":"van Rooijen MS, Gotz H, Vriens P, Heijman T, Koekenbier R, van Veen M, et al. Sender and receiver acceptability and usability of an online partner notification tool for sexually transmitted infection in the Netherlands. Sex Transm Dis. 2018;45:354\u20137.","journal-title":"Sex Transm Dis."},{"key":"6501_CR13","doi-asserted-by":"publisher","first-page":"1397","DOI":"10.1177\/0956462419878043","volume":"30","author":"D Lessard","year":"2019","unstructured":"Lessard D, Aslan A, Zeggagh J, Morel S, Michels D, Lebouch\u00e9 B. Acceptability of a digital patient notification and linkage-to-care tool for French PrEPers (WeFLASH\u00a9): key stakeholders\u2019 perspectives. Int J STD AIDS. 2019;30:1397\u2013407. https:\/\/doi.org\/10.1177\/0956462419878043.","journal-title":"Int J STD AIDS."},{"key":"6501_CR14","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1097\/OLQ.0b013e3181d707f1","volume":"37","author":"JE Bilardi","year":"2010","unstructured":"Bilardi JE, Fairley CK, Hopkins CA, Hocking JS, Kit Sze J, Chen MY. Let them know: evaluation of an online partner notification service for chlamydia that offers E-mail and SMS messaging. Sex Transm Dis. 2010;37:563\u20135.","journal-title":"Sex Transm Dis"},{"key":"6501_CR15","first-page":"234","volume":"93","author":"J Gibbs","year":"2017","unstructured":"Gibbs J, Gkatzidou V, Tickle L, Manning SR, Tilakkumar T, Hone K, et al. \u201cCan you recommend any good STI apps?\u201d A review of content, accuracy and comprehensiveness of current mobile medical applications for STIs and related genital infections. Sex Transm Infect. 2017;93:234\u20135.","journal-title":"Sex Transm Infect."},{"unstructured":"INTEGRATE|Joint Action on integrating prevention, testing and linkage to care strategies across HIV, viral hepatitis, TB and STIs in Europ (cited 2020 Sep 17). https:\/\/integrateja.eu\/.","key":"6501_CR16"},{"key":"6501_CR17","doi-asserted-by":"publisher","first-page":"173","DOI":"10.2196\/jmir.5441","volume":"18","author":"RJ Guy","year":"2016","unstructured":"Guy RJ, Micallef JM, Mooney-Somers J, Jamil MS, Harvey C, Bateson D, et al. Evaluation of chlamydia partner notification practices and use of the \u201clet them know\u201d website by family planning clinicians in Australia: cross-sectional study. J Med Internet Res. 2016;18:173.","journal-title":"J Med Internet Res."},{"key":"6501_CR18","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1016\/j.jbi.2007.09.004","volume":"41","author":"S Pilemalm","year":"2008","unstructured":"Pilemalm S, Timpka T. Third generation participatory design in health informatics-Making user participation applicable to large-scale information system projects. J Biomed Inform. 2008;41:327\u201339.","journal-title":"J Biomed Inform"},{"key":"6501_CR19","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1186\/s12911-015-0197-8","volume":"15","author":"V Gkatzidou","year":"2015","unstructured":"Gkatzidou V, Hone K, Sutcliffe L, Gibbs J, Sadiq ST, Szczepura A, et al. User interface design for mobile-based sexual health interventions for young people: design recommendations from a qualitative study on an online Chlamydia clinical care pathway. BMC Med Inform Decis Mak. 2015;15:72. https:\/\/doi.org\/10.1186\/s12911-015-0197-8.","journal-title":"BMC Med Inform Decis Mak."},{"key":"6501_CR20","doi-asserted-by":"publisher","first-page":"974","DOI":"10.1186\/s12889-016-3648-y","volume":"16","author":"CRH Aicken","year":"2016","unstructured":"Aicken CRH, Fuller SS, Sutcliffe LJ, Estcourt CS, Gkatzidou V, Oakeshott P, et al. Young people\u2019s perceptions of smartphone-enabled self-testing and online care for sexually transmitted infections: qualitative interview study. BMC Public Health. 2016;16:974. https:\/\/doi.org\/10.1186\/s12889-016-3648-y.","journal-title":"BMC Public Health."},{"unstructured":"World Health Organization. Global health sector strategies on HIV, viral hepatitis and sexually transmitted infections, for the period 2016\u20132021. 2016. https:\/\/apps.who.int\/iris\/bitstream\/handle\/10665\/246178\/WHO-HIV-2016.05-eng.pdf;jsessionid=46F4C7556AA64E61C596C597E58E8F2F?sequence=1.","key":"6501_CR21"},{"unstructured":"European Centre for Disease Prevention and Control. Communication strategies for the prevention of HIV, STI and hepatitis among MSM in Europe. Stockholm; 2016. Available from: https:\/\/www.ecdc.europa.eu\/sites\/portal\/files\/media\/en\/publications\/Publications\/Communication-strategy-prevention-HIV-STI-hepatitis-MSM.pdf.","key":"6501_CR22"},{"unstructured":"User Experience Questionnaire (UEQ) (cited 2020 Sep 10). https:\/\/www.ueq-online.org\/.","key":"6501_CR23"},{"unstructured":"World Health Organization. Consolidated Guidelines on Hiv Testing Services. 2019; https:\/\/apps.who.int\/iris\/bitstream\/handle\/10665\/179870\/9789241508926_eng.pdf?sequence=1LB-0ojl.","key":"6501_CR24"},{"unstructured":"European Centre for Disease Prevention and Control. Public health guidance on HIV, hepatitis B and C testing in the EU\/EEA\u2014an integrated approach. Stockholm; 2018 (cited 2019 Oct 10); https:\/\/www.ecdc.europa.eu\/sites\/default\/files\/documents\/hiv-hep-testing-guidance_0.pdf.","key":"6501_CR25"},{"unstructured":"European Centre for Disease Prevention and Control. HIV and STI prevention among men who have sex with men. (cited 2020 Sep 14); www.ecdc.europa.eu.","key":"6501_CR26"},{"unstructured":"Risk Radar (cited 2020 Sep 10). https:\/\/integrateja.eu\/riskradar\/.","key":"6501_CR27"},{"unstructured":"RiskRadar\u2014Apps on Google Play (cited 2020 Sep 10). https:\/\/play.google.com\/store\/apps\/details?id=com.tdermaris.integratetoolkit.","key":"6501_CR28"},{"unstructured":"RiskRadar on the App Store [Internet]. [cited 2020 Sep 10]. https:\/\/apps.apple.com\/app\/id1469764662","key":"6501_CR29"},{"unstructured":"Mobile Survey Response Rates: Averages by App Category\u2014apptentive (cited 2021 Apr 7). https:\/\/www.apptentive.com\/blog\/2016\/10\/04\/mobile-survey-response-rates\/.","key":"6501_CR30"},{"doi-asserted-by":"crossref","unstructured":"Ridgway JP, Schmitt J, Friedman E, Taylor M, Devlin S, McNulty M, et al. HIV Care Continuum and COVID-19 Outcomes Among People Living with HIV During the COVID-19 Pandemic, Chicago, IL. AIDS Behav. Springer; 2020 (cited 2020 Aug 31). p. 1. https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7203502\/.","key":"6501_CR31","DOI":"10.1007\/s10461-020-02905-2"},{"unstructured":"Survey shows that the COVID-19 pandemic increases vulnerability of LGBTI people|UNAIDS (cited 2020 Sep 14). https:\/\/www.unaids.org\/en\/resources\/presscentre\/featurestories\/2020\/july\/20200710_survey-covid19-lgbti-people.","key":"6501_CR32"},{"doi-asserted-by":"crossref","unstructured":"Togun T, Kampmann B, Stoker NG, Lipman M. Anticipating the impact of the COVID-19 pandemic on TB patients and TB control programmes. Ann Clin Microbiol Antimicrob. 2020; 21.","key":"6501_CR33","DOI":"10.1186\/s12941-020-00363-1"},{"unstructured":"Hightow-Weidman L, Muessig K, Claude K, Roberts J, Zlotorzynska M, Travis Sanchez. Maximizing digital interventions for youth in the midst of Covid-19: lessons from the adolescent trials network for HIV interventions.","key":"6501_CR34"},{"doi-asserted-by":"crossref","unstructured":"Sittig DF, Singh H. COVID-19 and the Need for a National Health Information Technology Infrastructure. JAMA. 2020 (cited 2020 Sep 7). p. 2373.","key":"6501_CR35","DOI":"10.1001\/jama.2020.7239"},{"key":"6501_CR36","doi-asserted-by":"publisher","first-page":"360","DOI":"10.1016\/j.bjid.2020.05.004","volume":"24","author":"B Hoagland","year":"2020","unstructured":"Hoagland B, Torres TS, Bezerra DRB, Geraldo K, Pimenta C, Veloso VG, et al. Telemedicine as a tool for PrEP delivery during the COVID-19 pandemic in a large HIV prevention service in Rio de Janeiro-Brazil. Brazilian J Infect Dis. 2020;24:360.","journal-title":"Brazilian J Infect Dis."}],"container-title":["BMC Infectious Diseases"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12879-021-06501-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12879-021-06501-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12879-021-06501-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T15:05:04Z","timestamp":1631545504000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcinfectdis.biomedcentral.com\/articles\/10.1186\/s12879-021-06501-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9]]},"references-count":36,"journal-issue":{"issue":"S2","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["6501"],"URL":"https:\/\/doi.org\/10.1186\/s12879-021-06501-0","relation":{},"ISSN":["1471-2334"],"issn-type":[{"type":"electronic","value":"1471-2334"}],"subject":[],"published":{"date-parts":[[2021,9]]},"assertion":[{"value":"29 July 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 July 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 September 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not Applicable. We have conducted a Data Protection Impact Assessment for RiskRadar along the GDPR guidelines and thoroughly evaluated and mitigated potential risks, emphasizing on data anonymization and encryption. Detailed cookies and privacy policies are featured prominently on all RiskRadar applications and users are prompted to read them carefully and consent to continue using the RiskRadar application. Only aggregated data are reported in this manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"All authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"866"}}