{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,4]],"date-time":"2026-11-04T10:53:58Z","timestamp":1793789638809,"version":"4.6.1"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,4,5]],"date-time":"2023-04-05T00:00:00Z","timestamp":1680652800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,5]],"date-time":"2023-04-05T00:00:00Z","timestamp":1680652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Contemp School Psychol"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>School psychologists and other school professionals are increasingly turning to digital citizenship programs to improve children\u2019s online safety. However, to date, there has been no rigorous outcome evaluation of these programs. The current study used a cluster randomized control trial methodology (CRCT) to evaluate the impact of the Be Internet Awesome digital citizenship program on knowledge, attitudinal, and behavioral outcomes for 1072 4th\u20136th graders at 14 participating schools (7 treatment and 7 control schools). Multilevel logistic, multinomial, and Gaussian models were used to test outcomes. The study found support for program impact on children\u2019s knowledge of new online safety concepts and self-efficacy for handling online problems relative to students in control conditions. However, no program impact was found for other outcomes including online privacy or civility, cyberbullying, and talking with parents about online problems. Findings highlight the need for clarity on digital citizenship program goals, innovative approaches, and increased evaluation research.<\/jats:p>","DOI":"10.1007\/s40688-023-00465-5","type":"journal-article","created":{"date-parts":[[2023,4,5]],"date-time":"2023-04-05T17:02:06Z","timestamp":1680714126000},"page":"509-523","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["The Impact of Youth Digital Citizenship Education: Insights from a Cluster Randomized Controlled Trial Outcome Evaluation of the Be Internet Awesome (BIA) Curriculum"],"prefix":"10.1007","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2451-4095","authenticated-orcid":false,"given":"Lisa M.","family":"Jones","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kimberly J.","family":"Mitchell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cheryl L.","family":"Beseler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,4,5]]},"reference":[{"key":"465_CR1","volume-title":"Teens, social media & technology 2018","author":"M Anderson","year":"2018","unstructured":"Anderson, M., & Jiang, J. (2018). Teens, social media & technology 2018. Pew Research Center https:\/\/www.pewresearch.org\/internet\/2018\/05\/31\/teens-social-media-technology-2018\/"},{"key":"465_CR2","volume-title":"Parenting children in the age of screens","author":"B Auxier","year":"2020","unstructured":"Auxier, B., Anderson, M., Perrin, A., & Turner, E. (2020). Parenting children in the age of screens. Pew Research Center https:\/\/www.pewresearch.org\/internet\/2020\/07\/28\/parenting-children-in-the-age-of-screens\/"},{"key":"465_CR3","doi-asserted-by":"crossref","unstructured":"Beseler, C. L., Jones, L. M., & Mitchell, K. J. (2021). Measuring online prosocial behaviors in primary school children: Psychometric properties of the online civility scale. Contemporary School Psychology, 1\u201311.","DOI":"10.1007\/s40688-021-00401-5"},{"key":"465_CR4","doi-asserted-by":"crossref","unstructured":"Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, West Sussex, UK: John Wiley & Sons Ltd.","DOI":"10.1002\/9780470743386"},{"issue":"3","key":"465_CR5","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1080\/02796015.2007.12087929","volume":"36","author":"CP Bradshaw","year":"2007","unstructured":"Bradshaw, C. P., Sawyer, A. L., & O\u2019Brennan, L. M. (2007). Bullying and peer victimization at school: Perceptual differences between students and school staff. School Psychology Review, 36(3), 361\u2013382.","journal-title":"School Psychology Review"},{"key":"465_CR6","unstructured":"Burton, P., O\u2019Neill, B., & Bulger, M. (in press). A global review of evidence of what works in preventing ICT-related violence, abuse and exploitation of children and in promoting digital citizenship. Centre for Justice and Crime Prevention."},{"key":"465_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jsp.2019.11.006","volume":"78","author":"K Bussey","year":"2020","unstructured":"Bussey, K., Luo, A., Fitzpatrick, S., & Allison, K. (2020). Defending victims of cyberbullying: The role of self-efficacy and moral disengagement. Journal of School Psychology, 78, 1\u201312.","journal-title":"Journal of School Psychology"},{"issue":"1","key":"465_CR8","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1177\/0963721417730833","volume":"27","author":"JL Clark","year":"2018","unstructured":"Clark, J. L., Algoe, S. B., & Green, M. C. (2018). Social network sites and well-being: The role of social connection. Current Directions in Psychological Science, 27(1), 32\u201337.","journal-title":"Current Directions in Psychological Science"},{"key":"465_CR9","volume-title":"Youth and digital citizenship+ (plus): Understanding skills for a digital world","author":"S Cortesi","year":"2020","unstructured":"Cortesi, S., Hasse, A., Lombana-Bermudez, A., Kim, S., & Gasser, U. (2020). Youth and digital citizenship+ (plus): Understanding skills for a digital world. Youth and Media, Berkman Klein Center for Internet and Society https:\/\/cyber.harvard.edu\/publication\/2020\/youth-and-digital-citizenship-plus"},{"key":"465_CR10","volume-title":"Preliminary results from the youth voice project: Victimization and strategies","author":"S Davis","year":"2010","unstructured":"Davis, S., & Nixon, C. (2010). Preliminary results from the youth voice project: Victimization and strategies. https:\/\/njbullying.org\/documents\/YVPMarch2010.pdf"},{"issue":"1","key":"465_CR11","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1002\/pits.20452","volume":"47","author":"CE Domitrovich","year":"2010","unstructured":"Domitrovich, C. E., Bradshaw, C. P., Greenberg, M. T., Embry, D., Poduska, J. M., & Ialongo, N. S. (2010). Integrated models of school-based prevention: Logic and theory. Psychology in the Schools, 47(1), 71\u201388.","journal-title":"Psychology in the Schools"},{"key":"465_CR12","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1007\/s10464-010-9300-6","volume":"45","author":"JA Durlak","year":"2010","unstructured":"Durlak, J. A., Weissberg, R. P., & Pachan, M. (2010). A meta-analysis of after-school programs that seek to promote personal and social skills in children and adolescents. American Journal of Community Psychology, 45, 294\u2013309.","journal-title":"American Journal of Community Psychology"},{"key":"465_CR13","doi-asserted-by":"publisher","first-page":"104720","DOI":"10.1016\/j.childyouth.2019.104720","volume":"109","author":"S Elbedour","year":"2020","unstructured":"Elbedour, S., Alqahtani, S., Rihan, I. E. S., Bawalsah, J. A., Booker-Ammah, B., & Turner, J. F., Jr. (2020). Cyberbullying: Roles of school psychologists and school counselors in addressing a pervasive social justice issue. Children and Youth Services Review, 109, 104720.","journal-title":"Children and Youth Services Review"},{"key":"465_CR14","volume-title":"Online victimization: A report on the nation\u2019s youth","author":"D Finkelhor","year":"2000","unstructured":"Finkelhor, D., Mitchell, K. J., & Wolak, J. (2000). Online victimization: A report on the nation\u2019s youth. Crimes Against Children Research Center http:\/\/unh.edu\/ccrc\/pdf\/jvq\/CV38.pdf"},{"key":"465_CR15","doi-asserted-by":"publisher","unstructured":"Finkelhor, D., Walsh, K., Jones, L., Mitchell, K., & Collier, A. (2020). Youth internet safety education: Aligning programs with the evidence base. Trauma, Violence & Abuse. https:\/\/doi.org\/10.1177\/1524838020916257","DOI":"10.1177\/1524838020916257"},{"key":"465_CR16","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1016\/j.avb.2018.07.002","volume":"45","author":"H Gaffney","year":"2019","unstructured":"Gaffney, H., Farrington, D. P., Espelage, D. L., & Ttofi, M. M. (2019). Are cyberbullying intervention and prevention programs effective? A systematic and meta-analytical review. Aggression and Violent Behavior, 45, 134\u2013153.","journal-title":"Aggression and Violent Behavior"},{"key":"465_CR17","volume-title":"Be Internet Awesome: Digital safety and citizenship curriculum","author":"Google Inc.","year":"2018","unstructured":"Google Inc. (2018). Be Internet Awesome: Digital safety and citizenship curriculum. Google, Inc. https:\/\/storage.googleapis.com\/gweb-interland.appspot.com\/en-us\/hub\/pdfs\/Google_BeInternetAwesome_DigitalCitizenshipSafety_2019Curriculum.pdf"},{"issue":"3","key":"465_CR18","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1300\/J202v06n03_06","volume":"6","author":"S Hinduja","year":"2007","unstructured":"Hinduja, S., & Patchin, J. W. (2007). Offline consequences of online victimization: School violence and delinquency. Journal of School Violence, 6(3), 89\u2013112.","journal-title":"Journal of School Violence"},{"key":"465_CR19","volume-title":"Zero to eight: Young children and their internet use","author":"D Holloway","year":"2013","unstructured":"Holloway, D., Green, L., & Livingstone, S. (2013). Zero to eight: Young children and their internet use. EU Kids Online https:\/\/ro.ecu.edu.au\/ecuworks2013\/929"},{"key":"465_CR20","unstructured":"International Society for Technology in Education (ISTE). (n.d.). ISTE standards for students. ISTE https:\/\/www.iste.org\/standards\/for-students"},{"key":"465_CR21","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1186\/s12874-017-0442-1","volume":"17","author":"JC Jakobsen","year":"2017","unstructured":"Jakobsen, J. C., Gluud, C., Wetterslev, J., & Winkel, P. (2017). When and how should multiple imputation be used for handling missing data in randomised clinical trials \u2013 A practical guide with flow chart. BMC Medical Research Methodology, 17, 162.","journal-title":"BMC Medical Research Methodology"},{"key":"465_CR22","volume-title":"The future of internet safety education: Critical lessons from four decades of youth drug abuse prevention","author":"LM Jones","year":"2010","unstructured":"Jones, L. M. (2010). The future of internet safety education: Critical lessons from four decades of youth drug abuse prevention. Berkman Center http:\/\/publius.cc\/future_internet_safety_education_critical_lessons_four_decades_youth_drug_abuse_prevention"},{"issue":"9","key":"465_CR23","doi-asserted-by":"publisher","first-page":"2063","DOI":"10.1177\/1461444815577797","volume":"18","author":"LM Jones","year":"2016","unstructured":"Jones, L. M., & Mitchell, K. J. (2016). Defining and measuring youth digital citizenship. New Media & Society, 18(9), 2063\u20132079.","journal-title":"New Media & Society"},{"key":"465_CR24","volume-title":"A content analysis of youth internet safety programs: Are effective prevention strategies being used?","author":"LM Jones","year":"2014","unstructured":"Jones, L. M., Mitchell, K. J., & Walsh, W. A. (2014). A content analysis of youth internet safety programs: Are effective prevention strategies being used? Crimes Against Children Research Center (CCRC), University of New Hampshire https:\/\/scholars.unh.edu\/cgi\/viewcontent.cgi?article=1040&context=ccrc"},{"key":"465_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.compedu.2020.103989","volume":"158","author":"AR Lauricella","year":"2020","unstructured":"Lauricella, A. R., Herdzinan, J., & Robb, M. (2020). Early childhood educators\u2019 teaching of digital citizenship competencies. Computers & Education, 158, 1\u20139.","journal-title":"Computers & Education"},{"key":"465_CR26","volume-title":"Online harassment, digital abuse, and cyberstalking in America","author":"A Lenhart","year":"2016","unstructured":"Lenhart, A., Ybarra, M., Zickuhr, K., & Price-Feeney, M. (2016). Online harassment, digital abuse, and cyberstalking in America. Data and Society Research Institute https:\/\/www.datasociety.net\/pubs\/oh\/Online_Harassment_2016.pdf"},{"key":"465_CR27","doi-asserted-by":"crossref","unstructured":"Livingstone, S., & Haddon, L. (2009). Kids online: Opportunities and risks for children. Bristol, UK: The Policy Press.","DOI":"10.46692\/9781847427342"},{"key":"465_CR28","volume-title":"Children\u2019s data and privacy online: Growing up in a digital age. Research findings","author":"S Livingstone","year":"2019","unstructured":"Livingstone, S., Stoilova, M., & Nandagiri, R. (2019). Children\u2019s data and privacy online: Growing up in a digital age. Research findings. London School of Economics and Political Science https:\/\/www.lse.ac.uk\/my-privacy-uk\/Assets\/Documents\/Childrens-data-and-privacy-online-report-for-web.pdf"},{"key":"465_CR29","unstructured":"Madden, M., Lenhart, A., Cortesi, S., Gasser, U., Duggan, M., Smith, A., & Beaton, M. (2013). Teens, social media, and privacy. Pew Research Center, 21(1055), 2\u201386. Retrieved at: https:\/\/assets.pewresearch.org\/wpcontent\/uploads\/sites\/14\/2013\/05\/PIP_TeensSocialMediaandPrivacy_PDF.pdf"},{"issue":"2","key":"465_CR30","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.jadohealth.2018.03.012","volume":"63","author":"S Madigan","year":"2018","unstructured":"Madigan, S., Villani, V., Azzopardi, C., Laut, D., Smith, T., Temple, J. R., Browne, D., & Dimitropoulos, G. (2018). The prevalence of unwanted online sexual exposure and solicitation among youth: A meta-analysis. Journal of Adolescent Health, 63(2), 133\u2013141.","journal-title":"Journal of Adolescent Health"},{"issue":"2","key":"465_CR31","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1016\/j.jadohealth.2010.06.009","volume":"48","author":"KJ Mitchell","year":"2011","unstructured":"Mitchell, K. J., Finkelhor, D., Wolak, J., Ybarra, M. L., & Turner, H. (2011). Youth internet victimization in a broader victimization context. Journal of Adolescent Health, 48(2), 128\u2013134.","journal-title":"Journal of Adolescent Health"},{"issue":"12","key":"465_CR32","doi-asserted-by":"publisher","first-page":"1225","DOI":"10.1016\/j.chiabu.2013.07.002","volume":"37","author":"KJ Mitchell","year":"2013","unstructured":"Mitchell, K. J., Jones, L. M., Finkelhor, D., & Wolak, J. (2013). Understanding the decline in unwanted online sexual solicitations for US youth 2000-2010: Findings from three youth internet safety surveys. Child Abuse and Neglect, 37(12), 1225\u20131236.","journal-title":"Child Abuse and Neglect"},{"issue":"5","key":"465_CR33","doi-asserted-by":"publisher","first-page":"602","DOI":"10.1016\/j.jadohealth.2014.06.007","volume":"55","author":"KL Modecki","year":"2014","unstructured":"Modecki, K. L., Minchin, J., Harbaugh, A. G., Guerra, N. G., & Runions, K. C. (2014). Bullying prevalence across contexts: A meta-analysis measuring cyber and traditional bullying. Journal of Adolescent Health, 55(5), 602\u2013611.","journal-title":"Journal of Adolescent Health"},{"key":"465_CR34","doi-asserted-by":"crossref","unstructured":"Mossberger, K., Tolbert, C. J., & McNeal, R. S. (2008). Digital citizenship. Cambrige, MA: MIT Press.","DOI":"10.7551\/mitpress\/7428.001.0001"},{"key":"465_CR35","volume-title":"Common core of data: America\u2019s public schools","author":"National Center for Education Statistics","year":"2018","unstructured":"National Center for Education Statistics. (2018). Common core of data: America\u2019s public schools https:\/\/nces.ed.gov\/ccd\/."},{"key":"465_CR36","volume-title":"Children\u2019s internet access at home","author":"National Center for Education Statistics","year":"2020","unstructured":"National Center for Education Statistics. (2020). Children\u2019s internet access at home. https:\/\/nces.ed.gov\/programs\/coe\/indicator_cch.asp ."},{"key":"465_CR37","volume-title":"Enhancing child safety and online technologies: Final report of the Internet Safety Technical Task Force","author":"J Palfrey","year":"2010","unstructured":"Palfrey, J., Boyd, D., & Sacco, D. (2010). Enhancing child safety and online technologies: Final report of the Internet Safety Technical Task Force. Berkman Center https:\/\/cyber.harvard.edu\/sites\/cyber.law.harvard.edu\/files\/ISTTF_Final_Report.pdf"},{"key":"465_CR38","unstructured":"Ribble, M., & Bailey, G. (2011). Digital citizenship in schools (2nd ed.). Arlington, VA: International Society for Technology in Education (ISTE)."},{"issue":"3","key":"465_CR39","doi-asserted-by":"publisher","first-page":"e66","DOI":"10.2105\/AJPH.2014.302393","volume":"105","author":"E Rice","year":"2015","unstructured":"Rice, E., Petering, R., Rhoades, H., Winetrobe, H., Goldbach, J., Plant, A., Montoya, J., & Kordic, T. (2015). Cyberbullying perpetration and victimization among middle-school students. American Journal of Public Health, 105(3), e66\u2013e72.","journal-title":"American Journal of Public Health"},{"key":"465_CR40","unstructured":"Rothman, K. J. (2012). Epidemiology: An introduction. Oxford, UK: Oxford University Press."},{"issue":"11","key":"465_CR41","doi-asserted-by":"publisher","first-page":"1178","DOI":"10.1037\/hea0000387","volume":"35","author":"P Sheeran","year":"2016","unstructured":"Sheeran, P., Maki, A., Montanaro, E., Avishai-Yitshak, A., Bryan, A., Klein, W. M., Miles, E., & Rothman, A. J. (2016). The impact of changing attitudes, norms, and self-efficacy on health-related intentions and behavior: A meta-analysis. Health Psychology, 35(11), 1178.","journal-title":"Health Psychology"},{"key":"465_CR42","volume-title":"The Common Sense census: Inside the 21st-century classroom","author":"V Vega","year":"2019","unstructured":"Vega, V., & Robb, M. B. (2019). The Common Sense census: Inside the 21st-century classroom. Common Sense Media https:\/\/www.commonsensemedia.org\/research\/the-common-sense-censusinside-the-21st-century-classroom-2019"},{"issue":"3","key":"465_CR43","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1177\/1077559507312962","volume":"13","author":"M Wells","year":"2008","unstructured":"Wells, M., & Mitchell, K. J. (2008). How do high-risk youth use the internet? Characteristics and implications for prevention. Child Maltreatment, 13(3), 227\u2013234.","journal-title":"Child Maltreatment"},{"key":"465_CR44","first-page":"138","volume":"161","author":"ML Ybarra","year":"2007","unstructured":"Ybarra, M. L., Mitchell, K. J., Finkelhor, D., & Wolak, J. (2007). Internet prevention messages: Targeting the right online behaviors. Archives of Pediatrics and Adolescent Medicine, 161, 138\u2013145.","journal-title":"Archives of Pediatrics and Adolescent Medicine"}],"container-title":["Contemporary School Psychology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40688-023-00465-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40688-023-00465-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40688-023-00465-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,18]],"date-time":"2024-11-18T15:07:48Z","timestamp":1731942468000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40688-023-00465-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,5]]},"references-count":44,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["465"],"URL":"https:\/\/doi.org\/10.1007\/s40688-023-00465-5","relation":{},"ISSN":["2159-2020","2161-1505"],"issn-type":[{"value":"2159-2020","type":"print"},{"value":"2161-1505","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,5]]},"assertion":[{"value":"20 March 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 April 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All procedures in this study were approved by the Institutional Review Board (IRB) at the University of New Hampshire.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"Informed consent was obtained from all schools, parents, and children participating in this study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}]}}