{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T00:35:24Z","timestamp":1777422924404,"version":"3.51.4"},"reference-count":35,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,8,19]],"date-time":"2022-08-19T00:00:00Z","timestamp":1660867200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Mount Royal University through an internal research grant","award":["Award #101276"],"award-info":[{"award-number":["Award #101276"]}]},{"name":"Faculty of Science and Technology research grant","award":["Award #101276"],"award-info":[{"award-number":["Award #101276"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Measuring citizen activities in online environments is an important enterprise in fields as diverse as political science, informatics, and education. Over the past decade, a variety of scholars have proposed survey instruments for measuring digital citizenship. This study investigates the psychometric properties of one such measure, the Digital Citizenship Scale (DCS). While previous investigations of the DCS drew participants exclusively from single educational environments (college students, teachers), this study is the first with a survey population (n = 1820) that includes both students and the general public from multiple countries. Four research questions were addressed, two of which were focused on the validity of the DCS for this wider population. Our results suggest refining the 26-item five-factor DCS tool into an abbreviated 19-item four-factor instrument. The other two research questions investigated how gender, generation, and nationality affect DCS scores and the relationship between the different DCS factors. While gender was found to have a minimal effect on scores, nationality and age did have a medium effect on the online political activism factor. Technical skills by themselves appear to play little role in predicting online political engagement; the largest predictor of online political engagement was critical perspective and a willingness to use the Internet in active ways beyond simply consuming content.<\/jats:p>","DOI":"10.3390\/informatics9030061","type":"journal-article","created":{"date-parts":[[2022,8,21]],"date-time":"2022-08-21T22:23:13Z","timestamp":1661120593000},"page":"61","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Evaluating and Revising the Digital Citizenship Scale"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3203-1448","authenticated-orcid":false,"given":"Randy","family":"Connolly","sequence":"first","affiliation":[{"name":"Department of Math and Computing, Mount Royal University, 4825 Mount Royal Gate SW, Calgary, AB T3E 6K6, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1678-2778","authenticated-orcid":false,"given":"Janet","family":"Miller","sequence":"additional","affiliation":[{"name":"Student Counselling, Mount Royal University, 4825 Mount Royal Gate SW, Calgary, AB T3E 6K6, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.compedu.2017.01.002","article-title":"What it means to be a citizen in the internet age: Development of a reliable and valid digital citizenship scale","volume":"107","author":"Choi","year":"2017","journal-title":"Comput. Educ."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndez-Prados, J.S., Lozano-D\u00edaz, A., and Ainz-Galende, A. (2021). Measuring digital citizenship: A comparative analysis. Informatics, 8.","DOI":"10.3390\/informatics8010018"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Almond, G.A., and Verba, S. (1963). The Civic Culture: Political Attitudes and Democracy in Five Nations, Princeton University Press.","DOI":"10.1515\/9781400874569"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Putnam, R. (2001). Bowling Alone: The Collapse and Revival of American Community, Simon and Schuster.","DOI":"10.1145\/358916.361990"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1093\/pa\/gsr056","article-title":"Understanding electoral turnout among British young people: A review of the literature","volume":"65","author":"Phelps","year":"2011","journal-title":"Parliam. Aff."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/1746197917734542","article-title":"Youth political (dis)engagement and the need for citizenship education: Encouraging young people\u2019s civic and political participation through the curriculum","volume":"14","author":"Pontes","year":"2019","journal-title":"Educ. Citizsh. Soc. Justice"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1111\/j.1467-9248.2007.00718.x","article-title":"Citizenship norms and the expansion of political participation","volume":"56","author":"Dalton","year":"2008","journal-title":"Political Stud."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1080\/1369118X.2013.871318","article-title":"The great equalizer? Patterns of social media use and youth political engagement in three advanced democracies","volume":"17","author":"Xenos","year":"2014","journal-title":"Inf. Commun. Soc."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1177\/1065912912436695","article-title":"Is online participation distinct from offline participation? A latent class analysis of participation types and their stratification","volume":"66","author":"Oser","year":"2013","journal-title":"Political Res. Q."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1177\/0894439314526559","article-title":"Digital Media and Political Participation: The Moderating Role of Political Interest Across Acts and Over Time","volume":"33","author":"Bimber","year":"2015","journal-title":"Soc. Sci. Comput. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fpos.2020.00001","article-title":"What is youth political participation? Literature review on youth political participation and political attitudes","volume":"2","author":"Weiss","year":"2020","journal-title":"Front. Political Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1177\/0894439318814190","article-title":"Young people, digital media, and engagement: A meta-analysis of research","volume":"38","author":"Boulianne","year":"2020","journal-title":"Soc. Sci. Comput. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1903","DOI":"10.1080\/1369118X.2018.1469657","article-title":"Updating citizenship? The effects of digital media use on citizenship understanding and political participation","volume":"22","author":"Ohme","year":"2018","journal-title":"Inf. Commun. Soc."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"15","DOI":"10.7821\/naer.2021.1.616","article-title":"Digital rights, digital citizenship and digital literacy: What\u2019s the difference?","volume":"10","author":"Pangrazio","year":"2021","journal-title":"J. New Approaches Educ. Res."},{"key":"ref_15","first-page":"12","article-title":"Digital citizenship focus questions for implementation","volume":"32","author":"Ribble","year":"2004","journal-title":"Learn. Lead. Technol."},{"key":"ref_16","first-page":"137","article-title":"Educational leadership in an online world: Connecting students to technology responsibly, safely, and ethically","volume":"17","author":"Ribble","year":"2013","journal-title":"J. Asynchronous Learn. Netw."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/s10805-018-9302-9","article-title":"Discrepancy between learning and practicing digital citizenship","volume":"16","author":"Hui","year":"2018","journal-title":"J. Acad. Ethics"},{"key":"ref_18","first-page":"155","article-title":"Development of youth digital citizenship scale and implication for educational setting","volume":"21","author":"Kim","year":"2018","journal-title":"J. Educ. Technol. Soc."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3327","DOI":"10.1007\/s11423-020-09824-y","article-title":"Development of the digital and socio-civic skills (DIGISOC) questionnaire","volume":"68","author":"Peart","year":"2020","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1080\/17508487.2016.1234494","article-title":"Towards a radical digital citizenship in digital education","volume":"60","author":"Emejulu","year":"2019","journal-title":"Crit. Stud. Educ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"237","DOI":"10.3102\/00028312041002237","article-title":"What kind of citizen? The politics of educating for democracy","volume":"41","author":"Westheimer","year":"2004","journal-title":"Am. Educ. Res. J."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1080\/00405841.2021.1987094","article-title":"Digital citizenship with intersectionality lens: Towards participatory democracy driven digital citizenship education","volume":"60","author":"Choi","year":"2021","journal-title":"Theory Into Pract."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1108\/IJILT-06-2018-0067","article-title":"What kind of (digital) citizen? A between-studies analysis of research and teaching for democracy","volume":"35","author":"Heath","year":"2018","journal-title":"Int. J. Inf. Learn. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.compedu.2018.03.005","article-title":"Teachers as digital citizens: The influence of individual backgrounds, internet use and psychological characteristics on teachers\u2019 levels of digital citizenship","volume":"121","author":"Choi","year":"2018","journal-title":"Comput. Educ."},{"key":"ref_25","first-page":"172","article-title":"Understanding university students\u2019 thoughts and practices about digital citizenship","volume":"21","author":"Kara","year":"2018","journal-title":"J. Educ. Technol. Soc."},{"key":"ref_26","first-page":"1","article-title":"Needs analysis of digital citizenship education for university students in South Korea: Using importance-performance analysis","volume":"20","author":"Yoon","year":"2019","journal-title":"Educ. Technol. Int."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lozano-D\u00edaz, A., and Fern\u00e1ndez-Prados, J.S. (2020). Educating digital citizens: An opportunity to critical and activist perspective of sustainable development goals. Sustainability, 12.","DOI":"10.20944\/preprints202008.0208.v1"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1080\/00913367.2016.1269304","article-title":"An analysis of data quality: Professional panels, student subject pools, and Amazon\u2019s Mechanical Turk","volume":"46","author":"Kees","year":"2017","journal-title":"J. Advert."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bentley, F.R., Daskalova, N., and White, B. (2017, January 6\u201311). Comparing the Reliability of Amazon Mechanical Turk and Survey Monkey to Traditional Market Research Surveys. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA.","DOI":"10.1145\/3027063.3053335"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"79","DOI":"10.20982\/tqmp.09.2.p079","article-title":"A beginner\u2019s guide to factor analysis: Focusing on exploratory factor analysis","volume":"9","author":"Yong","year":"2013","journal-title":"Tutor. Quant. Methods Psychol."},{"key":"ref_31","unstructured":"Field, A. (2018). Discovering Statistics using IBM SPSS Statistics, Sage Press."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1017\/S1755773916000230","article-title":"The continuous expansion of citizen participation: A new taxonomy","volume":"10","author":"Theocharis","year":"2018","journal-title":"Eur. Political Sci. Rev."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1080\/00933104.2016.1210549","article-title":"Concept Analysis of Digital Citizenship for Democratic Citizenship Education in the Internet Age","volume":"44","author":"Choi","year":"2016","journal-title":"Theory Res. Soc. Educ."},{"key":"ref_34","unstructured":"Jolliffe, F.R. (1986). Survey Design and Analysis, Ellis Horwood."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.33151\/ajp.8.3.93","article-title":"Exploratory factor analysis: A five-step guide for novices","volume":"8","author":"Williams","year":"2010","journal-title":"Australas. J. Paramed."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/3\/61\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:12:07Z","timestamp":1760141527000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/3\/61"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,19]]},"references-count":35,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["informatics9030061"],"URL":"https:\/\/doi.org\/10.3390\/informatics9030061","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,19]]}}}