{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T20:31:50Z","timestamp":1773001910584,"version":"3.50.1"},"reference-count":49,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T00:00:00Z","timestamp":1714348800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>The importance of researching information on the Internet is ever increasing. While ease of use and accessibility are advantages, there is a risk of not being able to adequately assess the relevance and reliability of online sources. With data from the BRIDGE-project (<jats:italic>N<\/jats:italic>\u2009=\u2009143) we assess the online movements of respondents and track how they researched digitally to answer a task on a generic, accessible topic. We then draw conclusions about their search behavior during this open online performance assessment. The controlled and monitored environment allowed to identify differences in their source selection and how those had an impact on the quality of their written statements respective to the given task.<\/jats:p>","DOI":"10.3389\/fcomp.2024.1366934","type":"journal-article","created":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T04:32:06Z","timestamp":1714365126000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Differences in source selection and their effect on the quality of written statements during a critical online reasoning performance assessment"],"prefix":"10.3389","volume":"6","author":[{"given":"Dominik","family":"Braunheim","sequence":"first","affiliation":[]},{"given":"Lisa","family":"Martin De Los Santos Kleinz","sequence":"additional","affiliation":[]},{"given":"Lukas","family":"Trierweiler","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2024,4,29]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1027\/1864-1105\/a000201","article-title":"How news type matters","volume":"28","author":"Andersen","year":"2016","journal-title":"J. Media Psychol."},{"key":"ref2","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1177\/1077695812469802","article-title":"Developing a news media literacy scale","volume":"68","author":"Ashley","year":"2013","journal-title":"Journal. Mass Commun. Educ."},{"key":"ref3","volume-title":"Soziale Medien. Gabler Wirschaftslexikon","author":"Bendel","year":"2018"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"145","DOI":"10.5771\/2196-7261-2023-2-145","article-title":"Erfassung und F\u00f6rderung von Kompetenzen zum kritischen Umgang mit Online-Informationen bei Rechtsreferendarinnen und -referendaren","volume":"10","author":"Braunheim","year":"2023","journal-title":"Zeitschrift f\u00fcr Didaktik der Rechtswissenschaft"},{"key":"ref5","volume-title":"ECAR study of students and information technology","author":"Brooks","year":"2016"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"143","DOI":"10.7557\/13.2377","article-title":"The elephant in the room: a place for Wikipedia in higher education? Nordlit","volume":"16","author":"Brox","year":"2012","journal-title":"Tidsskrift I Litteratur Og Kultur"},{"key":"ref7","first-page":"413","article-title":"The digital misinformation pipeline","volume-title":"Positive Learning in the Age of Information","author":"Ciampaglia","year":"2018"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1186\/s12874-018-0599-2","article-title":"Bubble effect: including internet search engines in systematic reviews introduces selection bias and impedes scientific reproducibility","volume":"18","author":"\u0106urkovi\u0107","year":"2018","journal-title":"BMC Med. Res. Methodol."},{"key":"ref9","author":"Fogg","year":"2003"},{"key":"ref10","volume-title":"Youth and digital media: From credibility to information quality","author":"Gasser","year":"2012"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1002\/rrq.027","article-title":"Comprehending and learning from internet sources: processing patterns of better and poorer learners","volume":"47","author":"Goldman","year":"2012","journal-title":"Read. Res. Q."},{"key":"ref12","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1146\/annurev-polisci-040811-115123","article-title":"Media Bias by the numbers: challenges and opportunities in the empirical study of partisan news","volume":"16","author":"Groeling","year":"2013","journal-title":"Annu. Rev. Polit. Sci."},{"key":"ref13","doi-asserted-by":"publisher","first-page":"eaau4586","DOI":"10.1126\/sciadv.aau4586","article-title":"Less than you think: prevalence and predictors of fake news dissemination on Facebook","volume":"5","author":"Guess","year":"2019","journal-title":"Sci. Adv."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1080\/13562517.2019.1578577","article-title":"Experts, knowledge and criticality in the age of \u2018alternative facts\u2019: re-examining the contribution of higher education","volume":"24","author":"Harrison","year":"2019","journal-title":"Teach. High. Educ."},{"key":"ref15","author":"Hasebrink","year":"2016"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.2281478","article-title":"Lessons learned: how college students seek information in the digital age","author":"Head","year":"2009","journal-title":"Soc. Sci. Res. Netw."},{"key":"ref17","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1515\/iwp-2018-0015","article-title":"Die Glaubw\u00fcrdigkeit der Wikipedia","volume":"69","author":"Hesse","year":"2018","journal-title":"Inform. Wissenschaft und Praxis"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1016\/j.eclinm.2018.12.005","article-title":"Social media use and adolescent mental health: findings from the UK millennium cohort study","volume":"6","author":"Kelly","year":"2018","journal-title":"EClinicalMedicine"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"7421","DOI":"10.1007\/s10639-022-10907-x","article-title":"Adolescents\u2019 credibility justifications when evaluating online texts","volume":"27","author":"Kiili","year":"2022","journal-title":"Educ. Inf. Technol."},{"key":"ref20","doi-asserted-by":"publisher","first-page":"Doc60","DOI":"10.3205\/zma001353","article-title":"Digital skills for medical students\u2014qualitative evaluation of the curriculum 4.0 \u201cmedicine in the digital age\u201d","volume":"37","author":"Kuhn","year":"2020","journal-title":"GMS J. Med. Educ."},{"key":"ref21","first-page":"6","article-title":"Macht ohne Verantwortung. Der wuchernde Einfluss der Medien und Desinteresse der Gesellschaft","volume":"41","author":"Leif","year":"2001","journal-title":"Aus Politik und Zeitgeschichte"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1002\/asi.22743","article-title":"Topic familiarity and information skills in online credibility evaluation","volume":"64","author":"Lucassen","year":"2013","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"ref23","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-658-19567-0_11","article-title":"Media effects on positive and negative learning","volume-title":"Positive learning in the age of information","author":"Maurer","year":"2018"},{"key":"ref24","article-title":"Positive and negative media effects on university students\u2019 learning: preliminary findings and a research program","volume-title":"Frontiers and advances in positive learning in the age of InformaTiOn (PLATO)","author":"Maurer","year":"2020"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1080\/07380569.2021.1912541","article-title":"Skipping the source and checking the contents: an in-depth look at students\u2019 approaches to web evaluation","volume":"38","author":"McGrew","year":"2021","journal-title":"Comput. Sch."},{"key":"ref26","first-page":"4","article-title":"The challenge That's bigger than fake news: civic reasoning in a social media environment","volume-title":"Am. Educ.","author":"McGrew","year":"2017"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"e50638","DOI":"10.2196\/50638","article-title":"Prompt engineering as an important emerging skill for medical professionals: tutorial","volume":"25","author":"Mesk\u00f3","year":"2023","journal-title":"J. Med. Internet Res."},{"key":"ref28","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/978-3-319-52246-3_3","article-title":"Evidence-Centered assessment design","volume-title":"Assessing model-based reasoning using evidence-centered design (Cham: Springer)","author":"Mislevy","year":"2017"},{"key":"ref29","doi-asserted-by":"publisher","first-page":"577843","DOI":"10.3389\/feduc.2020.577843","article-title":"Assessing university students\u2019 critical online reasoning ability: a conceptual and assessment framework with preliminary evidence","volume":"5","author":"Molerov","year":"2020","journal-title":"Front. Educ."},{"key":"ref30","first-page":"8","article-title":"Kommunikation, Medien und die \u00f6ffentliche Debatte","volume":"344","author":"M\u00fcller-Brehm","year":"2020","journal-title":"Informationen zur politischen Bildung"},{"key":"ref31","doi-asserted-by":"publisher","first-page":"914857","DOI":"10.3389\/feduc.2022.914857","article-title":"Validation of newly developed tasks for the assessment of generic critical online reasoning (COR) of university students and graduates","volume":"7","author":"Nagel","year":"2022","journal-title":"Front. Educ."},{"key":"ref32","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/978-3-658-27886-1_14","article-title":"Performance assessment of generic and domain-specific skills in higher education economics","volume-title":"Student learning in German higher education: Innovative measurement approaches and research results","author":"Nagel","year":"2020"},{"key":"ref33","volume-title":"Science education in an age of misinformation","author":"Osborne","year":"2022"},{"key":"ref34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-322-83735-6_1","article-title":"Erkenntnisgewinnung. Hypothesenbildung und Statistik","volume-title":"Neuere statistische Verfahren und Modellbildung in der Geo\u00f6kologie","author":"Schr\u00f6der","year":"1994"},{"key":"ref35","first-page":"246","article-title":"Erosion des Vertrauens zwischen Medien und Publikum?","volume":"5","author":"Schultz","year":"2017","journal-title":"Media Perspektiven"},{"key":"ref36","volume-title":"Theorien der Mediennutzung","author":"Schweiger","year":"2007"},{"key":"ref37","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1080\/15305058.2018.1543309","article-title":"Assessment of university students\u2019 critical thinking: next generation performance assessment","volume":"19","author":"Shavelson","year":"2019","journal-title":"Int. J. Test."},{"key":"ref38","author":"Speicher","year":"2015"},{"key":"ref39","volume-title":"Mediennutzung Studierender: \u00dcber den Umgang mit Medien in hochschulischen Kontexten. Systematisches Review nationaler und internationaler Studien zur Mediennutzung Studierender","author":"Steffens","year":"2017"},{"key":"ref40","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1146\/annurev-psych-020821-011744","article-title":"Attitudes, habits, and behavior change","volume":"73","author":"Verplanken","year":"2022","journal-title":"Annu. Rev. Psychol."},{"key":"ref41","volume-title":"Measuring Wikipedia","author":"Voss","year":"2005"},{"key":"ref42","volume-title":"Politikpanel Deutschland \u2013 Ausgew\u00e4hlte Ergebnisse der zweiten Welle einer Bev\u00f6lkerungsumfrage zu den Auswirkungen des Corona-Virus","author":"Wagschal","year":"2020"},{"key":"ref43","volume-title":"Fundamentals of critical argumentation. Critical reasoning and argumentation","author":"Walton","year":"2006"},{"key":"ref44","author":"Wineburg","year":"2017"},{"key":"ref45","doi-asserted-by":"publisher","first-page":"2096","DOI":"10.1177\/1461444815580413","article-title":"Political information repertoires and political participation","volume":"18","author":"Wolfsfeld","year":"2016","journal-title":"New Media Soc."},{"key":"ref46","doi-asserted-by":"publisher","first-page":"597","DOI":"10.2991\/assehr.k.220504.109","article-title":"Analysis on how algorithms reshape People\u2019s existence, cognition, and relationships","volume":"664","author":"Zhang","year":"2022","journal-title":"Adv. Soc. Sci. Educ. Hum. Res."},{"key":"ref47","doi-asserted-by":"publisher","first-page":"2192","DOI":"10.3389\/fpsyg.2020.02192","article-title":"The role of students\u2019 beliefs when critically reasoning from multiple contradictory sources of information in performance assessments","volume":"11","author":"Zlatkin-Troitschanskaia","year":"2020","journal-title":"Front. Psychol."},{"key":"ref48","doi-asserted-by":"publisher","first-page":"9","DOI":"10.15366\/jospoe2021.13.001","article-title":"Performance assessment and digital training framework for young professionals\u2019 generic and domain-specific online reasoning in law, medicine, and teacher practice","volume":"13","author":"Zlatkin-Troitschanskaia","year":"","journal-title":"J. Supranat. Pol. Educ."},{"key":"ref49","doi-asserted-by":"publisher","first-page":"1996","DOI":"10.1080\/03075079.2021.1953336","article-title":"Students\u2019 online information use and learning progress in higher education \u2013 a critical literature review","volume":"46","author":"Zlatkin-Troitschanskaia","year":"","journal-title":"Stud. High. Educ."}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2024.1366934\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T04:32:17Z","timestamp":1714365137000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2024.1366934\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,29]]},"references-count":49,"alternative-id":["10.3389\/fcomp.2024.1366934"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2024.1366934","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,29]]},"article-number":"1366934"}}