{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T10:41:34Z","timestamp":1780569694351,"version":"3.54.1"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T00:00:00Z","timestamp":1716336000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T00:00:00Z","timestamp":1716336000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"publisher","award":["197315"],"award-info":[{"award-number":["197315"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"publisher","award":["204700"],"award-info":[{"award-number":["204700"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008375","name":"University of Basel","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008375","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["EPJ Data Sci."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We assess whether the classic psychometric paradigm of risk perception can be improved or supplanted by novel approaches relying on language embeddings. To this end, we introduce the Basel Risk Norms, a large data set covering 1004 distinct sources of risk (e.g., vaccination, nuclear energy, artificial intelligence) and compare the psychometric paradigm against novel text and free-association embeddings in predicting risk perception. We find that an ensemble model combining text and free association rivals the predictive accuracy of the psychometric paradigm, captures additional affect and frequency-related dimensions of risk perception not accounted for by the classic approach, and has greater range of applicability to real-world text data, such as news headlines. Overall, our results establish the ensemble of text and free-association embeddings as a promising new tool for researchers and policymakers to track real-world risk perception.<\/jats:p>","DOI":"10.1140\/epjds\/s13688-024-00478-x","type":"journal-article","created":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T06:01:53Z","timestamp":1716357713000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Novel embeddings improve the prediction of risk perception"],"prefix":"10.1140","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-2965-1889","authenticated-orcid":false,"given":"Zak","family":"Hussain","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rui","family":"Mata","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dirk U.","family":"Wulff","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,5,22]]},"reference":[{"key":"478_CR1","doi-asserted-by":"publisher","first-page":"1232","DOI":"10.1126\/science.165.3899.1232","volume":"165","author":"C Starr","year":"1969","unstructured":"Starr C (1969) Social benefit versus technological risk. Science 165:1232\u20131238. https:\/\/doi.org\/10.1126\/science.165.3899.1232","journal-title":"Science"},{"key":"478_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2020.104344","volume":"203","author":"Y Li","year":"2020","unstructured":"Li Y, Hills T, Hertwig R (2020) A brief history of risk. Cognition 203:104344 https:\/\/doi.org\/10.1016\/j.cognition.2020.104344","journal-title":"Cognition"},{"key":"478_CR3","volume-title":"The precipice: existential risk and the future of humanity","author":"T Ord","year":"2020","unstructured":"Ord T (2020) The precipice: existential risk and the future of humanity. Bloomsbury Publishing, London"},{"issue":"2","key":"478_CR4","doi-asserted-by":"publisher","DOI":"10.1037\/0278-6133.26.2.136","volume":"26","author":"NT Brewer","year":"2007","unstructured":"Brewer NT, Chapman GB, Gibbons FX et al. (2007) Meta-analysis of the relationship between risk perception and health behavior: the example of vaccination. Health Psychol 26(2):136. https:\/\/doi.org\/10.1037\/0278-6133.26.2.136","journal-title":"Health Psychol"},{"key":"478_CR5","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.tifs.2016.01.003","volume":"49","author":"A Bearth","year":"2016","unstructured":"Bearth A, Siegrist M (2016) Are risk or benefit perceptions more important for public acceptance of innovative food technologies: a meta-analysis. Trends Food Sci Technol 49:14\u201323. https:\/\/doi.org\/10.1016\/j.tifs.2016.01.003","journal-title":"Trends Food Sci Technol"},{"issue":"2","key":"478_CR6","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1038\/s41558-018-0371-y","volume":"9","author":"AM van Valkengoed","year":"2019","unstructured":"van Valkengoed AM, Steg L (2019) Meta-analyses of factors motivating climate change adaptation behaviour. Nat Clim Change 9(2):158\u2013163. https:\/\/doi.org\/10.1038\/s41558-018-0371-y","journal-title":"Nat Clim Change"},{"issue":"2","key":"478_CR7","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1007\/bf00143739","volume":"9","author":"B Fischhoff","year":"1978","unstructured":"Fischhoff B, Slovic P, Lichtenstein S et al. (1978) How safe is safe enough? A psychometric study of attitudes towards technological risks and benefits. Policy Sci 9(2):127\u2013152. https:\/\/doi.org\/10.1007\/bf00143739","journal-title":"Policy Sci"},{"issue":"4799","key":"478_CR8","doi-asserted-by":"publisher","first-page":"280","DOI":"10.1126\/science.3563507","volume":"236","author":"P Slovic","year":"1987","unstructured":"Slovic P (1987) Perception of risk. Science 236(4799):280\u2013285. https:\/\/doi.org\/10.1126\/science.3563507","journal-title":"Science"},{"key":"478_CR9","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.jmp.2016.05.003","volume":"75","author":"KT Fox-Glassman","year":"2016","unstructured":"Fox-Glassman KT, Weber EU (2016) What makes risk acceptable? Revisiting the 1978 psychological dimensions of perceptions of technological risks. J Math Psychol 75:157\u2013169. https:\/\/doi.org\/10.1016\/j.jmp.2016.05.003","journal-title":"J Math Psychol"},{"issue":"2","key":"478_CR10","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1093\/pubmed\/fdn009","volume":"30","author":"LJ Bomlitz","year":"2008","unstructured":"Bomlitz LJ, Brezis M (2008) Misrepresentation of health risks by mass media. J Public Health 30(2):202\u2013204. https:\/\/doi.org\/10.1093\/pubmed\/fdn009","journal-title":"J Public Health"},{"issue":"2","key":"478_CR11","doi-asserted-by":"publisher","first-page":"35","DOI":"10.18775\/ijmsba.1849-5664-5419.2014.72.1005","volume":"7","author":"D Tsoy","year":"2021","unstructured":"Tsoy D, Tirasawasdichai T, Kurpayanidi KI et al. (2021) Role of social media in shaping public risk perception during COVID-19 pandemic: a theoretical review. Int J Manag Sci Bus Adm 7(2):35\u201341. https:\/\/doi.org\/10.18775\/ijmsba.1849-5664-5419.2014.72.1005","journal-title":"Int J Manag Sci Bus Adm"},{"issue":"3","key":"478_CR12","doi-asserted-by":"publisher","first-page":"631","DOI":"10.1177\/17456916211026896","volume":"17","author":"R Hertwig","year":"2022","unstructured":"Hertwig R, Wulff DU (2022) A description\u2013experience framework of the psychology of risk. Perspect Psychol Sci 17(3):631\u2013651. https:\/\/doi.org\/10.1177\/17456916211026896","journal-title":"Perspect Psychol Sci"},{"issue":"3","key":"478_CR13","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1177\/09637214211068113","volume":"31","author":"S Bhatia","year":"2022","unstructured":"Bhatia S, Aka A (2022) Cognitive modeling with representations from large-scale digital data. Curr Dir Psychol Sci 31(3):207\u2013214. https:\/\/doi.org\/10.1177\/09637214211068113","journal-title":"Curr Dir Psychol Sci"},{"key":"478_CR14","doi-asserted-by":"crossref","unstructured":"Hussain Z, Binz M, Mata R et al (2023) A tutorial on open-source large language models for behavioral science. PsyArXiv preprint","DOI":"10.31234\/osf.io\/f7stn"},{"issue":"8","key":"478_CR15","doi-asserted-by":"publisher","first-page":"3800","DOI":"10.1287\/mnsc.2018.3121","volume":"65","author":"S Bhatia","year":"2019","unstructured":"Bhatia S (2019) Predicting risk perception: new insights from data science. Manag Sci 65(8):3800\u20133823. https:\/\/doi.org\/10.1287\/mnsc.2018.3121","journal-title":"Manag Sci"},{"key":"478_CR16","doi-asserted-by":"publisher","first-page":"1532","DOI":"10.3115\/v1\/d14-1162","volume-title":"Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP)","author":"J Pennington","year":"2014","unstructured":"Pennington J, Socher R, Manning CD (2014) GloVe: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp\u00a01532\u20131543. https:\/\/doi.org\/10.3115\/v1\/d14-1162"},{"key":"478_CR17","unstructured":"Mikolov T, Grave E, Bojanowski P et al (2017) Advances in pre-training distributed word representations. arXiv preprint. arXiv:1712.09405"},{"key":"478_CR18","unstructured":"Devlin J, Chang MW, Lee K et al (2018) BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint. arXiv:1810.04805"},{"key":"478_CR19","doi-asserted-by":"publisher","unstructured":"Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. Adv Neural Inf Process Syst 30. https:\/\/doi.org\/10.48550\/arXiv.1706.03762","DOI":"10.48550\/arXiv.1706.03762"},{"issue":"1","key":"478_CR20","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1111\/tops.12586","volume":"14","author":"DU Wulff","year":"2022","unstructured":"Wulff DU, De Deyne S, Aeschbach S et al. (2022) Using network science to understand the aging lexicon: linking individuals\u2019 experience, semantic networks, and cognitive performance. Top Cogn Sci 14(1):93\u2013110. https:\/\/doi.org\/10.1111\/tops.12586","journal-title":"Top Cogn Sci"},{"issue":"27","key":"478_CR21","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.abm1883","volume":"8","author":"DU Wulff","year":"2022","unstructured":"Wulff DU, Mata R (2022) On the semantic representation of risk. Sci Adv 8(27):eabm1883. https:\/\/doi.org\/10.1126\/sciadv.abm1883","journal-title":"Sci Adv"},{"issue":"3","key":"478_CR22","doi-asserted-by":"publisher","first-page":"987","DOI":"10.3758\/s13428-018-1115-7","volume":"51","author":"S De Deyne","year":"2019","unstructured":"De Deyne S, Navarro DJ, Perfors A et al. (2019) The \u201csmall world of words\u201d English word association norms for over 12,000 cue words. Behav Res Methods 51(3):987\u20131006. https:\/\/doi.org\/10.3758\/s13428-018-1115-7","journal-title":"Behav Res Methods"},{"key":"478_CR23","doi-asserted-by":"publisher","unstructured":"Vankrunkelsven H, Verheyen S, Storms G et al (2018) Predicting lexical norms: a comparison between a word association model and text-based word co-occurrence models. J Cogn 1(1). https:\/\/doi.org\/10.5334\/joc.50","DOI":"10.5334\/joc.50"},{"issue":"9","key":"478_CR24","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000192","volume":"145","author":"S De Deyne","year":"2016","unstructured":"De Deyne S, Navarro DJ, Perfors A et al. (2016) Structure at every scale: a semantic network account of the similarities between unrelated concepts. J Exp Psychol Gen 145(9):1228. https:\/\/doi.org\/10.1037\/xge0000192","journal-title":"J Exp Psychol Gen"},{"key":"478_CR25","doi-asserted-by":"publisher","first-page":"1861","DOI":"10.24963\/ijcai.2017\/671","volume-title":"Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers","author":"S De Deyne","year":"2016","unstructured":"De Deyne S, Perfors A, Navarro DJ (2016) Predicting human similarity judgments with distributional models: the value of word associations. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, pp\u00a01861\u20131870. https:\/\/doi.org\/10.24963\/ijcai.2017\/671"},{"issue":"8","key":"478_CR26","doi-asserted-by":"publisher","DOI":"10.1111\/cogs.13030","volume":"45","author":"R Richie","year":"2021","unstructured":"Richie R, Bhatia S (2021) Similarity judgment within and across categories: a comprehensive model comparison. Cogn Sci 45(8):e13030. https:\/\/doi.org\/10.1111\/cogs.13030","journal-title":"Cogn Sci"},{"key":"478_CR27","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/978-3-540-24775-3_3","volume-title":"Pacific-Asia conference on knowledge discovery and data mining","author":"RR Bouckaert","year":"2004","unstructured":"Bouckaert RR, Frank E (2004) Evaluating the replicability of significance tests for comparing learning algorithms. In: Pacific-Asia conference on knowledge discovery and data mining. Springer, Berlin, pp\u00a03\u201312"},{"key":"478_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.31234\/osf.io\/mfkuq","volume":"55","author":"C Gao","year":"2022","unstructured":"Gao C, Shinkareva SV, Desai RH (2022) SCOPE: the South Carolina psycholinguistic metabase. Behav Res Methods 55:1\u201332. https:\/\/doi.org\/10.31234\/osf.io\/mfkuq","journal-title":"Behav Res Methods"},{"issue":"8","key":"478_CR29","doi-asserted-by":"publisher","DOI":"10.3390\/electronics8080832","volume":"8","author":"DV Carvalho","year":"2019","unstructured":"Carvalho DV, Pereira EM, Cardoso JS (2019) Machine learning interpretability: a survey on methods and metrics. Electronics 8(8):832. https:\/\/doi.org\/10.3390\/electronics8080832","journal-title":"Electronics"},{"issue":"1","key":"478_CR30","doi-asserted-by":"publisher","DOI":"10.3390\/e23010018","volume":"23","author":"P Linardatos","year":"2020","unstructured":"Linardatos P, Papastefanopoulos V, Kotsiantis S (2020) Explainable AI: a review of machine learning interpretability methods. Entropy 23(1):18. https:\/\/doi.org\/10.3390\/e23010018","journal-title":"Entropy"},{"key":"478_CR31","unstructured":"European Commission (2018). Artificial Intelligence for Europe (COM\/2018\/795). https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=COM"},{"key":"478_CR32","unstructured":"Preda G (2023) BBC News RSS feeds [self-updating data set]. Retrieved March 23, 2023, from https:\/\/www.kaggle.com\/datasets\/gpreda\/bbc-news"},{"key":"478_CR33","doi-asserted-by":"publisher","unstructured":"McInnes L, Healy J, Melville J (2018) UMAP: uniform manifold approximation and projection for dimension reduction. arXiv preprint. https:\/\/doi.org\/10.48550\/arXiv.1802.03426","DOI":"10.48550\/arXiv.1802.03426"},{"issue":"2","key":"478_CR34","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1007\/s11166-020-09336-3","volume":"61","author":"B Bruine De\u00a0Bruin","year":"2020","unstructured":"Bruine De\u00a0Bruin B, Saw HW, Goldman DP (2020) Political polarization in US residents\u2019 COVID-19 risk perceptions, policy preferences, and protective behaviors. J Risk Uncertain 61(2):177\u2013194. https:\/\/doi.org\/10.1007\/s11166-020-09336-3","journal-title":"J Risk Uncertain"},{"issue":"11","key":"478_CR35","doi-asserted-by":"publisher","first-page":"1444","DOI":"10.1038\/s41562-022-01479-4","volume":"6","author":"MA Jenny","year":"2022","unstructured":"Jenny MA, Betsch C (2022) Large-scale behavioural data are key to climate policy. Nat Hum Behav 6(11):1444\u20131447. https:\/\/doi.org\/10.1038\/s41562-022-01479-4","journal-title":"Nat Hum Behav"},{"issue":"1","key":"478_CR36","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1111\/j.1539-6924.2012.01941.x","volume":"33","author":"M Siegrist","year":"2013","unstructured":"Siegrist M (2013) The necessity for longitudinal studies in risk perception research. Risk Anal 33(1):50\u201351. https:\/\/doi.org\/10.1111\/j.1539-6924.2012.01941.x","journal-title":"Risk Anal"},{"key":"478_CR37","unstructured":"Binz M, Schulz E (2023) Turning large language models into cognitive models. arXiv preprint. arXiv:2306.03917"},{"key":"478_CR38","doi-asserted-by":"crossref","unstructured":"Binz M, Alaniz S, Roskies A et al (2023) How should the advent of large language models affect the practice of science? arXiv preprint. arXiv:2312.03759","DOI":"10.31219\/osf.io\/yr9xb"},{"issue":"S1","key":"478_CR39","doi-asserted-by":"publisher","first-page":"2191","DOI":"10.1111\/risa.13599","volume":"40","author":"M Siegrist","year":"2020","unstructured":"Siegrist M, \u00c1rvai J (2020) Risk perception: reflections on 40 years of research. Risk Anal 40(S1):2191\u20132206. https:\/\/doi.org\/10.1111\/risa.13599","journal-title":"Risk Anal"},{"key":"478_CR40","doi-asserted-by":"publisher","first-page":"611","DOI":"10.3758\/BF03212969","volume":"6","author":"EU Weber","year":"1999","unstructured":"Weber EU, Hsee CK (1999) Models and mosaics: investigating cross-cultural differences in risk perception and risk preference. Psychon Bull Rev 6:611\u2013617. https:\/\/doi.org\/10.3758\/BF03212969","journal-title":"Psychon Bull Rev"},{"key":"478_CR41","unstructured":"Geisen E (2022) Improve data quality by using a commitment request instead of attention checks. https:\/\/www.qualtrics.com\/blog\/attention-checks-and-data-quality\/"},{"key":"478_CR42","unstructured":"Mikolov T, Chen K, Corrado G et al (2013) Efficient estimation of word representations in vector space. arXiv preprint. arXiv:1301.3781"},{"key":"478_CR43","doi-asserted-by":"crossref","unstructured":"Wulff DU, Mata R (2023) Automated jingle\u2013jangle detection: using embeddings to tackle taxonomic incommensurability. PsyArXiv preprint","DOI":"10.31234\/osf.io\/9h7aw"},{"issue":"3","key":"478_CR44","doi-asserted-by":"publisher","first-page":"890","DOI":"10.3758\/s13428-011-0183-8","volume":"44","author":"JA Bullinaria","year":"2012","unstructured":"Bullinaria JA, Levy JP (2012) Extracting semantic representations from word co-occurrence statistics: stop-lists, stemming, and SVD. Behav Res Methods 44(3):890\u2013907. https:\/\/doi.org\/10.3758\/s13428-011-0183-8","journal-title":"Behav Res Methods"},{"issue":"1","key":"478_CR45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2105-7-91","volume":"7","author":"S Varma","year":"2006","unstructured":"Varma S, Simon R (2006) Bias in error estimation when using cross-validation for model selection. BMC Bioinform 7(1):1\u20138. https:\/\/doi.org\/10.1186\/1471-2105-7-91","journal-title":"BMC Bioinform"},{"key":"478_CR46","doi-asserted-by":"publisher","unstructured":"Hussain Z, Mata R, Wulff DU (2022) Semantic accounts of risk perception. https:\/\/doi.org\/10.17605\/OSF.IO\/6M7XR. osf.io\/6m7xr","DOI":"10.17605\/OSF.IO\/6M7XR"},{"key":"478_CR47","doi-asserted-by":"publisher","unstructured":"Hussain Z, Mata R, Wulff DU (2023) Semantic accounts of risk perception. https:\/\/doi.org\/10.17605\/OSF.IO\/GU9DF. osf.io\/gu9df","DOI":"10.17605\/OSF.IO\/GU9DF"}],"container-title":["EPJ Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-024-00478-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1140\/epjds\/s13688-024-00478-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-024-00478-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T06:02:05Z","timestamp":1716357725000},"score":1,"resource":{"primary":{"URL":"https:\/\/epjdatascience.springeropen.com\/articles\/10.1140\/epjds\/s13688-024-00478-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,22]]},"references-count":47,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["478"],"URL":"https:\/\/doi.org\/10.1140\/epjds\/s13688-024-00478-x","relation":{},"ISSN":["2193-1127"],"issn-type":[{"value":"2193-1127","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,22]]},"assertion":[{"value":"18 October 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 May 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"38"}}