{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,29]],"date-time":"2025-08-29T10:06:43Z","timestamp":1756462003760,"version":"3.41.0"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,12,22]],"date-time":"2021-12-22T00:00:00Z","timestamp":1640131200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Web"],"published-print":{"date-parts":[[2022,5,31]]},"abstract":"<jats:p>\n            As the Internet grows in number of users and in the diversity of services, it becomes more influential on peoples lives. It has the potential of constructing or modifying the opinion, the mental perception, and the values of individuals. What is being created and published online is a reflection of people\u2019s values and beliefs. As a global platform, the Internet is a great source of information for researching the online culture of many different countries. In this work we develop a methodology for measuring data from textual online sources using word embedding models, to create a country-based online human values index that captures cultural traits and values worldwide. Our methodology is applied with a dataset of 1.7 billion tweets, and then we identify their location among 59 countries. We create a list of 22\n            <jats:bold>Online Values Inquiries (OVI)<\/jats:bold>\n            , each one capturing different questions from the World Values Survey, related to several values such as religion, science, and abortion. We observe that our methodology is indeed capable of capturing human values online for different counties and different topics. We also show that some online values are highly correlated (up to\n            <jats:italic>c<\/jats:italic>\n            = 0.69,\n            <jats:italic>p<\/jats:italic>\n            &lt; 0.05) with the corresponding offline values, especially religion-related ones. Our method is generic, and we believe it is useful for social sciences specialists, such as demographers and sociologists, that can use their domain knowledge and expertise to create their own Online Values Inquiries, allowing them to analyze human values in the online environment.\n          <\/jats:p>","DOI":"10.1145\/3501306","type":"journal-article","created":{"date-parts":[[2021,12,22]],"date-time":"2021-12-22T18:19:01Z","timestamp":1640197141000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Measuring International Online Human Values with Word Embeddings"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7274-3116","authenticated-orcid":false,"given":"Gabriel","family":"Magno","sequence":"first","affiliation":[{"name":"Universidade Federal de Minas Gerais (UFMG), Minas Gerais, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6452-0361","authenticated-orcid":false,"given":"Virgilio","family":"Almeida","sequence":"additional","affiliation":[{"name":"Universidade Federal de Minas Gerais (UFMG), Minas Gerais, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,12,22]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186011"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature23018"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.3386\/w20010"},{"key":"e_1_3_2_5_2","volume-title":"Culture & Conflict Resolution","author":"Avruch K.","year":"1998","unstructured":"K. Avruch and United States Institute of Peace. 1998. Culture & Conflict Resolution. United States Institute of Peace Press. 98030951https:\/\/books.google.com.br\/books?id=OofmUheyGJAC."},{"key":"e_1_3_2_6_2","first-page":"089443931982801","article-title":"Linking Twitter and survey data: The impact of survey mode and demographics on consent rates across three UK studies","author":"Baghal Tarek A. l.","year":"2019","unstructured":"Tarek A. l. Baghal, Luke Sloan, Curtis Jessop, Matthew L. Williams, and Pete Burnap. 2019. Linking Twitter and survey data: The impact of survey mode and demographics on consent rates across three UK studies. Social Science Computer Review 0, 0 (2019), 0894439319828011. DOI: https:\/\/doi.org\/10.1177\/0894439319828011arXiv:https:\/\/doi.org\/10.1177\/0894439319828011","journal-title":"Social Science Computer Review"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1080\/24694452.2017.1308240"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0206841"},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","unstructured":"Piotr Bojanowski Edouard Grave Armand Joulin and Tomas Mikolov. 2017. Enriching Word Vectors with Subword Information. arxiv:1607.04606 [cs.CL]","DOI":"10.1162\/tacl_a_00051"},{"key":"e_1_3_2_10_2","volume-title":"ICWSM","author":"Bollen Johan","year":"2011","unstructured":"Johan Bollen, Huina Mao, and Alberto Pepe. 2011. Modeling public mood and emotion: Twitter sentiment and socio-economic phenomena. In ICWSM."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jocs.2010.12.007"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.5555\/3157382.3157584"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.aal4230"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531608"},{"key":"e_1_3_2_15_2","article-title":"Twitter: Number of monthly active users 2010\u20132019","author":"Clement J.","year":"2019","unstructured":"J. Clement. 2019. Twitter: Number of monthly active users 2010\u20132019. Statista. https:\/\/www.statista.com\/statistics\/282087\/number-of-monthly-active-twitter-users\/. [Online: accessed 02-Feb-2020].","journal-title":"Statista. https:\/\/www.statista.com\/statistics\/282087\/number-of-monthly-active-twitter-users\/"},{"key":"e_1_3_2_16_2","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171\u20134186. DOI: https:\/\/doi.org\/10.18653\/v1\/N19-1423"},{"key":"e_1_3_2_17_2","first-page":"63","volume-title":"The Use of Twitter in 2013 Italian Political Election","author":"Di Fraia Guido","year":"2014","unstructured":"Guido Di Fraia and Maria Carlotta Missaglia. 2014. The Use of Twitter in 2013 Italian Political Election. Springer International Publishing, Cham, 63\u201377. DOI: https:\/\/doi.org\/10.1007\/978-3-319-04666-2_5"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2017.1353640"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3091478.3091496"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1177\/0022022110381429"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531725"},{"key":"e_1_3_2_22_2","volume-title":"International AAAI Conference on Web and Social Media","author":"Garcia-Gavilanes Ruth","year":"2013","unstructured":"Ruth Garcia-Gavilanes, Daniele Quercia, and Alejandro Jaimes. 2013. Cultural dimensions in Twitter: Time, individualism and power. In International AAAI Conference on Web and Social Media. https:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM13\/paper\/view\/6102."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433490"},{"key":"e_1_3_2_24_2","article-title":"A walk in Facebook: Uniform sampling of users in online social networks","volume":"0906","author":"Gjoka Minas","year":"2009","unstructured":"Minas Gjoka, Maciej Kurant, Carter T. Butts, and Athina Markopoulou. 2009. A walk in Facebook: Uniform sampling of users in online social networks. CoRR abs\/0906.0060 (2009). arXiv:0906.0060 http:\/\/arxiv.org\/abs\/0906.0060.","journal-title":"CoRR"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.5555\/1314498.1314572"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.74.6.1464"},{"key":"e_1_3_2_27_2","article-title":"World Internet Users and 2019 Population Stats","author":"Group Miniwatts Marketing","year":"2019","unstructured":"Miniwatts Marketing Group. 2019. World Internet Users and 2019 Population Stats. Internet World Stats. https:\/\/www.internetworldstats.com\/stats.htm. [Online: accessed 02-Feb-2020].","journal-title":"Internet World Stats. https:\/\/www.internetworldstats.com\/stats.htm"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2017.55"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1080\/15230406.2014.890072"},{"key":"e_1_3_2_30_2","volume-title":"Cultures and Organizations: Software of the Mind, Third Edition","author":"Hofstede G.","year":"2010","unstructured":"G. Hofstede, G. J. Hofstede, and M. Minkov. 2010. Cultures and Organizations: Software of the Mind, Third Edition. McGraw-Hill Education. 91000205https:\/\/books.google.com.br\/books?id=o4OqTgV3V00C."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1515\/9780691214429"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.2307\/2657288"},{"key":"e_1_3_2_33_2","article-title":"World Values Survey: Round Six - Country-Pooled Datafile 2010\u20132014","author":"Inglehart R.","year":"2014","unstructured":"R. Inglehart, C. Haerpfer, A. Moreno, C. Welzel, K. Kizilova, J. Diez-Medrano, M. Lagos, P. Norris, E. Ponarin, B. Puranen, et\u00a0al. 2014. World Values Survey: Round Six - Country-Pooled Datafile 2010\u20132014. Madrid: JD Systems Institute.","journal-title":"Madrid: JD Systems Institute"},{"key":"e_1_3_2_34_2","volume-title":"Essais de Linguistique G\u00e9n\u00e9rale","author":"Jakobson R.","year":"1969","unstructured":"R. Jakobson and N. Ruwet. 1969. Essais de Linguistique G\u00e9n\u00e9rale. Editions de Minuit. https:\/\/books.google.com.br\/books?id=OZhHvgAACAAJ."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2018.11.024"},{"key":"e_1_3_2_36_2","first-page":"482","volume-title":"EACL","author":"Lebret R\u00e9mi","year":"2014","unstructured":"R\u00e9mi Lebret and Ronan Collobert. 2014. Word embeddings through Hellinger PCA. In EACL, Gosse Bouma and Yannick Parmentier (Eds.). The Association for Computer Linguistics, 482\u2013490. http:\/\/www.aclweb.org\/anthology\/E14-1051."},{"key":"e_1_3_2_37_2","series-title":"A Technique for the Measurement of Attitudes","volume-title":"A Technique for the Measurement of Attitudes","author":"Likert R.","year":"1932","unstructured":"R. Likert. 1932. A Technique for the Measurement of Attitudes. Number N\u00ba 136-165 in A Technique for the Measurement of Attitudes. Publisher not identified. 33012634https:\/\/books.google.com.br\/books?id=9rotAAAAYAAJ."},{"key":"e_1_3_2_38_2","volume-title":"Sociology","author":"Macionis J. J.","year":"2016","unstructured":"J. J. Macionis. 2016. Sociology. Pearson; 16th edition. https:\/\/books.google.com.br\/books?id=BbjRZR2MJuIC."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2398776.2398794"},{"key":"e_1_3_2_40_2","article-title":"Efficient estimation of word representations in vector space","volume":"1301","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. CoRR abs\/1301.3781 (2013). http:\/\/dblp.uni-trier.de\/db\/journals\/corr\/corr1301.html#abs-1301-3781.","journal-title":"CoRR"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.5555\/2999792.2999959"},{"key":"e_1_3_2_42_2","volume-title":"What Makes Us Different and Similar: A New Interpretation of the World Values Survey and Other Cross-Cultural Data","author":"Minkov Michael","year":"2007","unstructured":"Michael Minkov. 2007. What Makes Us Different and Similar: A New Interpretation of the World Values Survey and Other Cross-Cultural Data. Klasika y Stil Publishing House."},{"key":"e_1_3_2_43_2","unstructured":"Malvina Nissim Rik van Noord and Rob van der Goot. 2019. Fair is Better than Sensational: Man is to Doctor as Woman is to Doctor. arxiv:1905.09866 [cs.CL]"},{"key":"e_1_3_2_44_2","volume-title":"ICWSM","author":"O\u2019Connor Brendan","year":"2010","unstructured":"Brendan O\u2019Connor, Ramnath Balasubramanyan, Bryan R. Routledge, and Noah A. Smith. 2010. From Tweets to polls: Linking text sentiment to public opinion time series. In ICWSM."},{"key":"e_1_3_2_45_2","first-page":"1","article-title":"The digital knowledge economy index: Mapping content production","author":"Ojanper\u00e4 Sanna","year":"2019","unstructured":"Sanna Ojanper\u00e4, Mark Graham, and Matthew Zook. 2019. The digital knowledge economy index: Mapping content production. The Journal of Development Studies 0, 0 (2019), 1\u201318. DOI: https:\/\/doi.org\/10.1080\/00220388.2018.1554208arXiv:https:\/\/doi.org\/10.1080\/00220388.2018.1554208","journal-title":"The Journal of Development Studies"},{"key":"e_1_3_2_46_2","first-page":"1532","volume-title":"EMNLP","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global vectors for word representation. In EMNLP, Vol. 14. 1532\u20131543."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1038\/srep00350"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2014.31"},{"key":"e_1_3_2_49_2","first-page":"45","volume-title":"Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks","author":"\u0158eh\u016f\u0159ek Radim","year":"2010","unstructured":"Radim \u0158eh\u016f\u0159ek and Petr Sojka. 2010. Software framework for topic modelling with large corpora. In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45\u201350."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/1879141.1879192"},{"key":"e_1_3_2_51_2","first-page":"627","article-title":"An improved model of semantic similarity based on lexical co-occurence","volume":"8","author":"Rohde Douglas L. T.","year":"2006","unstructured":"Douglas L. T. Rohde, Laura M. Gonnerman, and David C. Plaut. 2006. An improved model of semantic similarity based on lexical co-occurence. Communications of the ACM 8 (2006), 627\u2013633.","journal-title":"Communications of the ACM"},{"key":"e_1_3_2_52_2","volume-title":"The Nature of Human Values","author":"Rokeach M.","year":"1973","unstructured":"M. Rokeach. 1973. The Nature of Human Values. Free Press. lc72092870https:\/\/books.google.com.br\/books?id=TfRGAAAAMAAJ."},{"key":"e_1_3_2_53_2","first-page":"1","volume-title":"Advances in Experimental Social Psychology","author":"Schwartz Shalom H.","year":"1992","unstructured":"Shalom H. Schwartz. 1992. Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. In Advances in Experimental Social Psychology, Mark P. Zanna (Ed.). Vol. 25. Academic Press, 1\u201365. DOI: https:\/\/doi.org\/10.1016\/S0065-2601(08)60281-6"},{"key":"e_1_3_2_54_2","article-title":"Twitter reveals its daily active user numbers for the first time","author":"Shaban Hamza","year":"2019","unstructured":"Hamza Shaban. 2019. Twitter reveals its daily active user numbers for the first time. The Washington Post. https:\/\/www.washingtonpost.com\/technology\/2019\/02\/07\/twitter-reveals-its-daily-active-user-numbers-first-time\/. [Online: accessed 04-Jul-2019].","journal-title":"The Washington Post. https:\/\/www.washingtonpost.com\/technology\/2019\/02\/07\/twitter-reveals-its-daily-active-user-numbers-first-time\/"},{"key":"e_1_3_2_55_2","volume-title":"Proceedings of the Eighth International Conference on Weblogs and Social Media, ICWSM 2014, Ann Arbor, Michigan, USA, June 1\u20134, 2014","author":"Silva Thiago H.","year":"2014","unstructured":"Thiago H. Silva, Pedro O. S. Vaz de Melo, Jussara M. Almeida, Mirco Musolesi, and Antonio A. F. Loureiro. 2014. You are what you eat (and drink): Identifying cultural boundaries by analyzing food and drink habits in foursquare. In Proceedings of the Eighth International Conference on Weblogs and Social Media, ICWSM 2014, Ann Arbor, Michigan, USA, June 1\u20134, 2014. http:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM14\/paper\/view\/8113."},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0142209"},{"key":"e_1_3_2_57_2","volume-title":"Culturally Speaking: Culture, Communication and Politeness Theory","author":"Spencer-Oatey H.","year":"2008","unstructured":"H. Spencer-Oatey. 2008. Culturally Speaking: Culture, Communication and Politeness Theory. Continuum. 2008008309https:\/\/books.google.com.br\/books?id=aTOBAAAAMAAJ."},{"key":"e_1_3_2_58_2","unstructured":"Helen Spencer-Oatey. 2012. What is Culture?: A Compilation of Quotations. https:\/\/www2.warwick.ac.uk\/fac\/soc\/al\/globalpad\/openhouse\/interculturalskills\/global_pad_-_what_is_culture.pdf. Recommended."},{"key":"e_1_3_2_59_2","article-title":"Evaluating language identification performance","year":"2015","unstructured":"tm. 2015. Evaluating language identification performance. Twitter Engineering. https:\/\/blog.twitter.com\/engineering\/en_us\/a\/2015\/evaluating-language-identification-performance. [Online: accessed 09-Oct-2021].","journal-title":"Twitter Engineering. https:\/\/blog.twitter.com\/engineering\/en_us\/a\/2015\/evaluating-language-identification-performance"},{"key":"e_1_3_2_60_2","article-title":"World Values Survey \u2014 Wikipedia, The Free Encyclopedia","year":"2019","unstructured":"Wikipedia. 2019. World Values Survey \u2014 Wikipedia, The Free Encyclopedia. http:\/\/en.wikipedia.org\/w\/index.php?title=World%20Values%20Survey&oldid=885226660. [Online: accessed 08-May-2019].","journal-title":"http:\/\/en.wikipedia.org\/w\/index.php?title=World%20Values%20Survey&oldid=885226660"},{"key":"e_1_3_2_61_2","article-title":"Languages with official status in India \u2014 Wikipedia, The Free Encyclopedia","author":"contributors Wikipedia","year":"2020","unstructured":"Wikipedia contributors. 2020. Languages with official status in India \u2014 Wikipedia, The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=Languages_with_official_status_in_India&oldid=938502640. [Online: accessed 02-Feb-2020].","journal-title":"https:\/\/en.wikipedia.org\/w\/index.php?title=Languages_with_official_status_in_India&oldid=938502640"},{"key":"e_1_3_2_62_2","article-title":"South Africa \u2014 Wikipedia, The Free Encyclopedia","author":"contributors Wikipedia","year":"2020","unstructured":"Wikipedia contributors. 2020. South Africa \u2014 Wikipedia, The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=South_Africa&oldid=938819999. [Online: accessed 02-Feb-2020].","journal-title":"https:\/\/en.wikipedia.org\/w\/index.php?title=South_Africa&oldid=938819999"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.5555\/3326943.3327026"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1418680112"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/2567948.2576930"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25321-8_3"}],"container-title":["ACM Transactions on the Web"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501306","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3501306","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:19Z","timestamp":1750188619000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501306"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,22]]},"references-count":65,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,5,31]]}},"alternative-id":["10.1145\/3501306"],"URL":"https:\/\/doi.org\/10.1145\/3501306","relation":{},"ISSN":["1559-1131","1559-114X"],"issn-type":[{"type":"print","value":"1559-1131"},{"type":"electronic","value":"1559-114X"}],"subject":[],"published":{"date-parts":[[2021,12,22]]},"assertion":[{"value":"2020-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}