{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T03:19:21Z","timestamp":1771471161777,"version":"3.50.1"},"reference-count":79,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T00:00:00Z","timestamp":1648598400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"publisher","award":["320781"],"award-info":[{"award-number":["320781"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,3,30]]},"abstract":"<jats:p>Quantifying the amount of polarization is crucial for understanding and studying political polarization in political and social systems. Several methods are used commonly to measure polarization in social networks by purely inspecting their structure. We analyse eight of such methods and show that all of them yield high polarization scores even for random networks with similar density and degree distributions to typical real-world networks. Further, some of the methods are sensitive to degree distributions and relative sizes of the polarized groups. We propose normalization to the existing scores and a minimal set of tests that a score should pass in order for it to be suitable for separating polarized networks from random noise. The performance of the scores increased by 38%-220% after normalization in a classification task of 203 networks. Further, we find that the choice of method is not as important as normalization, after which most of the methods have better performance than the best-performing method before normalization. This work opens up the possibility to critically assess and compare the features and performance of different methods for measuring structural polarization.<\/jats:p>","DOI":"10.1145\/3512962","type":"journal-article","created":{"date-parts":[[2022,4,7]],"date-time":"2022-04-07T16:54:59Z","timestamp":1649350499000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures"],"prefix":"10.1145","volume":"6","author":[{"given":"Ali","family":"Salloum","sequence":"first","affiliation":[{"name":"Aalto University, Espoo, Finland"}]},{"given":"Ted Hsuan Yun","family":"Chen","sequence":"additional","affiliation":[{"name":"Aalto University &amp; University of Helsinki, Espoo, Finland"}]},{"given":"Mikko","family":"Kivel\u00e4","sequence":"additional","affiliation":[{"name":"Aalto University, Espoo, Finland"}]}],"member":"320","published-online":{"date-parts":[[2022,4,7]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Measurement validity: A shared standard for qualitative and quantitative research. American political science review 95, 3","author":"Adcock Robert","year":"2001","unstructured":"Robert Adcock and David Collier . 2001. Measurement validity: A shared standard for qualitative and quantitative research. American political science review 95, 3 ( 2001 ), 529--546. Robert Adcock and David Collier. 2001. Measurement validity: A shared standard for qualitative and quantitative research. American political science review 95, 3 (2001), 529--546."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v8i1.14524"},{"key":"e_1_2_1_3_1","volume-title":"Analyzing Voting Behavior in Italian Parliament: Group Cohesion and Evolution. In 2012 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining. IEEE, 140--146","author":"Amelio Alessia","year":"2012","unstructured":"Alessia Amelio and Clara Pizzuti . 2012 . Analyzing Voting Behavior in Italian Parliament: Group Cohesion and Evolution. In 2012 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining. IEEE, 140--146 . https:\/\/doi.org\/10.1109\/ASONAM.2012.33 10.1109\/ASONAM.2012.33 Alessia Amelio and Clara Pizzuti. 2012. Analyzing Voting Behavior in Italian Parliament: Group Cohesion and Evolution. In 2012 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining. IEEE, 140--146. https:\/\/doi.org\/10.1109\/ASONAM.2012.33"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.85.066118"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1804840115"},{"key":"e_1_2_1_6_1","volume-title":"Dynamics of political polarization. American sociological review 72, 5","author":"Baldassarri Delia","year":"2007","unstructured":"Delia Baldassarri and Peter Bearman . 2007. Dynamics of political polarization. American sociological review 72, 5 ( 2007 ), 784--811. Delia Baldassarri and Peter Bearman. 2007. Dynamics of political polarization. American sociological review 72, 5 (2007), 784--811."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1086\/590649"},{"key":"e_1_2_1_8_1","volume-title":"Emergence of Scaling in Random Networks. Science 286, 5439","author":"Barab\u00e1si Albert-L\u00e1szl\u00f3","year":"1999","unstructured":"Albert-L\u00e1szl\u00f3 Barab\u00e1si and R\u00e9ka Albert . 1999. Emergence of Scaling in Random Networks. Science 286, 5439 ( 1999 ), 509--512. https:\/\/doi.org\/10.1126\/science.286.5439.509 10.1126\/science.286.5439.509 Albert-L\u00e1szl\u00f3 Barab\u00e1si and R\u00e9ka Albert. 1999. Emergence of Scaling in Random Networks. Science 286, 5439 (1999), 509--512. https:\/\/doi.org\/10.1126\/science.286.5439.509"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.124.048301"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2978950"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1093\/jcmc\/zmx002"},{"key":"e_1_2_1_12_1","volume-title":"Polarization of Climate Politics Results from Partisan Sorting: Evidence from Finnish Twittersphere. arXiv:2007.02706","author":"Yun Chen Ted Hsuan","year":"2020","unstructured":"Ted Hsuan Yun Chen , Ali Salloum , Antti Gronow , Tuomas Yl\u00e4-Anttila , and Mikko Kivel\u00e4 . 2020. Polarization of Climate Politics Results from Partisan Sorting: Evidence from Finnish Twittersphere. arXiv:2007.02706 ( 2020 ). Ted Hsuan Yun Chen, Ali Salloum, Antti Gronow, Tuomas Yl\u00e4-Anttila, and Mikko Kivel\u00e4. 2020. Polarization of Climate Politics Results from Partisan Sorting: Evidence from Finnish Twittersphere. arXiv:2007.02706 (2020)."},{"key":"e_1_2_1_13_1","volume-title":"Cosma Rohilla Shalizi, and Mark EJ Newman","author":"Clauset Aaron","year":"2009","unstructured":"Aaron Clauset , Cosma Rohilla Shalizi, and Mark EJ Newman . 2009 . Power-law distributions in empirical data. SIAM review 51, 4 (2009), 661--703. Aaron Clauset, Cosma Rohilla Shalizi, and Mark EJ Newman. 2009. Power-law distributions in empirical data. SIAM review 51, 4 (2009), 661--703."},{"key":"e_1_2_1_14_1","volume-title":"Proc. 5th International AAAI Conference on Weblogs and Social Media (ICWSM). http:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM11\/paper\/view\/2847","author":"Conover Michael","year":"2011","unstructured":"Michael Conover , Jacob Ratkiewicz , Matthew Francisco , Bruno Gon\u00e7alves , Alessandro Flammini , and Filippo Menczer . 2011 . Political Polarization on Twitter . In Proc. 5th International AAAI Conference on Weblogs and Social Media (ICWSM). http:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM11\/paper\/view\/2847 Michael Conover, Jacob Ratkiewicz, Matthew Francisco, Bruno Gon\u00e7alves, Alessandro Flammini, and Filippo Menczer. 2011. Political Polarization on Twitter. In Proc. 5th International AAAI Conference on Weblogs and Social Media (ICWSM). http:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM11\/paper\/view\/2847"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7285"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1140\/epjds\/s13688-019-0213-9"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0116046"},{"key":"e_1_2_1_18_1","volume-title":"Social Informatics","author":"Darwish Kareem","unstructured":"Kareem Darwish . 2019. Quantifying Polarization on Twitter: The Kavanaugh Nomination . In Social Informatics . Springer International Publishing , Cham , 188--201. Kareem Darwish. 2019. Quantifying Polarization on Twitter: The Kavanaugh Nomination. In Social Informatics. Springer International Publishing, Cham, 188--201."},{"key":"e_1_2_1_19_1","volume-title":"Esteban Zindel Feuerstein, and Marco Brambilla.","author":"Ortiz de Zarate Juan Manuel","year":"2020","unstructured":"Juan Manuel Ortiz de Zarate , Marco Di Giovanni , Esteban Zindel Feuerstein, and Marco Brambilla. 2020 . Measuring Controversy in Social Networks Through NLP. In String Processing and Information Retrieval. Springer International Publishing , Cham, 194--209. Juan Manuel Ortiz de Zarate, Marco Di Giovanni, Esteban Zindel Feuerstein, and Marco Brambilla. 2020. Measuring Controversy in Social Networks Through NLP. In String Processing and Information Retrieval. Springer International Publishing, Cham, 194--209."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1304"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1086\/230995"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICAIIT.2019.8834552"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13278-020-00703-1"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5486\/PMD.1959.6.3-4.12"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Dario Fasino Arianna Tonetto and Francesco Tudisco. [n.d.]. Generating large scale-free networks with the Chung--Lu random graph model. Networks ([n. d.]). https:\/\/doi.org\/10.1002\/net.22012    10.1002\/net.22012\nDario Fasino Arianna Tonetto and Francesco Tudisco. [n.d.]. Generating large scale-free networks with the Chung--Lu random graph model. Networks ([n. d.]). https:\/\/doi.org\/10.1002\/net.22012","DOI":"10.1002\/net.22012"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.polisci.11.053106.153836"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0605965104"},{"key":"e_1_2_1_28_1","volume-title":"Community detection in networks: A user guide. Physics reports 659","author":"Fortunato Santo","year":"2016","unstructured":"Santo Fortunato and Darko Hric . 2016. Community detection in networks: A user guide. Physics reports 659 ( 2016 ), 1--44. Santo Fortunato and Darko Hric. 2016. Community detection in networks: A user guide. Physics reports 659 (2016), 1--44."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1137\/16M1087175"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186139"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3140565"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0201879"},{"key":"e_1_2_1_34_1","volume-title":"Randomized reference models for temporal networks. arXiv:1806.04032","author":"Gauvin Laetitia","year":"2018","unstructured":"Laetitia Gauvin , Mathieu G\u00e9nois , M\u00e1rton Karsai , Mikko Kivel\u00e4 , Taro Takaguchi , Eugenio Valdano , and Christian L Vestergaard . 2018. Randomized reference models for temporal networks. arXiv:1806.04032 ( 2018 ). Laetitia Gauvin, Mathieu G\u00e9nois, M\u00e1rton Karsai, Mikko Kivel\u00e4, Taro Takaguchi, Eugenio Valdano, and Christian L Vestergaard. 2018. Randomized reference models for temporal networks. arXiv:1806.04032 (2018)."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 7th International Conference on Weblogs and Social Media, ICWSM 2013 (01","author":"Guerra P.H.","year":"2013","unstructured":"P.H. Guerra , Wagner Meira Jr , Claire Cardie , and R. Kleinberg . 2013. A measure of polarization on social media Networks-Based on community boundaries . Proceedings of the 7th International Conference on Weblogs and Social Media, ICWSM 2013 (01 2013 ), 215--224. P.H. Guerra, Wagner Meira Jr, Claire Cardie, and R. Kleinberg. 2013. A measure of polarization on social media Networks-Based on community boundaries. Proceedings of the 7th International Conference on Weblogs and Social Media, ICWSM 2013 (01 2013), 215--224."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.70.025101"},{"key":"e_1_2_1_37_1","first-page":"1","article-title":"Cross-ideological discussions among conservative and liberal bloggers","volume":"134","author":"Hargittai Eszter","year":"2008","unstructured":"Eszter Hargittai , Jason Gallo , and Matthew Kane . 2008 . Cross-ideological discussions among conservative and liberal bloggers . Public Choice 134 , 1 -- 2 (2008), 67--86. Eszter Hargittai, Jason Gallo, and Matthew Kane. 2008. Cross-ideological discussions among conservative and liberal bloggers. Public Choice 134, 1--2 (2008), 67--86.","journal-title":"Public Choice"},{"key":"e_1_2_1_38_1","volume-title":"Kathryn Blackmond Laskey, and Samuel Leinhardt","author":"Holland Paul W","year":"1983","unstructured":"Paul W Holland , Kathryn Blackmond Laskey, and Samuel Leinhardt . 1983 . Stochastic blockmodels: First steps. Social networks 5, 2 (1983), 109--137. Paul W Holland, Kathryn Blackmond Laskey, and Samuel Leinhardt. 1983. Stochastic blockmodels: First steps. Social networks 5, 2 (1983), 109--137."},{"key":"#cr-split#-e_1_2_1_39_1.1","doi-asserted-by":"crossref","unstructured":"Michael Hout and Christopher Maggio. 2020. Immigration Race and Political Polarization. https:\/\/doi.org\/10.31235\/osf.io\/p7q2w 10.31235\/osf.io","DOI":"10.31235\/osf.io\/p7q2w"},{"key":"#cr-split#-e_1_2_1_39_1.2","doi-asserted-by":"crossref","unstructured":"Michael Hout and Christopher Maggio. 2020. Immigration Race and Political Polarization. https:\/\/doi.org\/10.31235\/osf.io\/p7q2w","DOI":"10.31235\/osf.io\/p7q2w"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.techfore.2021.120924"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1038\/nclimate2666"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1177\/106591290105400107"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/305219.305248"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1970.tb01770.x"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.socnet.2012.11.001"},{"key":"e_1_2_1_46_1","volume-title":"Informal networks and organizational crises: An experimental simulation. Social psychology quarterly","author":"Krackhardt David","year":"1988","unstructured":"David Krackhardt and Robert N Stern . 1988. Informal networks and organizational crises: An experimental simulation. Social psychology quarterly ( 1988 ), 123--140. David Krackhardt and Robert N Stern. 1988. Informal networks and organizational crises: An experimental simulation. Social psychology quarterly (1988), 123--140."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.81.046110"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1151659.1159930"},{"key":"e_1_2_1_49_1","volume-title":"The real cost of political polarization: evidence from the COVID-19 pandemic. Available at SSRN 3638373","author":"Makridis Christos","year":"2020","unstructured":"Christos Makridis and Jonathan T Rothwell . 2020. The real cost of political polarization: evidence from the COVID-19 pandemic. Available at SSRN 3638373 ( 2020 ). Christos Makridis and Jonathan T Rothwell. 2020. The real cost of political polarization: evidence from the COVID-19 pandemic. Available at SSRN 3638373 (2020)."},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 27th European Conference on Information Systems (ECIS). https:\/\/aisel.aisnet.org\/ecis2019_rp\/91\/","author":"Markgraf Moritz","year":"2019","unstructured":"Moritz Markgraf and Manfred Schoch . 2019 . Quantification of Echo Chambers: A Methodological Framework Considering Multi-party Systems . In Proceedings of the 27th European Conference on Information Systems (ECIS). https:\/\/aisel.aisnet.org\/ecis2019_rp\/91\/ Moritz Markgraf and Manfred Schoch. 2019. Quantification of Echo Chambers: A Methodological Framework Considering Multi-party Systems. In Proceedings of the 27th European Conference on Information Systems (ECIS). https:\/\/aisel.aisnet.org\/ecis2019_rp\/91\/"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1111\/ajps.12089"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764218759576"},{"key":"e_1_2_1_53_1","article-title":"Modularity of regular and treelike graphs","volume":"6","author":"McDiarmid Colin","year":"2017","unstructured":"Colin McDiarmid and Fiona Skerman . 2017 . Modularity of regular and treelike graphs . Journal of Complex Networks 6 , 4 (10 2017), 596--619. https:\/\/doi.org\/10.1093\/comnet\/cnx046 arXiv:https:\/\/academic.oup.com\/comnet\/article-pdf\/6\/4\/596\/25451962\/cnx046.pdf 10.1093\/comnet Colin McDiarmid and Fiona Skerman. 2017. Modularity of regular and treelike graphs. Journal of Complex Networks 6, 4 (10 2017), 596--619. https:\/\/doi.org\/10.1093\/comnet\/cnx046 arXiv:https:\/\/academic.oup.com\/comnet\/article-pdf\/6\/4\/596\/25451962\/cnx046.pdf","journal-title":"Journal of Complex Networks"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1002\/rsa.20910"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0147805"},{"key":"e_1_2_1_56_1","volume-title":"A critical point for random graphs with a given degree sequence. Random structures & algorithms 6, 2--3","author":"Molloy Michael","year":"1995","unstructured":"Michael Molloy and Bruce Reed . 1995. A critical point for random graphs with a given degree sequence. Random structures & algorithms 6, 2--3 ( 1995 ), 161--180. Michael Molloy and Bruce Reed. 1995. A critical point for random graphs with a given degree sequence. Random structures & algorithms 6, 2--3 (1995), 161--180."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1017\/nws.2012.3"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1063\/1.4913758"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.socnet.2018.07.007"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196764"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359243"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0601602103"},{"key":"e_1_2_1_63_1","volume-title":"Almerima Jamakovic, Priya Mahadevan, Amin Vahdat, Kevin E Bassler, Zolt\u00e1n Toroczkai, Mari\u00e1n Bogun\u00e1, Guido Caldarelli, et al.","author":"Orsini Chiara","year":"2015","unstructured":"Chiara Orsini , Marija M Dankulov , Pol Colomer-de Sim\u00f3n , Almerima Jamakovic, Priya Mahadevan, Amin Vahdat, Kevin E Bassler, Zolt\u00e1n Toroczkai, Mari\u00e1n Bogun\u00e1, Guido Caldarelli, et al. 2015 . Quantifying randomness in real networks. Nature communications 6, 1 (2015), 1--10. Chiara Orsini, Marija M Dankulov, Pol Colomer-de Sim\u00f3n, Almerima Jamakovic, Priya Mahadevan, Amin Vahdat, Kevin E Bassler, Zolt\u00e1n Toroczkai, Mari\u00e1n Bogun\u00e1, Guido Caldarelli, et al. 2015. Quantifying randomness in real networks. Nature communications 6, 1 (2015), 1--10."},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of ACM Conference (Conference'17)","author":"Ozer Mert","year":"2017","unstructured":"Mert Ozer , Mehmet Yigit Yildirim , and Hasan Davulcu . 2017 . Measuring the Polarization Effects of Bot Accounts in the US Gun Control Debate on Social Media . Proceedings of ACM Conference (Conference'17) (2017). Mert Ozer, Mehmet Yigit Yildirim, and Hasan Davulcu. 2017. Measuring the Polarization Effects of Bot Accounts in the US Gun Control Debate on Social Media. Proceedings of ACM Conference (Conference'17) (2017)."},{"key":"e_1_2_1_65_1","volume-title":"Parsimonious module inference in large networks. Physical review letters 110, 14","author":"Peixoto Tiago P","year":"2013","unstructured":"Tiago P Peixoto . 2013. Parsimonious module inference in large networks. Physical review letters 110, 14 ( 2013 ), 148701. Tiago P Peixoto. 2013. Parsimonious module inference in large networks. Physical review letters 110, 14 (2013), 148701."},{"key":"e_1_2_1_66_1","volume-title":"Measuring the Controversy Level of Arabic Trending Topics on Twitter. In 2016 7th International Conference on Information and Communication Systems (ICICS). https:\/\/doi.org\/10","author":"Rababah Abdullateef","year":"2016","unstructured":"Abdullateef Rababah , Mahmoud Al-Ayyoub , Yaser Jararweh , and Mohammed Al-Kabi . 2016 . Measuring the Controversy Level of Arabic Trending Topics on Twitter. In 2016 7th International Conference on Information and Communication Systems (ICICS). https:\/\/doi.org\/10 .1109\/IACS.2016.7476097 10.1109\/IACS.2016.7476097 Abdullateef Rababah, Mahmoud Al-Ayyoub, Yaser Jararweh, and Mohammed Al-Kabi. 2016. Measuring the Controversy Level of Arabic Trending Topics on Twitter. In 2016 7th International Conference on Information and Communication Systems (ICICS). https:\/\/doi.org\/10.1109\/IACS.2016.7476097"},{"key":"e_1_2_1_67_1","doi-asserted-by":"crossref","unstructured":"Ammar Rashed Mucahid Kutlu Kareem Darwish Tamer Elsayed and Cans?n Bayrak. 2020. Embeddings-Based Clustering for Target Specific Stances: The Case of a Polarized Turkey. arXiv:2005.09649 [cs.SI]  Ammar Rashed Mucahid Kutlu Kareem Darwish Tamer Elsayed and Cans?n Bayrak. 2020. Embeddings-Based Clustering for Target Specific Stances: The Case of a Polarized Turkey. arXiv:2005.09649 [cs.SI]","DOI":"10.1609\/icwsm.v15i1.18082"},{"key":"e_1_2_1_68_1","volume-title":"Affective polarisation in European party systems. European journal of political research 59, 2","author":"Reiljan Andres","year":"2020","unstructured":"Andres Reiljan . 2020. \" Fear and loathing across party lines'(also) in Europe : Affective polarisation in European party systems. European journal of political research 59, 2 ( 2020 ), 376--396. Andres Reiljan. 2020. \"Fear and loathing across party lines'(also) in Europe: Affective polarisation in European party systems. European journal of political research 59, 2 (2020), 376--396."},{"key":"e_1_2_1_69_1","volume-title":"Combining Network and Language Indicators for Tracking Conflict Intensity","author":"Rumshisky Anna","unstructured":"Anna Rumshisky , Mikhail Gronas , Peter Potash , Mikhail Dubov , Alexey Romanov , Saurabh Kulshreshtha , and Alex Gribov . 2017. Combining Network and Language Indicators for Tracking Conflict Intensity . In Social Informatics, Giovanni Luca Ciampaglia, Afra Mashhadi, and Taha Yasseri (Eds.). Springer International Publishing , Cham , 391--404. Anna Rumshisky, Mikhail Gronas, Peter Potash, Mikhail Dubov, Alexey Romanov, Saurabh Kulshreshtha, and Alex Gribov. 2017. Combining Network and Language Indicators for Tracking Conflict Intensity. In Social Informatics, Giovanni Luca Ciampaglia, Afra Mashhadi, and Taha Yasseri (Eds.). Springer International Publishing, Cham, 391--404."},{"key":"e_1_2_1_70_1","doi-asserted-by":"crossref","unstructured":"Ali Salloum. 2021. Code and Data for Separating Controversy from Noise: Comparison and Normalization of Structural Polarization Measures. https:\/\/github.com\/alesalloum\/normalized_polarization.  Ali Salloum. 2021. Code and Data for Separating Controversy from Noise: Comparison and Normalization of Structural Polarization Measures. https:\/\/github.com\/alesalloum\/normalized_polarization.","DOI":"10.1145\/3512962"},{"key":"e_1_2_1_71_1","volume-title":"Ted Hsuan Yun Chen, and Mikko Kivel\u00e4","author":"Salloum Ali","year":"2021","unstructured":"Ali Salloum , Ted Hsuan Yun Chen, and Mikko Kivel\u00e4 . 2021 . Data for Separating Controversy from Noise : Comparison and Normalization of Structural Polarization Measures . https:\/\/doi.org\/10.5281\/zenodo.4434245. 10.5281\/zenodo.4434245 Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivel\u00e4. 2021. Data for Separating Controversy from Noise: Comparison and Normalization of Structural Polarization Measures. https:\/\/doi.org\/10.5281\/zenodo.4434245."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2013825118"},{"key":"e_1_2_1_73_1","volume-title":"A review of natural language processing techniques for opinion mining systems. Information fusion 36","author":"Sun Shiliang","year":"2017","unstructured":"Shiliang Sun , Chen Luo , and Junyu Chen . 2017. A review of natural language processing techniques for opinion mining systems. Information fusion 36 ( 2017 ), 10--25. Shiliang Sun, Chen Luo, and Junyu Chen. 2017. A review of natural language processing techniques for opinion mining systems. Information fusion 36 (2017), 10--25."},{"key":"e_1_2_1_74_1","volume-title":"Research methods knowledge base","author":"Trochim William MK","unstructured":"William MK Trochim and James P Donnelly . 2001. Research methods knowledge base . Vol. 2 . Atomic Dog Pub . William MK Trochim and James P Donnelly. 2001. Research methods knowledge base. Vol. 2. Atomic Dog Pub."},{"key":"e_1_2_1_75_1","volume-title":"Party Polarization in Congress: A Network Science Approach. arXiv:0907","author":"Waugh Andrew Scott","unstructured":"Andrew Scott Waugh , Liuyi Pei , James H. Fowler , Peter J. Mucha , and Mason A. Porter . 2011 . Party Polarization in Congress: A Network Science Approach. arXiv:0907 .3509 [physics.soc-ph] Andrew Scott Waugh, Liuyi Pei, James H. Fowler, Peter J. Mucha, and Mason A. Porter. 2011. Party Polarization in Congress: A Network Science Approach. arXiv:0907.3509 [physics.soc-ph]"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/2492517.2492557"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1409770111"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.5555\/3327546.3327723"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1080\/09644016.2016.1166602"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3512962","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3512962","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:19Z","timestamp":1750188679000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3512962"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,30]]},"references-count":79,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2022,3,30]]}},"alternative-id":["10.1145\/3512962"],"URL":"https:\/\/doi.org\/10.1145\/3512962","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,30]]},"assertion":[{"value":"2022-04-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}