{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T22:42:23Z","timestamp":1784673743376,"version":"3.55.0"},"reference-count":62,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2016,4,20]],"date-time":"2016-04-20T00:00:00Z","timestamp":1461110400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["ACI-1358567"],"award-info":[{"award-number":["ACI-1358567"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Social norms have traditionally been difficult to quantify. In any particular society, their sheer number and complex interdependencies often limit a system-level analysis. One exception is that of the network of norms that sustain the online Wikipedia community. We study the fifteen-year evolution of this network using the interconnected set of pages that establish, describe, and interpret the community\u2019s norms. Despite Wikipedia\u2019s reputation for ad hoc governance, we find that its normative evolution is highly conservative. The earliest users create norms that both dominate the network and persist over time. These core norms govern both content and interpersonal interactions using abstract principles such as neutrality, verifiability, and assume good faith. As the network grows, norm neighborhoods decouple topologically from each other, while increasing in semantic coherence. Taken together, these results suggest that the evolution of Wikipedia\u2019s norm network is akin to bureaucratic systems that predate the information age.<\/jats:p>","DOI":"10.3390\/fi8020014","type":"journal-article","created":{"date-parts":[[2016,4,20]],"date-time":"2016-04-20T11:00:40Z","timestamp":1461150040000},"page":"14","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["The Evolution of Wikipedia\u2019s Norm Network"],"prefix":"10.3390","volume":"8","author":[{"given":"Bradi","family":"Heaberlin","sequence":"first","affiliation":[{"name":"Program in Cognitive Science, Indiana University, 1900 E 10th St, Bloomington, IN 47406, USA"},{"name":"Department of Political Science, Indiana University, 1100 E 7th St, Bloomington, IN 47405, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simon","family":"DeDeo","sequence":"additional","affiliation":[{"name":"Program in Cognitive Science, Indiana University, 1900 E 10th St, Bloomington, IN 47406, USA"},{"name":"Center for Complex Networks and Systems Research, Department of Informatics, Indiana University, 919 E 10th St, Bloomington, IN 47408, USA"},{"name":"Ostrom Workshop in Political Theory and Policy Analysis, 513 N Park Avenue, Bloomington, IN 47408, USA"},{"name":"Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2016,4,20]]},"reference":[{"key":"ref_1","unstructured":"Sherif, M. (1936). The Psychology of Social Norms, Harper."},{"key":"ref_2","unstructured":"Durkheim, E. (1938). The Rules of Sociological Method, Free Press."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"599","DOI":"10.2307\/1885324","article-title":"The economics of caste and of the rat race and other woeful tales","volume":"90","author":"Akerlof","year":"1976","journal-title":"Q. J. Econ."},{"key":"ref_4","unstructured":"Martin, M., and McIntyre, L.C. (1994). Readings in the Philosophy of Social Science, MIT Press."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ellickson, R.C., and Ellickson, R.C. (2009). Order without Law: How Neighbors Settle Disputes, Harvard University Press.","DOI":"10.2307\/j.ctvk12rdz"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bowles, S. (2009). Microeconomics: Behavior, Institutions, and Evolution, Princeton University Press.","DOI":"10.2307\/j.ctvcm4gc3"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"293","DOI":"10.2307\/1906815","article-title":"A formal theory of the employment relationship","volume":"19","author":"Simon","year":"1951","journal-title":"Econometrica"},{"key":"ref_8","unstructured":"Brennan, G., and Buchanan, J.M. (2008). The reason of rules, Cambridge University Press."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1146\/annurev.psych.57.102904.190038","article-title":"Psychological perspectives on legitimacy and legitimation","volume":"57","author":"Tyler","year":"2006","journal-title":"Annu. Rev. Psychol."},{"key":"ref_10","first-page":"231","article-title":"Legitimacy and cooperation: Why do people help the police fight crime in their communities","volume":"6","author":"Tyler","year":"2008","journal-title":"Ohio State J. Crim. Law"},{"key":"ref_11","unstructured":"Dunning, E., Goudsblom, J., and Mennell, S. (2000). The Civilizing Process: Sociogenetic and Psychogenetic Investigations, Wiley. [2nd ed.]."},{"key":"ref_12","unstructured":"Pinker, S. (2011). The Better Angels of Our Nature: Why Violence Has Declined, Penguin Group."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"9419","DOI":"10.1073\/pnas.1405984111","article-title":"The civilizing process in London\u2019s Old Bailey","volume":"111","author":"Klingenstein","year":"2014","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"943","DOI":"10.1371\/journal.pbio.0030194","article-title":"The evolution of norms","volume":"3","author":"Ehrlich","year":"2005","journal-title":"PLoS Biol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hess, C., and Ostrom, E. (2006). Understanding Knowledge as a Commons, MIT Press.","DOI":"10.7551\/mitpress\/6980.001.0001"},{"key":"ref_16","unstructured":"Benkler, Y. (2006). The Wealth of Networks: How Social Production Transforms Markets and Freedom, Yale University Press."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hess, C., and Ostrom, E. (2006). Understanding Knowledge as a Commons, MIT Press.","DOI":"10.7551\/mitpress\/6980.001.0001"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Frischmann, B., Madison, M., and Strandburg, K. (2014). Governing Knowledge Commons, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780199972036.001.0001"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ostrom, E. (1990). Governing the Commons: The Evolution of Institutions for Collective Action, Cambridge University Press.","DOI":"10.1017\/CBO9780511807763"},{"key":"ref_20","unstructured":"Hess, C., and Ostrom, E. (2011). Understanding Knowledge as a Commons: From Theory to Practice, MIT Press."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1080\/13662710802033734","article-title":"Getting clear about communities in open innovation","volume":"15","author":"West","year":"2008","journal-title":"Ind. Innov."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1007\/s10997-007-9024-7","article-title":"The governance of open source initiatives: What does it mean to be community managed?","volume":"11","year":"2007","journal-title":"J. Manag. Gov."},{"key":"ref_23","unstructured":"Beschastnikh, I., Kriplean, T., and McDonald, D.W. (April, January 30). Wikipedian self-governance in action: Motivating the policy lens. Proceedings of the ICWSM, Seattle, WA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"March, J.G., Schulz, M., and Zhou, X. (2000). The Dynamics of Rules: Change in Written Organizational Codes, Stanford University Press.","DOI":"10.1515\/9781503618411"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Butler, B., Joyce, E., and Pike, J. (2008, January 5\u201310). Don\u2019t look now, but we\u2019ve created a bureaucracy: The nature and roles of policies and rules in wikipedia. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy.","DOI":"10.1145\/1357054.1357227"},{"key":"ref_26","unstructured":"Schneider, J., Passant, A., and Breslin, J. (2010, January 26\u201327). A qualitative and quantitative analysis of how Wikipedia talk pages are used. Proceedings of the 2010 ACM Conference on Web Science, Raleigh, NC, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kriplean, T., Beschastnikh, I., McDonald, D.W., and Golder, S.A. (2007, January 4\u20137). Community, consensus, coercion, control: CS*W or how policy mediates mass participation. Proceedings of the 2007 International ACM Conference on Supporting Group Work, Sanibel Island, FL, USA.","DOI":"10.1145\/1316624.1316648"},{"key":"ref_28","first-page":"4","article-title":"Hyperlink analyses of the World Wide Web: A review","volume":"8","author":"Park","year":"2003","journal-title":"J. Comput. Med. Commun."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.socnet.2009.07.003","article-title":"Opening the black box of link formation: Social factors underlying the structure of the web","volume":"31","year":"2009","journal-title":"Soc. Netw."},{"key":"ref_30","unstructured":"Strube, M., and Ponzetto, S.P. (2006, January 16\u201320). WikiRelate! Computing semantic relatedness using Wikipedia. Proceedings of the AAAI 21st National Conference on Artificial Intelligence, Boston, MA, USA."},{"key":"ref_31","unstructured":"Witten, I., and Milne, D. (2008, January 13). An effective, low-cost measure of semantic relatedness obtained from Wikipedia links. Proceedings of the AAAIWorkshop onWikipedia and Artificial Intelligence: An Evolving Synergy, Chicago, IL, USA."},{"key":"ref_32","unstructured":"Bellomi, F., and Bonato, R. (2005, January 4\u20138). Network analysis for Wikipedia. Proceedings of the Wikimania, Frankfurt am Main, Germany."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lizorkin, D., Medelyan, O., and Grineva, M. (2009, January 20\u201324). Analysis of community structure in Wikipedia. Proceedings of the 18th International Conference on World Wide Web, Madrid, Spain.","DOI":"10.1145\/1526709.1526938"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.socnet.2007.05.001","article-title":"The authority of Supreme Court precedent","volume":"30","author":"Fowler","year":"2008","journal-title":"Soc. Netw."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"337","DOI":"10.2307\/3053929","article-title":"On the meaning and pattern of legal citations: Evidence from state wrongful discharge precedent cases","volume":"31","author":"Walsh","year":"1997","journal-title":"Law Soc. Rev."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"178","DOI":"10.2307\/1956126","article-title":"The transmission of legal precedent: A study of state Supreme Courts","volume":"79","author":"Caldeira","year":"1985","journal-title":"Am. Political Sci. Rev."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s12110-008-9037-1","article-title":"Five misunderstandings about cultural evolution","volume":"19","author":"Henrich","year":"2008","journal-title":"Hum. Nat."},{"key":"ref_38","unstructured":"Shirky, C. (2008). Here Comes Everybody: The Power of Organizing without Organizations, Penguin."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1111\/j.1573-7861.2008.01090.x","article-title":"Governance, Organization, and Democracy on the Internet: The Iron Law and the Evolution of Wikipedia","volume":"24","author":"Konieczny","year":"2009","journal-title":"Sociol. Forum"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1080\/19331681.2010.489408","article-title":"Adhocratic governance in the Internet age: A case of Wikipedia","volume":"7","author":"Konieczny","year":"2010","journal-title":"J. Inf. Technol. Politics"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1086\/226550","article-title":"Institutionalized organizations: Formal structure as myth and ceremony","volume":"83","author":"Meyer","year":"1977","journal-title":"Am. J. Sociol."},{"key":"ref_42","unstructured":"Open Data for the paper the Evolution of Wikipedia\u2019s Norm Network. Available online: https:\/\/bit.ly\/wikinorm."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Morgan, J.T., and Zachry, M. (2010, January 7\u201310). Negotiating with angry mastodons: The wikipedia policy environment as genre ecology. Proceedings of the 16th ACM International Conference on Supporting Group Work, Sanibel, FL, USA.","DOI":"10.1145\/1880071.1880098"},{"key":"ref_44","unstructured":"Template:Policy. Available online: https:\/\/en.wikipedia.org\/wiki\/Template:Policy."},{"key":"ref_45","unstructured":"Template:Guideline. Available online: https:\/\/en.wikipedia.org\/wiki\/Template:Guideline."},{"key":"ref_46","unstructured":"Template:Essay. Available online: https:\/\/en.wikipedia.org\/wiki\/Template:Essay."},{"key":"ref_47","unstructured":"Template:Proposed. Available online: https:\/\/en.wikipedia.org\/wiki\/Template:Proposed."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1177\/0002764212469365","article-title":"The rise and decline of an open collaboration system: How Wikipedia\u2019s reaction to popularity is causing its decline","volume":"57","author":"Halfaker","year":"2013","journal-title":"Am. Behav. Sci."},{"key":"ref_50","unstructured":"Wikipedia Statistics: Active Wikipedians. Available online: https:\/\/stats.wikimedia.org\/EN\/TablesWikipediansEditsGt5.htm."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Brush, E.R., Krakauer, D.C., and Flack, J.C. (2013). A family of algorithms for computing consensus about node state from network data. PLoS Comput. Biol., 9.","DOI":"10.1371\/journal.pcbi.1003109"},{"key":"ref_52","unstructured":"StatsGrok. Data from service created by Domas Mituzas, visualized by Wikipedia User Henrik."},{"key":"ref_53","first-page":"993","article-title":"Latent dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"2246","DOI":"10.3390\/e15062246","article-title":"Bootstrap methods for the empirical study of decision-making and information flows in social systems","volume":"15","author":"DeDeo","year":"2013","journal-title":"Entropy"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"P10008","DOI":"10.1088\/1742-5468\/2008\/10\/P10008","article-title":"Fast unfolding of communities in large networks","volume":"2008","author":"Blondel","year":"2008","journal-title":"J. Stat. Mech. Theory Exp."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1002\/asi.22680","article-title":"Scholarly network similarities: How bibliographic coupling networks, citation networks, cocitation networks, topical networks, coauthorship networks, and coword networks relate to each other","volume":"63","author":"Yan","year":"2012","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The Measurement of Observer Agreement for Categorical Data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Jacomy, M., Venturini, T., Heymann, S., and Bastian, M. (2014). ForceAtlas2, a Continuous Graph Layout Algorithm for Handy Network Visualization Designed for the Gephi Software. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0098679"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1126\/science.159.3810.56","article-title":"The Matthew effect in science","volume":"159","author":"Merton","year":"1968","journal-title":"Science"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1111\/jcom.12082","article-title":"Laboratories of oligarchy? How the Iron Law extends to peer production","volume":"64","author":"Shaw","year":"2014","journal-title":"J. Commun."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"49","DOI":"10.2753\/MIS0742-1222260103","article-title":"Decentralization in Wikipedia governance","volume":"26","author":"Forte","year":"2009","journal-title":"J. Manag. Inf. Syst."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1037\/0033-2909.112.1.155","article-title":"A power primer","volume":"112","author":"Cohen","year":"1992","journal-title":"Psychol. Bull."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/8\/2\/14\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:22:34Z","timestamp":1760210554000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/8\/2\/14"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,4,20]]},"references-count":62,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2016,6]]}},"alternative-id":["fi8020014"],"URL":"https:\/\/doi.org\/10.3390\/fi8020014","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,4,20]]}}}