{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T12:38:20Z","timestamp":1791549500201,"version":"4.3.4"},"reference-count":62,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,1,20]],"date-time":"2020-01-20T00:00:00Z","timestamp":1579478400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The use of Project Gutenberg (PG) as a text corpus has been extremely popular in statistical analysis of language for more than 25 years. However, in contrast to other major linguistic datasets of similar importance, no consensual full version of PG exists to date. In fact, most PG studies so far either consider only a small number of manually selected books, leading to potential biased subsets, or employ vastly different pre-processing strategies (often specified in insufficient details), raising concerns regarding the reproducibility of published results. In order to address these shortcomings, here we present the Standardized Project Gutenberg Corpus (SPGC), an open science approach to a curated version of the complete PG data containing more than 50,000 books and more than     3 \u00d7  10 9      word-tokens. Using different sources of annotated metadata, we not only provide a broad characterization of the content of PG, but also show different examples highlighting the potential of SPGC for investigating language variability across time, subjects, and authors. We publish our methodology in detail, the code to download and process the data, as well as the obtained corpus itself on three different levels of granularity (raw text, timeseries of word tokens, and counts of words). In this way, we provide a reproducible, pre-processed, full-size version of Project Gutenberg as a new scientific resource for corpus linguistics, natural language processing, and information retrieval.<\/jats:p>","DOI":"10.3390\/e22010126","type":"journal-article","created":{"date-parts":[[2020,1,21]],"date-time":"2020-01-21T03:04:43Z","timestamp":1579575883000},"page":"126","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":49,"title":["A Standardized Project Gutenberg Corpus for Statistical Analysis of Natural Language and Quantitative Linguistics"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0879-7865","authenticated-orcid":false,"given":"Martin","family":"Gerlach","sequence":"first","affiliation":[{"name":"Department of Chemical and Biological Engineering, Northwestern University, Evanston, IL 60208, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4938-2452","authenticated-orcid":false,"given":"Francesc","family":"Font-Clos","sequence":"additional","affiliation":[{"name":"Center for Complexity and Biosystems, Department of Physics, University of Milan, 20133 Milano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Degli Esposti, M., Altmann, E.G., and Pachet, F. (2016). Statistical laws in linguistics. Creativity and Universality in Language, Springer.","DOI":"10.1007\/978-3-319-24403-7"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1073\/pnas.0335980100","article-title":"Least effort and the origins of scaling in human language","volume":"100","year":"2003","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"943","DOI":"10.1038\/srep00943","article-title":"Languages cool as they expand: Allometric scaling and the decreasing need for new words","volume":"2","author":"Petersen","year":"2012","journal-title":"Sci. Rep."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5890","DOI":"10.1038\/srep05890","article-title":"The dynamics of correlated novelties","volume":"4","author":"Tria","year":"2014","journal-title":"Sci. Rep."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5348","DOI":"10.1073\/pnas.1420946112","article-title":"Understanding scaling through history-dependent processes with collapsing sample space","volume":"112","author":"Hanel","year":"2015","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"238701","DOI":"10.1103\/PhysRevLett.114.238701","article-title":"Log-log convexity of type-token growth in Zipf\u2019s systems","volume":"114","author":"Corral","year":"2015","journal-title":"Phys. Rev. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cocho, G., Flores, J., Gershenson, C., Pineda, C., and S\u00e1nchez, S. (2015). Rank Diversity of Languages: Generic Behavior in Computational Linguistics. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0121898"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3326","DOI":"10.1109\/TNNLS.2019.2890970","article-title":"Natural Language Statistical Features of LSTM-Generated Texts","volume":"30","author":"Lippi","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_9","first-page":"021023","article-title":"Statistics of shared components in complex component systems","volume":"8","author":"Mazzolini","year":"2018","journal-title":"Phys. Rev. X"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2603","DOI":"10.1098\/rspb.2001.1824","article-title":"Language as an evolving word web","volume":"268","author":"Dorogovtsev","year":"2001","journal-title":"Proc. R. Soc. B"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1002\/cplx.20305","article-title":"Language networks: Their structure, function, and evolution","volume":"15","author":"Valverde","year":"2010","journal-title":"Complexity"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"123024","DOI":"10.1088\/1367-2630\/13\/12\/123024","article-title":"Comparing intermittency and network measurements of words and their dependence on authorship","volume":"13","author":"Amancio","year":"2011","journal-title":"New J. Phys."},{"key":"ref_13","unstructured":"Choudhury, M., Chatterjee, D., and Mukherjee, A. (2010, January 23\u201327). Global topology of word co-occurrence networks: Beyond the two-regime power-law. Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), Beijing, China."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1016\/j.plrev.2014.04.004","article-title":"Approaching human language with complex networks","volume":"11","author":"Cong","year":"2014","journal-title":"Phys. Life Rev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"20140841","DOI":"10.1098\/rsif.2014.0841","article-title":"Universals versus historical contingencies in lexical evolution","volume":"11","author":"Bochkarev","year":"2014","journal-title":"J. R. Soc. Interface"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"20141044","DOI":"10.1098\/rsif.2014.1044","article-title":"Extracting information from S-curves of language change","volume":"11","author":"Ghanbarnejad","year":"2014","journal-title":"J. R. Soc. Interface"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"170830","DOI":"10.1098\/rsos.170830","article-title":"Frequency patterns of semantic change: Corpus-based evidence of a near-critical dynamics in language change","volume":"4","author":"Feltgen","year":"2017","journal-title":"R. Soc. Open Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gon\u00e7alves, B., Loureiro-Porto, L., Ramasco, J.J., and S\u00e1nchez, D. (2018). Mapping the Americanization of English in space and time. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0197741"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"8260","DOI":"10.1073\/pnas.1721059115","article-title":"The dynamics of norm change in the cultural evolution of language","volume":"115","author":"Amato","year":"2018","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_20","unstructured":"Karjus, A., Blythe, R.A., Kirby, S., and Smith, K. (2018). Challenges in detecting evolutionary forces in language change using diachronic corpora. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1142\/S0219525910002530","article-title":"Towards the quantification of the semantic information encoded in written language","volume":"13","author":"Montemurro","year":"2010","journal-title":"Adv. Complex Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Takahira, R., Tanaka-Ishii, K., and Debowski, \u0141. (2016). Entropy rate estimates for natural language\u2014A new extrapolation of compressed large-scale corpora. Entropy, 18.","DOI":"10.3390\/e18100364"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1080\/09296174.2016.1169847","article-title":"Quantifying structure differences in literature using symbolic diversity and entropy criteria","volume":"24","author":"Febres","year":"2017","journal-title":"J. Quant. Linguist."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Bentz, C., Alikaniotis, D., Cysouw, M., and Ferrer-i Cancho, R. (2017). The entropy of words\u2014Learnability and expressivity across more than 1000 languages. Entropy, 19.","DOI":"10.20944\/preprints201704.0180.v1"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"51915","DOI":"10.1103\/PhysRevE.69.051915","article-title":"Patterns in syntactic dependency networks","volume":"69","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.ins.2016.09.051","article-title":"In narrative texts punctuation marks obey the same statistics as words","volume":"375","author":"Kulig","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1126\/science.1199644","article-title":"Quantitative analysis of culture using millions of digitized books","volume":"331","author":"Michel","year":"2011","journal-title":"Science"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Masucci, A.P., Kalampokis, A., Egu\u00edluz, V.M., and Hern\u00e1ndez-Garc\u00eda, E. (2011). Wikipedia information flow analysis reveals the scale-free architecture of the semantic space. PLoS ONE, 6.","DOI":"10.1371\/journal.pone.0017333"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Yasseri, T., Kornai, A., and Kert\u00e9sz, J. (2012). A practical approach to language complexity: A Wikipedia case study. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0048386"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Dodds, P.S., Harris, K.D., Kloumann, I.M., Bliss, C.A., and Danforth, C.M. (2011). Temporal patterns of happiness and information in a global social network: Hedonometrics and twitter. PLoS ONE, 6.","DOI":"10.1371\/journal.pone.0026752"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1126\/science.332.6025.35-b","article-title":"Culturomics: Statistical traps muddy the data","volume":"332","year":"2011","journal-title":"Science"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Pechenick, E.A., Danforth, C.M., and Dodds, P.S. (2015). Characterizing the Google Books corpus: Strong limits to inferences of socio-cultural and linguistic evolution. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0137041"},{"key":"ref_33","unstructured":"Hart, M. (2018, July 18). Project Gutenberg. Available online: https:\/\/www.gutenberg.org."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1209\/0295-5075\/26\/4\/001","article-title":"Entropy and long-range correlations in literary English","volume":"26","author":"Ebeling","year":"1994","journal-title":"Europhys. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1063\/1.166191","article-title":"Entropy estimation of symbol sequences","volume":"6","author":"Schurmann","year":"1996","journal-title":"Chaos"},{"key":"ref_36","first-page":"455","article-title":"The effects of lexical specialization on the growth curve of the vocabulary","volume":"22","author":"Baayen","year":"1996","journal-title":"Comput. Linguist."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"11582","DOI":"10.1073\/pnas.1117723109","article-title":"On the origin of long-range correlations in texts","volume":"109","author":"Altmann","year":"2012","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Moreno-S\u00e1nchez, I., Font-Clos, F., and Corral, \u00c1. (2016). Large-scale analysis of Zipf\u2019s law in English texts. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0147073"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"052811","DOI":"10.1103\/PhysRevE.91.052811","article-title":"Text mixing shapes the anatomy of rank-frequency distributions","volume":"91","author":"Williams","year":"2015","journal-title":"Phys. Rev. E"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Tria, F., Loreto, V., and Servedio, V. (2018). Zipf\u2019s, Heaps\u2019 and Taylor\u2019s Laws are determined by the expansion into the adjacent possible. Entropy, 20.","DOI":"10.3390\/e20100752"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"7682","DOI":"10.1073\/pnas.1115407109","article-title":"Quantitative patterns of stylistic influence in the evolution of literature","volume":"109","author":"Hughes","year":"2012","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1140\/epjds\/s13688-016-0093-1","article-title":"The emotional arcs of stories are dominated by six basic shapes","volume":"5","author":"Reagan","year":"2016","journal-title":"EPJ Data Sci."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1140\/epjb\/e2005-00121-8","article-title":"The variation of Zipf\u2019s law in human language","volume":"44","year":"2005","journal-title":"Eur. Phys. J. B - Condens. Matter Complex Syst."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1076\/jqul.8.3.165.4101","article-title":"Two Regimes in the Frequency of Words and the Origins of Complex Lexicons: Zipf\u2019s Law Revisited","volume":"8","year":"2001","journal-title":"J. Quant. Linguist."},{"key":"ref_45","unstructured":"Dheeru, D., and Karra Taniskidou, E. (2018, July 18). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/index.php."},{"key":"ref_46","unstructured":"Davies, M. (2018, July 18). The Corpus of Contemporary American English (COCA): 560 Million Words, 1990-Present. Available online: https:\/\/www.english-corpora.org\/coca\/."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1017\/S0266078400006854","article-title":"100 million words of English","volume":"9","author":"Leech","year":"1993","journal-title":"Engl. Today"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Biber, D., and Reppen, R. (2015). The Cambridge Handbook of English Corpus Linguistics, Cambridge University Press.","DOI":"10.1017\/CBO9781139764377"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Jones, C., and Waller, D. (2015). Corpus Linguistics for Grammar: A guide for research, Routledge.","DOI":"10.4324\/9781315713779"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1461","DOI":"10.1073\/pnas.0610487104","article-title":"Semiotic dynamics and collaborative tagging","volume":"104","author":"Cattuto","year":"2007","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_51","first-page":"63","article-title":"NLTK: The Natural Language Toolkit","volume":"Volume 1","author":"Loper","year":"2002","journal-title":"Proceedings of the ACL-02 Workshop on Effective Tools and Methodologies for Teaching Natural Language Processing and Computational Linguistics"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Manning, C.D., Raghavan, P., and Sch\u00fctze, H. (2008). Introduction to Information Retrieval, Cambridge University Press.","DOI":"10.1017\/CBO9780511809071"},{"key":"ref_53","first-page":"021009","article-title":"Similarity of symbol frequency distributions with heavy tails","volume":"6","author":"Gerlach","year":"2016","journal-title":"Phys. Rev. X"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"McInnes, L., and Healy, J. (2018). UMAP: Uniform manifold approximation and projection for dimension reduction. arXiv.","DOI":"10.21105\/joss.00861"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1561\/1500000005","article-title":"Authorship attribution","volume":"1","author":"Juola","year":"2008","journal-title":"Found. Trends\u00ae Inf. Retr."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1002\/asi.21001","article-title":"A survey of modern authorship attribution methods","volume":"60","author":"Stamatatos","year":"2009","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Ioannidis, J.P.A. (2005). Why most published research findings are false. PLoS Med., 2.","DOI":"10.1371\/journal.pmed.0020124"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349, aac4716.","DOI":"10.1126\/science.aac4716"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1038\/s41562-018-0399-z","article-title":"Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015","volume":"2","author":"Camerer","year":"2018","journal-title":"Nat. Hum. Behav."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1140\/epjds\/s13688-018-0135-y","article-title":"Success in books: A big data approach to bestsellers","volume":"7","author":"Yucesoy","year":"2018","journal-title":"EPJ Data Sci."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1109\/18.61115","article-title":"Divergence measures based on the Shannon entropy","volume":"37","author":"Lin","year":"1991","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"041905","DOI":"10.1103\/PhysRevE.65.041905","article-title":"Analysis of symbolic sequences using the Jensen\u2013Shannon divergence","volume":"65","author":"Grosse","year":"2002","journal-title":"Phys. Rev. E Stat. Nonlin. Soft Matter Phys."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/1\/126\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:05:30Z","timestamp":1760364330000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/1\/126"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,20]]},"references-count":62,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["e22010126"],"URL":"https:\/\/doi.org\/10.3390\/e22010126","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,20]]}}}