{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:05:04Z","timestamp":1760241904574,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,10,23]],"date-time":"2018-10-23T00:00:00Z","timestamp":1540252800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Among several developments, the field of Economic Complexity (EC) has notably seen the introduction of two new techniques. One is the Bootstrapped Selective Predictability Scheme (SPSb), which can provide quantitative forecasts of the Gross Domestic Product of countries. The other, Hidden Markov Model (HMM) regularisation, denoises the datasets typically employed in the literature. We contribute to EC along three different directions. First, we prove the convergence of the SPSb algorithm to a well-known statistical learning technique known as Nadaraya-Watson Kernel regression. The latter has significantly lower time complexity, produces deterministic results, and it is interchangeable with SPSb for the purpose of making predictions. Second, we study the effects of HMM regularization on the Product Complexity and logPRODY metrics, for which a model of time evolution has been recently proposed. We find confirmation for the original interpretation of the logPRODY model as describing the change in the global market structure of products with new insights allowing a new interpretation of the Complexity measure, for which we propose a modification. Third, we explore new effects of regularisation on the data. We find that it reduces noise, and observe for the first time that it increases nestedness in the export network adjacency matrix.<\/jats:p>","DOI":"10.3390\/e20110814","type":"journal-article","created":{"date-parts":[[2018,10,24]],"date-time":"2018-10-24T02:59:40Z","timestamp":1540349980000},"page":"814","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Complexity of Products: The Effect of Data Regularisation"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5057-7866","authenticated-orcid":false,"given":"Orazio","family":"Angelini","sequence":"first","affiliation":[{"name":"Department of Mathematics, King\u2019s College London, The Strand, London WC2R 2LS, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5913-3268","authenticated-orcid":false,"given":"Tiziana","family":"Di Matteo","sequence":"additional","affiliation":[{"name":"Department of Mathematics, King\u2019s College London, The Strand, London WC2R 2LS, UK"},{"name":"Department of Computer Science, University College London, Gower Street, London WC1E 6BT, UK"},{"name":"Complexity Science Hub Vienna, Josefstaedter Strasse 39, A 1080 Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,10,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1038\/srep00723","article-title":"A New Metrics for Countries\u2019 Fitness and Products\u2019 Complexity","volume":"2","author":"Tacchella","year":"2012","journal-title":"Sci. Rep."},{"key":"ref_2","first-page":"1120","article-title":"Sources, Procedures, and Microeconomic Effects of Innovation","volume":"26","author":"Dosi","year":"1988","journal-title":"J. Econ. Lit."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/0305-750X(92)90097-F","article-title":"Technological capabilities and industrialization","volume":"20","author":"Lall","year":"1992","journal-title":"World Dev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0167-2681(94)90094-9","article-title":"Understanding corporate coherence. Theory and evidence","volume":"23","author":"Teece","year":"1994","journal-title":"J. Econ. Behav. Organ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1126\/science.1144581","article-title":"The Product Space Conditions the Development of Nations","volume":"317","author":"Hidalgo","year":"2007","journal-title":"Science"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"10570","DOI":"10.1073\/pnas.0900943106","article-title":"The building blocks of economic complexity","volume":"106","author":"Hidalgo","year":"2009","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cristelli, M., Gabrielli, A., Tacchella, A., Caldarelli, G., and Pietronero, L. (2013). Measuring the Intangibles: A Metrics for the Economic Complexity of Countries and Products. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0070726"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2825948","DOI":"10.1155\/2018\/2825948","article-title":"A Comparative Analysis of the Predictive Abilities of Economic Complexity Metrics Using International Trade Network","volume":"2018","author":"Liao","year":"2018","journal-title":"Complexity"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"9383","DOI":"10.1073\/pnas.1633576100","article-title":"The nested assembly of plant-animal mutualistic networks","volume":"100","author":"Bascompte","year":"2003","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"8182","DOI":"10.1038\/srep08182","article-title":"Ranking species in mutualistic networks","volume":"5","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1227","DOI":"10.1111\/j.0030-1299.2008.16644.x","article-title":"A consistent metric for nestedness analysis in ecological systems: reconciling concept and measurement","volume":"117","author":"Loyola","year":"2008","journal-title":"Oikos"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zaccaria, A., Cristelli, M., Tacchella, A., and Pietronero, L. (2014). How the Taxonomy of Products Drives the Economic Development of Countries. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0113770"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Loreto, V., Servedio, V.D.P., Strogatz, S.H., and Tria, F. (2017). Dynamics on expanding spaces: Modeling the emergence of novelties. arXiv.","DOI":"10.1007\/978-3-319-24403-7_5"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Pugliese, E., Chiarotti, G.L., Zaccaria, A., and Pietronero, L. (2017). Complex Economies Have a Lateral Escape from the Poverty Trap. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0168540"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cristelli, M., Tacchella, A., and Pietronero, L. (2015). The Heterogeneous Dynamics of Economic Complexity. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0117174"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cristelli, M., Tacchella, A., Cader, M., Roster, K., and Pietronero, L. (2017). On the Predictability of Growth, The World Bank.","DOI":"10.1596\/1813-9450-8117"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1175\/1520-0469(1969)26<636:APARBN>2.0.CO;2","article-title":"Atmospheric Predictability as Revealed by Naturally Occurring Analogues","volume":"26","author":"Lorenz","year":"1969","journal-title":"J. Atmos. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1038\/s41567-018-0204-y","article-title":"A dynamical systems approach to gross domestic product forecasting","volume":"14","author":"Tacchella","year":"2018","journal-title":"Nat. Phys."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Sbardella, A., Pugliese, E., and Pietronero, L. (2017). Economic development and wage inequality: A complex system analysis. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0182774"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Angelini, O., Cristelli, M., Zaccaria, A., and Pietronero, L. (2017). The complex dynamics of products and its asymptotic properties. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0186436"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J. (2001). The Elements of Statistical Learning, Springer New York Inc.","DOI":"10.1007\/978-0-387-21606-5"},{"key":"ref_22","unstructured":"Angelini, O. (2018). ganileni\/ectools: First release. Zenodo."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"185","DOI":"10.12688\/f1000research.4831.1","article-title":"FALCON: A software package for analysis of nestedness in bipartite networks","volume":"3","author":"Beckett","year":"2014","journal-title":"F1000Research"},{"key":"ref_24","unstructured":"Angelini, O. (2018). ganileni\/pyfalcon: First release. Zenodo."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1111\/j.1467-9957.1965.tb00050.x","article-title":"Trade Liberalisation and \u201cRevealed\u201d Comparative Advantage","volume":"33","author":"Balassa","year":"1965","journal-title":"Manch. Sch."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1893","DOI":"10.1140\/epjst\/e2015-50118-1","article-title":"On the convergence of the Fitness-Complexity algorithm","volume":"225","author":"Pugliese","year":"2016","journal-title":"Eur. Phys. J. Spec. Top."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/j.physa.2016.05.023","article-title":"The mathematics of non-linear metrics for nested networks","volume":"460","author":"Wu","year":"2016","journal-title":"Phys. A Stat. Mech. Appl."},{"key":"ref_28","first-page":"1","article-title":"How metrics for economic complexity are affected by noise","volume":"3","author":"Battiston","year":"2014","journal-title":"Complex. Econ."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1140\/epjb\/e2015-60298-7","article-title":"Measuring economic complexity of countries and products: which metric to use?","volume":"88","author":"Mariani","year":"2015","journal-title":"Eur. Phys. J. B"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10887-006-9009-4","article-title":"What you export matters","volume":"12","author":"Hausmann","year":"2007","journal-title":"J. Econ. Growth"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"50","DOI":"10.2307\/1058595","article-title":"A Generalized Interpretation of the Herfindahl Index","volume":"48","author":"Kelly","year":"1981","journal-title":"South. Econ. J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1137\/1109020","article-title":"On Estimating Regression","volume":"9","author":"Nadaraya","year":"1964","journal-title":"Theory Probab. Appl."},{"key":"ref_33","first-page":"359","article-title":"Smooth Regression Analysis","volume":"26","author":"Watson","year":"1964","journal-title":"Sankhy\u0101 Indian J. Stat. Ser. A (1961\u20132002)"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MASSP.1986.1165342","article-title":"An introduction to hidden Markov models","volume":"3","author":"Rabiner","year":"1986","journal-title":"IEEE ASSP Mag."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gaulier, G., and Zignago, S. (2010). BACI: International Trade Database at the Product-Level (the 1994\u20132007 Version). SSRN Electron. J.","DOI":"10.2139\/ssrn.1994500"},{"key":"ref_36","unstructured":"(2015, July 01). CEPII BACI Dataset. Available online: http:\/\/www.cepii.fr\/CEPII\/en\/welcome.asp."},{"key":"ref_37","unstructured":"(2015, July 01). World Customs Organization. Available online: http:\/\/www.wcoomd.org\/."},{"key":"ref_38","unstructured":"(2017, December 22). The World Bank Open Data. Available online: http:\/\/data.worldbank.org\/."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Tumminello, M., Miccich\u00e8, S., Lillo, F., Piilo, J., and Mantegna, R.N. (2011). Statistically validated networks in bipartite complex systems. PLoS ONE, 6.","DOI":"10.1371\/journal.pone.0017994"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/11\/814\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:25:39Z","timestamp":1760196339000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/11\/814"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,23]]},"references-count":39,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["e20110814"],"URL":"https:\/\/doi.org\/10.3390\/e20110814","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2018,10,23]]}}}