{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,26]],"date-time":"2026-09-26T01:54:40Z","timestamp":1790387680943,"version":"4.1.0"},"reference-count":71,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T00:00:00Z","timestamp":1640563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>With population explosion and globalization, the spread of infectious diseases has been a major concern. In 2019, a newly identified type of Coronavirus caused an outbreak of respiratory illness, popularly known as COVID-19, and became a pandemic. Although enormous efforts have been made to understand the spread of COVID-19, our knowledge of the COVID-19 dynamics still remains limited. The present study employs the concepts of chaos theory to examine the temporal dynamic complexity of COVID-19 around the world. The false nearest neighbor (FNN) method is applied to determine the dimensionality and, hence, the complexity of the COVID-19 dynamics. The methodology involves: (1) reconstruction of a single-variable COVID-19 time series in a multi-dimensional phase space to represent the underlying dynamics; and (2) identification of \u201cfalse\u201d neighbors in the reconstructed phase space and estimation of the dimension of the COVID-19 series. For implementation, COVID-19 data from 40 countries\/regions around the world are studied. Two types of COVID-19 data are analyzed: (1) daily COVID-19 cases; and (2) daily COVID-19 deaths. The results for the 40 countries\/regions indicate that: (1) the dynamics of COVID-19 cases exhibit low- to medium-level complexity, with dimensionality in the range 3 to 7; and (2) the dynamics of COVID-19 deaths exhibit complexity anywhere from low to high, with dimensionality ranging from 3 to 13. The results also suggest that the complexity of the dynamics of COVID-19 deaths is greater than or at least equal to that of the dynamics of COVID-19 cases for most (three-fourths) of the countries\/regions. These results have important implications for modeling and predicting the spread of COVID-19 (and other infectious diseases), especially in the identification of the appropriate complexity of models.<\/jats:p>","DOI":"10.3390\/e24010050","type":"journal-article","created":{"date-parts":[[2021,12,28]],"date-time":"2021-12-28T01:18:15Z","timestamp":1640654295000},"page":"50","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Complexity of COVID-19 Dynamics"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0523-890X","authenticated-orcid":false,"given":"Bellie","family":"Sivakumar","sequence":"first","affiliation":[{"name":"Department of Civil Engineering, Indian Institute of Technology Bombay, Powai, Mumbai 400076, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bhadran","family":"Deepthi","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, Indian Institute of Technology Bombay, Powai, Mumbai 400076, India"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,27]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (WHO) (2021, November 26). Novel Coronavirus\u2014China. Available online: https:\/\/www.who.int\/csr\/don\/12-january-2020-novel-coronavirus-china\/en\/."},{"key":"ref_2","unstructured":"World Health Organization (WHO) (2021, November 26). Coronavirus Disease (COVID-19) Pandemic. Available online: https:\/\/www.who.int\/emergencies\/diseases\/novel-coronavirus-2019."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.1016\/S0140-6736(20)30971-5","article-title":"Global call to action for inclusion of migrants and refugees in the COVID-19 response","volume":"395","author":"Orcutt","year":"2020","journal-title":"Lancet"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"155586","DOI":"10.1016\/j.scitotenv.2021.145586","article-title":"Impacts of COVID-19 pandemic on the wastewater pathway into surface water: A review","volume":"774","author":"Bandala","year":"2021","journal-title":"Sci. Total. Environ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1111\/chso.12430","article-title":"The impact of the COVID-19 pandemic on the mental health and well-being of children and young people","volume":"35","author":"Cowie","year":"2021","journal-title":"Child. Soc."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/00330124.2020.1823864","article-title":"The immediate impact of COVID-19 on postsecondary teaching and learning","volume":"73","author":"Day","year":"2021","journal-title":"Prof. Geogr."},{"key":"ref_7","first-page":"1486","article-title":"Impact of COVID-19 pandemic on tourism: Recovery proposal for future tourism","volume":"33","author":"Deb","year":"2021","journal-title":"Geoj. J. Tour. Geosites"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"105169","DOI":"10.1016\/j.resconrec.2020.105169","article-title":"A critical analysis of the impacts of COVID-19 on the global economy and ecosystems and opportunities for circular economy strategies","volume":"164","author":"Mustapha","year":"2021","journal-title":"Resour. Conserv. Recycl."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"116441","DOI":"10.1016\/j.apenergy.2021.116441","article-title":"Impacts of COVID-19 on energy demand and consumption: Challenges, lessons and emerging opportunities","volume":"285","author":"Jiang","year":"2021","journal-title":"Appl. Energy"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1007\/s00477-020-01837-6","article-title":"COVID-19 and water","volume":"35","author":"Sivakumar","year":"2021","journal-title":"Stoch. Environ. Res. Risk Assess."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1093\/imammb\/2.4.221","article-title":"Can nonlinear dynamics elucidate mechanisms in ecology and epidemiology?","volume":"2","author":"Schaffer","year":"1985","journal-title":"IMA J. Math. Appl. Med. Biol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1016\/S0022-5193(85)80294-0","article-title":"Nearly one-dimensional dynamics in an epidemic","volume":"112","author":"Schaffer","year":"1985","journal-title":"J. Theor. Biol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1016\/0040-5809(88)90019-6","article-title":"Oscillations and chaos in epidemics: A nonlinear dynamic study of six childhood diseases in Copenhagen, Denmark","volume":"33","author":"Olsen","year":"1988","journal-title":"Theor. Popul. Biol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1007\/BF00276080","article-title":"An epidemiological model with a delay and a nonlinear incidence rate","volume":"27","author":"Hethcote","year":"1989","journal-title":"J. Math. Biol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1177\/096228029500400205","article-title":"Spatial heterogeneity, nonlinear dynamics and chaos in infectious diseases","volume":"4","author":"Grenfell","year":"1995","journal-title":"Stat. Methods Med. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1126\/science.287.5453.667","article-title":"A simple model for complex dynamical transitions in epidemics","volume":"287","author":"Earn","year":"2000","journal-title":"Science"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1051\/mmnp\/20127308","article-title":"Deterministic chaos vs. stochastic fluctuation in an eco-epidemic model","volume":"7","author":"Mandal","year":"2012","journal-title":"Math. Model. Nat. Phenom."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.matcom.2018.09.024","article-title":"Nonlinear dynamics of infectious diseases via information-induced vaccination and saturated treatment","volume":"157","author":"Kumar","year":"2019","journal-title":"Math. Comput. Simul."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1731","DOI":"10.1007\/s11071-020-05771-8","article-title":"Computational analysis of the SARS-CoV-2 and other viruses based on the Kolmogorov\u2019s complexity and Shannon\u2019s information theories","volume":"101","author":"Machado","year":"2020","journal-title":"Nonlinear Dyn."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1525","DOI":"10.1007\/s11071-021-06836-y","article-title":"Advances in the computational analysis of SARS-CoV2 genome","volume":"106","author":"Machado","year":"2021","journal-title":"Nonlinear Dyn."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1966","DOI":"10.1126\/science.1086616","article-title":"Transmission dynamics and control of severe acute respiratory syndrome","volume":"300","author":"Lipsitch","year":"2003","journal-title":"Science"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2223","DOI":"10.1098\/rspb.2004.2800","article-title":"Modelling strategies for controlling SARS outbreaks","volume":"271","author":"Gumel","year":"2004","journal-title":"Proc. Biol. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"031917","DOI":"10.1103\/PhysRevE.69.031917","article-title":"Transmission of severe acute respiratory syndrome in dynamical small-world networks","volume":"69","author":"Masuda","year":"2004","journal-title":"Phys. Rev. E Stat. Nonlin. Soft Matter Phys."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1097\/01.ede.0000181633.80269.4c","article-title":"Dynamically modeling SARS and other newly emerging respiratory illnesses: Past, present, and future","volume":"16","author":"Bauch","year":"2005","journal-title":"Epidemiology"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bandt, C. (2020). Entropy ratio and entropy concentration coefficient, with application to the COVID-19 pandemic. Entropy, 22.","DOI":"10.3390\/e22111315"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"138835","DOI":"10.1016\/j.scitotenv.2020.138835","article-title":"Correlation between climate indicators and COVID-19 pandemic in New York, USA","volume":"728","author":"Bashir","year":"2000","journal-title":"Sci. Total Environ."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1126\/science.aba9757","article-title":"The effect of travel restrictions on the spread of the novel 2019 coronavirus (COVID-19) outbreak","volume":"368","author":"Chinazzi","year":"2020","journal-title":"Science"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1038\/s41591-020-0883-7","article-title":"Modelling the COVID-19 epidemic and implementation of population-wide interventions in Italy","volume":"26","author":"Giordano","year":"2020","journal-title":"Nat. Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1038\/s41586-020-2284-y","article-title":"Population flow drives spatio-temporal distribution of COVID-19 in China","volume":"582","author":"Jia","year":"2020","journal-title":"Nature"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1199","DOI":"10.1056\/NEJMoa2001316","article-title":"Early transmission dynamics in Wuhan, China, of novel coronavirus-infected pneumonia","volume":"382","author":"Li","year":"2020","journal-title":"N. Engl. J. Med."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2150023","DOI":"10.1142\/S0218348X21500237","article-title":"Complexity and information-based analysis of the variations of the SARS-CoV-2 genome in the United States of America (USA)","volume":"28","author":"Namazi","year":"2020","journal-title":"Fractals"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2150123","DOI":"10.1142\/S0218348X21501231","article-title":"Complexity-based analysis of the alterations in the structure of coronaviruses","volume":"29","author":"Namazi","year":"2021","journal-title":"Fractals"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"e102","DOI":"10.1016\/S1473-3099(20)30129-8","article-title":"Can we contain the COVID-19 outbreak with the same measures as for SARS?","volume":"20","author":"Chiew","year":"2020","journal-title":"Lancet Infect. Dis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3905","DOI":"10.1016\/j.scitotenv.2020.139051","article-title":"Effects of temperature and humidity on the new daily cases and deaths of COVID-19 in 166 countries","volume":"729","author":"Wu","year":"2020","journal-title":"Sci. Total Environ."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Baj\u00edc, D., \u00d0aj\u00edc, V., and Milovanov\u00edc, B. (2021). Entropy analysis of COVID-19 cardiovascular signals. Entropy, 23.","DOI":"10.3390\/e23010087"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"200434","DOI":"10.4209\/aaqr.200434","article-title":"Probable Relationship between COVID-19, Pollutants and Meteorology: A Case Study at Santiago, Chile","volume":"21","author":"Salini","year":"2021","journal-title":"Aerosol Air Qual. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"113112","DOI":"10.1063\/1.4967730","article-title":"A chaotic model for the epidemic of Ebola virus disease in West Africa (2013\u20132016)","volume":"26","author":"Mangiarotti","year":"2016","journal-title":"Chaos"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"e95","DOI":"10.1017\/S0950268820000990","article-title":"Chaos theory applied to the outbreak of COVID-19: An ancillary approach to decision-making in pandemic context","volume":"148","author":"Mangiarotti","year":"2020","journal-title":"Epidemiol. Infect."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"3403","DOI":"10.1103\/PhysRevA.45.3403","article-title":"Determining embedding dimension for phase space reconstruction using a geometric method","volume":"45","author":"Kennel","year":"1992","journal-title":"Phys. Rev. A"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1103\/PhysRevLett.45.712","article-title":"Geometry from a time series","volume":"45","author":"Packard","year":"1980","journal-title":"Phys. Rev. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Rand, D.A., and Young, L.S. (1981). Detecting strange attractors in turbulence. Dynamical Systems and Turbulence, Lecture Notes in Mathematics, Springer.","DOI":"10.1007\/BFb0091903"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kantz, H., and Schreiber, T. (2004). Nonlinear Time Series Analysis, Cambridge University Press.","DOI":"10.1017\/CBO9780511755798"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/0167-2789(86)90031-X","article-title":"Extracting qualitative dynamics from experimental data","volume":"20","author":"Broomhead","year":"1986","journal-title":"Physica D"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1007\/BF01053745","article-title":"Embeddology","volume":"65","author":"Sauer","year":"1991","journal-title":"J. Stat. Phys."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Elsner, J.B., and Tsonis, A.A. (1996). Singular Spectrum Analysis: A New Tool in Time Series Analysis, Plenum Press.","DOI":"10.1007\/978-1-4757-2514-8"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1029\/95WR02872","article-title":"Nonlinear dynamics of Great Salt Lake: Dimension estimation","volume":"32","author":"Sangoyomi","year":"1996","journal-title":"Water Resour. Res."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2950","DOI":"10.1103\/PhysRevE.51.2950","article-title":"Method of false nearest neighbors: A cautionary note","volume":"51","author":"Fredkin","year":"1995","journal-title":"Phys. Rev. E"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/S0167-2789(97)00118-8","article-title":"Practical method for determining the minimum embedding dimension of a scalar time series","volume":"110","author":"Cao","year":"1997","journal-title":"Physica D"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"4970","DOI":"10.1103\/PhysRevE.60.4970","article-title":"Improved false nearest neighbor method to detect determinism in time series data","volume":"60","author":"Hegger","year":"1999","journal-title":"Phys. Rev. E"},{"key":"ref_50","first-page":"1","article-title":"False nearest neighbors and false strands: A reliable minimum embedding dimension algorithm","volume":"66","author":"Kennel","year":"2002","journal-title":"Phys. Rev. E"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"084102","DOI":"10.1103\/PhysRevLett.91.084102","article-title":"Estimating good discrete partitions from observed data: Symbolic fast nearest neighbors","volume":"91","author":"Kennel","year":"2003","journal-title":"Phys. Rev. Lett."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"645","DOI":"10.5194\/hess-5-645-2001","article-title":"Rainfall dynamics at different temporal scales: A chaotic perspective","volume":"5","author":"Sivakumar","year":"2001","journal-title":"Hydrol. Earth Syst. Sci."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"706","DOI":"10.1016\/j.jhydrol.2015.10.056","article-title":"Streamflow variability and classification using false nearest neighbour method","volume":"531","author":"Vignesh","year":"2015","journal-title":"J. Hydrol."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1103\/PhysRevA.33.1134","article-title":"Independent coordinates for strange attractors from mutual information","volume":"33","author":"Fraser","year":"1986","journal-title":"Phys. Rev. A"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"6162","DOI":"10.1103\/PhysRevE.55.6162","article-title":"False-nearest-neighbor algorithm and noise-corrupted time series","volume":"55","author":"Rhodes","year":"1997","journal-title":"Phys. Rev. E"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1623\/hysj.2005.50.4.591","article-title":"Correlation dimension estimation of hydrologic series and data size requirement: Myth and reality","volume":"50","author":"Sivakumar","year":"2005","journal-title":"Hydrol. Sci. J."},{"key":"ref_57","unstructured":"Sivakumar, B. (2017). Chaos in Hydrology: Bridging Determinism and Stochasticity, Springer Science+Business Media."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"R13","DOI":"10.1103\/PhysRevE.48.R13","article-title":"Determination of the noise level of chaotic time series","volume":"48","author":"Schreiber","year":"1993","journal-title":"Phys. Rev. E"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"2366","DOI":"10.1103\/PhysRevLett.84.2366","article-title":"Estimation of noise levels for models of chaotic dynamical systems","volume":"84","author":"Heald","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1752","DOI":"10.1103\/PhysRevE.48.1752","article-title":"Noise reduction in chaotic timeseries data: A survey of common methods","volume":"48","author":"Kostelich","year":"1993","journal-title":"Phys. Rev. E."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/S0167-2789(05)80005-3","article-title":"Noise reduction schemes for chaotic time series","volume":"79","author":"Davies","year":"1994","journal-title":"Physica D"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/S0022-1694(99)00051-7","article-title":"A systematic approach to noise reduction in chaotic hydrological time series","volume":"219","author":"Sivakumar","year":"1999","journal-title":"J. Hydrol."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1103\/PhysRevA.39.845","article-title":"Attractor dimension of nonstationary dynamical systems from small data sets","volume":"39","author":"Havstad","year":"1989","journal-title":"Phys. Rev. A"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Mayer-Kress, G. (1986). An approach to error-estimation in the application of dimension algorithms. Dimensions and Entropies in Chaotic Systems, Springer.","DOI":"10.1007\/978-3-642-71001-8"},{"key":"ref_65","first-page":"386","article-title":"Proper choice of the time delay for the analysis of chaotic time series","volume":"141","author":"Liebert","year":"1989","journal-title":"Phys. Lett. A"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"7058","DOI":"10.1103\/PhysRevA.45.7058","article-title":"Mutual information, strange attractors, and the optimal estimation of dimension","volume":"45","author":"Martinerie","year":"1992","journal-title":"Phys. Rev. A"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"5676","DOI":"10.1103\/PhysRevE.58.5676","article-title":"Delay time window and plateau onset of the correlation dimension for small data sets","volume":"58","author":"Kim","year":"1998","journal-title":"Phys. Rev. E"},{"key":"ref_68","unstructured":"Jones, R.P. (2021). Low COVID-19 testing in the majority of nations has resulted in gross undercounting of infections and deaths. J. Health Care Financ., 1\u201310."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"n2668","DOI":"10.1136\/bmj.n2668","article-title":"COVID 19: A strong pandemic response relies on good data","volume":"375","author":"Godlee","year":"2021","journal-title":"BMJ"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1007\/s10654-021-00787-9","article-title":"Over- and under-estimation of COVID-19 deaths","volume":"36","author":"Ioannidis","year":"2021","journal-title":"Eur. J. Epidemiol."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"n2239","DOI":"10.1136\/bmj.n2239","article-title":"Under-reporting of deaths limits our understanding of true burden of COVID-19","volume":"375","author":"Whittaker","year":"2021","journal-title":"BMJ"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/50\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:54:26Z","timestamp":1760169266000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/50"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,27]]},"references-count":71,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["e24010050"],"URL":"https:\/\/doi.org\/10.3390\/e24010050","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,27]]}}}