{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,5]],"date-time":"2026-07-05T21:56:39Z","timestamp":1783288599991,"version":"3.54.6"},"reference-count":54,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,21]],"date-time":"2023-09-21T00:00:00Z","timestamp":1695254400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"EPSRC Fellowship Funding","doi-asserted-by":"publisher","award":["EP\/R031118\/1"],"award-info":[{"award-number":["EP\/R031118\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"EPSRC Fellowship Funding","doi-asserted-by":"publisher","award":["BB\/V011456\/1"],"award-info":[{"award-number":["BB\/V011456\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJMS"],"abstract":"<jats:p>The global COVID-19 pandemic resulted in widespread harms but also rapid advances in vaccine development, diagnostic testing, and treatment. As the disease moves to endemic status, the need to identify characteristic biomarkers of the disease for diagnostics or therapeutics has lessened, but lessons can still be learned to inform biomarker research in dealing with future pathogens. In this work, we test five sets of research-derived biomarkers against an independent targeted and quantitative Liquid Chromatography\u2013Mass Spectrometry metabolomics dataset to evaluate how robustly these proposed panels would distinguish between COVID-19-positive and negative patients in a hospital setting. We further evaluate a crowdsourced panel comprising the COVID-19 metabolomics biomarkers most commonly mentioned in the literature between 2020 and 2023. The best-performing panel in the independent dataset\u2014measured by F1 score (0.76) and AUROC (0.77)\u2014included nine biomarkers: lactic acid, glutamate, aspartate, phenylalanine, \u03b2-alanine, ornithine, arachidonic acid, choline, and hypoxanthine. Panels comprising fewer metabolites performed less well, showing weaker statistical significance in the independent cohort than originally reported in their respective discovery studies. Whilst the studies reviewed here were small and may be subject to confounders, it is desirable that biomarker panels be resilient across cohorts if they are to find use in the clinic, highlighting the importance of assessing the robustness and reproducibility of metabolomics analyses in independent populations.<\/jats:p>","DOI":"10.3390\/ijms241814371","type":"journal-article","created":{"date-parts":[[2023,9,21]],"date-time":"2023-09-21T04:53:05Z","timestamp":1695271985000},"page":"14371","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Meta-Analysis of COVID-19 Metabolomics Identifies Variations in Robustness of Biomarkers"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1429-0032","authenticated-orcid":false,"given":"Anthony","family":"Onoja","sequence":"first","affiliation":[{"name":"School of Health Sciences, Faculty of Health and Medical Sciences, University of Surrey, Guildford GU2 7XH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9224-5296","authenticated-orcid":false,"given":"Johanna","family":"von Gerichten","sequence":"additional","affiliation":[{"name":"School of Chemistry and Chemical Engineering, Faculty of Engineering and Physical Sciences, University of Surrey, Guildford GU2 7XH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0561-5421","authenticated-orcid":false,"given":"Holly-May","family":"Lewis","sequence":"additional","affiliation":[{"name":"School of Biosciences, Faculty of Health and Medical Sciences, University of Surrey, Guildford GU2 7XH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9050-7910","authenticated-orcid":false,"given":"Melanie J.","family":"Bailey","sequence":"additional","affiliation":[{"name":"School of Chemistry and Chemical Engineering, Faculty of Engineering and Physical Sciences, University of Surrey, Guildford GU2 7XH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8202-6180","authenticated-orcid":false,"given":"Debra J.","family":"Skene","sequence":"additional","affiliation":[{"name":"School of Biosciences, Faculty of Health and Medical Sciences, University of Surrey, Guildford GU2 7XH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2956-6676","authenticated-orcid":false,"given":"Nophar","family":"Geifman","sequence":"additional","affiliation":[{"name":"School of Health Sciences, Faculty of Health and Medical Sciences, University of Surrey, Guildford GU2 7XH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9417-6511","authenticated-orcid":false,"given":"Matt","family":"Spick","sequence":"additional","affiliation":[{"name":"School of Health Sciences, Faculty of Health and Medical Sciences, University of Surrey, Guildford GU2 7XH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1080\/10408363.2020.1783198","article-title":"The COVID-19 Pandemic","volume":"57","author":"Ciotti","year":"2020","journal-title":"Crit. Rev. Clin. Lab. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.bpa.2020.11.009","article-title":"Economic Impact of COVID-19 Pandemic on Healthcare Facilities and Systems: International Perspectives","volume":"35","author":"Kaye","year":"2021","journal-title":"Best Pract. Res. Clin. Anaesthesiol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1761","DOI":"10.1016\/S0140-6736(20)31211-3","article-title":"The COVID-19 MS Coalition\u2014Accelerating Diagnostics, Prognostics, and Treatment","volume":"395","author":"Struwe","year":"2020","journal-title":"Lancet"},{"key":"ref_4","unstructured":"WHO (2020). Target Product Profiles for Priority Diagnostics to Support Response to the COVID-19 Pandemic v. 1.0, WHO."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"102323","DOI":"10.1016\/j.artmed.2022.102323","article-title":"Hybrid Learning Method Based on Feature Clustering and Scoring for Enhanced COVID-19 Breath Analysis by an Electronic Nose","volume":"129","author":"Hidayat","year":"2022","journal-title":"Artif. Intell. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"100786","DOI":"10.1016\/j.eclinm.2021.100786","article-title":"Changes to the Sebum Lipidome upon COVID-19 Infection Observed via Rapid Sampling from the Skin","volume":"33","author":"Spick","year":"2021","journal-title":"EClinicalMedicine"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"110271","DOI":"10.1016\/j.celrep.2021.110271","article-title":"Proteomic and Metabolomic Profiling of Urine Uncovers Immune Responses in Patients with COVID-19","volume":"38","author":"Bi","year":"2022","journal-title":"Cell Rep."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"123537","DOI":"10.1016\/j.talanta.2022.123537","article-title":"A Colorimetric Electronic Tongue for Point-of-Care Detection of COVID-19 Using Salivary Metabolites","volume":"246","author":"Bordbar","year":"2022","journal-title":"Talanta"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bourgin, M., Durand, S., and Kroemer, G. (2023). Diagnostic, Prognostic and Mechanistic Biomarkers of COVID-19 Identified by Mass Spectrometric Metabolomics. Metabolites, 13.","DOI":"10.3390\/metabo13030342"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bruzzone, C., Conde, R., Embade, N., Mato, J.M., and Millet, O. (2023). Metabolomics as a Powerful Tool for Diagnostic, Pronostic and Drug Intervention Analysis in COVID-19. Front. Mol. Biosci., 10.","DOI":"10.3389\/fmolb.2023.1111482"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"6350","DOI":"10.1038\/s41598-021-85788-0","article-title":"Metabolomics Analysis Reveals a Modified Amino Acid Metabolism That Correlates with Altered Oxygen Homeostasis in COVID-19 Patients","volume":"11","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e13221","DOI":"10.1111\/obr.13221","article-title":"Amino Acid Sensing Pathway: A Major Check Point in the Pathogenesis of Obesity and COVID-19","volume":"22","author":"Philips","year":"2021","journal-title":"Obes. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.livprodsci.2003.09.005","article-title":"Modifications of Protein and Amino Acid Metabolism during Inflammation and Immune System Activation","volume":"87","author":"Melchior","year":"2004","journal-title":"Livest. Prod. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.1093\/nsr\/nwaa086","article-title":"Plasma Metabolomic and Lipidomic Alterations Associated with COVID-19","volume":"7","author":"Wu","year":"2020","journal-title":"Natl. Sci. Rev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"584987","DOI":"10.3389\/fcvm.2020.584987","article-title":"Lipid Profile Features and Their Associations with Disease Severity and Mortality in Patients with COVID-19","volume":"7","author":"Sun","year":"2020","journal-title":"Front. Cardiovasc. Med."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hensen, T., F\u00e4ssler, D., O\u2019Mahony, L., Albrich, W.C., Barda, B., Garzoni, C., Kleger, G.-R., Pietsch, U., Suh, N., and Hertel, J. (2023). The Effects of Hospitalisation on the Serum Metabolome in COVID-19 Patients. Metabolites, 13.","DOI":"10.3390\/metabo13080951"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Roccaforte, V., Daves, M., Lippi, G., Spreafico, M., and Bonato, C. (2021). Altered Lipid Profile in Patients with COVID-19 Infection. J. Lab. Precis. Med., 6.","DOI":"10.21037\/jlpm-20-98"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"155197","DOI":"10.1016\/j.metabol.2022.155197","article-title":"Machine Learning and Semi-Targeted Lipidomics Identify Distinct Serum Lipid Signatures in Hospitalized COVID-19-Positive and COVID-19-Negative Patients","volume":"131","author":"Iftimie","year":"2022","journal-title":"Metabolism"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lewis, H.-M., Liu, Y., Frampas, C.F., Longman, K., Spick, M., Stewart, A., Sinclair, E., Kasar, N., Greener, D., and Whetton, A.D. (2022). Metabolomics Markers of COVID-19 Are Dependent on Collection Wave. Metabolites, 12.","DOI":"10.3390\/metabo12080713"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"154922","DOI":"10.1016\/j.metabol.2021.154922","article-title":"Systematic Review with Meta-Analysis of Diagnostic Test Accuracy for COVID-19 by Mass Spectrometry","volume":"126","author":"Spick","year":"2022","journal-title":"Metabolism"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.cca.2016.10.019","article-title":"Analytical and Biological Variability in Biomarker Measurement in the Hispanic Community Health Study\/Study of Latinos","volume":"463","author":"Thyagarajan","year":"2016","journal-title":"Clin. Chim. Acta"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s11306-006-0037-z","article-title":"Statistical Strategies for Avoiding False Discoveries in Metabolomics and Related Experiments","volume":"2","author":"Broadhurst","year":"2007","journal-title":"Metabolomics"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lamb, L.E., Janicki, J.J., Bartolone, S.N., Peters, K.M., and Chancellor, M.B. (2017). Development of an Interstitial Cystitis Risk Score for Bladder Permeability. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0185686"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1038\/s41746-021-00414-7","article-title":"Crowdsourcing Digital Health Measures to Predict Parkinson\u2019s Disease Severity: The Parkinson\u2019s Disease Digital Biomarker DREAM Challenge","volume":"4","author":"Sieberts","year":"2021","journal-title":"NPJ Digit. Med."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"12460","DOI":"10.1038\/ncomms12460","article-title":"Crowdsourced Assessment of Common Genetic Contribution to Predicting Anti-TNF Treatment Response in Rheumatoid Arthritis","volume":"7","author":"Sieberts","year":"2016","journal-title":"Nat. Commun."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"104384","DOI":"10.1016\/j.jcv.2020.104384","article-title":"Comparing the Analytical Performance of Three SARS-CoV-2 Molecular Diagnostic Assays","volume":"127","author":"Uhteg","year":"2020","journal-title":"J. Clin. Virol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e78200","DOI":"10.7554\/eLife.78200","article-title":"Post-Acute Sequelae of COVID-19: A Metabolic Perspective","volume":"11","author":"Scherer","year":"2022","journal-title":"eLife"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1007\/s12016-021-08848-3","article-title":"A Review of Persistent Post-COVID Syndrome (PPCS)","volume":"64","author":"Oronsky","year":"2023","journal-title":"Clin. Rev. Allergy Immunol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1007\/s42000-022-00382-x","article-title":"Assessment of DHEAS, Cortisol, and DHEAS\/Cortisol Ratio in Patients with COVID-19: A Pilot Study","volume":"21","author":"Tomo","year":"2022","journal-title":"Hormones"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e0272","DOI":"10.1097\/CCE.0000000000000272","article-title":"Metabolomics Profiling of Critically Ill Coronavirus Disease 2019 Patients: Identification of Diagnostic and Prognostic Biomarkers","volume":"2","author":"Fraser","year":"2020","journal-title":"Crit. Care Explor."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Almulla, A.F., Supasitthumrong, T., Tunvirachaisakul, C., Algon, A.A.A., Al-Hakeim, H.K., and Maes, M. (2022). The Tryptophan Catabolite or Kynurenine Pathway in COVID-19 and Critical COVID-19: A Systematic Review and Meta-Analysis. BMC Infect. Dis., 22.","DOI":"10.1186\/s12879-022-07582-1"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"20866","DOI":"10.1038\/s41598-021-00286-7","article-title":"Inferring a Causal Relationship between Ceramide Levels and COVID-19 Respiratory Distress","volume":"11","author":"Khodadoust","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Caterino, M., Costanzo, M., Fedele, R., Cevenini, A., Gelzo, M., Di Minno, A., Andolfo, I., Capasso, M., Russo, R., and Annunziata, A. (2021). The Serum Metabolome of Moderate and Severe COVID-19 Patients Reflects Possible Liver Alterations Involving Carbon and Nitrogen Metabolism. Int. J. Mol. Sci., 22.","DOI":"10.3390\/ijms22179548"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1007\/s11306-018-1332-1","article-title":"A Comparison of Human Serum and Plasma Metabolites Using Untargeted 1H NMR Spectroscopy and UPLC-MS","volume":"14","author":"Kaluarachchi","year":"2018","journal-title":"Metabolomics"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2365","DOI":"10.1002\/elps.200900778","article-title":"Comparison of Serum versus Plasma Collection in Gas Chromatography--Mass Spectrometry-Based Metabolomics","volume":"31","author":"Dettmer","year":"2010","journal-title":"Electrophoresis"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Spick, M., Campbell, A., Baricevic-Jones, I., von Gerichten, J., Lewis, H.-M., Frampas, C.F., Longman, K., Stewart, A., Dunn-Walters, D., and Skene, D.J. (2022). Multi-Omics Reveals Mechanisms of Partial Modulation of COVID-19 Dysregulation by Glucocorticoid Treatment. Int. J. Mol. Sci., 23.","DOI":"10.3390\/ijms232012079"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"6856","DOI":"10.1038\/s41467-022-34244-2","article-title":"Variant-Specific Symptoms of COVID-19 among 1,542,510 People in England","volume":"13","author":"Whitaker","year":"2022","journal-title":"Nat. Commun."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2257","DOI":"10.1093\/cid\/ciab079","article-title":"The Impact of Vaccination on Coronavirus Disease 2019 (COVID-19) Outbreaks in the United States","volume":"73","author":"Moghadas","year":"2021","journal-title":"Clin. Infect. Dis."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1038\/s41380-021-01309-5","article-title":"The Acid Sphingomyelinase\/Ceramide System in COVID-19","volume":"27","author":"Kornhuber","year":"2022","journal-title":"Mol. Psychiatry"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Carpinteiro, A., Gripp, B., Hoffmann, M., P\u00f6hlmann, S., Hoertel, N., Edwards, M.J., Kamler, M., Kornhuber, J., Becker, K.A., and Gulbins, E. (2021). Inhibition of Acid Sphingomyelinase by Ambroxol Prevents SARS-CoV-2 Entry into Epithelial Cells. J. Biol. Chem., 296.","DOI":"10.1016\/j.jbc.2021.100701"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1367","DOI":"10.1093\/rfs\/hhu001","article-title":"Wisdom of Crowds: The Value of Stock Opinions Transmitted Through Social Media","volume":"27","author":"Chen","year":"2014","journal-title":"Rev. Financ. Stud."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1257\/mic.2.1.112","article-title":"Na\u00efve Learning in Social Networks and the Wisdom of Crowds","volume":"2","author":"Golub","year":"2010","journal-title":"Am. Econ. J. Microecon."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"The DREAM5 Consortium, Marbach, D., Costello, J.C., K\u00fcffner, R., Vega, N.M., Prill, R.J., Camacho, D.M., Allison, K.R., Kellis, M., and Collins, J.J. (2012). Wisdom of Crowds for Robust Gene Network Inference. Nat. Methods, 9, 796\u2013804.","DOI":"10.1038\/nmeth.2016"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"20180130","DOI":"10.1098\/rsif.2018.0130","article-title":"Counteracting Estimation Bias and Social Influence to Improve the Wisdom of Crowds","volume":"15","author":"Kao","year":"2018","journal-title":"J. R. Soc. Interface"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2200","DOI":"10.1001\/jama.2011.713","article-title":"Comparison of Effect Sizes Associated with Biomarkers Reported in Highly Cited Individual Articles and in Subsequent Meta-Analyses","volume":"305","author":"Ioannidis","year":"2011","journal-title":"JAMA"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1038\/s41419-021-03540-y","article-title":"Metabolomic Analyses of COVID-19 Patients Unravel Stage-Dependent and Prognostic Biomarkers","volume":"12","author":"Danlos","year":"2021","journal-title":"Cell Death Dis."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"100369","DOI":"10.1016\/j.xcrm.2021.100369","article-title":"Longitudinal Metabolomics of Human Plasma Reveals Prognostic Markers of COVID-19 Disease Severity","volume":"2","author":"Sindelar","year":"2021","journal-title":"Cell Rep. Med."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"e105896","DOI":"10.15252\/embj.2020105896","article-title":"Blood Molecular Markers Associated with COVID-19 Immunopathology and Multi-organ Damage","volume":"39","author":"Chen","year":"2020","journal-title":"EMBO J."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Ballout, R.A., Kong, H., Sampson, M., Otvos, J.D., Cox, A.L., Agbor-Enoh, S., and Remaley, A.T. (2021). The NIH Lipo-COVID Study: A Pilot NMR Investigation of Lipoprotein Subfractions and Other Metabolites in Patients with Severe COVID-19. Biomedicines, 9.","DOI":"10.33774\/chemrxiv-2021-dctkq"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2471","DOI":"10.1021\/acs.analchem.0c04497","article-title":"COVID-19 Automated Diagnosis and Risk Assessment through Metabolomics and Machine Learning","volume":"93","author":"Delafiori","year":"2021","journal-title":"Anal. Chem."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2508","DOI":"10.1210\/jc.2009-2561","article-title":"Prolonged Inactivity Up-Regulates Cholesteryl Ester Transfer Protein Independently of Body Fat Changes in Humans","volume":"95","author":"Mazzucco","year":"2010","journal-title":"J. Clin. Endocrinol. Metab."},{"key":"ref_52","unstructured":"easyPubMed (2023, June 05). Available online: https:\/\/cran.r-project.org\/web\/packages\/easyPubMed\/."},{"key":"ref_53","unstructured":"wordcloud2 (2023, June 16). Available online: https:\/\/cran.r-project.org\/web\/packages\/wordcloud2\/."},{"key":"ref_54","first-page":"2825","article-title":"Scikit-Learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."}],"container-title":["International Journal of Molecular Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1422-0067\/24\/18\/14371\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:54:31Z","timestamp":1760129671000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1422-0067\/24\/18\/14371"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,21]]},"references-count":54,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["ijms241814371"],"URL":"https:\/\/doi.org\/10.3390\/ijms241814371","relation":{},"ISSN":["1422-0067"],"issn-type":[{"value":"1422-0067","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,21]]}}}