{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T23:41:31Z","timestamp":1782517291259,"version":"3.54.5"},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T00:00:00Z","timestamp":1712188800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T00:00:00Z","timestamp":1712188800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["956832"],"award-info":[{"award-number":["956832"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cheminform"],"abstract":"<jats:sec>\n                    <jats:title>Abstract<\/jats:title>\n                    <jats:p>Stakeholders of machine learning models desire explainable artificial intelligence (XAI) to produce human-understandable and consistent interpretations. In computational toxicity, augmentation of text-based molecular representations has been used successfully for transfer learning on downstream tasks. Augmentations of molecular representations can also be used at inference to compare differences between multiple representations of the same ground-truth. In this study, we investigate the robustness of eight XAI methods using test-time augmentation for a molecular-representation model in the field of computational toxicity prediction. We report significant differences between explanations for different representations of the same ground-truth, and show that randomized models have similar variance. We hypothesize that text-based molecular representations in this and past research reflect tokenization more than learned parameters. Furthermore, we see a greater variance between in-domain predictions than out-of-domain predictions, indicating XAI measures something other than learned parameters. Finally, we investigate the relative importance given to expert-derived structural alerts and find similar importance given irregardless of applicability domain, randomization and varying training procedures. We therefore caution future research to validate their methods using a similar comparison to human intuition without further investigation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Scientific contribution<\/jats:title>\n                    <jats:p>In this research we critically investigate XAI through test-time augmentation, contrasting previous assumptions about using expert validation and showing inconsistencies within models for identical representations. SMILES augmentation has been used to increase model accuracy, but was here adapted from the field of image test-time augmentation to be used as an independent indication of the consistency within SMILES-based molecular representation models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Graphical Abstract<\/jats:title>\n                  <\/jats:sec>","DOI":"10.1186\/s13321-024-00824-1","type":"journal-article","created":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T00:07:47Z","timestamp":1712189267000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Using test-time augmentation to investigate explainable AI: inconsistencies between method, model and human intuition"],"prefix":"10.1186","volume":"16","author":[{"given":"Peter B. R.","family":"Hartog","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabian","family":"Kr\u00fcger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samuel","family":"Genheden","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Igor V.","family":"Tetko","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,4,4]]},"reference":[{"key":"824_CR1","unstructured":"Vellido A, Mart\u00edn-Guerrero JD, Lisboa PJ (2012) Making machine learning models interpretable. In: ESANN, vol. 12, pp 163\u2013172. Citeseer"},{"key":"824_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2023.101805","volume":"99","author":"S Ali","year":"2023","unstructured":"Ali S, Abuhmed T, El-Sappagh S, Muhammad K, Alonso-Moral JM, Confalonieri R, Guidotti R, Del Ser J, D\u00edaz-Rodr\u00edguez N, Herrera F (2023) Explainable artificial intelligence (XAI): What we know and what is left to attain trustworthy artificial intelligence. Inf Fus 99:101805","journal-title":"Inf Fus"},{"key":"824_CR3","unstructured":"Sundararajan M, Taly A, Yan Q (2017) Axiomatic attribution for deep networks"},{"key":"824_CR4","volume-title":"Advances in neural information processing systems","author":"SM Lundberg","year":"2017","unstructured":"Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Advances in neural information processing systems, vol 30. Curran Associates Inc, New York"},{"key":"824_CR5","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016) \u201cwhy should i trust you?\u201d explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 1135\u20131144","DOI":"10.1145\/2939672.2939778"},{"key":"824_CR6","doi-asserted-by":"crossref","unstructured":"Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A (2016) Learning deep features for discriminative localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2921\u20132929","DOI":"10.1109\/CVPR.2016.319"},{"key":"824_CR7","first-page":"5052","volume-title":"Advances in neural information processing systems","author":"Y Qiang","year":"2022","unstructured":"Qiang Y, Pan D, Li C, Li X, Jang R, Zhu D (2022) AttCAT: explaining transformers via attentive class activation tokens. In: Koyejo S, Mohamed S, Agarwal A, Belgrave D, Cho K, Oh A (eds) Advances in neural information processing systems, vol 35. Curran Associates, Inc., New York, pp 5052\u20135064"},{"key":"824_CR8","unstructured":"Adebayo J, Gilmer J, Muelly M, Goodfellow I, Hardt M, Kim B (2018) Sanity checks for saliency maps. Adv Neural Inf Process Syst 31"},{"key":"824_CR9","doi-asserted-by":"crossref","unstructured":"Kindermans P-J, Hooker S, Adebayo J, Alber M, Sch\u00fctt KT, D\u00e4hne S, Erhan D, Kim B (2019) The (un) reliability of saliency methods. Explainable AI: interpreting, explaining and visualizing deep learning, pp 267\u2013280","DOI":"10.1007\/978-3-030-28954-6_14"},{"key":"824_CR10","volume-title":"Advances in neural information processing systems","author":"P Schwab","year":"2019","unstructured":"Schwab P, Karlen W (2019) CXplain: causal explanations for model interpretation under uncertainty. In: Wallach H, Larochelle H, Beygelzimer A, Alch\u00e9-Buc F, Fox E, Garnett R (eds) Advances in neural information processing systems, vol 32. Curran Associates Inc, New York"},{"issue":"8","key":"824_CR11","doi-asserted-by":"publisher","first-page":"1616","DOI":"10.1021\/ja01062a035","volume":"86","author":"C Hansch","year":"1964","unstructured":"Hansch C, Fujita T (1964) p-$$\\sigma$$-$$\\pi$$ analysis: a method for the correlation of biological activity and chemical structure. J Am Chem Soc 86(8):1616\u20131626","journal-title":"J Am Chem Soc"},{"issue":"1","key":"824_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13321-020-00423-w","volume":"12","author":"P Karpov","year":"2020","unstructured":"Karpov P, Godin G, Tetko IV (2020) Transformer-CNN: Swiss knife for QSAR modeling and interpretation. J Cheminf 12(1):1\u201312","journal-title":"J Cheminf"},{"issue":"11","key":"824_CR13","doi-asserted-by":"publisher","first-page":"2840","DOI":"10.1021\/ci300400a","volume":"52","author":"C Xu","year":"2012","unstructured":"Xu C, Cheng F, Chen L, Du Z, Li W, Liu G, Lee PW, Tang Y (2012) In silico prediction of chemical Ames mutagenicity. J Chem Inf Model 52(11):2840\u20132847","journal-title":"J Chem Inf Model"},{"issue":"24","key":"824_CR14","doi-asserted-by":"publisher","first-page":"11606","DOI":"10.1073\/pnas.91.24.11606","volume":"91","author":"P Gee","year":"1994","unstructured":"Gee P, Maron DM, Ames BN (1994) Detection and classification of mutagens: a set of base-specific salmonella tester strains. Proc Natl Acad Sci 91(24):11606\u201311610","journal-title":"Proc Natl Acad Sci"},{"issue":"4","key":"824_CR15","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1093\/mutage\/gep017","volume":"24","author":"M Kamber","year":"2009","unstructured":"Kamber M, Fl\u00fcckiger-Isler S, Engelhardt G, Jaeckh R, Zeiger E (2009) Comparison of the Ames II and traditional Ames test responses with respect to mutagenicity, strain specificities, need for metabolism and correlation with rodent carcinogenicity. Mutagenesis 24(4):359\u2013366","journal-title":"Mutagenesis"},{"issue":"1","key":"824_CR16","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1021\/ci00057a005","volume":"28","author":"D Weininger","year":"1988","unstructured":"Weininger D (1988) Smiles, a chemical language and information system. 1. Introduction to methodology and encoding rules. J Chem Inf Computer Sci 28(1):31\u201336","journal-title":"J Chem Inf Computer Sci"},{"key":"824_CR17","doi-asserted-by":"crossref","unstructured":"Wiseman S, Rush AM (2016) Sequence-to-sequence learning as beam-search optimization. arXiv preprint arXiv:1606.02960","DOI":"10.18653\/v1\/D16-1137"},{"key":"824_CR18","volume-title":"Advances in Neural Information Processing Systems","author":"A Vaswani","year":"2017","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Advances in Neural Information Processing Systems, vol 30. Curran Associates Inc, New York"},{"key":"824_CR19","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805"},{"key":"824_CR20","doi-asserted-by":"crossref","unstructured":"Lewis M, Liu Y, Goyal N, Ghazvininejad M, Mohamed A, Levy O, Stoyanov V, Zettlemoyer L (2019) Bart: denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461","DOI":"10.18653\/v1\/2020.acl-main.703"},{"issue":"4","key":"824_CR21","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1016\/j.drudis.2020.01.020","volume":"25","author":"H \u00d6zt\u00fcrk","year":"2020","unstructured":"\u00d6zt\u00fcrk H, \u00d6zg\u00fcr A, Schwaller P, Laino T, Ozkirimli E (2020) Exploring chemical space using natural language processing methodologies for drug discovery. Drug Discov Today 25(4):689\u2013705","journal-title":"Drug Discov Today"},{"issue":"1","key":"824_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13321-020-00460-5","volume":"12","author":"L David","year":"2020","unstructured":"David L, Thakkar A, Mercado R, Engkvist O (2020) Molecular representations in ai-driven drug discovery: a review and practical guide. J Cheminf 12(1):1\u201322","journal-title":"J Cheminf"},{"key":"824_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2023.109347","volume":"137","author":"M Xu","year":"2023","unstructured":"Xu M, Yoon S, Fuentes A, Park DS (2023) A comprehensive survey of image augmentation techniques for deep learning. Pattern Recognit 137:109347","journal-title":"Pattern Recognit"},{"key":"824_CR24","unstructured":"Bjerrum EJ (2017) Smiles enumeration as data augmentation for neural network modeling of molecules. arXiv preprint arXiv:1703.07076"},{"issue":"4","key":"824_CR25","doi-asserted-by":"publisher","first-page":"794","DOI":"10.1021\/ci950204c","volume":"36","author":"IV Tetko","year":"1996","unstructured":"Tetko IV, Villa AE, Livingstone DJ (1996) Neural network studies. 2. Variable selection. J Chem Inf Computer Sci 36(4):794\u2013803","journal-title":"J Chem Inf Computer Sci"},{"key":"824_CR26","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.neucom.2019.01.103","volume":"338","author":"G Wang","year":"2019","unstructured":"Wang G, Li W, Aertsen M, Deprest J, Ourselin S, Vercauteren T (2019) Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks. Neurocomputing 338:34\u201345","journal-title":"Neurocomputing"},{"key":"824_CR27","unstructured":"Ayhan MS, Berens P (2022) Test-time data augmentation for estimation of heteroscedastic aleatoric uncertainty in deep neural networks. In: Medical Imaging with Deep Learning"},{"key":"824_CR28","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2021.103473","volume":"296","author":"M Langer","year":"2021","unstructured":"Langer M, Oster D, Speith T, Hermanns H, K\u00e4stner L, Schmidt E, Sesing A, Baum K (2021) What do we want from explainable artificial intelligence (XAI)?-a stakeholder perspective on XAI and a conceptual model guiding interdisciplinary XAI research. Artif Intell 296:103473","journal-title":"Artif Intell"},{"key":"824_CR29","doi-asserted-by":"crossref","unstructured":"Kovaleva O, Romanov A, Rogers A, Rumshisky A (2019) Revealing the dark secrets of BERT. arXiv preprint arXiv:1908.08593","DOI":"10.18653\/v1\/D19-1445"},{"key":"824_CR30","doi-asserted-by":"crossref","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp 618\u2013626","DOI":"10.1109\/ICCV.2017.74"},{"key":"824_CR31","unstructured":"Huang K, Fu T, Gao W, Zhao Y, Roohani Y, Leskovec J, Coley CW, Xiao C, Sun J, Zitnik M (2021) Therapeutics data commons: machine learning datasets and tasks for drug discovery and development. arXiv preprint arXiv:2102.09548"},{"issue":"W1","key":"824_CR32","doi-asserted-by":"publisher","first-page":"612","DOI":"10.1093\/nar\/gkv352","volume":"43","author":"M Davies","year":"2015","unstructured":"Davies M, Nowotka M, Papadatos G, Dedman N, Gaulton A, Atkinson F, Bellis L, Overington JP (2015) ChEMBL web services: streamlining access to drug discovery data and utilities. Nucl Acids Res 43(W1):612\u2013620","journal-title":"Nucl Acids Res"},{"issue":"D1","key":"824_CR33","doi-asserted-by":"publisher","first-page":"930","DOI":"10.1093\/nar\/gky1075","volume":"47","author":"D Mendez","year":"2019","unstructured":"Mendez D, Gaulton A, Bento AP, Chambers J, De Veij M, F\u00e9lix E, Magari\u00f1os MP, Mosquera JF, Mutowo P, Nowotka M (2019) ChEMBL: towards direct deposition of bioassay data. Nucl Acids Res 47(D1):930\u2013940","journal-title":"Nucl Acids Res"},{"key":"824_CR34","doi-asserted-by":"publisher","unstructured":"Landrum G (2006) RDKit: open-source cheminformatics software https:\/\/doi.org\/10.5281\/zenodo.7415128, https:\/\/www.rdkit.org. Accessed 9 Oct 2023","DOI":"10.5281\/zenodo.7415128"},{"issue":"1","key":"824_CR35","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1021\/jm040835a","volume":"48","author":"J Kazius","year":"2005","unstructured":"Kazius J, McGuire R, Bursi R (2005) Derivation and validation of toxicophores for mutagenicity prediction. J Med Chem 48(1):312\u2013320","journal-title":"J Med Chem"},{"key":"824_CR36","first-page":"8024","volume-title":"Advances in neural information processing systems","author":"A Paszke","year":"2019","unstructured":"...Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L, Desmaison A, Kopf A, Yang E, DeVito Z, Raison M, Tejani A, Chilamkurthy S, Steiner B, Fang L, Bai J, Chintala S (2019) PyTorch: an imperative style, high-performance deep learning library. In: Wallach H, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox E, Garnett R (eds) Advances in neural information processing systems, vol 32. Curran Associates Inc, New York, pp 8024\u20138035"},{"key":"824_CR37","doi-asserted-by":"publisher","unstructured":"Falcon W (2019). The PyTorch Lightning team: PyTorch Lightning https:\/\/doi.org\/10.5281\/zenodo.3828935. https:\/\/github.com\/Lightning-AI\/lightning. Accessed 19 Oct 2023","DOI":"10.5281\/zenodo.3828935"},{"key":"824_CR38","unstructured":"Kokhlikyan N, Miglani V, Martin M, Wang E, Alsallakh B, Reynolds J, Melnikov A, Kliushkina N, Araya C, Yan S, Reblitz-Richardson O (2020) Captum: a unified and generic model interpretability library for PyTorch"},{"key":"824_CR39","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","volume":"17","author":"P Virtanen","year":"2020","unstructured":"...Virtanen P, Gommers R, Oliphant TE, Haberland M, Reddy T, Cournapeau D, Burovski E, Peterson P, Weckesser W, Bright J, van der Walt SJ, Brett M, Wilson J, Millman KJ, Mayorov N, Nelson ARJ, Jones E, Kern R, Larson E, Carey CJ, Polat \u0130, Feng Y, Moore EW, VanderPlas J, Laxalde D, Perktold J, Cimrman R, Henriksen I, Quintero EA, Harris CR, Archibald AM, Ribeiro AH, Pedregosa F, van Mulbregt P (2020) SciPy 1.0 contributors: SciPy 1.0\u2014fundamental algorithms for scientific computing in python. Nat Methods 17:261\u2013272. https:\/\/doi.org\/10.1038\/s41592-019-0686-2","journal-title":"Nat Methods"},{"key":"824_CR40","unstructured":"Dabkowski P, Gal Y (2017) Real time image saliency for black box classifiers. Adv Neural Inf Process Syst 30"},{"key":"824_CR41","doi-asserted-by":"crossref","unstructured":"Zafar MB, Donini M, Slack D, Archambeau C, Das S, Kenthapadi K (2021) On the lack of robust interpretability of neural text classifiers. arXiv preprint arXiv:2106.04631","DOI":"10.18653\/v1\/2021.findings-acl.327"},{"issue":"1","key":"824_CR42","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1186\/s13321-023-00725-9","volume":"15","author":"UV Ucak","year":"2023","unstructured":"Ucak UV, Ashyrmamatov I, Lee J (2023) Improving the quality of chemical language model outcomes with atom-in-smiles tokenization. J Cheminf 15(1):55","journal-title":"J Cheminf"},{"key":"824_CR43","doi-asserted-by":"publisher","DOI":"10.1039\/D2DD00099G","author":"J Born","year":"2023","unstructured":"Born J, Markert G, Janakarajan N, Kimber TB, Volkamer A, Mart\u00ednez MR, Manica M (2023) Chemical representation learning for toxicity prediction. Digit Discov. https:\/\/doi.org\/10.1039\/D2DD00099G","journal-title":"Digit Discov"},{"key":"824_CR44","unstructured":"Crabb\u00e9 J, Schaar M (2023) Evaluating the robustness of interpretability methods through explanation invariance and equivariance. arXiv preprint arXiv:2304.06715"},{"issue":"4","key":"824_CR45","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1109\/TPAMI.2008.110","volume":"31","author":"M Lan","year":"2008","unstructured":"Lan M, Tan CL, Su J, Lu Y (2008) Supervised and traditional term weighting methods for automatic text categorization. IEEE Trans Pattern Anal Mach Intell 31(4):721\u2013735","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"7","key":"824_CR46","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1038\/s42256-021-00343-w","volume":"3","author":"G Erion","year":"2021","unstructured":"Erion G, Janizek JD, Sturmfels P, Lundberg SM, Lee S-I (2021) Improving performance of deep learning models with axiomatic attribution priors and expected gradients. Nat Mach Intell 3(7):620\u2013631","journal-title":"Nat Mach Intell"},{"key":"824_CR47","doi-asserted-by":"crossref","unstructured":"Schwaller P, Hoover B, Reymond J-L, Strobelt H, Laino T (2021) Transformer-based neural networks capture organic chemistry grammar from unsupervised learning of chemical reactions. In: American Chemical Society (ACS) Spring Meeting","DOI":"10.1126\/sciadv.abe4166"},{"key":"824_CR48","doi-asserted-by":"crossref","unstructured":"Fradkin P, Young A, Atanackovic L, Frey B, Lee LJ, Wang B (2022) A graph neural network approach for molecule carcinogenicity prediction. Bioinformatics 38(Supplement_1), 84\u201391","DOI":"10.1093\/bioinformatics\/btac266"}],"container-title":["Journal of Cheminformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13321-024-00824-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13321-024-00824-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13321-024-00824-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T00:09:37Z","timestamp":1712189377000},"score":1,"resource":{"primary":{"URL":"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-024-00824-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,4]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["824"],"URL":"https:\/\/doi.org\/10.1186\/s13321-024-00824-1","relation":{"has-preprint":[{"id-type":"doi","id":"10.26434\/chemrxiv-2024-kdx3g","asserted-by":"object"}]},"ISSN":["1758-2946"],"issn-type":[{"value":"1758-2946","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,4]]},"assertion":[{"value":"20 December 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"All authors have read and agreed to the published version of the manuscript.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"39"}}