{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:41:45Z","timestamp":1785537705699,"version":"3.56.0"},"reference-count":53,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2025,7,21]],"date-time":"2025-07-21T00:00:00Z","timestamp":1753056000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,21]],"date-time":"2025-07-21T00:00:00Z","timestamp":1753056000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Causal graphs are widely used in software engineering to document and explore causal relationships. Though widely used, they may also be wildly misleading. Causal structures generated from SE data can be highly variable. This instability is so significant that conclusions drawn from one graph may be totally reversed in another, even when both graphs are learned from the same or very similar project data. To document this problem, this paper examines causal graphs found by four causal graph generators (PC, FCI, GES, and LiNGAM) when applied to 23 data sets, relating to three different SE tasks: (a)\u00a0learning how configuration options are selected for different properties; (b)\u00a0understanding how management choices affect software projects; and (c)\u00a0defect prediction. Graphs were compared between (a)\u00a0different projects exploring the same task; (b)\u00a0version <jats:italic>i<\/jats:italic> and <jats:inline-formula>\n              <jats:tex-math>$$i+1$$<\/jats:tex-math>\n            <\/jats:inline-formula> of a system; (c)\u00a0different 90% samples of the data; and (d)\u00a0small variations in the causal graph generator. Measured in terms of the Jaccard index of the number of edges shared by two different graphs, over half the edges were changed by these treatments. Hence, we conclude two things. Firstly, specific conclusions found by causal graph generators about how two specific variables affect each other may not generalize since those conclusions could be reversed by minor changes in how those graphs are generated. Secondly, before researchers can report supposedly general conclusions from causal graphs (e.g., \u201clong functions cause more defects\u201d), they should test that such conclusions hold over the numerous causal graphs that might be generated from the same data.<\/jats:p>","DOI":"10.1007\/s10664-025-10690-6","type":"journal-article","created":{"date-parts":[[2025,7,21]],"date-time":"2025-07-21T07:44:50Z","timestamp":1753083890000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Shaky structures: The wobbly world of causal graphs in software analytics"],"prefix":"10.1007","volume":"30","author":[{"given":"Jeremy","family":"Hulse","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nasir U.","family":"Eisty","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5040-3196","authenticated-orcid":false,"given":"Tim","family":"Menzies","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,21]]},"reference":[{"issue":"3","key":"10690_CR1","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1214\/ss\/1009213726","volume":"16","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Statistical modeling: The two cultures (with comments and a rejoinder by the author). Stat. Sci. 16(3):199\u2013231","journal-title":"Stat. Sci."},{"key":"10690_CR2","doi-asserted-by":"crossref","unstructured":"Carroll C, Falessi D, Forney V, Frances A, Izurieta C, Seaman C (2015) A mapping study of software causal factors for improving maintenance. In 2015 ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), pp.\u00a01\u20134","DOI":"10.1109\/ESEM.2015.7321183"},{"key":"10690_CR3","doi-asserted-by":"crossref","unstructured":"Chadbourne P, Eisty NU (2023) Applications of causality and causal inference in software engineering. In: 2023 IEEE\/ACIS 21st International Conference on Software Engineering Research, Management and Applications (SERA), pp.\u00a047\u201352","DOI":"10.1109\/SERA57763.2023.10197835"},{"key":"10690_CR4","doi-asserted-by":"crossref","unstructured":"Chen P, Qi Y, Zheng P, Hou D (2014) Causeinfer: Automatic and distributed performance diagnosis with hierarchical causality graph in large distributed systems. In: IEEE INFOCOM 2014 - IEEE Conference on Computer Communications, pp.\u00a01887\u20131895","DOI":"10.1109\/INFOCOM.2014.6848128"},{"key":"10690_CR5","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1145\/3636423","volume":"56","author":"D Cheng","year":"2024","unstructured":"Cheng D, Li J, Liu L, Liu J, Le TD (2024) Data-driven causal effect estimation based on graphical causal modelling: A survey. ACM Comput. Surv. 56:5","journal-title":"ACM Comput. Surv."},{"key":"10690_CR6","first-page":"855","volume":"3","author":"DM Chickering","year":"2002","unstructured":"Chickering DM (2002) Optimal structure identification with greedy search. J. Mach. Learn. Res. 3:855\u2013894","journal-title":"J. Mach. Learn. Res."},{"key":"10690_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2105-13-35","volume":"13","author":"L Chindelevitch","year":"2012","unstructured":"Chindelevitch L, Loh P-R, Enayetallah A, Berger B, Ziemek D (2012) Assessing statistical significance in causal graphs. BMC Bioinformatics 13:1\u201314","journal-title":"BMC Bioinformatics"},{"key":"10690_CR8","doi-asserted-by":"crossref","unstructured":"Clark AG, Foster M, Walkinshaw N, Hierons RM (2023) Metamorphic testing with causal graphs. In: 2023 IEEE Conference on Software Testing, Verification and Validation (ICST), pp.\u00a0153\u2013164","DOI":"10.1109\/ICST57152.2023.00023"},{"issue":"05","key":"10690_CR9","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1109\/MS.2009.132","volume":"26","author":"J Cusick","year":"2009","unstructured":"Cusick J, Williams L, Everett W, Musa JD (2009) IEEE Softw. 26(05):102","journal-title":"IEEE Softw."},{"key":"10690_CR10","unstructured":"Dash D, Druzdzel MJ (1999) A hybrid anytime algorithm for the construction of causal models from sparse data. In: Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence (San Francisco, CA, USA), UAI\u201999, Morgan Kaufmann Publishers Inc., p.\u00a0142\u2013149"},{"issue":"3","key":"10690_CR11","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1007\/s11633-014-0791-8","volume":"11","author":"C-L Dong","year":"2014","unstructured":"Dong C-L, Zhang Q, Geng S-C (2014) A modeling and probabilistic reasoning method of dynamic uncertain causality graph for industrial fault diagnosis. Int. J. Autom. Comput. 11(3):288\u2013298","journal-title":"Int. J. Autom. Comput."},{"key":"10690_CR12","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-4541-9","volume-title":"An introduction to the bootstrap","author":"B Efron","year":"1993","unstructured":"Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman & Hall\/CRC monographs on statistics and applied probability, Chapman and Hall, London"},{"issue":"2","key":"10690_CR13","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s10664-022-10277-5","volume":"28","author":"NA Ernst","year":"2023","unstructured":"Ernst NA, Baldassarre MT (2023) Registered reports in software engineering. Empir. Softw. Eng. 28(2):55","journal-title":"Empir. Softw. Eng."},{"issue":"5","key":"10690_CR14","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1109\/32.815326","volume":"25","author":"NE Fenton","year":"1999","unstructured":"Fenton NE, Neil M (1999) A critique of software defect prediction models. IEEE Trans. Software Eng. 25(5):675\u2013689","journal-title":"IEEE Trans. Software Eng."},{"key":"10690_CR15","doi-asserted-by":"crossref","unstructured":"Fenton NE, Neil M (2000) Software metrics: roadmap. In: International Conference on Software Engineering, ACM Press, pp.\u00a0357\u2013370","DOI":"10.1145\/336512.336588"},{"key":"10690_CR16","doi-asserted-by":"crossref","unstructured":"Fischbach J, Hauptmann B, Konwitschny L, Spies D, Vogelsang A (2020) Towards causality extraction from requirements. In: 2020 IEEE 28th International Requirements Engineering Conference (RE), pp.\u00a0388\u2013393","DOI":"10.1109\/RE48521.2020.00053"},{"key":"10690_CR17","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.infsof.2016.04.017","volume":"76","author":"W Fu","year":"2016","unstructured":"Fu W, Menzies T, Shen X (2016) Tuning for software analytics: Is it really necessary? Inf. Softw. Technol. 76:135\u2013146","journal-title":"Inf. Softw. Technol."},{"key":"10690_CR18","doi-asserted-by":"crossref","unstructured":"Giamattei L, Guerriero A, Pietrantuono R, Russo S (2024) Causal reasoning in software quality assurance: A systematic review. Information and Software Technology. 107599","DOI":"10.1016\/j.infsof.2024.107599"},{"key":"10690_CR19","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1145\/3635709","volume":"33","author":"L Giamattei","year":"2024","unstructured":"Giamattei L, Guerriero A, Pietrantuono R, Russo S (2024) Causality-driven testing of autonomous driving systems. ACM Trans. Softw. Eng. Methodol. 33:3","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"10690_CR20","doi-asserted-by":"crossref","unstructured":"Granger CW (1969) Investigating causal relations by econometric models and cross-spectral methods. Econometrica: journal of the Econometric Society 424\u2013438","DOI":"10.2307\/1912791"},{"key":"10690_CR21","first-page":"2409","volume":"13","author":"A Hauser","year":"2012","unstructured":"Hauser A, B\u00fchlmann P (2012) Characterization and greedy learning of interventional Markov equivalence classes of directed acyclic graphs. J. Mach. Learn. Res. 13:2409\u20132464","journal-title":"J. Mach. Learn. Res."},{"key":"10690_CR22","unstructured":"Hess MR, Kromrey JD (2004) Robust confidence intervals for effect sizes: A comparative study of cohen\u2019sd and cliff\u2019s delta under non-normality and heterogeneous variances. In: Annual meeting of the American Educational Research Association, vol.\u00a01, Citeseer"},{"key":"10690_CR23","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1016\/j.dss.2012.11.001","volume":"56","author":"Y Hu","year":"2013","unstructured":"Hu Y, Zhang X, Ngai E, Cai R, Liu M (2013) Software project risk analysis using bayesian networks with causality constraints. Decis. Support Syst. 56:439\u2013449","journal-title":"Decis. Support Syst."},{"key":"10690_CR24","doi-asserted-by":"crossref","unstructured":"Ibrahim A, Pretschner A (2020) From checking to inference: Actual causality computations as optimization problems. In: Automated Technology for Verification and Analysis (Cham), D.\u00a0V. Hung and O.\u00a0Sokolsky, Eds., Springer International Publishing, pp.\u00a0343\u2013359","DOI":"10.1007\/978-3-030-59152-6_19"},{"key":"10690_CR25","doi-asserted-by":"crossref","unstructured":"Iqbal MS, Krishna R, Javidian MA, Ray B, Jamshidi P (2022) Unicorn: reasoning about configurable system performance through the lens of causality. In: Proceedings of the Seventeenth European Conference on Computer Systems. (New York, NY, USA), EuroSys \u201922, Association for Computing Machinery, p.\u00a0199\u2013217","DOI":"10.1145\/3492321.3519575"},{"key":"10690_CR26","doi-asserted-by":"publisher","first-page":"726","DOI":"10.1109\/ACCESS.2013.2286822","volume":"1","author":"K Jaber","year":"2013","unstructured":"Jaber K, Sharif B, Liu C (2013) A study on the effect of traceability links in software maintenance. IEEE Access 1:726\u2013741","journal-title":"IEEE Access"},{"key":"10690_CR27","doi-asserted-by":"crossref","unstructured":"Johnson B, Brun Y, Meliou A (2020) Causal testing: understanding defects\u2019 root causes. In: Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (New York, NY, USA), ICSE \u201920, Association for Computing Machinery, p.\u00a087\u201399","DOI":"10.1145\/3377811.3380377"},{"key":"10690_CR28","doi-asserted-by":"crossref","unstructured":"Jureczko M, Madeyski L (2010) Towards identifying software project clusters with regard to defect prediction. In: Proceedings of the 6th international conference on predictive models in software engineering, pp.\u00a01\u201310","DOI":"10.1145\/1868328.1868342"},{"issue":"11","key":"10690_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v047.i11","volume":"47","author":"M Kalisch","year":"2012","unstructured":"Kalisch M, M\u00e4chler M, Colombo D, Maathuis MH, B\u00fchlmann P (2012) Causal inference using graphical models with the R package pcalg. J. Stat. Softw. 47(11):1\u201326","journal-title":"J. Stat. Softw."},{"issue":"5","key":"10690_CR30","doi-asserted-by":"publisher","first-page":"1483","DOI":"10.1109\/TCBB.2016.2591526","volume":"16","author":"TD Le","year":"2019","unstructured":"Le TD, Hoang T, Li J, Liu L, Liu H, Hu S (2019) A fast pc algorithm for high dimensional causal discovery with multi-core pcs. IEEE\/ACM Trans. Comput. Biol. Bioinf. 16(5):1483\u20131495","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinf."},{"issue":"17","key":"10690_CR31","doi-asserted-by":"publisher","first-page":"556","DOI":"10.2307\/2025310","volume":"70","author":"D Lewis","year":"1973","unstructured":"Lewis D (1973) Causation. Journal of Philosophy 70(17):556\u2013567","journal-title":"Journal of Philosophy"},{"issue":"6","key":"10690_CR32","doi-asserted-by":"publisher","first-page":"679","DOI":"10.3390\/e23060679","volume":"23","author":"XS Liang","year":"2021","unstructured":"Liang XS (2021) Normalized multivariate time series causality analysis and causal graph reconstruction. Entropy 23(6):679","journal-title":"Entropy"},{"issue":"2","key":"10690_CR33","doi-asserted-by":"publisher","first-page":"545","DOI":"10.11144\/Javeriana.upsy10-2.cdcp","volume":"10","author":"G Macbeth","year":"2011","unstructured":"Macbeth G, Razumiejczyk E, Ledesma RD (2011) Cliff\u015b delta calculator: Un programa para calcular el tama\u00f1o del efecto no param\u00e9trico al comparar dos grupos de observaciones. Universitas Psychologica 10(2):545","journal-title":"Universitas Psychologica"},{"key":"10690_CR34","unstructured":"Menzies T, Richardson J (2005) Xomo: Understanding development options for autonomy. In: COCOMO forum, vol.\u00a02005"},{"issue":"16","key":"10690_CR35","doi-asserted-by":"publisher","first-page":"1562","DOI":"10.1056\/NEJMon1211064","volume":"367","author":"FH Messerli","year":"2012","unstructured":"Messerli FH (2012) Chocolate consumption, cognitive function, and nobel laureates. N. Engl. J. Med. 367(16):1562\u20131564","journal-title":"N. Engl. J. Med."},{"issue":"4","key":"10690_CR36","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1109\/TSE.2012.45","volume":"39","author":"N Mittas","year":"2012","unstructured":"Mittas N, Angelis L (2012) Ranking and clustering software cost estimation models through a multiple comparisons algorithm. IEEE Trans. Software Eng. 39(4):537\u2013551","journal-title":"IEEE Trans. Software Eng."},{"issue":"05","key":"10690_CR37","doi-asserted-by":"publisher","first-page":"1215","DOI":"10.1109\/TSE.2024.3379943","volume":"50","author":"DN Palacio","year":"2024","unstructured":"Palacio DN, Velasco A, Cooper N, Rodriguez A, Moran K, Poshyvanyk D (2024) Toward a theory of causation for interpreting neural code models. IEEE Trans. Software Eng. 50(05):1215\u20131243","journal-title":"IEEE Trans. Software Eng."},{"key":"10690_CR38","first-page":"157","volume-title":"From Bayesian Networks to Causal Networks","author":"J Pearl","year":"1995","unstructured":"Pearl J (1995) From Bayesian Networks to Causal Networks. Springer, US, Boston, MA, pp 157\u2013182"},{"key":"10690_CR39","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511803161","volume-title":"Causality","author":"J Pearl","year":"2009","unstructured":"Pearl J (2009) Causality. Cambridge University Press, Cambridge"},{"key":"10690_CR40","unstructured":"Pearl J, Dechter R (1996) Identifying independencies in causal graphs with feedback. In: Proceedings of the Twelfth International Conference on Uncertainty in Artificial Intelligence. (San Francisco, CA, USA), UAI\u201996, Morgan Kaufmann Publishers Inc., p.\u00a0420\u2013426"},{"key":"10690_CR41","volume-title":"The book of why: the new science of cause and effect","author":"J Pearl","year":"2018","unstructured":"Pearl J, Mackenzie D (2018) The book of why: the new science of cause and effect. Basic Books, New York"},{"issue":"3","key":"10690_CR42","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1007\/s10664-023-10296-w","volume":"28","author":"K Peng","year":"2023","unstructured":"Peng K, Kaltenecker C, Siegmund N, Apel S, Menzies T (2023) Veer: enhancing the interpretability of model-based optimizations. Empir. Softw. Eng. 28(3):61","journal-title":"Empir. Softw. Eng."},{"issue":"2","key":"10690_CR43","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1109\/2.485846","volume":"29","author":"M Raynal","year":"1996","unstructured":"Raynal M, Singhal M (1996) Logical time: capturing causality in distributed systems. Computer 29(2):49\u201356","journal-title":"Computer"},{"issue":"1","key":"10690_CR44","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1177\/2515245917745629","volume":"1","author":"JM Rohrer","year":"2018","unstructured":"Rohrer JM (2018) Thinking clearly about correlations and causation: Graphical causal models for observational data. Adv. Methods Pract. Psychol. Sci. 1(1):27\u201342","journal-title":"Adv. Methods Pract. Psychol. Sci."},{"key":"10690_CR45","first-page":"2003","volume":"7","author":"S Shimizu","year":"2006","unstructured":"Shimizu S, Hoyer PO, Hyv\u00e4rinen A, Kerminen A (2006) A linear non-gaussian acyclic model for causal discovery. J. Mach. Learn. Res. 7:2003\u20132030","journal-title":"J. Mach. Learn. Res."},{"key":"10690_CR46","doi-asserted-by":"crossref","unstructured":"Siebert J (2023) Applications of statistical causal inference in software engineering. Information and Software Technology 159, 107198. https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0950584923000526","DOI":"10.1016\/j.infsof.2023.107198"},{"key":"10690_CR47","volume-title":"Causation, Prediction, and Search","author":"P Spirtes","year":"2000","unstructured":"Spirtes P, Glymour C, Scheines R (2000) Causation, Prediction, and Search. MIT Press, Cambridge"},{"key":"10690_CR48","unstructured":"Spirtes P, Zhang J (2002) Causal inference in the presence of latent variables: automated variable construction and simultaneous inference. Proceedings of the Eighth International Workshop on Artificial Intelligence and Statistics"},{"key":"10690_CR49","unstructured":"Spirtes PL, Meek C, Richardson TS (2013) Causal inference in the presence of latent variables and selection bias. arXiv:1302.4983"},{"issue":"4","key":"10690_CR50","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1038\/s41390-018-0071-3","volume":"84","author":"TC Williams","year":"2018","unstructured":"Williams TC, Bach CC, Matthiesen NB, Henriksen TB, Gagliardi L (2018) Directed acyclic graphs: a tool for causal studies in paediatrics. Pediatr. Res. 84(4):487\u2013493","journal-title":"Pediatr. Res."},{"issue":"4","key":"10690_CR51","doi-asserted-by":"publisher","DOI":"10.1115\/1.4042342","volume":"141","author":"D Wu","year":"2019","unstructured":"Wu D, Coatanea E, Wang GG (2019) Employing knowledge on causal relationship to assist multidisciplinary design optimization. J. Mech. Des. 141(4):041402","journal-title":"J. Mech. Des."},{"issue":"60","key":"10690_CR52","first-page":"1","volume":"25","author":"Y Zheng","year":"2024","unstructured":"Zheng Y, Huang B, Chen W, Ramsey J, Gong M, Cai R, Shimizu S, Spirtes P, Zhang K (2024) Causal-learn: Causal discovery in python. J. Mach. Learn. Res. 25(60):1\u20138","journal-title":"J. Mach. Learn. Res."},{"key":"10690_CR53","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-7091-0741-6","volume-title":"Network analysis literacy","author":"KA Zweig","year":"2016","unstructured":"Zweig KA et al (2016) Network analysis literacy. Springer, New York"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-025-10690-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-025-10690-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-025-10690-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,13]],"date-time":"2025-09-13T08:55:40Z","timestamp":1757753740000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-025-10690-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,21]]},"references-count":53,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["10690"],"URL":"https:\/\/doi.org\/10.1007\/s10664-025-10690-6","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,21]]},"assertion":[{"value":"17 June 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Lacking human or animal subjects, an ethical review was not required.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"This study had no human subjects.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed Consent"}},{"value":"The authors declared that they have no conflict of interest. The authors have no competing interests to declare that are relevant to the content of this article.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}},{"value":"Clinical trial number: not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Clinical Trial Number"}}],"article-number":"142"}}