{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T20:39:48Z","timestamp":1772138388963,"version":"3.50.1"},"reference-count":63,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2023,6,29]],"date-time":"2023-06-29T00:00:00Z","timestamp":1687996800000},"content-version":"vor","delay-in-days":84,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"National Institute on Aging of the National Institutes of Health","award":["3P30 AG059307-02S1"],"award-info":[{"award-number":["3P30 AG059307-02S1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,4,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Biases within probabilistic electronic phenotyping algorithms are largely unexplored. In this work, we characterize differences in subgroup performance of phenotyping algorithms for Alzheimer\u2019s disease and related dementias (ADRD) in older adults.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and methods<\/jats:title>\n                    <jats:p>We created an experimental framework to characterize the performance of probabilistic phenotyping algorithms under different racial distributions allowing us to identify which algorithms may have differential performance, by how much, and under what conditions. We relied on rule-based phenotype definitions as reference to evaluate probabilistic phenotype algorithms created using the Automated PHenotype Routine for Observational Definition, Identification, Training and Evaluation framework.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We demonstrate that some algorithms have performance variations anywhere from 3% to 30% for different populations, even when not using race as an input variable. We show that while performance differences in subgroups are not present for all phenotypes, they do affect some phenotypes and groups more disproportionately than others.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Our analysis establishes the need for a robust evaluation framework for subgroup differences. The underlying patient populations for the algorithms showing subgroup performance differences have great variance between model features when compared with the phenotypes with little to no differences.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>We have created a framework to identify systematic differences in the performance of probabilistic phenotyping algorithms specifically in the context of ADRD as a use case. Differences in subgroup performance of probabilistic phenotyping algorithms are not widespread nor do they occur consistently. This highlights the great need for careful ongoing monitoring to evaluate, measure, and try to mitigate such differences.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamiaopen\/ooad043","type":"journal-article","created":{"date-parts":[[2023,6,22]],"date-time":"2023-06-22T21:25:33Z","timestamp":1687469133000},"source":"Crossref","is-referenced-by-count":3,"title":["Characterizing subgroup performance of probabilistic phenotype algorithms within older adults: a case study for dementia, mild cognitive impairment, and Alzheimer\u2019s and Parkinson\u2019s diseases"],"prefix":"10.1093","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8499-824X","authenticated-orcid":false,"given":"Juan M","family":"Banda","sequence":"first","affiliation":[{"name":"Department of Computer Science, College of Arts and Sciences, Georgia State University , Atlanta, Georgia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9385-7158","authenticated-orcid":false,"given":"Nigam H","family":"Shah","sequence":"additional","affiliation":[{"name":"Stanford Center for Biomedical Informatics Research, Stanford University School of Medicine , Stanford, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vyjeyanthi S","family":"Periyakoil","sequence":"additional","affiliation":[{"name":"Stanford Department of Medicine , Palo Alto, California, USA"},{"name":"VA Palo Alto Health Care System , Palo Alto, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,6,28]]},"reference":[{"key":"2023062904104244700_ooad043-B1","doi-asserted-by":"crossref","first-page":"E167","DOI":"10.1001\/amajethics.2019.167","article-title":"Can AI help reduce disparities in general medical and mental health care?","volume":"21","author":"Chen","year":"2019","journal-title":"AMA J Ethics"},{"issue":"6464","key":"2023062904104244700_ooad043-B2","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"key":"2023062904104244700_ooad043-B3","first-page":"232","author":"Seyyed-Kalantari","year":"2021"},{"issue":"2","key":"2023062904104244700_ooad043-B4","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1167\/tvst.10.2.13","article-title":"Addressing artificial intelligence bias in retinal diagnostics","volume":"10","author":"Burlina","year":"2021","journal-title":"Transl Vis Sci Technol"},{"issue":"11","key":"2023062904104244700_ooad043-B5","doi-asserted-by":"crossref","first-page":"2393","DOI":"10.1093\/jamia\/ocab148","article-title":"Bias and fairness assessment of a natural language processing opioid misuse classifier: detection and mitigation of electronic health record data disadvantages across racial subgroups","volume":"28","author":"Thompson","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"11","key":"2023062904104244700_ooad043-B6","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1001\/jamadermatol.2021.3129","article-title":"Lack of transparency and potential bias in artificial intelligence data sets and algorithms: A scoping review","volume":"157","author":"Daneshjou","year":"2021","journal-title":"JAMA Dermatol"},{"issue":"5","key":"2023062904104244700_ooad043-B7","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1007\/s40264-022-01176-1","article-title":"Artificial intelligence based on machine learning in pharmacovigilance: A scoping review","volume":"45","author":"Kompa","year":"2022","journal-title":"Drug Saf"},{"key":"2023062904104244700_ooad043-B8","doi-asserted-by":"crossref","first-page":"104738","DOI":"10.1016\/j.ijmedinf.2022.104738","article-title":"Ethical, legal, and social considerations of AI-based medical decision-support tools: A scoping review","volume":"161","author":"\u010cartolovni","year":"2022","journal-title":"Int J Med Inform"},{"issue":"5","key":"2023062904104244700_ooad043-B9","doi-asserted-by":"crossref","first-page":"e36388","DOI":"10.2196\/36388","article-title":"Evaluation and mitigation of racial bias in clinical machine learning models: Scoping review","volume":"10","author":"Huang","year":"2022","journal-title":"JMIR Med Inform"},{"issue":"24","key":"2023062904104244700_ooad043-B10","doi-asserted-by":"crossref","first-page":"2377","DOI":"10.1001\/jama.2019.18058","article-title":"Addressing bias in artificial intelligence in health care","volume":"322","author":"Parikh","year":"2019","journal-title":"JAMA"},{"issue":"12","key":"2023062904104244700_ooad043-B11","doi-asserted-by":"crossref","first-page":"2020","DOI":"10.1093\/jamia\/ocaa094","article-title":"Latent bias and the implementation of artificial intelligence in medicine","volume":"27","author":"DeCamp","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2023062904104244700_ooad043-B12","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1038\/s43856-021-00028-w","article-title":"Mitigating bias in machine learning for medicine","volume":"1","author":"Vokinger","year":"2021","journal-title":"Commun Med (Lond)"},{"issue":"11","key":"2023062904104244700_ooad043-B13","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.1001\/jamainternmed.2018.3763","article-title":"Potential biases in machine learning algorithms using electronic health record data","volume":"178","author":"Gianfrancesco","year":"2018","journal-title":"JAMA Intern Med"},{"key":"2023062904104244700_ooad043-B14","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1038\/s41746-020-0253-3","article-title":"Presenting machine learning model information to clinical end users with model facts labels","volume":"3","author":"Sendak","year":"2020","journal-title":"NPJ Digit Med"},{"issue":"1","key":"2023062904104244700_ooad043-B15","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1038\/s41746-021-00549-7","article-title":"Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: A scoping review","volume":"5","author":"de Hond","year":"2022","journal-title":"NPJ Digit Med"},{"issue":"1","key":"2023062904104244700_ooad043-B16","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","article-title":"AI in health and medicine","volume":"28","author":"Rajpurkar","year":"2022","journal-title":"Nat Med"},{"issue":"12","key":"2023062904104244700_ooad043-B17","doi-asserted-by":"crossref","first-page":"e323","DOI":"10.2196\/jmir.5870","article-title":"Guidelines for developing and reporting machine learning predictive models in biomedical research: A multidisciplinary view","volume":"18","author":"Luo","year":"2016","journal-title":"J Med Internet Res"},{"issue":"5","key":"2023062904104244700_ooad043-B18","doi-asserted-by":"crossref","first-page":"e384","DOI":"10.1016\/S2589-7500(22)00003-6","article-title":"The medical algorithmic audit","volume":"4","author":"Liu","year":"2022","journal-title":"Lancet Digit Health"},{"key":"2023062904104244700_ooad043-B19","volume-title":"8th Innovations in Theoretical Computer Science Conference (ITCS 2017)","author":"Kleinberg","year":"2017"},{"key":"2023062904104244700_ooad043-B20","author":"Chouldechova","year":"2018"},{"key":"2023062904104244700_ooad043-B21","first-page":"453","author":"Beutel","year":"2019"},{"issue":"5","key":"2023062904104244700_ooad043-B22","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1145\/3376898","article-title":"A snapshot of the frontiers of fairness in machine learning","volume":"63","author":"Chouldechova","year":"2020","journal-title":"Commun ACM"},{"key":"2023062904104244700_ooad043-B23","author":"Castelnovo","year":"2021"},{"key":"2023062904104244700_ooad043-B24","author":"Xu","year":"2022"},{"issue":"5","key":"2023062904104244700_ooad043-B25","doi-asserted-by":"crossref","first-page":"e221","DOI":"10.1016\/S2589-7500(20)30065-0","article-title":"Ethical limitations of algorithmic fairness solutions in health care machine learning","volume":"2","author":"McCradden","year":"2020","journal-title":"Lancet Digit Health"},{"key":"2023062904104244700_ooad043-B26","author":"Chen","year":"2021"},{"issue":"11","key":"2023062904104244700_ooad043-B27","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1056\/NEJMp1714229","article-title":"Implementing machine learning in health care\u2014addressing ethical challenges","volume":"378","author":"Char","year":"2018","journal-title":"N Engl J Med"},{"key":"2023062904104244700_ooad043-B28","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1146\/annurev-biodatasci-080917-013315","article-title":"Advances in electronic phenotyping: From rule-based definitions to machine learning models","volume":"1","author":"Banda","year":"2018","journal-title":"Annu Rev Biomed Data Sci"},{"issue":"3","key":"2023062904104244700_ooad043-B29","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1093\/jamia\/ocx110","article-title":"High-fidelity phenotyping: Richness and freedom from bias","volume":"25","author":"Hripcsak","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023062904104244700_ooad043-B30","doi-asserted-by":"crossref","first-page":"e63","DOI":"10.1097\/CCM.0000000000004710","article-title":"Practitioner\u2019s guide to latent class analysis: Methodological considerations and common pitfalls","volume":"49","author":"Sinha","year":"2021","journal-title":"Crit Care Med"},{"issue":"1","key":"2023062904104244700_ooad043-B31","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1186\/s13054-021-03487-8","article-title":"Deploying unsupervised clustering analysis to derive clinical phenotypes and risk factors associated with mortality risk in 2022 critically ill patients with COVID-19 in Spain","volume":"25","author":"Rodr\u00edguez","year":"2021","journal-title":"Crit Care"},{"issue":"1","key":"2023062904104244700_ooad043-B32","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.jalz.2018.06.3063","article-title":"Racial and ethnic estimates of Alzheimer\u2019s disease and related dementias in the United States (2015\u20132060) in adults aged \u226565 years","volume":"15","author":"Matthews","year":"2019","journal-title":"Alzheimers Dement"},{"issue":"10","key":"2023062904104244700_ooad043-B33","doi-asserted-by":"crossref","first-page":"1802","DOI":"10.2105\/AJPH.2012.301110","article-title":"Health disparities among lesbian, gay, and bisexual older adults: Results from a population-based study","volume":"103","author":"Fredriksen-Goldsen","year":"2013","journal-title":"Am J Public Health"},{"issue":"4","key":"2023062904104244700_ooad043-B34","doi-asserted-by":"crossref","first-page":"S221","DOI":"10.1093\/geronb\/57.4.S221","article-title":"Gender and ethnic\/racial disparities in health care utilization among older adults","volume":"57","author":"Dunlop","year":"2002","journal-title":"J Gerontol B Psychol Sci Soc Sci"},{"key":"2023062904104244700_ooad043-B35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.annepidem.2018.09.007","article-title":"How do we assess a racial disparity in health? Distribution, interaction, and interpretation in epidemiological studies","volume":"29","author":"Ward","year":"2019","journal-title":"Ann Epidemiol"},{"issue":"11","key":"2023062904104244700_ooad043-B36","doi-asserted-by":"crossref","first-page":"1329","DOI":"10.1089\/jpm.2013.9468","article-title":"Racial and ethnic disparities in palliative care","volume":"16","author":"Johnson","year":"2013","journal-title":"J Palliat Med"},{"issue":"1","key":"2023062904104244700_ooad043-B37","doi-asserted-by":"crossref","first-page":"e100457","DOI":"10.1136\/bmjhci-2021-100457","article-title":"Investigating for bias in healthcare algorithms: A sex-stratified analysis of supervised machine learning models in liver disease prediction","volume":"29","author":"Straw","year":"2022","journal-title":"BMJ Health Care Inform"},{"issue":"1","key":"2023062904104244700_ooad043-B38","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1097\/EDE.0000000000001101","article-title":"Development of algorithmic dementia ascertainment for racial\/ethnic disparities research in the US Health and Retirement Study","volume":"31","author":"Gianattasio","year":"2020","journal-title":"Epidemiology"},{"issue":"2","key":"2023062904104244700_ooad043-B39","doi-asserted-by":"crossref","first-page":"e63","DOI":"10.1016\/S2589-7500(19)30012-3","article-title":"A chronological map of 308 physical and mental health conditions from 4 million individuals in the English National Health Service","volume":"1","author":"Kuan","year":"2019","journal-title":"Lancet Digit Health"},{"key":"2023062904104244700_ooad043-B40","author":"Phenotype Library"},{"key":"2023062904104244700_ooad043-B41","author":"Phenotype Library"},{"issue":"8","key":"2023062904104244700_ooad043-B42","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1177\/1533317518791401","article-title":"Mild cognitive impairment in clinical practice: A review article","volume":"33","author":"Jongsiriyanyong","year":"2018","journal-title":"Am J Alzheimers Dis Other Demen"},{"key":"2023062904104244700_ooad043-B43","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1192\/bjp.180.2.131","article-title":"Genotype and phenotype in Alzheimer\u2019s disease","volume":"180","author":"Holmes","year":"2002","journal-title":"Br J Psychiatry"},{"issue":"6","key":"2023062904104244700_ooad043-B44","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1093\/jamia\/ocv202","article-title":"PheKB: A catalog and workflow for creating electronic phenotype algorithms for transportability","volume":"23","author":"Kirby","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"12","key":"2023062904104244700_ooad043-B45","doi-asserted-by":"crossref","first-page":"1545","DOI":"10.1093\/jamia\/ocz105","article-title":"UK phenomics platform for developing and validating electronic health record phenotypes: CALIBER","volume":"26","author":"Denaxas","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023062904104244700_ooad043-B46","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1136\/amiajnl-2012-001145","article-title":"Next-generation phenotyping of electronic health records","volume":"20","author":"Hripcsak","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2023062904104244700_ooad043-B47","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1093\/jamia\/ocw028","article-title":"Learning statistical models of phenotypes using noisy labeled training data","volume":"23","author":"Agarwal","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2023062904104244700_ooad043-B48","first-page":"48","article-title":"Electronic phenotyping with APHRODITE and the Observational Health Sciences and Informatics (OHDSI) data network","volume":"2017","author":"Banda","year":"2017","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"issue":"1","key":"2023062904104244700_ooad043-B49","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the LASSO","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J Roy Stat Soc Ser B"},{"key":"2023062904104244700_ooad043-B50","volume-title":"The Oxford Handbook of Economic Forecasting","author":"Jones","year":"2011"},{"issue":"1","key":"2023062904104244700_ooad043-B51","first-page":"5","article-title":"Random forests. Mach","volume":"45","author":"Breiman","year":"2001","journal-title":"Learn"},{"issue":"3","key":"2023062904104244700_ooad043-B52","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach Learn"},{"issue":"5","key":"2023062904104244700_ooad043-B53","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v028.i05","article-title":"Building predictive models in R using the caret package","volume":"28","author":"Kuhn","year":"2008","journal-title":"J Stat Soft"},{"key":"2023062904104244700_ooad043-B54","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J Artif Intell Res"},{"issue":"9","key":"2023062904104244700_ooad043-B55","doi-asserted-by":"crossref","first-page":"1525","DOI":"10.1093\/jamia\/ocac093","article-title":"The harm of class imbalance corrections for risk prediction models: Illustration and simulation using logistic regression","volume":"29","author":"van den Goorbergh","year":"2022","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023062904104244700_ooad043-B56","doi-asserted-by":"crossref","first-page":"3254","DOI":"10.1038\/s41598-022-07167-7","article-title":"A comparison of approaches to improve worst-case predictive model performance over patient subpopulations","volume":"12","author":"Pfohl","year":"2022","journal-title":"Sci Rep"},{"key":"2023062904104244700_ooad043-B57","doi-asserted-by":"crossref","first-page":"103621","DOI":"10.1016\/j.jbi.2020.103621","article-title":"An empirical characterization of fair machine learning for clinical risk prediction","volume":"113","author":"Pfohl","year":"2021","journal-title":"J Biomed Inform"},{"issue":"1","key":"2023062904104244700_ooad043-B58","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1001\/jama.2017.19198","article-title":"What this computer needs is a physician: Humanism and artificial intelligence","volume":"319","author":"Verghese","year":"2018","journal-title":"JAMA"},{"issue":"1","key":"2023062904104244700_ooad043-B59","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s41666-020-00082-4","article-title":"Federated learning for healthcare informatics","volume":"5","author":"Xu","year":"2021","journal-title":"J Healthc Inform Res"},{"key":"2023062904104244700_ooad043-B60","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1186\/s12911-022-01879-6","article-title":"Learning patient-level prediction models across multiple healthcare databases: Evaluation of ensembles for increasing model transportability","volume":"22","author":"Reps","year":"2022","journal-title":"BMC Med Inform Decis Mak"},{"issue":"6","key":"2023062904104244700_ooad043-B61","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1093\/jamia\/ocaa032","article-title":"Development and validation of phenotype classifiers across multiple sites in the observational health data sciences and informatics network","volume":"27","author":"Kashyap","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"27","key":"2023062904104244700_ooad043-B62","doi-asserted-by":"crossref","first-page":"7329","DOI":"10.1073\/pnas.1510502113","article-title":"Characterizing treatment pathways at scale using the OHDSI network","volume":"113","author":"Hripcsak","year":"2016","journal-title":"Proc Natl Acad Sci USA"},{"key":"2023062904104244700_ooad043-B63","first-page":"574","article-title":"Observational health data sciences and informatics (OHDSI): Opportunities for observational researchers. Stud","volume":"216","author":"Hripcsak","year":"2015","journal-title":"Health Technol Inform"}],"container-title":["JAMIA Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article-pdf\/6\/2\/ooad043\/50735997\/ooad043.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article-pdf\/6\/2\/ooad043\/50735997\/ooad043.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,22]],"date-time":"2024-10-22T16:44:05Z","timestamp":1729615445000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article\/doi\/10.1093\/jamiaopen\/ooad043\/7209883"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,6]]},"references-count":63,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4,6]]}},"URL":"https:\/\/doi.org\/10.1093\/jamiaopen\/ooad043","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.09.20.22280172","asserted-by":"object"}]},"ISSN":["2574-2531"],"issn-type":[{"value":"2574-2531","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,7,1]]},"published":{"date-parts":[[2023,4,6]]},"article-number":"ooad043"}}