{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,13]],"date-time":"2026-08-13T03:38:44Z","timestamp":1786592324840,"version":"build-2736575974"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1011175","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,6,8]],"date-time":"2023-06-08T00:00:00Z","timestamp":1686182400000}}],"reference-count":68,"publisher":"Public Library of Science (PLoS)","issue":"5","license":[{"start":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T00:00:00Z","timestamp":1685059200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NIH","award":["R01GM118652"],"award-info":[{"award-number":["R01GM118652"]}]},{"name":"NIH","award":["R35GM139628"],"award-info":[{"award-number":["R35GM139628"]}]},{"name":"Wimmer Family Foundation"},{"name":"NIH","award":["5T32GM007601"],"award-info":[{"award-number":["5T32GM007601"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Machine learning tools have proven useful across biological disciplines, allowing researchers to draw conclusions from large datasets, and opening up new opportunities for interpreting complex and heterogeneous biological data. Alongside the rapid growth of machine learning, there have also been growing pains: some models that appear to perform well have later been revealed to rely on features of the data that are artifactual or biased; this feeds into the general criticism that machine learning models are designed to optimize model performance over the creation of new biological insights. A natural question arises: how do we develop machine learning models that are inherently interpretable or explainable? In this manuscript, we describe the SWIF(r) reliability score (SRS), a method building on the SWIF(r) generative framework that reflects the trustworthiness of the classification of a specific instance. The concept of the reliability score has the potential to generalize to other machine learning methods. We demonstrate the utility of the SRS when faced with common challenges in machine learning including: 1) an unknown class present in testing data that was not present in training data, 2) systemic mismatch between training and testing data, and 3) instances of testing data that have missing values for some attributes. We explore these applications of the SRS using a range of biological datasets, from agricultural data on seed morphology, to 22 quantitative traits in the UK Biobank, and population genetic simulations and 1000 Genomes Project data. With each of these examples, we demonstrate how the SRS can allow researchers to interrogate their data and training approach thoroughly, and to pair their domain-specific knowledge with powerful machine-learning frameworks. We also compare the SRS to related tools for outlier and novelty detection, and find that it has comparable performance, with the advantage of being able to operate when some data are missing. The SRS, and the broader discussion of interpretable scientific machine learning, will aid researchers in the biological machine learning space as they seek to harness the power of machine learning without sacrificing rigor and biological insight.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1011175","type":"journal-article","created":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T13:31:30Z","timestamp":1685107890000},"page":"e1011175","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":24,"title":["Enabling interpretable machine learning for biological data with reliability scores"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6812-9458","authenticated-orcid":true,"given":"K. D.","family":"Ahlquist","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3495-8359","authenticated-orcid":true,"given":"Lauren A.","family":"Sugden","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9588-7964","authenticated-orcid":true,"given":"Sohini","family":"Ramachandran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2023,5,26]]},"reference":[{"issue":"6","key":"pcbi.1011175.ref001","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1016\/j.tig.2020.03.005","article-title":"Opening the black box: interpretable machine learning for geneticists","volume":"36","author":"CB Azodi","year":"2020","journal-title":"Trends Genet"},{"issue":"1","key":"pcbi.1011175.ref002","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2594473.2594475","article-title":"Comprehensible classification models: a position paper.","volume":"15","author":"AA Freitas","year":"2014","journal-title":"SIGKDD Explor."},{"issue":"3","key":"pcbi.1011175.ref003","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1145\/3236386.3241340","article-title":"The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery.","volume":"16","author":"ZC Lipton","year":"2018","journal-title":"ACM Queue."},{"issue":"5","key":"pcbi.1011175.ref004","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead","volume":"1","author":"C. Rudin","year":"2019","journal-title":"Nat Mach Intell."},{"issue":"1","key":"pcbi.1011175.ref005","doi-asserted-by":"crossref","first-page":"dev188474","DOI":"10.1242\/dev.188474","article-title":"What machine learning can do for developmental biology","volume":"148","author":"P. Villoutreix","year":"2021","journal-title":"Development"},{"key":"pcbi.1011175.ref006","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.coisb.2020.07.009","article-title":"Learning dynamics from large biological data sets: machine learning meets systems biology.","volume":"22","author":"W Gilpin","year":"2020","journal-title":"Curr Opin Syst Biol"},{"key":"pcbi.1011175.ref007","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.inffus.2018.09.012","article-title":"Machine learning for integrating data in biology and medicine: Principles, practice, and opportunities.","volume":"50","author":"M Zitnik","year":"2019","journal-title":"Inf Fusion."},{"key":"pcbi.1011175.ref008","doi-asserted-by":"crossref","first-page":"642774","DOI":"10.3389\/fevo.2021.642774","article-title":"Computer vision, machine learning, and the promise of phenomics in ecology and evolutionary biology","volume":"9","author":"MD L\u00fcrig","year":"2021","journal-title":"Front Ecol Evol"},{"issue":"9","key":"pcbi.1011175.ref009","doi-asserted-by":"crossref","first-page":"2208","DOI":"10.3390\/molecules23092208","article-title":"Machine learning for drug-target interaction prediction.","volume":"23","author":"R Chen","year":"2018","journal-title":"Molecules."},{"issue":"10","key":"pcbi.1011175.ref010","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1038\/s41592-021-01205-4","article-title":"DOME: recommendations for supervised machine learning validation in biology.","volume":"18","author":"I Walsh","year":"2021","journal-title":"Nat Methods"},{"key":"pcbi.1011175.ref011","first-page":"685","article-title":"Reproducibility Transparency and Evaluation of Machine Learning in Health Applications","author":"J. Wojtusiak","year":"2021","journal-title":"Biomed Eng Syst Technol Int Jt Conf BIOSTEC."},{"issue":"10","key":"pcbi.1011175.ref012","doi-asserted-by":"crossref","first-page":"1132","DOI":"10.1038\/s41592-021-01256-7","article-title":"Reproducibility standards for machine learning in the life sciences","volume":"18","author":"BJ Heil","year":"2021","journal-title":"Nat Methods"},{"issue":"1","key":"pcbi.1011175.ref013","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1038\/s42003-021-01674-5","article-title":"Systematic auditing is essential to debiasing machine learning in biology","volume":"4","author":"FE Eid","year":"2021","journal-title":"Commun Biology"},{"issue":"11","key":"pcbi.1011175.ref014","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1038\/s41580-019-0176-5","article-title":"Setting the standards for machine learning in biology","volume":"20","author":"DT Jones","year":"2019","journal-title":"Nat Rev Mol Cell Biol"},{"issue":"1","key":"pcbi.1011175.ref015","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1038\/s41580-021-00407-0","article-title":"A guide to machine learning for biologists","volume":"23","author":"JG Greener","year":"2022","journal-title":"Nat Rev Mol Cell Biol"},{"key":"pcbi.1011175.ref016","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.sigpro.2013.12.026","article-title":"A review of novelty detection.","volume":"99","author":"MA Pimentel","year":"2014","journal-title":"Signal processing."},{"key":"pcbi.1011175.ref017","first-page":"32","article-title":"Failing loudly: An empirical study of methods for detecting dataset shift.","author":"S Rabanser","year":"2019","journal-title":"Adv Neural Inf Process Syst."},{"key":"pcbi.1011175.ref018","article-title":"Enhancing the reliability of out-of-distribution image detection in neural networks.","author":"S Liang","year":"2017","journal-title":"arXiv:1706.02690"},{"key":"pcbi.1011175.ref019","article-title":"Learning confidence for out-of-distribution detection in neural networks.","author":"T DeVries","year":"2018","journal-title":"arXiv:1802.04865 [Preprint]."},{"key":"pcbi.1011175.ref020","first-page":"31","article-title":"A simple unified framework for detecting out-of-distribution samples and adversarial attacks.","author":"K Lee","year":"2018","journal-title":"Adv Neural Inf Process Syst."},{"key":"pcbi.1011175.ref021","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1145\/335191.335388","article-title":"LOF: identifying density-based local outliers","author":"MM Breunig","year":"2000","journal-title":"Proc ACM SIGMOD Int Conf Manag Data"},{"issue":"1","key":"pcbi.1011175.ref022","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1038\/s41467-018-03100-7","article-title":"Localization of adaptive variants in human genomes using averaged one-dependence estimation","volume":"9","author":"LA Sugden","year":"2018","journal-title":"Nature Commun"},{"key":"pcbi.1011175.ref023","volume-title":"Machine learning: a probabilistic perspective","author":"KP Murphy","year":"2012"},{"key":"pcbi.1011175.ref024","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1214\/21-SS133","article-title":"Interpretable machine learning: Fundamental principles and 10 grand challenges.","volume":"16","author":"C Rudin","year":"2022","journal-title":"Stat Surv"},{"key":"pcbi.1011175.ref025","article-title":"Genetic data analysis. Methods for discrete population genetic data. Sinauer Associates, Inc","author":"BS Weir","year":"1990","journal-title":"Publishers"},{"issue":"3","key":"pcbi.1011175.ref026","doi-asserted-by":"crossref","first-page":"e72","DOI":"10.1371\/journal.pbio.0040072","article-title":"A map of recent positive selection in the human genome","volume":"4","author":"BF Voight","year":"2006","journal-title":"PLoS Biol"},{"issue":"3","key":"pcbi.1011175.ref027","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1093\/genetics\/123.3.585","article-title":"Statistical method for testing the neutral mutation hypothesis by DNA polymorphism","volume":"123","author":"F. Tajima","year":"1989","journal-title":"Genetics"},{"issue":"7164","key":"pcbi.1011175.ref028","doi-asserted-by":"crossref","first-page":"913","DOI":"10.1038\/nature06250","article-title":"Genome-wide detection and characterization of positive selection in human populations","volume":"449","author":"PC Sabeti","year":"2007","journal-title":"Nature"},{"issue":"1","key":"pcbi.1011175.ref029","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1093\/genetics\/74.1.175","article-title":"Distribution of gene frequency as a test of the theory of the selective neutrality of polymorphisms","volume":"74","author":"RC Lewontin","year":"1973","journal-title":"Genetics"},{"issue":"6313","key":"pcbi.1011175.ref030","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1126\/science.aag0776","article-title":"Detection of human adaptation during the past 2000 years.","volume":"354","author":"Y Field","year":"2016","journal-title":"Science"},{"key":"pcbi.1011175.ref031","first-page":"338","article-title":"Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls","author":"JA Sterne","year":"2009","journal-title":"BMJ"},{"key":"pcbi.1011175.ref032","doi-asserted-by":"crossref","first-page":"1487","DOI":"10.1007\/s10462-019-09709-4","article-title":"Missing value imputation: a review and analysis of the literature (2006\u20132017).","volume":"53","author":"WC Lin","year":"2020","journal-title":"Artif Intell Rev."},{"issue":"4","key":"pcbi.1011175.ref033","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1080\/10705510802339072","article-title":"What improves with increased missing data imputations?","volume":"15","author":"TE Bodner","year":"2008","journal-title":"Struct Equ Modeling."},{"key":"pcbi.1011175.ref034","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.jclinepi.2019.02.016","article-title":"The proportion of missing data should not be used to guide decisions on multiple imputation.","volume":"110","author":"P Madley-Dowd","year":"2019","journal-title":"J Clin Epidemiol."},{"key":"pcbi.1011175.ref035","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s10994-005-4258-6","article-title":"Not so naive Bayes: aggregating one-dependence estimators.","volume":"58","author":"GI Webb","year":"2005","journal-title":"Mach Learn."},{"issue":"3","key":"pcbi.1011175.ref036","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1534\/genetics.110.116459","article-title":"Searching for footprints of positive selection in whole-genome SNP data from nonequilibrium populations","volume":"185","author":"P Pavlidis","year":"2010","journal-title":"Genetics"},{"issue":"7492","key":"pcbi.1011175.ref037","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1038\/nature12961","article-title":"The genomic landscape of Neanderthal ancestry in present-day humans","volume":"507","author":"S Sankararaman","year":"2014","journal-title":"Nature"},{"issue":"3","key":"pcbi.1011175.ref038","doi-asserted-by":"crossref","first-page":"e1005928","DOI":"10.1371\/journal.pgen.1005928","article-title":"S\/HIC: robust identification of soft and hard sweeps using machine learning.","volume":"12","author":"DR Schrider","year":"2016","journal-title":"PLoS Genet."},{"issue":"1","key":"pcbi.1011175.ref039","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1038\/s41559-018-0735-8","article-title":"Multiple episodes of interbreeding between Neanderthal and modern humans.","volume":"3","author":"FA Villanea","year":"2019","journal-title":"Nat Ecol Evol."},{"issue":"1","key":"pcbi.1011175.ref040","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1534\/genetics.120.303143","article-title":"Space is the place: Effects of continuous spatial structure on analysis of population genetic data","volume":"215","author":"CJ Battey","year":"2020","journal-title":"Genetics"},{"key":"pcbi.1011175.ref041","doi-asserted-by":"crossref","first-page":"e54507","DOI":"10.7554\/eLife.54507","article-title":"Predicting geographic location from genetic variation with deep neural networks.","volume":"9","author":"CJ Battey","year":"2020","journal-title":"Elife."},{"issue":"8","key":"pcbi.1011175.ref042","doi-asserted-by":"crossref","first-page":"e0183810","DOI":"10.1371\/journal.pone.0183810","article-title":"Hybrid multiscale modeling and prediction of cancer cell behavior","volume":"12","author":"MH Zangooei","year":"2017","journal-title":"PloS One"},{"issue":"8","key":"pcbi.1011175.ref043","doi-asserted-by":"crossref","first-page":"e45","DOI":"10.1093\/nar\/gkz096","article-title":"DriverML: a machine learning algorithm for identifying driver genes in cancer sequencing studies","volume":"47","author":"Y Han","year":"2019","journal-title":"Nucleic Acids Res"},{"issue":"10","key":"pcbi.1011175.ref044","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1038\/ng1885","article-title":"A high-resolution HLA and SNP haplotype map for disease association studies in the extended human MHC","volume":"38","author":"PI De Bakker","year":"2006","journal-title":"Nat Genet"},{"issue":"10","key":"pcbi.1011175.ref045","doi-asserted-by":"crossref","first-page":"2555","DOI":"10.1093\/molbev\/msw127","article-title":"Excess of deleterious mutations around HLA genes reveals evolutionary cost of balancing selection","volume":"33","author":"TL Lenz","year":"2016","journal-title":"Mol Biol Evol"},{"key":"pcbi.1011175.ref046","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1002\/cjs.5550340410","article-title":"Classification with reject option","volume":"1","author":"R Herbei","year":"2006","journal-title":"Can J Stat"},{"issue":"1","key":"pcbi.1011175.ref047","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-021-01655-y","article-title":"Machine learning with asymmetric abstention for biomedical decision-making.","volume":"21","author":"M Gandouz","year":"2021","journal-title":"BMC Med Inform Decis Mak."},{"key":"pcbi.1011175.ref048","first-page":"278","article-title":"An effective baseline for robustness to distributional shift","author":"S Thulasidasan","year":"2021","journal-title":"Proc Int Conf Mach Learn Appl"},{"key":"pcbi.1011175.ref049","author":"S Thulasidasan","year":"2019","journal-title":"arXiv:1905.10964 [Preprint]."},{"key":"pcbi.1011175.ref050","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/978-3-642-13105-9_2","article-title":"Complete gradient clustering algorithm for features analysis of x-ray images","volume":"2","author":"M Charytanowicz","year":"2010","journal-title":"Information Technologies in Biomedicine"},{"key":"pcbi.1011175.ref051","first-page":"413","article-title":"Isolation forest.","author":"FT Liu","year":"2008","journal-title":"Proc IEEE Int Conf Data Min"},{"issue":"1","key":"pcbi.1011175.ref052","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2133360.2133363","article-title":"Isolation-based anomaly detection.","volume":"6","author":"FT Liu","year":"2012","journal-title":"ACM Trans Knowl Discov Data."},{"issue":"3","key":"pcbi.1011175.ref053","first-page":"212","article-title":"A fast algorithm for the minimum covariance determinant estimator.","volume":"41","author":"PJ Rousseeuw","year":"1999"},{"issue":"3","key":"pcbi.1011175.ref054","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1080\/00401706.1980.10486163","article-title":"Mixture models, outliers, and the EM algorithm","volume":"22","author":"M Aitkin","year":"1980","journal-title":"Technometrics."},{"issue":"7571","key":"pcbi.1011175.ref055","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1038\/nature15393","article-title":"A global reference for human genetic variation.","volume":"526","author":"1000 Genomes Project Consortium","year":"2015","journal-title":"Nature"},{"issue":"1","key":"pcbi.1011175.ref056","doi-asserted-by":"crossref","first-page":"18","DOI":"10.3390\/e23010018","article-title":"Explainable AI: A review of machine learning interpretability methods.","volume":"23","author":"P Linardatos","year":"2020","journal-title":"Entropy."},{"key":"pcbi.1011175.ref057","doi-asserted-by":"crossref","first-page":"e48376","DOI":"10.7554\/eLife.48376","article-title":"Variable prediction accuracy of polygenic scores within an ancestry group.","volume":"9","author":"H Mostafavi","year":"2020","journal-title":"Elife"},{"issue":"3","key":"pcbi.1011175.ref058","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1038\/s41551-018-0195-0","article-title":"Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning.","volume":"2","author":"R Poplin","year":"2018","journal-title":"Nat Biomed Eng."},{"issue":"1","key":"pcbi.1011175.ref059","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1038\/s41746-019-0105-1","article-title":"Deep learning predicts hip fracture using confounding patient and healthcare variables.","volume":"2","author":"MA Badgeley","year":"2019","journal-title":"NPJ Digit Med."},{"key":"pcbi.1011175.ref060","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python.","volume":"12","author":"F Pedregosa","year":"2011","journal-title":"J Mach Learn Res."},{"issue":"5","key":"pcbi.1011175.ref061","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1016\/j.ajhg.2022.03.005","article-title":"Enrichment analyses identify shared associations for 25 quantitative traits in over 600,000 individuals from seven diverse ancestries","volume":"109","author":"SP Smith","year":"2022","journal-title":"Am J Hum Genet"},{"issue":"2","key":"pcbi.1011175.ref062","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1111\/1755-0998.12968","article-title":"Tree-sequence recording in SLiM opens new horizons for forward-time simulation of whole genomes","volume":"19","author":"BC Haller","year":"2019","journal-title":"Mol Ecol Resour"},{"issue":"29","key":"pcbi.1011175.ref063","doi-asserted-by":"crossref","first-page":"11983","DOI":"10.1073\/pnas.1019276108","article-title":"Demographic history and rare allele sharing among human populations","volume":"108","author":"S Gravel","year":"2011","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"2","key":"pcbi.1011175.ref064","doi-asserted-by":"crossref","first-page":"e1005004","DOI":"10.1371\/journal.pgen.1005004","article-title":"Recent selective sweeps in North American Drosophila melanogaster show signatures of soft sweeps.","volume":"11","author":"NR Garud","year":"2015","journal-title":"PLoS Genet."},{"issue":"6","key":"pcbi.1011175.ref065","doi-asserted-by":"crossref","first-page":"e1007387","DOI":"10.1371\/journal.pgen.1007387","article-title":"Human demographic history has amplified the effects of background selection across the genome","volume":"14","author":"R Torres","year":"2018","journal-title":"PLoS Genet"},{"issue":"5","key":"pcbi.1011175.ref066","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1093\/molbev\/msu077","article-title":"On detecting incomplete soft or hard selective sweeps using haplotype structure","volume":"31","author":"A Ferrer-Admetlla","year":"2014","journal-title":"Mol Biol Evol"},{"issue":"10","key":"pcbi.1011175.ref067","doi-asserted-by":"crossref","first-page":"2824","DOI":"10.1093\/molbev\/msu211","article-title":"selscan: an efficient multithreaded program to perform EHH-based scans for positive selection","volume":"31","author":"ZA Szpiech","year":"2014","journal-title":"Mol Biol Evol"},{"issue":"11","key":"pcbi.1011175.ref068","doi-asserted-by":"crossref","first-page":"2996","DOI":"10.1093\/molbev\/msx209","article-title":"Detecting long-term balancing selection using allele frequency correlation","volume":"34","author":"KM Siewert","year":"2017","journal-title":"Mol Biol Evol"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1011175","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,6,8]],"date-time":"2023-06-08T00:00:00Z","timestamp":1686182400000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011175","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,8]],"date-time":"2023-06-08T13:54:15Z","timestamp":1686232455000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011175"}},"subtitle":[],"editor":[{"given":"Luis Pedro","family":"Coelho","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2023,5,26]]},"references-count":68,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,5,26]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1011175","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.02.18.481082","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,26]]}}}