{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T23:55:01Z","timestamp":1768434901336,"version":"3.49.0"},"reference-count":55,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2024,7,27]],"date-time":"2024-07-27T00:00:00Z","timestamp":1722038400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,8,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Software is vital for the advancement of biology and medicine. Impact evaluations of scientific software have primarily emphasized traditional citation metrics of associated papers, despite these metrics inadequately capturing the dynamic picture of impact and despite challenges with improper citation.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>To understand how software developers evaluate their tools, we conducted a survey of participants in the Informatics Technology for Cancer Research (ITCR) program funded by the National Cancer Institute (NCI). We found that although developers realize the value of more extensive metric collection, they find a lack of funding and time hindering. We also investigated software among this community for how often infrastructure that supports more nontraditional metrics were implemented and how this impacted rates of papers describing usage of the software. We found that infrastructure such as social media presence, more in-depth documentation, the presence of software health metrics, and clear information on how to contact developers seemed to be associated with increased mention rates. Analysing more diverse metrics can enable developers to better understand user engagement, justify continued funding, identify novel use cases, pinpoint improvement areas, and ultimately amplify their software\u2019s impact. Challenges are associated, including distorted or misleading metrics, as well as ethical and security concerns. More attention to nuances involved in capturing impact across the spectrum of biomedical software is needed. For funders and developers, we outline guidance based on experience from our community. By considering how we evaluate software, we can empower developers to create tools that more effectively accelerate biological and medical research progress.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>More information about the analysis, as well as access to data and code is available at https:\/\/github.com\/fhdsl\/ITCR_Metrics_manuscript_website.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btae469","type":"journal-article","created":{"date-parts":[[2024,7,27]],"date-time":"2024-07-27T16:31:35Z","timestamp":1722097895000},"source":"Crossref","is-referenced-by-count":6,"title":["Best practices to evaluate the impact of biomedical research software\u2014metric collection beyond citations"],"prefix":"10.1093","volume":"40","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5801-9087","authenticated-orcid":false,"given":"Awan","family":"Afiaz","sequence":"first","affiliation":[{"name":"Department of Biostatistics, University of Washington , Seattle, WA, 98195, United States"},{"name":"Biostatistics Program, Public Health Sciences Division, Fred Hutchinson Cancer Center , Seattle, WA, 98109, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7476-1329","authenticated-orcid":false,"given":"Andrey A","family":"Ivanov","sequence":"additional","affiliation":[{"name":"Department of Pharmacology and Chemical Biology, Emory University School of Medicine, Emory University , Atlanta , GA, 30322, United States"}]},{"given":"John","family":"Chamberlin","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah , Salt Lake City, UT, 84108, United States"}]},{"given":"David","family":"Hanauer","sequence":"additional","affiliation":[{"name":"Department of Learning Health Sciences, University of Michigan Medical School , Ann Arbor, MI, 48109, United States"}]},{"given":"Candace L","family":"Savonen","sequence":"additional","affiliation":[{"name":"Biostatistics Program, Public Health Sciences Division, Fred Hutchinson Cancer Center , Seattle, WA, 98109, United States"}]},{"given":"Mary J","family":"Goldman","sequence":"additional","affiliation":[{"name":"UC Santa Cruz Genomics Institute, University of California Santa Cruz , Santa Cruz, CA, 95060, United States"}]},{"given":"Martin","family":"Morgan","sequence":"additional","affiliation":[{"name":"Roswell Park Comprehensive Cancer Center , Buffalo, NY, 14263, United States"}]},{"given":"Michael","family":"Reich","sequence":"additional","affiliation":[{"name":"University of California , San Diego, La Jolla, CA, 92093, United States"}]},{"given":"Alexander","family":"Getka","sequence":"additional","affiliation":[{"name":"University of Pennsylvania , Philadelphia, PA, 19104, United States"}]},{"given":"Aaron","family":"Holmes","sequence":"additional","affiliation":[{"name":"Jonsson Comprehensive Cancer Center, University of California , Los Angeles, CA, 90095, United States"},{"name":"Institute for Precision Health, University of California , Los Angeles, CA, 90095, United States"},{"name":"Department of Human Genetics, University of California , Los Angeles, CA, 90095, United States"},{"name":"Department of Urology, University of California , Los Angeles, CA, 90095, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2243-8487","authenticated-orcid":false,"given":"Sarthak","family":"Pati","sequence":"additional","affiliation":[{"name":"University of Pennsylvania , Philadelphia, PA, 19104, United States"},{"name":"Division of Computational Pathology, Department of Pathology and Laboratory Medicine, Indiana University School of Medicine , Indianapolis, IN, 46202, United States"},{"name":"Center for Federated Learning, Indiana University School of Medicine , Indianapolis, IN, 46202, United States"}]},{"given":"Dan","family":"Knight","sequence":"additional","affiliation":[{"name":"Jonsson Comprehensive Cancer Center, University of California , Los Angeles, CA, 90095, United States"},{"name":"Institute for Precision Health, University of California , Los Angeles, CA, 90095, United States"},{"name":"Department of Human Genetics, University of California , Los Angeles, CA, 90095, United States"},{"name":"Department of Urology, University of California , Los Angeles, CA, 90095, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0553-7520","authenticated-orcid":false,"given":"Paul C","family":"Boutros","sequence":"additional","affiliation":[{"name":"Jonsson Comprehensive Cancer Center, University of California , Los Angeles, CA, 90095, United States"},{"name":"Institute for Precision Health, University of California , Los Angeles, CA, 90095, United States"},{"name":"Department of Human Genetics, University of California , Los Angeles, CA, 90095, United States"},{"name":"Department of Urology, University of California , Los Angeles, CA, 90095, United States"}]},{"given":"Spyridon","family":"Bakas","sequence":"additional","affiliation":[{"name":"University of Pennsylvania , Philadelphia, PA, 19104, United States"},{"name":"Division of Computational Pathology, Department of Pathology and Laboratory Medicine, Indiana University School of Medicine , Indianapolis, IN, 46202, United States"},{"name":"Center for Federated Learning, Indiana University School of Medicine , Indianapolis, IN, 46202, United States"}]},{"given":"J Gregory","family":"Caporaso","sequence":"additional","affiliation":[{"name":"Pathogen and Microbiome Institute, Northern Arizona University , Flagstaff, AZ, 86011, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9954-6799","authenticated-orcid":false,"given":"Guilherme","family":"Del Fiol","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah , Salt Lake City, UT, 84108, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8793-9982","authenticated-orcid":false,"given":"Harry","family":"Hochheiser","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Pittsburgh , Pittsburgh, PA, 15206, United States"}]},{"given":"Brian","family":"Haas","sequence":"additional","affiliation":[{"name":"Methods Development Laboratory, Broad Institute , Cambridge, MA, 02141, United States"}]},{"given":"Patrick D","family":"Schloss","sequence":"additional","affiliation":[{"name":"Department of Microbiology and Immunology, University of Michigan , Ann Arbor, MI, 48109, United States"}]},{"given":"James A","family":"Eddy","sequence":"additional","affiliation":[{"name":"Sage Bionetworks , Seattle, WA, 98121, United States"}]},{"given":"Jake","family":"Albrecht","sequence":"additional","affiliation":[{"name":"Sage Bionetworks , Seattle, WA, 98121, United States"}]},{"given":"Andrey","family":"Fedorov","sequence":"additional","affiliation":[{"name":"Department of Radiology, Brigham and Women\u2019s Hospital, Harvard Medical School , Boston, MA, 02138, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2725-0694","authenticated-orcid":false,"given":"Levi","family":"Waldron","sequence":"additional","affiliation":[{"name":"Department of Epidemiology and Biostatistics, City University of New York Graduate School of Public Health and Health Policy , New York, NY, 10027, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1833-4397","authenticated-orcid":false,"given":"Ava M","family":"Hoffman","sequence":"additional","affiliation":[{"name":"Biostatistics Program, Public Health Sciences Division, Fred Hutchinson Cancer Center , Seattle, WA, 98109, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7363-0327","authenticated-orcid":false,"given":"Richard L","family":"Bradshaw","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah , Salt Lake City, UT, 84108, United States"}]},{"given":"Jeffrey T","family":"Leek","sequence":"additional","affiliation":[{"name":"Biostatistics Program, Public Health Sciences Division, Fred Hutchinson Cancer Center , Seattle, WA, 98109, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1325-6067","authenticated-orcid":false,"given":"Carrie","family":"Wright","sequence":"additional","affiliation":[{"name":"Biostatistics Program, Public Health Sciences Division, Fred Hutchinson Cancer Center , Seattle, WA, 98109, United States"}]}],"member":"286","published-online":{"date-parts":[[2024,7,27]]},"reference":[{"key":"2024080313122684200_btae469-B1","doi-asserted-by":"crossref","first-page":"bax054","DOI":"10.1093\/database\/bax054","article-title":"CTD2 dashboard: a searchable web interface to connect validated results from the Cancer Target Discovery and Development Network","volume":"2017","author":"Aksoy","year":"2017","journal-title":"Database (Oxford)"},{"key":"2024080313122684200_btae469-B2","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/978-3-319-16486-1_10","volume-title":"New Contributions in Information Systems and Technologies","author":"Amorim","year":"2015"},{"key":"2024080313122684200_btae469-B3","volume-title":"Amsterdam Declaration on Funding Research Software Sustainability","author":"Barker","year":"2023"},{"key":"2024080313122684200_btae469-B4","volume-title":"The Goal Question Metric Approach, Volume I","author":"Basili","year":"1994"},{"key":"2024080313122684200_btae469-B5","doi-asserted-by":"crossref","first-page":"101614","DOI":"10.1016\/j.giq.2021.101614","article-title":"Open government data portals: predictors of site engagement among early users of health data NY","volume":"38","author":"Begany","year":"2021","journal-title":"Gov Inform Quart"},{"key":"2024080313122684200_btae469-B6","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/j.jce.2006.10.001","article-title":"Intrinsic motivation in open source software development","volume":"35","author":"Bitzer","year":"2007","journal-title":"J Comp Econ"},{"key":"2024080313122684200_btae469-B7","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1038\/s41587-019-0209-9","article-title":"Reproducible, interactive, scalable and extensible microbiome data science using QIIME 2","volume":"37","author":"Bolyen","year":"2019","journal-title":"Nat Biotechnol"},{"key":"2024080313122684200_btae469-B8","doi-asserted-by":"crossref","first-page":"1912","DOI":"10.1021\/acs.analchem.0c03581","article-title":"A practical guide to metabolomics software development","volume":"93","author":"Chang","year":"2021","journal-title":"Anal Chem"},{"key":"2024080313122684200_btae469-B9","volume-title":"Inmates Are Running the Asylum, The: Why High-Tech Products Drive Us Crazy and How to Restore the Sanity","author":"Cooper","year":"2004","edition":"2nd edn"},{"key":"2024080313122684200_btae469-B10","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1002\/asi.24454","article-title":"Softcite dataset: a dataset of software mentions in biomedical and economic research publications","volume":"72","author":"Du","year":"2021","journal-title":"J Assoc Inf Sci Technol"},{"key":"2024080313122684200_btae469-B11","first-page":"212","author":"Eisty","year":"2018"},{"key":"2024080313122684200_btae469-B43","year":"2019"},{"key":"2024080313122684200_btae469-B12","author":"Fenner","year":"2018"},{"key":"2024080313122684200_btae469-B13","doi-asserted-by":"crossref","first-page":"giz053","DOI":"10.1093\/gigascience\/giz053","article-title":"Over-optimization of academic publishing metrics: observing Goodhart\u2019s Law in action","volume":"8","author":"Fire","year":"2019","journal-title":"GigaScience"},{"key":"2024080313122684200_btae469-B14","volume-title":"Design Patterns: Elements of Reusable Object-Oriented Software","author":"Gamma","year":"1995"},{"key":"2024080313122684200_btae469-B15","first-page":"228","article-title":"A comparative study of maintainability index of open source software","volume":"2","author":"Ganpati","year":"2012","journal-title":"Int J Emerg Technol Adv Eng"},{"key":"2024080313122684200_btae469-B16","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1038\/s41587-020-0546-8","article-title":"Visualizing and interpreting cancer genomics data via the Xena platform","volume":"38","author":"Goldman","year":"2020","journal-title":"Nat Biotechnol"},{"key":"2024080313122684200_btae469-B17","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.jbi.2015.05.003","article-title":"Supporting information retrieval from electronic health records: a report of University of Michigan\u2019s nine-year experience in developing and using the Electronic Medical Record Search Engine (EMERSE)","volume":"55","author":"Hanauer","year":"2015","journal-title":"J Biomed Inform"},{"key":"2024080313122684200_btae469-B18","volume-title":"Accountability: Power, Ethos and the Technologies of Managing","author":"Hoskin","year":"1996"},{"key":"2024080313122684200_btae469-B19","doi-asserted-by":"crossref","first-page":"2137","DOI":"10.1002\/asi.23538","article-title":"Software in the scientific literature: problems with seeing, finding, and using software mentioned in the biology literature","volume":"67","author":"Howison","year":"2016","journal-title":"J Assoc Inf Sci Technol"},{"key":"2024080313122684200_btae469-B20","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1093\/reseval\/rvv014","article-title":"Understanding the scientific software ecosystem and its impact: current and future measures","volume":"24","author":"Howison","year":"2015","journal-title":"Res Eval"},{"key":"2024080313122684200_btae469-B21","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1038\/nmeth.3252","article-title":"Orchestrating high-throughput genomic analysis with Bioconductor","volume":"12","author":"Huber","year":"2015","journal-title":"Nat Methods"},{"key":"2024080313122684200_btae469-B22","doi-asserted-by":"crossref","first-page":"e1009481","DOI":"10.1371\/journal.pcbi.1009481","article-title":"Ten simple rules on writing clean and reliable open-source scientific software","volume":"17","author":"Hunter-Zinck","year":"2021","journal-title":"PLoS Comput Biol"},{"key":"2024080313122684200_btae469-B23","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.1158\/0008-5472.CAN-17-2212","article-title":"Cancer informatics: new tools for a data-driven age in cancer research","volume":"77","author":"Kibbe","year":"2017","journal-title":"Cancer Res"},{"key":"2024080313122684200_btae469-B24","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MCSE.2019.2943847","article-title":"A literature review on methods for the extraction of usage statements of software and data","volume":"22","author":"Kr\u00fcger","year":"2020","journal-title":"Comput Sci Eng"},{"key":"2024080313122684200_btae469-B25","author":"Kumar","year":"2017"},{"key":"2024080313122684200_btae469-B26","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1093\/bioinformatics\/btg405","article-title":"affy\u2014analysis of Affymetrix GeneChip data at the probe level","volume":"20","author":"Gautier","year":"2004","journal-title":"Bioinformatics"},{"key":"2024080313122684200_btae469-B27","first-page":"437","author":"Lenarduzzi","year":"2020"},{"key":"2024080313122684200_btae469-B28","doi-asserted-by":"crossref","first-page":"138","DOI":"10.12659\/MSMBR.892101","article-title":"Comparing bioinformatic gene expression profiling methods: microarray and RNA-Seq","volume":"20","author":"Mantione","year":"2014","journal-title":"Med Sci Monit Basic Res"},{"key":"2024080313122684200_btae469-B29","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1002\/spe.2961","article-title":"Reusability affecting factors and software metrics for reusability: a systematic literature review","volume":"51","author":"Mehboob","year":"2021","journal-title":"Softw Pract Exp"},{"key":"2024080313122684200_btae469-B30","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1038\/s41559-023-02008-w","article-title":"Better incentives are needed to reward academic software development","volume":"7","author":"Merow","year":"2023","journal-title":"Nat Ecol Evol"},{"key":"2024080313122684200_btae469-B31","author":"Mullen","year":"2020"},{"key":"2024080313122684200_btae469-B32","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/0164-1212(94)90067-1","article-title":"Construction and testing of polynomials predicting software maintainability","volume":"24","author":"Oman","year":"1994","journal-title":"J Syst Softw"},{"key":"2024080313122684200_btae469-B33","author":"Pag\u00e8s","year":"2022"},{"key":"2024080313122684200_btae469-B34","doi-asserted-by":"crossref","first-page":"e1002216","DOI":"10.1371\/journal.pcbi.1002216","article-title":"BioStar: an online question & answer resource for the bioinformatics community","volume":"7","author":"Parnell","year":"2011","journal-title":"PLoS Comput Biol"},{"key":"2024080313122684200_btae469-B35","doi-asserted-by":"crossref","first-page":"110652","DOI":"10.1016\/j.jss.2020.110652","article-title":"Exploring software reusability metrics with Q&A forum data","volume":"168","author":"Patrick","year":"2020","journal-title":"J Syst Softw"},{"key":"2024080313122684200_btae469-B36","first-page":"81","volume-title":"Expert Shell Scripting","author":"Peters","year":"2009"},{"key":"2024080313122684200_btae469-B37","doi-asserted-by":"crossref","first-page":"e1002802","DOI":"10.1371\/journal.pcbi.1002802","article-title":"Ten simple rules for the open development of scientific software","volume":"8","author":"Prli\u0107","year":"2012","journal-title":"PLoS Comput Biol"},{"key":"2024080313122684200_btae469-B38","author":"R Validation Hub","year":"2024"},{"key":"2024080313122684200_btae469-B39","author":"Ramakrishnan","year":"2017"},{"key":"2024080313122684200_btae469-B40","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.cels.2017.07.003","article-title":"The GenePattern notebook environment","volume":"5","author":"Reich","year":"2017","journal-title":"Cell Syst"},{"key":"2024080313122684200_btae469-B41","first-page":"252","author":"Rossi","year":"2010"},{"key":"2024080313122684200_btae469-B42","doi-asserted-by":"crossref","first-page":"114861","DOI":"10.1016\/j.eswa.2021.114861","article-title":"An agent-based system for modeling users\u2019 acquisition and retention in startup apps","volume":"176","author":"Sayyed-Alikhani","year":"2021","journal-title":"Exp Syst Appl"},{"key":"2024080313122684200_btae469-B44","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1186\/s13059-019-1763-7","article-title":"Challenges in funding and developing genomic software: roots and remedies","volume":"20","author":"Siepel","year":"2019","journal-title":"Genome Biol"},{"key":"2024080313122684200_btae469-B45","doi-asserted-by":"crossref","first-page":"e86","DOI":"10.7717\/peerj-cs.86","article-title":"Software citation principles","volume":"2","author":"Smith","year":"2016","journal-title":"PeerJ Comput Sci"},{"key":"2024080313122684200_btae469-B46","author":"Srivastava","year":"2011"},{"key":"2024080313122684200_btae469-B47","doi-asserted-by":"crossref","first-page":"W345","DOI":"10.1093\/nar\/gkac247","article-title":"The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2022 update","volume":"50","author":"The Galaxy Community","year":"2022","journal-title":"Nucleic Acids Res"},{"key":"2024080313122684200_btae469-B48","first-page":"709","article-title":"Academic software downloads from google code: useful usage indicators?","volume":"21","author":"Thelwall","year":"2016","journal-title":"Inform Res"},{"key":"2024080313122684200_btae469-B49","volume-title":"The Pragmatic Programmer, 20th Anniversary Edition","author":"Thomas","year":"2019"},{"key":"2024080313122684200_btae469-B50","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1080\/00031305.2017.1375988","article-title":"Documenting and evaluating data science contributions in academic promotion in departments of statistics and biostatistics","volume":"72","author":"Waller","year":"2018","journal-title":"Am Stat"},{"key":"2024080313122684200_btae469-B51","first-page":"226","author":"Wang","year":"2006"},{"key":"2024080313122684200_btae469-B52","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1200\/CCI.20.00086","article-title":"Informatics tools for cancer research and care: bridging the gap between innovation and implementation","volume":"4","author":"Warner","year":"2020","journal-title":"JCO Clin Cancer Inform"},{"key":"2024080313122684200_btae469-B53","first-page":"18","article-title":"Software maintainability index revisited","author":"Welker","year":"2001","journal-title":"CrossTalk\u2014J Defense Softw Eng"},{"key":"2024080313122684200_btae469-B54","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1038\/s41592-021-01254-9","article-title":"Reproducible, scalable, and shareable analysis pipelines with bioinformatics workflow managers","volume":"18","author":"Wratten","year":"2021","journal-title":"Nat Methods"},{"key":"2024080313122684200_btae469-B55","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s42400-021-00084-8","article-title":"Evaluation indicators for open-source software: a review","volume":"4","author":"Zhao","year":"2021","journal-title":"Cybersecur"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btae469\/58667432\/btae469.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/40\/8\/btae469\/58723814\/btae469.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/40\/8\/btae469\/58723814\/btae469.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,3]],"date-time":"2024-08-03T13:13:14Z","timestamp":1722690794000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/doi\/10.1093\/bioinformatics\/btae469\/7721930"}},"subtitle":[],"editor":[{"given":"Jonathan","family":"Wren","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2024,7,27]]},"references-count":55,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2024,8,2]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btae469","relation":{},"ISSN":["1367-4811"],"issn-type":[{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,8]]},"published":{"date-parts":[[2024,7,27]]},"article-number":"btae469"}}