{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T19:48:00Z","timestamp":1781552880468,"version":"3.54.5"},"reference-count":57,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T00:00:00Z","timestamp":1692921600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100020595","name":"National Science and Technology Council of Taiwan","doi-asserted-by":"crossref","award":["NSTC 111-2636-E-A49-014 and 111-2628-E-A49-026-MY3"],"award-info":[{"award-number":["NSTC 111-2636-E-A49-014 and 111-2628-E-A49-026-MY3"]}],"id":[{"id":"10.13039\/100020595","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>Electronic health records (EHRs) play a crucial role in healthcare decision-making by giving physicians insights into disease progression and suitable treatment options. Within EHRs, laboratory test results are frequently utilized for predicting disease progression. However, processing laboratory test results often poses challenges due to variations in units and formats. In addition, leveraging the temporal information in EHRs can improve outcomes, prognoses, and diagnosis predication. Nevertheless, the irregular frequency of the data in these records necessitates data preprocessing, which can add complexity to time-series analyses.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Methods<\/jats:title>\n<jats:p>To address these challenges, we developed an open-source R package that facilitates the extraction of temporal information from laboratory records. The proposed <jats:italic>lab<\/jats:italic> package generates analysis-ready time series data by segmenting the data into time-series windows and imputing missing values. Moreover, users can map local laboratory codes to the Logical Observation Identifier Names and Codes (LOINC), an international standard. This mapping allows users to incorporate additional information, such as reference ranges and related diseases. Moreover, the reference ranges provided by LOINC enable us to categorize results into normal or abnormal. Finally, the analysis-ready time series data can be further summarized using descriptive statistics and utilized to develop models using machine learning technologies.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>Using the <jats:italic>lab<\/jats:italic> package, we analyzed data from MIMIC-III, focusing on newborns with patent ductus arteriosus (PDA). We extracted time-series laboratory records and compared the differences in test results between patients with and without 30-day in-hospital mortality. We then identified significant variations in several laboratory test results 7 days after PDA diagnosis. Leveraging the time series\u2013analysis-ready data, we trained a prediction model with the long short-term memory algorithm, achieving an area under the receiver operating characteristic curve of 0.83 for predicting 30-day in-hospital mortality in model training. These findings demonstrate the lab package\u2019s effectiveness in analyzing disease progression.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Conclusions<\/jats:title>\n<jats:p>The proposed <jats:italic>lab<\/jats:italic> package simplifies and expedites the workflow involved in laboratory records extraction. This tool is particularly valuable in assisting clinical data analysts in overcoming the obstacles associated with heterogeneous and sparse laboratory records.<\/jats:p>\n<\/jats:sec>","DOI":"10.7717\/peerj-cs.1528","type":"journal-article","created":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T07:35:27Z","timestamp":1692948927000},"page":"e1528","source":"Crossref","is-referenced-by-count":1,"title":["lab: an R package for generating analysis-ready data from laboratory records"],"prefix":"10.7717","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1814-5553","authenticated-orcid":true,"given":"Yi-Ju","family":"Tseng","sequence":"first","affiliation":[{"name":"Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu, Taiwan"},{"name":"Computational Health Informatics Program, Boston Children\u2019s Hospital, Boston, MA, United States of America"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chun Ju","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Information Management, National Taiwan University, Taipei, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chia Wei","family":"Chang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"4443","published-online":{"date-parts":[[2023,8,25]]},"reference":[{"issue":"4","key":"10.7717\/peerj-cs.1528\/ref-1","doi-asserted-by":"publisher","first-page":"642","DOI":"10.1016\/j.jbi.2012.04.012","article-title":"Standardizing clinical laboratory data for secondary use","volume":"45","author":"Abhyankar","year":"2012","journal-title":"Journal of Biomedical Informatics"},{"key":"10.7717\/peerj-cs.1528\/ref-2","doi-asserted-by":"publisher","first-page":"k1479","DOI":"10.1136\/bmj.k1479","article-title":"Biases in electronic health record data due to processes within the healthcare system: retrospective observational study","volume":"361","author":"Agniel","year":"2018","journal-title":"BMJ (Online)"},{"issue":"4","key":"10.7717\/peerj-cs.1528\/ref-3","doi-asserted-by":"publisher","first-page":"e27","DOI":"10.2196\/jmir.5.4.e27","article-title":"Generic design of web-based clinical databases","volume":"5","author":"Anh\u00f8j","year":"2003","journal-title":"Journal of Medical Internet Research"},{"key":"10.7717\/peerj-cs.1528\/ref-4","volume-title":"Predicting coronary artery disease using deep learning algorithms and time series data","author":"Chiang","year":"2022"},{"issue":"6","key":"10.7717\/peerj-cs.1528\/ref-5","doi-asserted-by":"publisher","first-page":"2298","DOI":"10.3390\/jcm12062298","article-title":"Evaluation of infective endocarditis in children: a 19-year retrospective study in Taiwan","volume":"12","author":"Chien","year":"2023","journal-title":"Journal of Clinical Medicine"},{"key":"10.7717\/peerj-cs.1528\/ref-6","article-title":"remotes: R package installation from remote repositories, including \u201cGitHub\u201d","author":"Cs\u00e1rdi","year":"2021"},{"issue":"2","key":"10.7717\/peerj-cs.1528\/ref-7","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1016\/j.ijmedinf.2016.07.009","article-title":"Validating the extract, transform, load process used to populate a large clinical research database","volume":"94","author":"Denney","year":"2016","journal-title":"International Journal of Medical Informatics"},{"issue":"23","key":"10.7717\/peerj-cs.1528\/ref-8","doi-asserted-by":"publisher","first-page":"2281","DOI":"10.1001\/jama.2019.4914","article-title":"Artificial intelligence in health care","volume":"321","author":"Emanuel","year":"2019","journal-title":"JAMA"},{"key":"10.7717\/peerj-cs.1528\/ref-9","article-title":"keras: R interface to \u201cKeras\u201d","author":"Falbel","year":"2022"},{"key":"10.7717\/peerj-cs.1528\/ref-10","article-title":"An extensive data processing pipeline for MIMIC-IV","author":"Gupta","year":"2022"},{"key":"10.7717\/peerj-cs.1528\/ref-11","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.ijmedinf.2018.01.006","article-title":"Critical Care Health Informatics Collaborative (CCHIC): data, tools and methods for reproducible research: a multi-centre UK intensive care database","volume":"112","author":"Harris","year":"2018","journal-title":"International Journal of Medical Informatics"},{"issue":"4","key":"10.7717\/peerj-cs.1528\/ref-12","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1001\/jama.229.4.457","article-title":"Adding value to the electronic health record through secondary use of data for quality assurance, research, and surveillance","volume":"13","author":"Hersh","year":"2007","journal-title":"American Journal of Managed Care"},{"issue":"01\/02","key":"10.7717\/peerj-cs.1528\/ref-13","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1055\/s-0041-1731784","article-title":"Why is the electronic health record so challenging for research and clinical care?","volume":"60","author":"Holmes","year":"2021","journal-title":"Methods of Information in Medicine"},{"key":"10.7717\/peerj-cs.1528\/ref-14","first-page":"4353","article-title":"Set functions for time series","volume-title":"Proceedings of the 37th International Conference on Machine Learning. Proceedings of Machine Learning Research. PMLR","author":"Horn","year":"2020"},{"issue":"5","key":"10.7717\/peerj-cs.1528\/ref-15","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1016\/j.jbi.2017.03.009","article-title":"Strategies for handling missing clinical data for automated surgical site infection detection from the electronic health record","volume":"68","author":"Hu","year":"2017","journal-title":"Journal of Biomedical Informatics"},{"issue":"1","key":"10.7717\/peerj-cs.1528\/ref-16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-017-0442-1","article-title":"When and how should multiple imputation be used for handling missing data in randomised clinical trials\u2014a practical guide with flowcharts","volume":"17","author":"Jakobsen","year":"2017","journal-title":"BMC Medical Research Methodology"},{"issue":"1","key":"10.7717\/peerj-cs.1528\/ref-17","doi-asserted-by":"publisher","first-page":"160035","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson","year":"2016","journal-title":"Scientific Data"},{"issue":"1","key":"10.7717\/peerj-cs.1528\/ref-18","doi-asserted-by":"publisher","first-page":"2445","DOI":"10.1186\/s12887-016-0592-z","article-title":"Quality of EHR data extractions for studies of preterm birth in a tertiary care center: guidelines for obtaining reliable data","volume":"16","author":"Knake","year":"2016","journal-title":"BMC Pediatrics"},{"issue":"3","key":"10.7717\/peerj-cs.1528\/ref-19","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1136\/ard-2022-222626","article-title":"From real-world electronic health record data to real-world results using artificial intelligence","volume":"82","author":"Knevel","year":"2023","journal-title":"Annals of the Rheumatic Diseases"},{"key":"10.7717\/peerj-cs.1528\/ref-20","doi-asserted-by":"publisher","first-page":"e13081","DOI":"10.1111\/irv.13081","article-title":"Applying symptom dynamics to accurately predict influenza virus infection: an international multicenter influenza-like illness surveillance study","volume":"17","author":"Li","year":"2023","journal-title":"Influenza and Other Respiratory Viruses"},{"key":"10.7717\/peerj-cs.1528\/ref-21","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1038\/s41746-021-00518-0","article-title":"Imputation of missing values for electronic health record laboratory data","volume":"4","author":"Li","year":"2021","journal-title":"npj Digital Medicine"},{"key":"10.7717\/peerj-cs.1528\/ref-22","first-page":"805","article-title":"Investigating the semantic interoperability of laboratory data exchanged using LOINC codes in three large institutions","volume":"2011","author":"Lin","year":"2011"},{"issue":"1","key":"10.7717\/peerj-cs.1528\/ref-23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-42637-5","article-title":"Data-driven discovery of a novel sepsis pre-shock state predicts impending septic shock in the ICU","volume":"9","author":"Liu","year":"2019","journal-title":"Scientific Reports"},{"key":"10.7717\/peerj-cs.1528\/ref-24","first-page":"144","article-title":"A unified approach to adoption of laboratory LOINC in Taiwan","author":"Liu","year":"2007"},{"issue":"2","key":"10.7717\/peerj-cs.1528\/ref-25","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1038\/s41390-022-02343-x","article-title":"Utilizing big data from electronic health records in pediatric clinical care","volume":"93","author":"Macias","year":"2023","journal-title":"Pediatric Research"},{"issue":"10","key":"10.7717\/peerj-cs.1528\/ref-26","doi-asserted-by":"publisher","first-page":"e38557","DOI":"10.2196\/38557","article-title":"Lifting hospital electronic health record data treasures: challenges and opportunities","volume":"10","author":"Maletzky","year":"2022","journal-title":"JMIR Medical Informatics"},{"key":"10.7717\/peerj-cs.1528\/ref-27","doi-asserted-by":"crossref","DOI":"10.1145\/3459930.3469536","article-title":"COP-E-CAT: cleaning and organization pipeline for EHR computational and analytic tasks","author":"Mandyam","year":"2021"},{"issue":"5","key":"10.7717\/peerj-cs.1528\/ref-28","doi-asserted-by":"publisher","first-page":"102130","DOI":"10.1016\/j.is.2022.102130","article-title":"A data preparation framework for cleaning electronic health records and assessing cleaning outcomes for secondary analysis","volume":"111","author":"Miao","year":"2023","journal-title":"Information Systems"},{"issue":"1","key":"10.7717\/peerj-cs.1528\/ref-29","doi-asserted-by":"publisher","first-page":"26094","DOI":"10.1038\/srep26094","article-title":"Deep patient: an unsupervised representation to predict the future of patients from the electronic health records","volume":"6","author":"Miotto","year":"2016","journal-title":"Scientific Reports"},{"issue":"13","key":"10.7717\/peerj-cs.1528\/ref-30","doi-asserted-by":"publisher","first-page":"1351","DOI":"10.1001\/jama.2013.393","article-title":"The inevitable application of big data to health care","volume":"309","author":"Murdoch","year":"2013","journal-title":"JAMA"},{"issue":"3","key":"10.7717\/peerj-cs.1528\/ref-31","doi-asserted-by":"publisher","first-page":"e190606","DOI":"10.1001\/jamanetworkopen.2019.0606","article-title":"Assessment of a deep learning model based on electronic health record data to forecast clinical outcomes in patients with rheumatoid arthritis","volume":"2","author":"Norgeot","year":"2019","journal-title":"JAMA Network Open"},{"issue":"4","key":"10.7717\/peerj-cs.1528\/ref-32","doi-asserted-by":"publisher","first-page":"872","DOI":"10.1093\/jamia\/ocv024","article-title":"Risk prediction for chronic kidney disease progression using heterogeneous electronic health record data and time series analysis","volume":"22","author":"Perotte","year":"2015","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"5","key":"10.7717\/peerj-cs.1528\/ref-33","doi-asserted-by":"publisher","first-page":"1113","DOI":"10.1038\/s41591-023-02332-5","article-title":"A deep learning algorithm to predict risk of pancreatic cancer from disease trajectories","volume":"29","author":"Placido","year":"2023","journal-title":"Nature Medicine"},{"issue":"14","key":"10.7717\/peerj-cs.1528\/ref-34","doi-asserted-by":"publisher","first-page":"1347","DOI":"10.1056\/NEJMra1814259","article-title":"Machine learning in medicine","volume":"380","author":"Rajkomar","year":"2019","journal-title":"New England Journal of Medicine"},{"issue":"4","key":"10.7717\/peerj-cs.1528\/ref-35","doi-asserted-by":"publisher","first-page":"763","DOI":"10.1016\/j.jbi.2012.01.009","article-title":"Building a robust, scalable and standards-driven infrastructure for secondary use of EHR data: the SHARPn project","volume":"45","author":"Rea","year":"2012","journal-title":"Journal of Biomedical Informatics"},{"issue":"11_Supplement","key":"10.7717\/peerj-cs.1528\/ref-36","doi-asserted-by":"publisher","first-page":"S130","DOI":"10.7326\/M19-0878","article-title":"Getting value from electronic health records: research needed to improve practice","volume":"172","author":"Rudin","year":"2020","journal-title":"Annals of Internal Medicine"},{"issue":"1","key":"10.7717\/peerj-cs.1528\/ref-37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1197\/jamia.M2273","article-title":"Toward a national framework for the secondary use of health data: an American Medical Informatics Association White Paper","volume":"14","author":"Safran","year":"2007","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"2","key":"10.7717\/peerj-cs.1528\/ref-38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3490234","article-title":"The Secondary use of electronic health records for data mining: data characteristics and challenges","volume":"55","author":"Sarwar","year":"2023","journal-title":"ACM Computing Surveys"},{"issue":"5","key":"10.7717\/peerj-cs.1528\/ref-39","doi-asserted-by":"publisher","first-page":"593","DOI":"10.1002\/pds.4713","article-title":"The Chang Gung research database\u2014a multi-institutional electronic medical records database for real-world epidemiological studies in Taiwan","volume":"28","author":"Shao","year":"2019","journal-title":"Pharmacoepidemiology and Drug Safety"},{"issue":"5","key":"10.7717\/peerj-cs.1528\/ref-40","doi-asserted-by":"publisher","first-page":"1589","DOI":"10.1109\/JBHI.2017.2767063","article-title":"Deep EHR: a survey of recent advances in deep learning techniques for Electronic Health Record (EHR) analysis","volume":"22","author":"Shickel","year":"2017","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"issue":"21","key":"10.7717\/peerj-cs.1528\/ref-41","doi-asserted-by":"publisher","first-page":"2199","DOI":"10.1001\/jama.2018.17163","article-title":"Clinical decision support in the era of artificial intelligence","volume":"320","author":"Shortliffe","year":"2018","journal-title":"Journal of the American Medical Association"},{"issue":"Suppl. 3","key":"10.7717\/peerj-cs.1528\/ref-42","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1016\/j.jbi.2014.11.005","article-title":"Incorporating temporal EHR data in predictive models for risk stratification of renal function deterioration","volume":"53","author":"Singh","year":"2015","journal-title":"Journal of Biomedical Informatics"},{"issue":"2","key":"10.7717\/peerj-cs.1528\/ref-43","doi-asserted-by":"publisher","first-page":"334","DOI":"10.2307\/3463097","article-title":"A manual of laboratory diagnostic tests","volume":"82","author":"Smalls","year":"1982","journal-title":"The American Journal of Nursing"},{"issue":"2","key":"10.7717\/peerj-cs.1528\/ref-44","doi-asserted-by":"publisher","first-page":"e0171784","DOI":"10.1371\/journal.pone.0171784","article-title":"rEHR: an R package for manipulating and analysing electronic health record data","volume":"12","author":"Springate","year":"2017","journal-title":"PLOS ONE"},{"key":"10.7717\/peerj-cs.1528\/ref-45","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/17.6.520","article-title":"Missing value estimation methods for DNA microarrays","author":"Troyanskaya","year":"2001"},{"issue":"5","key":"10.7717\/peerj-cs.1528\/ref-46","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1016\/j.bj.2017.08.002","article-title":"Chang Gung research database: a multi-institutional database consisting of original medical records","volume":"40","author":"Tsai","year":"2017","journal-title":"Biomedical Journal"},{"key":"10.7717\/peerj-cs.1528\/ref-47","doi-asserted-by":"publisher","first-page":"e520","DOI":"10.7717\/peerj-cs.520","article-title":"dxpr: an R package for generating analysis-ready data from electronic health records\u2014diagnoses and procedures","volume":"7","author":"Tseng","year":"2021","journal-title":"PeerJ Computer Science"},{"key":"10.7717\/peerj-cs.1528\/ref-48","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.ijmedinf.2019.05.003","article-title":"Predicting breast cancer metastasis by using serum biomarkers and clinicopathological data with machine learning technologies","volume":"128","author":"Tseng","year":"2019","journal-title":"International Journal of Medical Informatics"},{"issue":"3","key":"10.7717\/peerj-cs.1528\/ref-49","doi-asserted-by":"publisher","first-page":"1036","DOI":"10.1109\/JBHI.2014.2357719","article-title":"Multiple-time-series clinical data processing for classification with merging algorithm and statistical measures","volume":"19","author":"Tseng","year":"2015","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"issue":"8","key":"10.7717\/peerj-cs.1528\/ref-50","doi-asserted-by":"publisher","first-page":"e2011768","DOI":"10.1001\/jamanetworkopen.2020.11768","article-title":"Development of a machine learning model for survival risk stratification of patients with advanced oral cancer","volume":"3","author":"Tseng","year":"2020","journal-title":"JAMA Network Open"},{"issue":"5","key":"10.7717\/peerj-cs.1528\/ref-51","doi-asserted-by":"publisher","first-page":"e185","DOI":"10.2196\/JMIR.9134","article-title":"Possible sources of bias in primary care electronic health record data use and reuse","volume":"20","author":"Verheij","year":"2018","journal-title":"Journal of Medical Internet Research"},{"issue":"2","key":"10.7717\/peerj-cs.1528\/ref-52","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1016\/j.neucom.2020.12.132","article-title":"Deep time series models for scarce data","volume":"456","author":"Wang","year":"2021","journal-title":"Neurocomputing"},{"key":"10.7717\/peerj-cs.1528\/ref-53","article-title":"icd: comorbidity calculations and tools for ICD-9 and ICD-10 codes","author":"Wasey","year":"2022"},{"issue":"1","key":"10.7717\/peerj-cs.1528\/ref-54","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1136\/amiajnl-2011-000681","article-title":"Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research","volume":"20","author":"Weiskopf","year":"2013","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"6","key":"10.7717\/peerj-cs.1528\/ref-55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3127881","article-title":"Mining electronic health records (EHRs): a survey","volume":"50","author":"Yadav","year":"2018","journal-title":"ACM Computing Surveys"},{"key":"10.7717\/peerj-cs.1528\/ref-56","article-title":"tableone: create \u201cTable 1\u201d to describe baseline characteristics with or without propensity score weights","author":"Yoshida","year":"2022"},{"issue":"2","key":"10.7717\/peerj-cs.1528\/ref-57","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1136\/amiajnl-2012-001063","article-title":"Mapping local laboratory interface terms to LOINC at a German university hospital using RELMA V.5: a semi-automated approach","volume":"20","author":"Zunner","year":"2013","journal-title":"Journal of the American Medical Informatics Association"}],"container-title":["PeerJ Computer Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/peerj.com\/articles\/cs-1528.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-1528.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-1528.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-1528.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T07:35:49Z","timestamp":1692948949000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/articles\/cs-1528"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,25]]},"references-count":57,"alternative-id":["10.7717\/peerj-cs.1528"],"URL":"https:\/\/doi.org\/10.7717\/peerj-cs.1528","archive":["CLOCKSS","LOCKSS","Portico"],"relation":{},"ISSN":["2376-5992"],"issn-type":[{"value":"2376-5992","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,25]]},"article-number":"e1528"}}