{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T20:28:32Z","timestamp":1786480112349,"version":"build-2736575974"},"reference-count":31,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Electronic health record (EHR) data are being increasingly used for retrospective observational research through large, robust databases, and advanced data extraction tools.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n We sought to assess the reliability of vital sign, ventilator, and continuous medication data captured in the EHR in a pediatric intensive care unit.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n We conducted a prospective concordance study of children receiving invasive mechanical ventilation in June 2025. Data sources included (1) a bedside clinical researcher, (2) automated EHR extraction, and (3) a continuous vital sign monitoring system. Vital signs from the EHR were compared to those obtained through the continuous vital sign monitoring system. Ventilator and medication data were compared to the bedside observations. Differences were measured as means with SDs or median differences with IQRs, and a 10% error rate was used as a concordance adequacy threshold.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n We obtained 110 bedside observations from 27 unique patients. Five of 8 measured vital signs in the EHR met the 10% concordance adequacy threshold (respiratory rate, 2.0\/20.4, 9.8%; cuff systolic blood pressure, 8.3\/99.4, 8.4%; invasive systolic blood pressure, 4.0\/88.0, 4.5%; invasive diastolic blood pressure, 3.8\/50.0, 7.6%; and oxygen saturation, 2\/96, 2.1%), with heart rate (11.4\/113, 10.1%), cuff diastolic blood pressure (9\/58.6, 15.3%), and end-tidal carbon dioxide (4.0\/36.6, 10.9%) failing to meet concordance. Occasional rare clinically meaningful outliers were observed, such as a systolic blood pressure difference of 31 mm Hg, a heart rate difference of 87 beats per minute, and a respiratory rate difference of 18 breaths per minute. All 6 ventilator settings met concordance adequacy criteria between the EHR and the bedside observations, with a median difference of 0.0 (IQR 0-0). Outliers were less common but included differences such as a respiratory rate of 34 breaths per minute and an inspiratory time of 0.3 seconds. Continuous medication dosing concordance was variable, with an overall low concordance between 30.8% (339.3\/11) and 31.4% (345.4\/11).<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n EHR data captured in the pediatric intensive care unit in our single-center sample were mostly concordant with other measured observations for vital signs and ventilator settings, but less concordant for continuous medications.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/93017","type":"journal-article","created":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T07:40:06Z","timestamp":1784187606000},"page":"e93017-e93017","source":"Crossref","is-referenced-by-count":0,"title":["Assessment of Electronic Clinical Monitoring Systems in the Pediatric Intensive Care Unit: Prospective Concordance Study"],"prefix":"10.2196","volume":"10","author":[{"given":"David","family":"Pham","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5490-1520","authenticated-orcid":false,"given":"Patricia","family":"Tachinardi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5456-2170","authenticated-orcid":false,"given":"Lucas","family":"Bulgarelli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wellington","family":"Dos Reis Lucena","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4297-9221","authenticated-orcid":false,"given":"Eneida","family":"Mendonca","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5251-2399","authenticated-orcid":false,"given":"Colin","family":"Rogerson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,8,11]]},"reference":[{"issue":"6","key":"R1","doi-asserted-by":"publisher","first-page":"1142","DOI":"10.1093\/jamia\/ocx080","article-title":"Electronic health record adoption in US hospitals: the emergence of a digital \u201cadvanced use\u201d divide","volume":"24","author":"Adler-Milstein","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"R2","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1056\/NEJMsa0802005","article-title":"Electronic health records in ambulatory care--a national survey of physicians","volume":"359","author":"DesRoches","journal-title":"N Engl J Med"},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.21037\/mhealth-24-2","article-title":"Capture of real-time data from electronic health records: scenarios and solutions","volume":"10","author":"Kirilov","journal-title":"Mhealth"},{"issue":"3","key":"R4","doi-asserted-by":"publisher","first-page":"464","DOI":"10.1055\/s-0040-1713634","article-title":"Defining an essential clinical dataset for admission patient history to reduce nursing documentation burden","volume":"11","author":"Sutton","journal-title":"Appl Clin Inform"},{"issue":"11 Suppl","key":"R5","doi-asserted-by":"publisher","first-page":"S79","DOI":"10.7326\/M19-0873","article-title":"Research and reporting considerations for observational studies using electronic health record data","volume":"172","author":"Callahan","journal-title":"Ann Intern Med"},{"issue":"2","key":"R6","doi-asserted-by":"publisher","first-page":"201","DOI":"10.5009\/gnl230272","article-title":"Challenges in and opportunities for electronic health record-based data analysis and interpretation","volume":"18","author":"Kim","journal-title":"Gut Liver"},{"key":"R7","volume":"2014","author":"Vawdrey","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"issue":"1","key":"R8","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-022-01899-x","article-title":"MIMIC-IV, a freely accessible electronic health record dataset","volume":"10","author":"Johnson","journal-title":"Sci Data"},{"issue":"6","key":"R9","doi-asserted-by":"publisher","first-page":"e581","DOI":"10.1097\/CCM.0000000000005517","article-title":"Systematic review and comparison of publicly available ICU data sets-a decision guide for clinicians and data scientists","volume":"50","author":"Sauer","journal-title":"Crit Care Med"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2018.178","article-title":"The eICU Collaborative Research Database, a freely available multi-center database for critical care research","volume":"5","author":"Pollard","journal-title":"Sci Data"},{"issue":"1","key":"R11","doi-asserted-by":"publisher","first-page":"38","DOI":"10.15265\/IY-2017-007","article-title":"Clinical data reuse or secondary use: current status and potential future progress","volume":"26","author":"Meystre","journal-title":"Yearb Med Inform"},{"issue":"5","key":"R12","doi-asserted-by":"publisher","first-page":"1239","DOI":"10.1016\/j.chest.2018.04.037","article-title":"Big data and data science in critical care","volume":"154","author":"Sanchez-Pinto","journal-title":"Chest"},{"issue":"5","key":"R13","doi-asserted-by":"publisher","first-page":"311","DOI":"10.5492\/wjccm.v11.i5.311","article-title":"Data science in the intensive care unit","volume":"11","author":"Luo","journal-title":"World J Crit Care Med"},{"issue":"12","key":"R14","doi-asserted-by":"publisher","first-page":"1999","DOI":"10.1093\/jamia\/ocaa245","article-title":"Assessing the practice of data quality evaluation in a national clinical data research network through a systematic scoping review in the era of real-world data","volume":"27","author":"Bian","journal-title":"J Am Med Inform Assoc"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.2196\/60709","article-title":"Challenges for data quality in the clinical data life cycle: systematic review","volume":"27","author":"An","journal-title":"J Med Internet Res"},{"issue":"1","key":"R16","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-022-01892-2","article-title":"Automating electronic health record data quality assessment","volume":"47","author":"Ozonze","journal-title":"J Med Syst"},{"issue":"10","key":"R17","doi-asserted-by":"publisher","first-page":"1730","DOI":"10.1093\/jamia\/ocad120","article-title":"Electronic health record data quality assessment and tools: a systematic review","volume":"30","author":"Lewis","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"R18","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-30691-z","article-title":"The quality of vital signs measurements and value preferences in electronic medical records varies by hospital, specialty, and patient demographics","volume":"13","author":"Jackson","journal-title":"Sci Rep"},{"issue":"4","key":"R19","doi-asserted-by":"publisher","DOI":"10.1111\/jep.70189","article-title":"Usability challenges in electronic health records: impact on documentation burden and clinical workflow: a scoping review","volume":"31","author":"Olakotan","journal-title":"J Eval Clin Pract"},{"issue":"11","key":"R20","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-022-01873-5","article-title":"Validation of an intensive care unit data mart for research and quality improvement","volume":"46","author":"Boncyk","journal-title":"J Med Syst"},{"issue":"2","key":"R21","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1097\/CCM.0000000000002060","article-title":"Accuracy of laboratory data communication on ICU daily rounds using an electronic health record","volume":"45","author":"Artis","journal-title":"Crit Care Med"},{"issue":"7","key":"R22","doi-asserted-by":"publisher","first-page":"1183","DOI":"10.1093\/jamia\/ocac033","article-title":"Acute vital signs changes are underrepresented by a conventional electronic health record when compared with automatically acquired data in a single-center tertiary pediatric cardiac intensive care unit","volume":"29","author":"Lowry","journal-title":"J Am Med Inform Assoc"},{"issue":"9596","key":"R23","doi-asserted-by":"publisher","first-page":"1453","DOI":"10.1016\/S0140-6736(07)61602-X","article-title":"The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies","volume":"370","author":"von Elm","journal-title":"Lancet"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2019.07.013","article-title":"Inadequate oxygen delivery index dose is associated with cardiac arrest risk in neonates following cardiopulmonary bypass surgery","volume":"142","author":"Futterman","journal-title":"Resuscitation"},{"issue":"11","key":"R25","doi-asserted-by":"publisher","DOI":"10.1097\/CCE.0000000000000563","article-title":"Use of a risk analytic algorithm to inform weaning from vasoactive medication in patients following pediatric cardiac surgery","volume":"3","author":"Goldsmith","journal-title":"Crit Care Explor"},{"issue":"12","key":"R26","doi-asserted-by":"publisher","DOI":"10.1097\/CCE.0000000000001013","article-title":"A near real-time risk analytics algorithm predicts elevated lactate levels in pediatric cardiac critical care patients","volume":"5","author":"Asfari","journal-title":"Crit Care Explor"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1016\/j.xjon.2024.09.006","article-title":"Validation of the inadequate delivery of oxygen index in an adult cardiovascular intensive care unit","volume":"22","author":"Holman","journal-title":"JTCVS Open"},{"key":"R28","unstructured":"R Core Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing. 2022. URL: https:\/\/www.r-project.org\/ [Accessed 26-07-2026]"},{"issue":"6","key":"R29","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2024-098241","article-title":"Prevalence and types of errors in the electronic health record: protocol for a mixed systematic review","volume":"15","author":"Kharko","journal-title":"BMJ Open"},{"issue":"2","key":"R30","doi-asserted-by":"publisher","first-page":"e74","DOI":"10.1097\/PCC.0000000000002873","article-title":"2022 Society of Critical Care Medicine clinical practice guidelines on prevention and management of pain, agitation, neuromuscular blockade, and delirium in critically ill pediatric patients with consideration of the ICU environment and early mobility","volume":"23","author":"Smith","journal-title":"Pediatr Crit Care Med"},{"issue":"3","key":"R31","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1177\/1074248414559838","article-title":"Pharmacotherapy update on the use of vasopressors and inotropes in the intensive care unit","volume":"20","author":"Jentzer","journal-title":"J Cardiovasc Pharmacol Ther"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T19:41:42Z","timestamp":1786477302000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e93017"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,11]]},"references-count":31,"URL":"https:\/\/doi.org\/10.2196\/93017","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,11]]},"article-number":"v10i6e93017"}}