{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,12]],"date-time":"2026-11-12T23:23:58Z","timestamp":1794525838536,"version":"4.9.1"},"reference-count":36,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"9","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":["Pediatr Emer Care"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:sec>\n            <jats:title>Objectives<\/jats:title>\n            <jats:p>The aim of this study was to determine the accuracy and interrater reliability of (1) point-of-care ultrasound (POCUS) image interpretation for identification of intussusception and (2) reliability of secondary signs associated with intussusception among experts compared with novice POCUS reviewers.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>We conducted a planned secondary analysis of a prospective, convenience sample of children aged 3 months to 6 years who were evaluated with POCUS for intussusception across 17 international pediatric emergency departments between October 2018 and December 2020. A random sample of 100 POCUS examinations was reviewed by novice and expert POCUS reviewers. The primary outcome was identification of the presence or absence of intussusception. Secondary outcomes included intussusception size and the presence of trapped free fluid or echogenic foci. Accuracy was summarized using sensitivity and specificity, which were estimated via generalized mixed effects logistic regression. Interrater reliability was summarized via Light's \u03ba statistics with bootstrapped standard errors (SEs). Accuracy and reliability of expert and novice POCUS reviewers were compared.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>Eighteen expert and 16 novice POCUS reviewers completed the reviews. The average expert sensitivity was 94.5% (95% confidence interval [CI], 88.6\u201397.5), and the specificity was 94.3% (95% CI, 90.3\u201396.7), significantly higher than the average novice sensitivity of 84.7% (95% CI, 74.3\u201391.4) and specificity of 80.4% (95% CI, 72.4, 86.7). \u03ba was significantly greater for expert (0.679, SE 0.039) compared with novice POCUS reviewers (0.424, SE 0.044; difference 0.256, SE 0.033). For our secondary outcome measure of intussusception size, \u03ba was significantly greater for experts (0.661, SE 0.038) compared with novices (0.397, SE 0.041; difference 0.264, SE 0.029). Interrater reliability was weak for expert and minimal for novice reviewers regarding the detection of trapped free fluid and echogenic foci.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions<\/jats:title>\n            <jats:p>Expert POCUS reviewers demonstrate high accuracy and moderate interrater reliability when identifying intussusception via image interpretation and perform better than novice reviewers.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1097\/pec.0000000000002786","type":"journal-article","created":{"date-parts":[[2022,6,24]],"date-time":"2022-06-24T18:00:37Z","timestamp":1656093637000},"page":"442-447","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":6,"title":["Accuracy and Interrater Reliability of Point-of-Care Ultrasonography Image Interpretation for Intussusception"],"prefix":"10.1097","volume":"38","author":[{"given":"Kelly R.","family":"Bergmann","sequence":"first","affiliation":[{"name":"Department of Emergency Medicine, Children\u2019s Minnesota, Minneapolis, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marshal","family":"Khant","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Children\u2019s Minnesota, Minneapolis, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shea","family":"Lammers","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Children\u2019s Minnesota, Minneapolis, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander C.","family":"Arroyo","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Maimonides Medical Center, Brooklyn, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pablo","family":"Avendano","sequence":"additional","affiliation":[{"name":"Division of Pediatric Emergency Medicine, University of Minnesota Masonic Children\u2019s Hospital, Minneapolis, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lindsey","family":"Chaudoin","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Atrium Health\u2019s Carolinas Medical Center, Charlotte, NC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie G.","family":"Cohen","sequence":"additional","affiliation":[{"name":"Department of Pediatrics and Emergency Medicine, Children\u2019s Healthcare Atlanta and Emory University, Atlanta, GA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J. Kate","family":"Deanehan","sequence":"additional","affiliation":[{"name":"Department of Pediatric Emergency Medicine, Johns Hopkins Children\u2019s Center, Baltimore, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aaron E.","family":"Kornblith","sequence":"additional","affiliation":[{"name":"Departments of Emergency Medicine and Pediatrics, University of California, San Francisco, San Francisco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samuel H. F.","family":"Lam","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Sutter Medical Center Sacramento, Sacramento, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Margaret","family":"Lin-Martore","sequence":"additional","affiliation":[{"name":"Departments of Emergency Medicine and Pediatrics, University of California, San Francisco, San Francisco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laurie","family":"Malia","sequence":"additional","affiliation":[{"name":"Division of Pediatric Emergency Medicine, Department of Emergency Medicine, Columbia University Vagelos College of Physicians and Surgeons, New York Presbyterian\u2013Morgan Stanley Children\u2019s Hospital, New York, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathryn H.","family":"Pade","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of California, San Diego, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel B.","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Pediatrics and Emergency Medicine, University of North Carolina, Chapel Hill, NC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam","family":"Sivitz","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Newark Beth Israel Medical Center, Newark, NJ"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Keren","family":"Shahar-Nissan","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Schneider Children\u2019s Medical Center of Israel, Petah Tikva, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter J.","family":"Snelling","sequence":"additional","affiliation":[{"name":"Department of Pediatric Emergency Medicine, Gold Coast University Hospital and Griffith University, Southport, Queensland, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark O.","family":"Tessaro","sequence":"additional","affiliation":[{"name":"Division of Pediatric Emergency Medicine, Hospital for Sick Children, Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rosemary","family":"Thomas-Mohtat","sequence":"additional","affiliation":[{"name":"Department of Pediatric Emergency Medicine, Children\u2019s National Hospital, Washington, DC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valerie","family":"Whitcomb","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Children\u2019s Minnesota, Minneapolis, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adriana","family":"Yock-Corrales","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Hospital Nacional de Ni\u00f1os \u201cDr. Carlos S\u00e1enz Herrera,\u201d CCSS, San Jos\u00e9, Costa Rica"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paige","family":"Walsh","sequence":"additional","affiliation":[{"name":"Department of Research and Sponsored Programs, Children's Minnesota, Minneapolis, MN."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dave","family":"Watson","sequence":"additional","affiliation":[{"name":"Department of Research and Sponsored Programs, Children's Minnesota, Minneapolis, MN."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manu","family":"Madhok","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Children\u2019s Minnesota, Minneapolis, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"In Collaboration with the P2Network Intussusception Study Group","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2022,6,24]]},"reference":[{"key":"bib1-20250504","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/j.annemergmed.2014.03.028","article-title":"Evaluation of acute appendicitis by pediatric emergency physician sonography","volume":"64","year":"2014","journal-title":"Ann Emerg Med"},{"key":"bib2-20250504","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1097\/PEC.0000000000001737","article-title":"A multi-institutional case series with review of point-of-care ultrasound to diagnose malrotation and midgut volvulus in the pediatric emergency department","volume":"35","year":"2019","journal-title":"Pediatr Emerg Care"},{"key":"bib3-20250504","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1016\/j.jemermed.2007.11.053","article-title":"Feasibility of emergency physician diagnosis of hypertrophic pyloric stenosis using point-of-care ultrasound: a multi-center case series","volume":"37","year":"2009","journal-title":"J Emerg Med"},{"key":"bib4-20250504","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1016\/j.annemergmed.2012.02.007","article-title":"Diagnosis of intussusception by physician novice sonographers in the emergency department","volume":"60","year":"2012","journal-title":"Ann Emerg Med"},{"key":"bib5-20250504","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1016\/j.annemergmed.2021.04.033","article-title":"Diagnostic accuracy of point-of-care ultrasound for intussusception: a multicenter, noninferiority study of paired diagnostic tests","volume":"78","year":"2021","journal-title":"Ann Emerg Med"},{"key":"bib6-20250504","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1016\/j.jemermed.2020.11.030","article-title":"Diagnostic accuracy of point-of-care ultrasound for intussusception performed by pediatric emergency medicine physicians","volume":"60","year":"2021","journal-title":"J Emerg Med"},{"key":"bib7-20250504","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/S0022-3476(05)81185-0","article-title":"Clinical application of ultrasonography in the diagnosis of intussusception","volume":"121","year":"1992","journal-title":"J Pediatr"},{"key":"bib8-20250504","first-page":"175","article-title":"Emergency medicine physicians performed ultrasound for pediatric intussusceptions","volume":"36","year":"2013","journal-title":"Biom J"},{"key":"bib9-20250504","doi-asserted-by":"crossref","first-page":"866","DOI":"10.1111\/acem.14226","article-title":"Evaluation of bedside sonography performed by emergency physicians to detect intussusception in children in the emergency department","volume":"28","year":"2021","journal-title":"Acad Emerg Med"},{"key":"bib10-20250504","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1097\/PEC.0b013e3182259908","article-title":"Utilization of emergency ultrasound in pediatric emergency departments","volume":"27","year":"2011","journal-title":"Pediatr Emerg Care"},{"key":"bib11-20250504","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1097\/PEC.0b013e318267a771","article-title":"Bedside ultrasound education in pediatric emergency medicine fellowship programs in the United States","volume":"28","year":"2012","journal-title":"Pediatr Emerg Care"},{"key":"bib12-20250504","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.7863\/jum.2012.31.9.1357","article-title":"Use of emergency ultrasound in United States pediatric emergency medicine fellowship programs in 2011","volume":"31","year":"2012","journal-title":"J Ultrasound Med"},{"key":"bib13-20250504","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1097\/PEC.0b013e3181884955","article-title":"Bedside ultrasound in pediatric emergency medicine fellowship programs in the United States: little formal training","volume":"24","year":"2008","journal-title":"Pediatr Emerg Care"},{"key":"bib14-20250504","doi-asserted-by":"crossref","first-page":"e10643","DOI":"10.1002\/aet2.10643","article-title":"Pediatric emergency medicine fellowship point-of-care ultrasound training in 2020","volume":"5","year":"2021","journal-title":"AEM Educ Train"},{"key":"bib15-20250504","doi-asserted-by":"crossref","first-page":"23","DOI":"10.20982\/tqmp.08.1.p023","article-title":"Computing inter-rater reliability for observational data: an overview and tutorial","volume":"8","year":"2012","journal-title":"Tutor Quant Methods Psychol"},{"key":"bib16-20250504","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.jbi.2008.08.010","article-title":"Research electronic data capture (REDCap)\u2014a metadata-driven methodology and workflow process for providing translational research informatics support","volume":"42","year":"2009","journal-title":"J Biomed Inform"},{"key":"bib17-20250504","doi-asserted-by":"crossref","first-page":"S45","DOI":"10.1016\/j.annemergmed.2019.08.117","article-title":"112 development and validation of a point-of-care ultrasound image quality assessment tool: the POCUS IQ scale","volume":"74","year":"2019","journal-title":"Ann Emerg Med"},{"key":"bib18-20250504","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1177\/1536867X0300300102","article-title":"Intra-class correlation in random-effects models for binary data","volume":"3","year":"2003","journal-title":"Stata J"},{"key":"bib19-20250504","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1037\/h0031643","article-title":"Measures of response agreement for qualitative data: some generalizations and alternatives","volume":"76","year":"1971","journal-title":"Psychol Bull"},{"key":"bib20-20250504","first-page":"276","article-title":"Interrater reliability: the kappa statistic","volume":"22","year":"2012","journal-title":"Biochem Med (Zagreb)"},{"key":"bib21-20250504","first-page":"1008","article-title":"Diagnostic accuracy of point-of-care ultrasound for intussusception in children presenting to the emergency department: a systematic review and meta-analysis","volume":"21","year":"2020","journal-title":"West J Emerg Med"},{"key":"bib22-20250504","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/j.jemermed.2019.06.007","article-title":"Pediatric emergency medicine point-of-care ultrasound for the diagnosis of intussusception","volume":"57","year":"2019","journal-title":"J Emerg Med"},{"key":"bib23-20250504","doi-asserted-by":"crossref","first-page":"1760","DOI":"10.1016\/j.ajem.2019.06.006","article-title":"Accuracy of point-of-care ultrasound and radiology-performed ultrasound for intussusception: a systematic review and meta-analysis","volume":"37","year":"2019","journal-title":"Am J Emerg Med"},{"key":"bib24-20250504","doi-asserted-by":"crossref","first-page":"e225","DOI":"10.1097\/PEC.0000000000002224","article-title":"Evidence-based diagnostic test accuracy of history, physical examination, and imaging for intussusception: a systematic review and meta-analysis","volume":"38","year":"2022","journal-title":"Pediatr Emerg Care"},{"key":"bib25-20250504","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1186\/s12887-020-02060-6","article-title":"Point-of-care ultrasound may be useful for detecting pediatric intussusception at an early stage","volume":"20","year":"2020","journal-title":"BMC Pediatr"},{"key":"bib26-20250504","doi-asserted-by":"crossref","first-page":"255","DOI":"10.5847\/wjem.j.issn.1920-8642.2014.04.002","article-title":"Emergency bedside ultrasound for the diagnosis of pediatric intussusception: a retrospective review","volume":"5","year":"2014","journal-title":"World J Emerg Med"},{"key":"bib27-20250504","doi-asserted-by":"crossref","first-page":"e90","DOI":"10.1097\/PEC.0000000000001283","article-title":"Point-of-care ultrasound could streamline the emergency department workflow of clinically nonspecific intussusception","volume":"36","year":"2020","journal-title":"Pediatr Emerg Care"},{"key":"bib28-20250504","doi-asserted-by":"crossref","first-page":"e27971","DOI":"10.1097\/MD.0000000000027971","article-title":"Effectiveness of the implementation of pediatric intussusception clinical pathway: a pre- and postintervention trial","volume":"100","year":"2021","journal-title":"Medicine (Baltimore)"},{"key":"bib29-20250504","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1002\/aet2.10365","article-title":"Core content for pediatric emergency medicine ultrasound fellowship training: a modified Delphi consensus study","volume":"4","year":"2020","journal-title":"AEM Educ Train"},{"key":"bib30-20250504","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1002\/aet2.10332","article-title":"Consensus core point-of-care ultrasound applications for pediatric emergency medicine training","volume":"3","year":"2019","journal-title":"AEM Educ Train"},{"key":"bib31-20250504","doi-asserted-by":"crossref","first-page":"601492","DOI":"10.3389\/fped.2021.601492","article-title":"Point-of-care ultrasound may reduce misdiagnosis of pediatric intussusception","volume":"9","year":"2021","journal-title":"Front Pediatr"},{"key":"bib32-20250504","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1111\/acem.12087","article-title":"Pediatric emergency medicine fellow training in ultrasound: consensus educational guidelines","volume":"20","year":"2013","journal-title":"Acad Emerg Med"},{"key":"bib33-20250504","doi-asserted-by":"crossref","first-page":"1746","DOI":"10.1016\/j.ajem.2019.06.024","article-title":"Point-of-care ultrasound diagnosis of small bowel-small bowel vs ileocolic intussusception","volume":"37","year":"2019","journal-title":"Am J Emerg Med"},{"key":"bib34-20250504","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1016\/j.jpedsurg.2020.06.014","article-title":"Accurately distinguishing pediatric ileocolic intussusception from small-bowel intussusception using ultrasonography","volume":"56","year":"2021","journal-title":"J Pediatr Surg"},{"key":"bib35-20250504","doi-asserted-by":"crossref","first-page":"e1687","DOI":"10.1097\/PEC.0000000000001677","article-title":"Credentialing pediatric emergency medicine faculty in point-of-care ultrasound: expert guidelines","volume":"37","year":"2021","journal-title":"Pediatr Emerg Care"},{"key":"bib36-20250504","doi-asserted-by":"crossref","first-page":"e10520","DOI":"10.1002\/aet2.10520","article-title":"The ultrasound competency assessment tool (UCAT): development and evaluation of a novel competency-based assessment tool for point-of-care ultrasound","volume":"5","year":"2021","journal-title":"AEM Educ Train"}],"container-title":["Pediatric Emergency Care"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/PEC.0000000000002786","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,4]],"date-time":"2025-05-04T18:06:53Z","timestamp":1746382013000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/PEC.0000000000002786"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,24]]},"references-count":36,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2022]]}},"URL":"https:\/\/doi.org\/10.1097\/pec.0000000000002786","relation":{},"ISSN":["1535-1815","0749-5161"],"issn-type":[{"value":"1535-1815","type":"electronic"},{"value":"0749-5161","type":"print"}],"subject":[],"published":{"date-parts":[[2022,6,24]]}}}