{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T01:48:38Z","timestamp":1792806518794,"version":"4.5.0"},"reference-count":49,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,1,20]],"date-time":"2021-01-20T00:00:00Z","timestamp":1611100800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 research and innovation program","award":["no. 689260 (Digi-NewB project)."],"award-info":[{"award-number":["no. 689260 (Digi-NewB project)."]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>Background: The definition of late-onset bacterial sepsis (LOS) in very preterm infants is not unified. The objective was to assess the concordance of LOS diagnosis between experts in neonatal infection and international classifications and to evaluate the potential impact on heart rate variability and rate of \u201cbronchopulmonary dysplasia or death\u201d. Methods: A retrospective (2017\u20132020) multicenter study including hospitalized infants born before 31 weeks of gestation with intention to treat at least 5-days with antibiotics was performed. LOS was classified as \u201ccertain or probable\u201d or \u201cdoubtful\u201d independently by five experts and according to four international classifications with concordance assessed by Fleiss\u2019s kappa test. Results: LOS was suspected at seven days (IQR: 5\u201311) of life in 48 infants. Following expert classification, 36 of them (75%) were considered as \u201ccertain or probable\u201d (kappa = 0.41). Following international classification, this number varied from 13 to 46 (kappa = \u22120.08). Using the expert classification, \u201cbronchopulmonary dysplasia or death\u201d occurred less frequently in the doubtful group (25% vs. 78%, p &lt; 0.001). Differences existed in HRV changes between the two groups. Conclusion: The definition of LOS is not consensual with a low international and moderate inter-observer agreement. This affects the evaluation of associated organ dysfunction and prognosis.<\/jats:p>","DOI":"10.3390\/ijerph18030882","type":"journal-article","created":{"date-parts":[[2021,1,20]],"date-time":"2021-01-20T12:16:18Z","timestamp":1611144978000},"page":"882","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Diagnosis of Neonatal Late-Onset Infection in Very Preterm Infant: Inter-Observer Agreement and International Classifications"],"prefix":"10.3390","volume":"18","author":[{"given":"Gaelle","family":"Bury","sequence":"first","affiliation":[{"name":"Department of Neonatology, CHU Rennes, Rennes University, Inserm-CIC 1414, F-35033 Rennes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"St\u00e9phanie","family":"Leroux","sequence":"additional","affiliation":[{"name":"Department of Neonatology, CHU Rennes, Rennes University, Inserm-CIC 1414, F-35033 Rennes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7322-4983","authenticated-orcid":false,"given":"Cristhyne","family":"Leon Borrego","sequence":"additional","affiliation":[{"name":"LTSI-UMR_S Inserm 1099, University of Rennes, F-35000 Rennes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christ\u00e8le","family":"Gras Leguen","sequence":"additional","affiliation":[{"name":"Department of Neonatology, University Hospital of Nantes, F-44000 Nantes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8787-6846","authenticated-orcid":false,"given":"Delphine","family":"Mitanchez","sequence":"additional","affiliation":[{"name":"Department of Neonatology, University Hospital of Tours, F-37044 Tours, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geraldine","family":"Gascoin","sequence":"additional","affiliation":[{"name":"Department of Neonatology, University Hospital of Angers, F-49100 Angers, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aurore","family":"Thollot","sequence":"additional","affiliation":[{"name":"Department of Neonatology, University Hospital of Poitiers, F-86021 Poitiers, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jean Michel","family":"Rou\u00e9","sequence":"additional","affiliation":[{"name":"Department of Neonatology, University Hospital of Brest, F-29200 Brest, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guy","family":"Carrault","sequence":"additional","affiliation":[{"name":"LTSI-UMR_S Inserm 1099, University of Rennes, F-35000 Rennes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4305-3765","authenticated-orcid":false,"given":"Patrick","family":"Pladys","sequence":"additional","affiliation":[{"name":"Department of Neonatology, CHU Rennes, Rennes University, Inserm-CIC 1414, F-35033 Rennes, France"},{"name":"LTSI-UMR_S Inserm 1099, University of Rennes, F-35000 Rennes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0064-7085","authenticated-orcid":false,"given":"Alain","family":"Beuch\u00e9e","sequence":"additional","affiliation":[{"name":"Department of Neonatology, CHU Rennes, Rennes University, Inserm-CIC 1414, F-35033 Rennes, France"},{"name":"LTSI-UMR_S Inserm 1099, University of Rennes, F-35000 Rennes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2151","DOI":"10.1016\/S0140-6736(12)60560-1","article-title":"Global, regional, and national causes of child mortality: An updated systematic analysis for 2010 with time trends since 2000","volume":"379","author":"Liu","year":"2012","journal-title":"Lancet"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"American College of Chest Physicians (1992). American College of Chest Physicians\/Society of Critical Care Medicine Consensus Conference: Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Crit. Care Med., 20, 864\u2013874.","DOI":"10.1097\/00003246-199206000-00025"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1016\/j.jpeds.2015.02.009","article-title":"Neonatal sepsis 2004\u20132013: The rise and fall of coagulase-negative staphylococci","volume":"166","author":"Bizzarro","year":"2015","journal-title":"J. Pediatr."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Cai, S., Thompson, D.K., Anderson, P.J., and Yang, J.Y. (2019). Short- and Long-Term Neurodevelopmental Outcomes of Very Preterm Infants with Neonatal Sepsis: A Systematic Review and Meta-Analysis. Children, 6.","DOI":"10.3390\/children6120131"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kim, J.K., Chang, Y.S., Sung, S., Ahn, S.Y., and Park, W.S. (2018). Trends in the incidence and associated factors of late-onset sepsis associated with improved survival in extremely preterm infants born at 23\u201326 weeks\u2019 gestation: A retrospective study. BMC Pediatr., 18.","DOI":"10.1186\/s12887-018-1130-y"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1162","DOI":"10.1001\/jamapediatrics.2015.2175","article-title":"Prognostic Factors for Poor Cognitive Development in Children Born Very Preterm or With Very Low Birth Weight: A Systematic Review","volume":"169","author":"Linsell","year":"2015","journal-title":"JAMA Pediatr."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4","DOI":"10.4161\/viru.27372","article-title":"Epidemiology of severe sepsis","volume":"5","author":"Mayr","year":"2014","journal-title":"Virulence"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1542\/peds.110.2.285","article-title":"Late-onset sepsis in very low birth weight neonates: The experience of the NICHD Neonatal Research Network","volume":"110","author":"Stoll","year":"2002","journal-title":"Pediatrics"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2357","DOI":"10.1001\/jama.292.19.2357","article-title":"Neurodevelopmental and growth impairment among extremely low-birth-weight infants with neonatal infection","volume":"292","author":"Stoll","year":"2004","journal-title":"JAMA"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1542\/peds.2007-3423","article-title":"Prolonged duration of initial empirical antibiotic treatment is associated with increased rates of necrotizing enterocolitis and death for extremely low birth weight infants","volume":"123","author":"Cotten","year":"2009","journal-title":"Pediatrics"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Dong, Y., and Speer, C.P. (2014). Late-onset neonatal sepsis: Recent developments. Arch. Dis. Child. Fetal Neonatal Ed.","DOI":"10.1136\/archdischild-2014-306213"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1016\/j.jpeds.2011.05.033","article-title":"Prolonged initial empirical antibiotic treatment is associated with adverse outcomes in premature infants","volume":"159","author":"Kuppala","year":"2011","journal-title":"J. Pediatr."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1770","DOI":"10.1016\/S0140-6736(17)31002-4","article-title":"Neonatal sepsis","volume":"390","author":"Shane","year":"2017","journal-title":"Lancet"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"McGovern, M., Giannoni, E., Kuester, H., Turner, M.A., van den Hoogen, A., Bliss, J.M., Koenig, J.M., Keij, F.M., Mazela, J., and Finnegan, R. (2020). Challenges in developing a consensus definition of neonatal sepsis. Pediatr. Res.","DOI":"10.1038\/s41390-020-0785-x"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1001\/jama.2016.0287","article-title":"The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3)","volume":"315","author":"Singer","year":"2016","journal-title":"JAMA"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1097\/01.PCC.0000149131.72248.E6","article-title":"International pediatric sepsis consensus conference: Definitions for sepsis and organ dysfunction in pediatrics","volume":"6","author":"Goldstein","year":"2005","journal-title":"Pediatr. Crit. Care Med."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1038\/pr.2017.224","article-title":"Progress in the management of neonatal sepsis: The importance of a consensus definition","volume":"83","author":"Wynn","year":"2018","journal-title":"Pediatr. Res."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"346","DOI":"10.3389\/fped.2018.00346","article-title":"Early Inflammatory Markers for the Diagnosis of Late-Onset Sepsis in Neonates: The Nosodiag Study","volume":"6","author":"Dillenseger","year":"2018","journal-title":"Front. Pediatr."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.earlhumdev.2018.01.008","article-title":"Vital signs analysis algorithm detects inflammatory response in premature infants with late onset sepsis and necrotizing enterocolitis","volume":"117","author":"Mithal","year":"2018","journal-title":"Early Hum. Dev."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1080\/23744235.2018.1487075","article-title":"Late onset sepsis: Comparison between coagulase-negative staphylococci and other bacteria in the neonatal intensive care unit","volume":"50","author":"Berlak","year":"2018","journal-title":"Infect. Dis."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"280","DOI":"10.3389\/fped.2018.00280","article-title":"Autonomic Nervous System Dysfunction in Pediatric Sepsis","volume":"6","author":"Badke","year":"2018","journal-title":"Front. Pediatr."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1159\/000208792","article-title":"Uncorrelated randomness of the heart rate is associated with sepsis in sick premature infants","volume":"96","author":"Beuchee","year":"2009","journal-title":"Neonatology"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1016\/j.clp.2010.06.002","article-title":"Heart rate characteristics: Physiomarkers for detection of late-onset neonatal sepsis","volume":"37","author":"Fairchild","year":"2010","journal-title":"Clin. Perinatol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1007\/s13312-014-0469-x","article-title":"A mathematical algorithm for detection of late-onset sepsis in very-low birth weight infants: A preliminary diagnostic test evaluation","volume":"51","author":"Gur","year":"2014","journal-title":"Indian Pediatr."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Joshi, R., Kommers, D., Oosterwijk, L., Feijs, L., Van Pul, C., and Andriessen, P. (2019). Predicting Neonatal Sepsis Using Features of Heart Rate Variability, Respiratory Characteristics and ECG-Derived Estimates of Infant Motion. IEEE J. Biomed. Health Inform.","DOI":"10.1109\/JBHI.2019.2927463"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1038\/pr.2013.136","article-title":"Septicemia mortality reduction in neonates in a heart rate characteristics monitoring trial","volume":"74","author":"Fairchild","year":"2013","journal-title":"Pediatr Res."},{"key":"ref_27","unstructured":"(2021, January 20). The Canadian Neonatal Network Abstractor\u2019s Manual, February 3, 2020 CNN v.3.4.3. Available online: http:\/\/www.canadianneonatalnetwork.org\/Portal\/LinkClick.aspx?fileticket=rrf6188nkEw%3d&tabid=692020."},{"key":"ref_28","unstructured":"(2021, January 20). National Healthcare Safety Network (NHSN) Patient Safety Component Manual. January 2020, Available online: https:\/\/www.cdc.gov\/nhsn\/pdfs\/pscmanual\/pcsmanual_current.pdf."},{"key":"ref_29","unstructured":"National Reference Center for Nosocomial Infection Surveillance (2021, January 20). NEO-KISS Protocol Nosocomial Infection Surveillance for preterm infants with birthweight <1500 g. Available online: https:\/\/www.nrz-hygiene.de\/fileadmin\/nrz\/module\/neo\/NEO-KISSProtocol_english_240210.pdf."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Piening, B.C., Geffers, C., Gastmeier, P., and Schwab, F. (2017). Pathogen-specific mortality in very low birth weight infants with primary bloodstream infection. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0180134"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"F36","DOI":"10.1136\/fn.85.1.F36","article-title":"Development and initial validation of the EDIN scale, a new tool for assessing prolonged pain in preterm infants","volume":"85","author":"Debillon","year":"2001","journal-title":"Arch. Dis. Child. Fetal Neonatal Ed."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1097\/AJP.0b013e3181a5b52a","article-title":"Taking up the challenge of measuring prolonged pain in (premature) neonates: The COMFORTneo scale seems promising","volume":"25","author":"Roofthooft","year":"2009","journal-title":"Clin. J. Pain"},{"key":"ref_33","first-page":"675","article-title":"Risk Factors and Outcomes of Late-Onset Bacterial Sepsis in Preterm Neonates Born at <32 Weeks\u2019 Gestation","volume":"32","author":"Shah","year":"2015","journal-title":"Am. J. Perinatol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Leon, C., Carrault, G., Pladys, P., and Beuchee, A. (2020). Early detection of late onset sepsis in premature infants using visibility graph analysis of heart rate variability. IEEE J. Biomed. Health Inform.","DOI":"10.23919\/CinC53138.2021.9662715"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Doyen, M., Ge, D., Beuchee, A., Carrault, G., and Hern\u00e1ndez, A.I. (2019). Robust, real-time generic detector based on a multi-feature probabilistic method. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0223785"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"585","DOI":"10.3389\/fphys.2020.00585","article-title":"Cardiorespiratory Alterations in a Newborn Ovine Model of Systemic Inflammation Induced by Lipopolysaccharide Injection","volume":"11","author":"Nault","year":"2020","journal-title":"Front. Physiol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1097\/MOP.0000000000000315","article-title":"Defining neonatal sepsis","volume":"28","author":"Wynn","year":"2016","journal-title":"Curr. Opin. Pediatr."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1007\/s00431-012-1910-6","article-title":"Clinical signs to identify late-onset sepsis in preterm infants","volume":"172","author":"Bekhof","year":"2013","journal-title":"Eur. J. Pediatr."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1159\/000355539","article-title":"Ventilator-associated pneumonia in neonatal patients: An update","volume":"105","author":"Cernada","year":"2014","journal-title":"Neonatology"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"e293","DOI":"10.1097\/INF.0000000000001688","article-title":"Central-peripheral Temperature Monitoring as a Marker for Diagnosing Late-onset Neonatal Sepsis","volume":"36","year":"2017","journal-title":"Pediatr. Infect. Dis. J."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"496","DOI":"10.2119\/molmed.2015.00064","article-title":"Postnatal Age Is a Critical Determinant of the Neonatal Host Response to Sepsis","volume":"21","author":"Wynn","year":"2015","journal-title":"Mol. Med."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2244","DOI":"10.3109\/14767058.2014.983896","article-title":"Are vital signs indicative for bacteremia in newborns?","volume":"28","author":"Yapicioglu","year":"2015","journal-title":"J. Matern. Fetal Neonatal Med."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s00431-017-3030-9","article-title":"Late-onset sepsis due to urinary tract infection in very preterm neonates is not uncommon","volume":"177","author":"Mohseny","year":"2018","journal-title":"Eur. J. Pediatr."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1016\/j.jpeds.2018.12.011","article-title":"Central Line-Associated Blood Stream Infections and Non-Central Line-Associated Blood Stream Infections Surveillance in Canadian Tertiary Care Neonatal Intensive Care Units","volume":"208","author":"Zipursky","year":"2019","journal-title":"J. Pediatr."},{"key":"ref_45","first-page":"CD012126","article-title":"C-reactive protein for diagnosing late-onset infection in newborn infants","volume":"1","author":"Brown","year":"2019","journal-title":"Cochrane Database Syst Rev."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1186\/s13054-018-2236-1","article-title":"The combination of procalcitonin and C-reactive protein or presepsin alone improves the accuracy of diagnosis of neonatal sepsis: A meta-analysis and systematic review","volume":"22","author":"Ruan","year":"2018","journal-title":"Crit. Care"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1038\/s41390-019-0517-2","article-title":"A neonatal sequential organ failure assessment score predicts mortality to late-onset sepsis in preterm very low birth weight infants","volume":"88","author":"Wynn","year":"2020","journal-title":"Pediatr. Res."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1016\/j.jpeds.2013.11.038","article-title":"Infection and other clinical correlates of abnormal heart rate characteristics in preterm infants","volume":"164","author":"Sullivan","year":"2014","journal-title":"J. Pediatr."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"15448","DOI":"10.1038\/s41598-019-51617-8","article-title":"Late-Onset Sepsis as a Risk Factor for Bronchopulmonary Dysplasia in Extremely Low Birth Weight Infants: A Nationwide Cohort Study","volume":"9","author":"Jung","year":"2019","journal-title":"Sci. Rep."}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/18\/3\/882\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:13:15Z","timestamp":1760159595000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/18\/3\/882"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,20]]},"references-count":49,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["ijerph18030882"],"URL":"https:\/\/doi.org\/10.3390\/ijerph18030882","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,20]]}}}