{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,22]],"date-time":"2026-05-22T13:09:05Z","timestamp":1779455345673,"version":"3.53.1"},"reference-count":38,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2026,5,22]],"date-time":"2026-05-22T00:00:00Z","timestamp":1779408000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Children"],"abstract":"<jats:p>Background: Pain assessment in critically ill, mechanically ventilated pediatric patients is highly complex owing to communication barriers and the frequent use of sedation. A standardized, rapid, and objective tool such as the Behavioral Pain Scale (BPS) is urgently needed in Japanese pediatric intensive care units (PICUs), particularly in mixed adult\u2013pediatric settings, to ensure consistent, multidisciplinary assessment. This study aimed to evaluate the clinical applicability, validity, and reliability of the Japanese version of the BPS in critically ill mechanically ventilated pediatric patients. Methods: This single-center, prospective cross-sectional observational study was conducted between October 2021 and March 2023. The final analysis included 70 observations from 37 pediatric patients who needed mechanical ventilation (MV). Concurrent and convergent validity were assessed using Spearman\u2019s rank correlation coefficients (\u03c1) between the BPS; the Face, Legs, Activity, Cry, Consolability (FLACC) scale; and the COMFORT-Behavior (COMFORT-B) scale. Interrater reliability was evaluated using intraclass correlation coefficients (ICCs) and weighted kappa values among the three independent observers. The sample size (52 observations) was calculated based on the kappa coefficient estimation. The impact of sedation depth (assessed using the Richmond Agitation\u2013Sedation Scale [RASS]) and the observers\u2019 prior clinical experience with the evaluations were also analyzed. Results: Concurrent and convergent validity were high, showing strong correlations with the FLACC (\u03c1 = 0.49\u20130.91) and COMFORT-B (\u03c1 = 0.69\u20130.87) scales. The total BPS score showed moderate interrater reliability (ICC = 0.66, 95% CI = 0.55\u20130.76; weighted \u03ba = 0.63\u20130.71). However, deep sedation (defined as a median RASS score \u2264 \u22124 across observers), present in 68.6% of the observations, caused a pronounced floor effect that suppressed behavioral responses, even during painful procedures. Consequently, the reliability of fine motor subscales like \u201cupper limb movement\u201d (\u03ba = 0.08) was slight and for \u201cfacial expression\u201d (\u03ba = 0.38), it was fair. Furthermore, the correlation strength with the FLACC scale varied significantly with observer experience, with the strongest correlation (\u03c1 = 0.91) achieved by the observer with extensive adult ICU experience. Conclusions: As an initial validation, the Japanese version of the BPS has demonstrated acceptable validity and moderate reliability in mechanically ventilated pediatric patients. However, its clinical application requires careful interpretation because of the pronounced floor effect under deep sedation. Furthermore, accurate assessment depends heavily on specific training and familiarity with the adult-derived scale. With adequate training, the BPS has the potential to serve as an alternative tool and a valuable common multidisciplinary language in mixed intensive care settings. Future research should investigate whether implementing this tool improves multidisciplinary communication and clinical outcomes.<\/jats:p>","DOI":"10.3390\/children13060719","type":"journal-article","created":{"date-parts":[[2026,5,22]],"date-time":"2026-05-22T12:14:52Z","timestamp":1779452092000},"page":"719","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Applicability, Validity, and Reliability of the Japanese Version of the Behavioral Pain Scale for Critically Ill Mechanically Ventilated Pediatric Patients: A Prospective Cross-Sectional Observational Study"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5270-8498","authenticated-orcid":false,"given":"Mitsuki","family":"Ikeda","sequence":"first","affiliation":[{"name":"Department of Emergency and Critical Care Medicine, Faculty of Medicine, University of Tsukuba, Tsukuba 305-8575, Japan"},{"name":"Department of Nursing, University of Tsukuba Hospital, Tsukuba 305-8576, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haruhiko","family":"Hoshino","sequence":"additional","affiliation":[{"name":"Adult Nursing (Acute Care) Department of Nursing, Faculty of Medical Technology, Teikyo University, Tokyo 192-0395, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6388-9263","authenticated-orcid":false,"given":"Yujiro","family":"Matsuishi","sequence":"additional","affiliation":[{"name":"Department of Nursing Science and Engineering, Women\u2019s Health Nursing and Midwifery, Faculty of Medicine, University of Tsukuba, Tsukuba 305-8575, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Misaki","family":"Kotani","sequence":"additional","affiliation":[{"name":"Department of Emergency and Critical Care Medicine, Faculty of Medicine, University of Tsukuba, Tsukuba 305-8575, Japan"},{"name":"Department of Nursing, University of Tsukuba Hospital, Tsukuba 305-8576, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shunsuke","family":"Kobayashi","sequence":"additional","affiliation":[{"name":"Department of Nursing, University of Tsukuba Hospital, Tsukuba 305-8576, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7166-1370","authenticated-orcid":false,"given":"Takahiro","family":"Kido","sequence":"additional","affiliation":[{"name":"Department of Emergency and Critical Care Medicine, Faculty of Medicine, University of Tsukuba, Tsukuba 305-8575, Japan"},{"name":"Department of Child Health, Institute of Medicine, University of Tsukuba, Tsukuba 305-8576, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuki","family":"Enomoto","sequence":"additional","affiliation":[{"name":"Department of Emergency and Critical Care Medicine, Faculty of Medicine, University of Tsukuba, Tsukuba 305-8575, Japan"},{"name":"Department of Pediatrics, University of Tsukuba Hospital, Tsukuba 305-8576, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6581-8618","authenticated-orcid":false,"given":"Nobutake","family":"Shimojo","sequence":"additional","affiliation":[{"name":"Department of Emergency and Critical Care Medicine, Faculty of Medicine, University of Tsukuba, Tsukuba 305-8575, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoshiaki","family":"Inoue","sequence":"additional","affiliation":[{"name":"Department of Emergency and Critical Care Medicine, Faculty of Medicine, University of Tsukuba, Tsukuba 305-8575, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,5,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1007\/s00134-016-4344-1","article-title":"Clinical recommendations for pain, sedation, withdrawal and delirium assessment in critically ill infants and children: An ESPNIC position statement for healthcare professionals","volume":"42","author":"Harris","year":"2016","journal-title":"Intensive Care Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1111\/j.1478-5153.2009.00323.x","article-title":"The comfort behavioural scale and the modified flacc scale in paediatric intensive care","volume":"14","author":"Johansson","year":"2009","journal-title":"Nurs. Crit. Care"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1097\/01.CCM.0000108875.35298.D2","article-title":"Pain behaviors observed during six common procedures: Results from Thunder Project II","volume":"32","author":"Puntillo","year":"2004","journal-title":"Crit. Care Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1037\/a0023876","article-title":"A Biopsychosocial Formulation of Pain Communication","volume":"137","author":"Hadjistavropoulos","year":"2011","journal-title":"Psychol. Bull."},{"key":"ref_5","first-page":"3","article-title":"The International Association for the Study of Pain definition of pain: As valid in 2018 as in 1979, but in need of regularly updated footnotes","volume":"3","author":"Treede","year":"2018","journal-title":"Pain Rep."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"(2014). J-PAD Guideline Committee of the Japanese Society of Intensive Care Medicine Japanese guidelines for the management of Pain Agitation, and Delirium in intensive care unit (J-PAD). J. Jpn. Soc. Intensive Care Med., 21, 539\u2013579. (In Japanese).","DOI":"10.3918\/jsicm.21.539"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1016\/S0885-3924(01)00288-3","article-title":"The association between physiological and behavioral pain measures in 0- to 3-year-old Infants after major surgery","volume":"22","author":"Koot","year":"2001","journal-title":"J. Pain Symptom Manag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.pmn.2010.07.002","article-title":"Validation of the COMFORT Behavior Scale and the FLACC Scale for Pain Assessment in Chinese Children after Cardiac Surgery","volume":"13","author":"Bai","year":"2012","journal-title":"Pain Manag. Nurs."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1097\/PCC.0b013e3182192d92","article-title":"The COMFORT behavior scale: Is a shorter observation period feasible?","volume":"13","author":"Boerlage","year":"2012","journal-title":"Pediatr. Crit. Care Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1002\/ejp.569","article-title":"The COMFORT behaviour scale detects clinically meaningful effects of analgesic and sedative treatment","volume":"19","author":"Boerlage","year":"2015","journal-title":"Eur. J. Pain"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2059","DOI":"10.1016\/j.pain.2011.05.001","article-title":"The COMFORT-Behavior scale is useful to assess pain and distress in 0- to 3-year-old children with Down syndrome","volume":"152","author":"Valkenburg","year":"2011","journal-title":"Pain"},{"key":"ref_12","first-page":"55","article-title":"Pain Assessment in Infants and Young Children: The FLACC Scale: A behavioral tool to measure pain in young children","volume":"102","author":"Merkel","year":"2002","journal-title":"AJN Am. J. Nurs."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"334","DOI":"10.4103\/jehp.jehp_780_23","article-title":"Comparison of the accuracy and the response time to behavioral pain scales (BPS and CPOT) during painful procedures in the intensive care unit","volume":"13","author":"Sedighi","year":"2024","journal-title":"J. Educ. Health Promot."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2258","DOI":"10.1097\/00003246-200112000-00004","article-title":"Assessing pain in critically ill sedated patients by using a behavioral pain scale","volume":"29","author":"Payen","year":"2001","journal-title":"Crit. Care Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1111\/j.1365-2648.2008.04947.x","article-title":"Pain assessment tools for unconscious or sedated intensive care patients: A systematic review","volume":"65","author":"Aantaa","year":"2009","journal-title":"J. Adv. Nurs."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1470","DOI":"10.1213\/01.ANE.0000182331.68722.FF","article-title":"Validation of a behavioral pain scale in critically ill, sedated, and mechanically ventilated patients","volume":"101","author":"Zeggwagh","year":"2005","journal-title":"Anesth. Analg."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.iccn.2005.04.004","article-title":"Use of a Behavioural Pain Scale to assess pain in ventilated, unconscious and\/or sedated patients","volume":"22","author":"Young","year":"2006","journal-title":"Intensive Crit. Care Nurs."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1111\/j.1478-5153.2008.00294.x","article-title":"Clinical tools for the assessment of pain in sedated critically ill adults","volume":"13","author":"Cade","year":"2008","journal-title":"Nurs. Crit. Care"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.iccn.2016.03.001","article-title":"Pain assessment in the critically ill adult: Recent evidence and new trends","volume":"34","year":"2016","journal-title":"Intensive Crit. Care Nurs."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1515\/sjpain-2017-0139","article-title":"Reliability of three linguistically and culturally validated pain assessment tools for sedated ICU patients by ICU nurses in Finland","volume":"18","year":"2018","journal-title":"Scand. J. Pain"},{"key":"ref_21","unstructured":"(2017). J-PAD Guideline Review Committee of the Japanese Society of Intensive Care Medicine Survey on the current status of the management of pain agitation, and delirium in intensive care units. J. Jpn. Soc. Intensive Care Med., 24, 199\u2013207. (In Japanese)."},{"key":"ref_22","first-page":"19","article-title":"A first contribution to the validation of the Italian version of the Behavioral Pain Scale in sedated, intubated, and mechanically ventilated paediatric patients","volume":"89","author":"Sulla","year":"2018","journal-title":"Acta Bio Medica Atenei Parm."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1016\/j.pmn.2019.10.004","article-title":"Validation of the Greek Version of Comfort-B, FLACC, and BPS Scales in Critically Ill Children and Their Association with Clinical Severity","volume":"21","author":"Tamvaki","year":"2020","journal-title":"Pain Manag. Nurs."},{"key":"ref_24","first-page":"e2021370","article-title":"Validation of the Italian version of Behavioral Pain Scale in sedated, intubated, and mechanically ventilated pediatric patients","volume":"92","author":"Guasconi","year":"2021","journal-title":"Acta Biomed."},{"key":"ref_25","unstructured":"Evans, J.D. (1996). Straightforward Statistics for the Behavioral Sciences, Marcel Dekker."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A Coefficient of Agreement for Nominal Scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1037\/h0028106","article-title":"Large sample standard errors of kappa and weighted kappa","volume":"72","author":"Fleiss","year":"1969","journal-title":"Psychol. Bull."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/BF02294215","article-title":"Sample size determinations for two rater kappa statistic","volume":"53","author":"Flack","year":"1988","journal-title":"Psychometrika"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1038\/bmt.2012.244","article-title":"Investigation of the freely available easy-to-use software \u201cEZR\u201d for medical statistics","volume":"48","author":"Kanda","year":"2013","journal-title":"Bone Marrow Transplant."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1097\/00000446-200501000-00019","article-title":"The COMFORT Behavior Scale: A tool for assessing pain and sedation in infants","volume":"105","author":"Peters","year":"2005","journal-title":"Am. J. Nurs."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2983","DOI":"10.1001\/jama.289.22.2983","article-title":"Monitoring Sedation Status over Time in ICU Patients Reliability and Validity of the Richmond Agitation-Sedation Scale (RASS)","volume":"289","author":"Ely","year":"2003","journal-title":"JAMA"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Matsuishi, Y., Hoshino, H., Shimojo, N., Enomoto, Y., Kido, T., Hoshino, T., Sumitani, M., and Inoue, Y. (2018). Verifying the validity and reliability of the Japanese version of the Face, Legs, Activity, Cry, Consolability (FLACC) Behavioral Scale. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0194094"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"73","DOI":"10.3918\/jsicm.17.73","article-title":"Development of a Japanese version of Richmond Agitation-Sedation Scale (RASS)","volume":"17","author":"Unoki","year":"2010","journal-title":"J. Jpn. Soc. Intensive Care Med."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Tapia, R., L\u00f3pez-Herce, J., Arias, \u00c1., del Castillo, J., and Menc\u00eda, S. (2022). Validity and Reliability of the Richmond Agitation-Sedation Scale in Pediatric Intensive Care Patients: A Multicenter Study. Front. Pediatr., 9.","DOI":"10.3389\/fped.2021.795487"},{"key":"ref_36","first-page":"69","article-title":"Statistics corner: A guide to appropriate use of correlation coefficient in medical research","volume":"24","author":"Mukaka","year":"2012","journal-title":"Malawi Med. J."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"Landis amd Koch1977_agreement of categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"55","DOI":"10.4037\/ajcc2010624","article-title":"Reliability and validity of the face, legs, activity, cry, consolability behavioral tool in assessing acute pain in critically ill patients","volume":"19","author":"Zanotti","year":"2010","journal-title":"Am. J. Crit. Care"}],"container-title":["Children"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9067\/13\/6\/719\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,22]],"date-time":"2026-05-22T12:44:27Z","timestamp":1779453867000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9067\/13\/6\/719"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,22]]},"references-count":38,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["children13060719"],"URL":"https:\/\/doi.org\/10.3390\/children13060719","relation":{},"ISSN":["2227-9067"],"issn-type":[{"value":"2227-9067","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,22]]}}}