{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T04:38:41Z","timestamp":1787027921931,"version":"build-2736575974"},"reference-count":31,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2022,7,29]],"date-time":"2022-07-29T00:00:00Z","timestamp":1659052800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Zhejiang Provincial Natural Science Foundation of China","award":["LGF20H040008"],"award-info":[{"award-number":["LGF20H040008"]}]},{"name":"the Zhejiang Provincial Natural Science Foundation of China","award":["2019PY045"],"award-info":[{"award-number":["2019PY045"]}]},{"name":"the Zhejiang Provincial Health Commission\u2019s Science and Technology Program of Medicine and Health","award":["LGF20H040008"],"award-info":[{"award-number":["LGF20H040008"]}]},{"name":"the Zhejiang Provincial Health Commission\u2019s Science and Technology Program of Medicine and Health","award":["2019PY045"],"award-info":[{"award-number":["2019PY045"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background: Accurate neonatal pain assessment (NPA) is the key to neonatal pain management, yet it is a challenging task for medical staff. This study aimed to analyze the clinical practicability of the artificial intelligence based NPA (AI-NPA) tool for real-world blood sampling. Method: We performed a prospective study to analyze the consistency of the NPA results given by a self-developed automated NPA system and nurses\u2019 on-site NPAs (OS-NPAs) for 232 newborns during blood sampling in neonatal wards, where the neonatal infant pain scale (NIPS) was used for evaluation. Spearman correlation analysis and the degree of agreement of the pain score and pain grade derived by the NIPS were applied for statistical analysis. Results: Taking the OS-NPA results as the gold standard, the accuracies of the NIPS pain score and pain grade given by the automated NPA system were 88.79% and 95.25%, with kappa values of 0.92 and 0.90 (p &lt; 0.001), respectively. Conclusion: The results of the automated NPA system for real-world neonatal blood sampling are highly consistent with the results of the OS-NPA. Considering the great advantages of automated NPA systems in repeatability, efficiency, and cost, it is worth popularizing the AI technique in NPA for precise and efficient neonatal pain management.<\/jats:p>","DOI":"10.3390\/diagnostics12081831","type":"journal-article","created":{"date-parts":[[2022,7,31]],"date-time":"2022-07-31T23:37:29Z","timestamp":1659310649000},"page":"1831","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Artificial Intelligence Based Pain Assessment Technology in Clinical Application of Real-World Neonatal Blood Sampling"],"prefix":"10.3390","volume":"12","author":[{"given":"Xiaoying","family":"Cheng","sequence":"first","affiliation":[{"name":"Quality Improvement Office, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health, Hangzhou 310052, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6918-4088","authenticated-orcid":false,"given":"Huaiyu","family":"Zhu","sequence":"additional","affiliation":[{"name":"College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linli","family":"Mei","sequence":"additional","affiliation":[{"name":"Administration Department of Nosocomial Infection, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health, Hangzhou 310052, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feixiang","family":"Luo","sequence":"additional","affiliation":[{"name":"Neonatal Intensive Care Unit, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health, Hangzhou 310052, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaofei","family":"Chen","sequence":"additional","affiliation":[{"name":"Gastroenterology Department, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health, Hangzhou 310052, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0763-3658","authenticated-orcid":false,"given":"Yisheng","family":"Zhao","sequence":"additional","affiliation":[{"name":"College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuohui","family":"Chen","sequence":"additional","affiliation":[{"name":"Administration Department of Nosocomial Infection, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health, Hangzhou 310052, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9335-4291","authenticated-orcid":false,"given":"Yun","family":"Pan","sequence":"additional","affiliation":[{"name":"College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"43","DOI":"10.21304\/2019.0601.00483","article-title":"A comprehensive analysis of neonatal pain and measures to reduce pain","volume":"6","author":"Kaur","year":"2019","journal-title":"J. Pediatric Crit. Care"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1111\/apa.14081","article-title":"Persistent pain in neonates: Challenges in assessment without the aid of a clinical tool","volume":"107","author":"Boyle","year":"2018","journal-title":"Acta Paediatr."},{"key":"ref_3","unstructured":"Wan, Y. (2017). The Occurrent Status and Influencing Factors of Neonatal Procedural Pain in Neonatal Intensive Care Unit, Chinese Academy of Medical Sciences & Peking Union Medical College."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1248","DOI":"10.1111\/apa.13810","article-title":"Assessment of continuous pain in newborns admitted to NICUs in 18 European countries","volume":"106","author":"Anand","year":"2017","journal-title":"Acta Paediatr."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.pediatrneurol.2018.10.001","article-title":"Behavioral and physiological signs for pain assessment in preterm and term neonates during a nociception-specific response: A systematic review","volume":"90","author":"Relland","year":"2019","journal-title":"Pediatric Neurol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"S29","DOI":"10.1097\/j.pain.0000000000000784","article-title":"Translational studies identify long-term impact of prior neonatal pain experience","volume":"158","author":"Walker","year":"2017","journal-title":"Pain"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/S0304-3959(98)00046-3","article-title":"Bedside application of the neonatal facial coding system in pain assessment of premature infants","volume":"76","author":"Grunau","year":"1998","journal-title":"Pain"},{"key":"ref_8","first-page":"13","article-title":"Analysis of behavioural and physiological parameters for the assessment of postoperative analgesic demand in newborns, infants and young children: A comprehensive report on seven consecutive studies","volume":"90","author":"Finke","year":"2000","journal-title":"Pediatric Anesth."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1097\/00002508-199603000-00004","article-title":"Premature infant pain profile: Development and initial validation","volume":"12","author":"Stevens","year":"1996","journal-title":"Clin. J. Pain"},{"key":"ref_10","first-page":"59","article-title":"The development of a tool to assess neonatal pain","volume":"12","author":"Lawrence","year":"1993","journal-title":"Neonatal Netw."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1016\/j.pmn.2013.10.002","article-title":"Neonatal nurses\u2019 perceptions of pain management: Survey of the United States and China","volume":"15","author":"Cong","year":"2014","journal-title":"Pain Manag. Nurs."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/S0304-3959(99)00258-4","article-title":"Differences in pain expression between male and female newborn infants","volume":"85","author":"Guinsburg","year":"2000","journal-title":"Pain"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1109\/RBME.2017.2777907","article-title":"A review of automated pain assessment in infants: Features, classification tasks, and databases","volume":"11","author":"Zamzmi","year":"2017","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1457","DOI":"10.1109\/TBME.2009.2039214","article-title":"Relevance vector machine learning for neonate pain intensity assessment using digital imaging","volume":"57","author":"Gholami","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Brahnam, S., Nanni, L., and Sexton, R. (2007). Introduction to neonatal facial pain detection using common and advanced face classification techniques. Advanced Computational Intelligence Paradigms in Healthcare, Springer.","DOI":"10.1007\/978-3-540-47527-9_9"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2109","DOI":"10.3788\/AOS20082811.2109","article-title":"Research on recognition for facial expression of pain in neonates","volume":"28","author":"Lu","year":"2008","journal-title":"Acta Opt. Sin."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Brahnam, S., Nanni, L., McMurtrey, S., Lumini, A., Brattin, R., Slack, M., and Barrier, T. (2019). Neonatal pain detection in videos using the iCOPEvid dataset and an ensemble of descriptors extracted from Gaussian of Local Descriptors. Appl. Comput. Inform., in press.","DOI":"10.1016\/j.aci.2019.05.003"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Egede, J., Valstar, M., Torres, M.T., and Sharkey, D. (2019, January 3\u20136). Automatic neonatal pain estimation: An acute pain in neonates database. Proceedings of the 2019 8th International Conference on Affective Computing and Intelligent Interaction, Cambridge, UK.","DOI":"10.1109\/ACII.2019.8925480"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1109\/TBIOM.2019.2918619","article-title":"Convolutional neural networks for neonatal pain assessment","volume":"1","author":"Zamzmi","year":"2019","journal-title":"IEEE Trans. Biom. Behav. Identity Sci."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2017, January 22\u201325). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3059","DOI":"10.21037\/qims-20-1302","article-title":"Camera-based discomfort detection using multi-channel attention 3D-CNN for hospitalized infants","volume":"11","author":"Sun","year":"2011","journal-title":"Quant. Imaging Med. Surg."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chen, S., Luo, F., Chen, X., Yan, J., Zhong, Y., and Pan, Y. (2019, January 23\u201327). A video database of neonatal facial expression based on painful clinical procedures. Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Berlin, Germany.","DOI":"10.1109\/EMBC.2019.8857723"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Huang, R., Zhang, S., Li, T., and He, R. (2017, January 22\u201329). Beyond face rotation: Global and local perception GAN for photorealistic and identity preserving frontal view synthesis. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.267"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., and Tang, X. (2017, January 22\u201325). Residual attention network for image classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.683"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1109\/TIP.2018.2868382","article-title":"Reliable crowdsourcing and deep locality-preserving learning for unconstrained facial expression recognition","volume":"28","author":"Li","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s40138-016-0089-y","article-title":"A guide to pain assessment and management in the neonate","volume":"4","author":"Witt","year":"2016","journal-title":"Curr. Emerg. Hosp. Med. Rep."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1016\/0304-3959(87)90073-X","article-title":"Pain expression in neonates: Facial action and cry","volume":"28","author":"Grunau","year":"1987","journal-title":"Pain"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1097\/00002508-200311000-00003","article-title":"Neonatal facial coding system for assessing postoperative pain in infants: Item reduction is valid and feasible","volume":"19","author":"Peters","year":"2003","journal-title":"Clin. J. Pain"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zamzmi, G., Pai, C., Goldgof, D., Kasturi, R., Sun, Y., and Ashmeade, T. (2017, January 12\u201314). Automated pain assessment in neonates. Proceedings of the 20th Scandinavian Conference on Image Analysis, Troms\u00f8, Norway.","DOI":"10.1007\/978-3-319-59129-2_30"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/TAFFC.2019.2926710","article-title":"A comprehensive and context-sensitive neonatal pain assessment using computer vision","volume":"13","author":"Zamzmi","year":"2019","journal-title":"IEEE Trans. Affect. Comput."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/12\/8\/1831\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:59:24Z","timestamp":1760140764000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/12\/8\/1831"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,29]]},"references-count":31,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["diagnostics12081831"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics12081831","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,29]]}}}