{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T08:04:57Z","timestamp":1780560297245,"version":"3.54.1"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T00:00:00Z","timestamp":1777420800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T00:00:00Z","timestamp":1780531200000},"content-version":"vor","delay-in-days":36,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"2024 Shanghai Jiao Tong University School of Medicine Nursing Research Top Priority Project","award":["Jyhz2404"],"award-info":[{"award-number":["Jyhz2404"]}]},{"name":"Does your manuscript contain any material from third parties? No, all of the material is owned by the authors and\/or no permissions are required","award":["2022YFF1202600"],"award-info":[{"award-number":["2022YFF1202600"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Educ"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Basic life support (BLS) skills are the core competencies of healthcare professionals in responding to emergency situations. Traditional manual assessments suffer from subjective bias, low efficiency, and are affected by examiner fatigue. Artificial intelligence (AI) technology brings innovative opportunities for skill assessment, but currently there is a lack of mature and validated BLS AI assessment systems.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Aim<\/jats:title>\n                    <jats:p>To construct a basic life support practice skills evaluation system based on artificial intelligence technology, and verify its equivalence to manual evaluation. The purpose is to construct an evaluation system of basic life support practice skills based on artificial intelligence technology, verify its equivalence with manual evaluation, and analyse the advantages and development direction of artificial intelligence technology in the evaluation of basic life support practice skills.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The BLS practical skills evaluation system based on AI technology was developed based on RTMPose, ST-GCN, SVM, YOLOX and Whisper AI base models, and the BLS practical skills assessment environment was constructed, which contains audio and video capture systems, CPR simulators with distance sensors, and displays for human\u2013computer interaction with candidates. Using a paired design, the BLS practical skills assessment was conducted in August 2024 among 85 new nurses of the class of 2024 at Ruijin Hospital of Shanghai Jiaotong University School of Medicine, where each candidate's BLS skills performance was assessed by both the examiner and the AI system. The differences between the examiner scores and the AI system scores were compared, and at the same time, the self-assessment results of the Visual Analogue Scale of Fatigue Severity (VAS-F) of the four examiners before and after the scores were collected, as well as the candidates' satisfaction and acceptance of the application of the system for the BLS practical skills assessment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      There was no significant difference between AI system scores and examiner scores (t\u2009=\u2009-0.294,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.769), with good absolute agreement further confirmed by an intraclass correlation coefficient of 0.868 (95% CI: 0.803\u20130.912). Examiner VAS-F self-ratings were 73.50\u2009\u00b1\u200919.33 before and 82.25\u2009\u00b1\u200925.10 after the examination, respectively, and 51 (64.56%) of the candidates indicated that the AI system assessment helped to reduce their nervousness.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>AI system marking is consistent with the results of examiner marking and can be used to evaluate BLS practical skills, and, the application of AI system can improve the effectiveness of the assessment organisation. Meanwhile, the candidates' acceptance of the AI system was good, and the application can be expanded after further optimisation of the system. Candidates showed good acceptance of the AI system; however, expansion of application should proceed only after further optimization of system stability to reduce failure rates below 5%.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12909-026-09285-6","type":"journal-article","created":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T02:28:36Z","timestamp":1777429716000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluation of basic life support practice skills based on artificial intelligence technology: system construction and evaluation equivalence validation"],"prefix":"10.1186","volume":"26","author":[{"given":"Yan","family":"Jiang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yin","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiayu","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Min","family":"Tang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yingchao","family":"Shi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenwen","family":"Qi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yirong","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jue","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,4,29]]},"reference":[{"issue":"4","key":"9285_CR1","doi-asserted-by":"publisher","first-page":"336","DOI":"10.5005\/jp-journals-10071-24670","volume":"28","author":"A Agarwal","year":"2024","unstructured":"Agarwal A, Baitha U, Ranjan P, et al. Knowledge and skills in cardiopulmonary resuscitation and effect of simulation training on it among healthcare workers in a tertiary care center in India. Indian J Crit Care Med. 2024;28(4):336\u201342. https:\/\/doi.org\/10.5005\/jp-journals-10071-24670.","journal-title":"Indian J Crit Care Med"},{"issue":"6","key":"9285_CR2","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1007\/s40037-019-00535-6","volume":"8","author":"B Paravattil","year":"2019","unstructured":"Paravattil B, Wilby KJ. Optimizing assessors\u2019 mental workload in rater-based assessment: a critical narrative review. Perspect Med Educ. 2019;8(6):339\u201345. https:\/\/doi.org\/10.1007\/s40037-019-00535-6.","journal-title":"Perspect Med Educ"},{"issue":"2","key":"9285_CR3","doi-asserted-by":"publisher","first-page":"86","DOI":"10.17691\/stm2023.15.2.08","volume":"15","author":"AE Bykanov","year":"2023","unstructured":"Bykanov AE, Danilov GV, Kostumov VV, et al. Artificial intelligence technologies in the microsurgical operating room (review). Sovrem Tekhnol Med. 2023;15(2):86\u201394. https:\/\/doi.org\/10.17691\/stm2023.15.2.08.","journal-title":"Sovrem Tekhnol Med"},{"issue":"2","key":"9285_CR4","doi-asserted-by":"publisher","first-page":"373","DOI":"10.3390\/s25020373","volume":"25","author":"Q Liu","year":"2025","unstructured":"Liu Q, Jiang X, Jiang R. Classroom behavior recognition using computer vision: a systematic review. Sensors. 2025;25(2):373. https:\/\/doi.org\/10.3390\/s25020373.","journal-title":"Sensors"},{"issue":"5","key":"9285_CR5","doi-asserted-by":"publisher","first-page":"805","DOI":"10.1111\/bjh.18358","volume":"198","author":"L Kaestner","year":"2022","unstructured":"Kaestner L. Artificial intelligence: training the trainer. Br J Haematol. 2022;198(5):805\u20136. https:\/\/doi.org\/10.1111\/bjh.18358.","journal-title":"Br J Haematol"},{"issue":"12","key":"9285_CR6","doi-asserted-by":"publisher","first-page":"15098","DOI":"10.1109\/TPAMI.2023.3305243","volume":"45","author":"F Zhan","year":"2023","unstructured":"Zhan F, Yu Y, Wu R, et al. Multimodal image synthesis and editing: the generative AI era. IEEE Trans Pattern Anal Mach Intell. 2023;45(12):15098\u2013119. https:\/\/doi.org\/10.1109\/TPAMI.2023.3305243.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"9285_CR7","doi-asserted-by":"publisher","unstructured":"Radford A, Kim JW, Xu T, et al. Robust Speech Recognition via Large-Scale Weak Supervision. In: Proceedings of the 40th International Conference on Machine Learning (ICML). 2022. https:\/\/doi.org\/10.48550\/arXiv.2212.04356.","DOI":"10.48550\/arXiv.2212.04356"},{"key":"9285_CR8","doi-asserted-by":"publisher","first-page":"12449","DOI":"10.48550\/arXiv.2006.11477","volume":"33","author":"A Baevski","year":"2020","unstructured":"Baevski A, Zhou Y, Mohamed A, Auli M. wav2vec 2.0: a framework for self-supervised learning of speech representations. Adv Neural Inform Process Syst (NeurIPS). 2020;33:12449\u201360. https:\/\/doi.org\/10.48550\/arXiv.2006.11477.","journal-title":"Adv Neural Inform Process Syst (NeurIPS)"},{"issue":"10","key":"9285_CR9","doi-asserted-by":"publisher","first-page":"1095","DOI":"10.1016\/j.ccell.2022.09.012","volume":"40","author":"J Lipkova","year":"2022","unstructured":"Lipkova J, Chen RJ, Chen B, et al. Artificial intelligence for multimodal data integration in oncology. Cancer Cell. 2022;40(10):1095\u2013110. https:\/\/doi.org\/10.1016\/j.ccell.2022.09.012.","journal-title":"Cancer Cell"},{"key":"9285_CR10","doi-asserted-by":"publisher","first-page":"4900507","DOI":"10.1109\/JTEHM.2022.3152365","volume":"10","author":"DK Lee","year":"2022","unstructured":"Lee DK, Choi H, Jheon S, Jo YH, Im CW. Development of an extended reality simulator for basic life support training. IEEE J Transl Eng Health Med. 2022;10:4900507. https:\/\/doi.org\/10.1109\/JTEHM.2022.3152365.","journal-title":"IEEE J Transl Eng Health Med"},{"issue":"3","key":"9285_CR11","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1016\/0165-1781(91)90027-m","volume":"36","author":"KA Lee","year":"1991","unstructured":"Lee KA, Hicks G, Nino-Murcia G. Validity and reliability of a scale to assess fatigue. Psychiatry Res. 1991;36(3):291\u20138. https:\/\/doi.org\/10.1016\/0165-1781(91)90027-m.","journal-title":"Psychiatry Res"},{"issue":"2","key":"9285_CR12","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","volume":"15","author":"TK Koo","year":"2016","unstructured":"Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155\u201363. https:\/\/doi.org\/10.1016\/j.jcm.2016.02.012.","journal-title":"J Chiropr Med"},{"key":"9285_CR13","volume-title":"Deep Learning","author":"I Goodfellow","year":"2016","unstructured":"Goodfellow I, Bengio Y, Courville A. Deep Learning. Cambridge, MA: MIT Press; 2016."},{"key":"9285_CR14","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1186\/s12909-025-07241-4","volume":"25","author":"M Tekin","year":"2025","unstructured":"Tekin M, Yurdal MO, Toraman \u00c7, Korkmaz G, Uysal \u0130. Is AI the future of evaluation in medical education? AI vs. human evaluation in objective structured clinical examination. BMC Med Educ. 2025;25:641. https:\/\/doi.org\/10.1186\/s12909-025-07241-4.","journal-title":"BMC Med Educ"},{"issue":"1","key":"9285_CR15","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1080\/10401334.2015.1107485","volume":"28","author":"W Tavares","year":"2016","unstructured":"Tavares W, Ginsburg S, Eva KW. Selecting and simplifying: rater performance and behavior when considering multiple competencies. Teach Learn Med. 2016;28(1):41\u201351. https:\/\/doi.org\/10.1080\/10401334.2015.1107485.","journal-title":"Teach Learn Med"},{"issue":"11","key":"9285_CR16","doi-asserted-by":"publisher","first-page":"S24","DOI":"10.1097\/ACM.0000000000000893","volume":"90","author":"LM Naismith","year":"2015","unstructured":"Naismith LM, Cavalcanti RB. Validity of cognitive load measures in simulation-based training: a systematic review. Acad Med. 2015;90(11):S24\u201335. https:\/\/doi.org\/10.1097\/ACM.0000000000000893.","journal-title":"Acad Med"},{"issue":"11","key":"9285_CR17","doi-asserted-by":"publisher","first-page":"6193","DOI":"10.1007\/s00784-021-03918-4","volume":"25","author":"LS Weber","year":"2021","unstructured":"Weber LS, Schulze R. The effects of examiner fatigue on the diagnostic accuracy of dental radiographs. Clin Oral Investig. 2021;25(11):6193\u20139. https:\/\/doi.org\/10.1007\/s00784-021-03918-4.","journal-title":"Clin Oral Investig"},{"issue":"3","key":"9285_CR18","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1007\/s10943-017-0429-6","volume":"58","author":"S Lee","year":"2019","unstructured":"Lee S, Jir\u00e1sek I. Associations between screen-based activity, spiritual well-being, and life satisfaction among adolescents. J Relig Health. 2019;58(3):795\u2013804. https:\/\/doi.org\/10.1007\/s10943-017-0429-6.","journal-title":"J Relig Health"},{"issue":"3","key":"9285_CR19","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1080\/0142159X.2024.2345266","volume":"47","author":"C Brown","year":"2025","unstructured":"Brown C, Khavandi S, Sebastian A, et al. The influence of candidates\u2019 race on examiners\u2019 ratings in standardised assessments of clinical practice. Med Teach. 2025;47(3):492\u20137. https:\/\/doi.org\/10.1080\/0142159X.2024.2345266.","journal-title":"Med Teach"},{"issue":"4","key":"9285_CR20","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1007\/s11948-023-00448-y","volume":"29","author":"G Curto","year":"2023","unstructured":"Curto G, Comim F. SAF: stakeholders\u2019 agreement on fairness in the practice of machine learning development. Sci Eng Ethics. 2023;29(4):29. https:\/\/doi.org\/10.1007\/s11948-023-00448-y.","journal-title":"Sci Eng Ethics"},{"key":"9285_CR21","doi-asserted-by":"crossref","unstructured":"Johnson MS. Responsible AI for measurement and learning: principles and practices. ETS Research Report RR-25-03. Princeton, NJ: Educational Testing Service; 2025.","DOI":"10.64634\/4ftg8n64"},{"issue":"7","key":"9285_CR22","doi-asserted-by":"publisher","first-page":"1030","DOI":"10.1080\/02602938.2021.1991273","volume":"47","author":"B Becker","year":"2021","unstructured":"Becker B, van Rijn P, Molenaar D, Debeer D. Item order and speededness: implications for test fairness in higher educational high-stakes testing. Assess Eval High Educ. 2021;47(7):1030\u201342. https:\/\/doi.org\/10.1080\/02602938.2021.1991273.","journal-title":"Assess Eval High Educ"}],"container-title":["BMC Medical Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12909-026-09285-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-026-09285-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-026-09285-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T07:25:58Z","timestamp":1780557958000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s12909-026-09285-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,29]]},"references-count":22,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["9285"],"URL":"https:\/\/doi.org\/10.1186\/s12909-026-09285-6","relation":{},"ISSN":["1472-6920"],"issn-type":[{"value":"1472-6920","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,29]]},"assertion":[{"value":"27 September 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 April 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 April 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was conducted in accordance with the Declaration of Helsinki and was approved by the Ethics Committee of Ruijin Hospital, Shanghai Jiao Tong University School of Medicine (Ethics Approval No. 2024-295 from the Ruijin Hospital Clinical Research Ethics Committee). All participants were informed of the study purpose and procedures, and written informed consent was obtained prior to participation.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"All authors have read and approved the final manuscript. Participants provided consent for the use of their anonymized data for research and publication purposes.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"912"}}