{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T20:07:51Z","timestamp":1790021271555,"version":"4.0.1"},"reference-count":16,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T00:00:00Z","timestamp":1789948800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T00:00:00Z","timestamp":1789948800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Surg Endosc"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Emergency undocking is a high-acuity, low-occurrence event in robotic surgery. Existing robotic curricula do not address this skill, and no validated instrument has been developed to assess performance. We developed the Structured Approach for Fast Emergency Robotic-Undocking (SAFER), a simulation-based assessment tool, and hypothesized it would be reliable, responsive to educational intervention, and able to distinguish between trainee experience levels. We present multisource validity evidence.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      Using a quasi-experimental design, 58 general surgery residents at a single academic institution completed two simulation assessment scenarios\u2014hemorrhage and hemodynamic instability\u2014at two timepoints 6\u00a0months apart. Each scenario was evaluated using a 9-item checklist and a global rating scale (maximum score 20 points), scored independently by two trained faculty raters. Between timepoints, participants received a structured teaching session and self-directed learning materials. Validity evidence was gathered across five domains: content, response process, internal structure, relationships to other variables, and consequences of testing. Psychometric analyses included intraclass correlation coefficients (ICC), Cronbach's\n                      <jats:italic>\u03b1<\/jats:italic>\n                      , standard error of measurement (SEM), and minimal detectable change at the 95% confidence level (MDC95).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Interrater reliability was excellent overall (ICC = 0.95, 95% CI 0.94\u20130.96) and across both scenarios and timepoints. Internal consistency was acceptable to good (Cronbach's\n                      <jats:italic>\u03b1<\/jats:italic>\n                      = 0.72\u20130.83). The MDC95 was 2.5 points, with 72% of paired learners exceeding this threshold at the second assessment. Mean total score improved by 5.73 points (Cohen's\n                      <jats:italic>d<\/jats:italic>\n                      = 1.38), with largest gains among junior residents. Baseline scores increased significantly with postgraduate year (PGY) level [\n                      <jats:italic>F<\/jats:italic>\n                      (4,102) = 3.99,\n                      <jats:italic>p<\/jats:italic>\n                      = 0.005], supporting known-groups validity.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>SAFER, a novel assessment tool for robotic emergency undocking, demonstrated strong reliability, acceptable internal consistency, large responsiveness to training, and expected performance patterns across trainee levels. Further multicenter validation and transfer studies are needed before use in higher-stakes assessments, such as credentialing or advancement decisions.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s00464-026-13329-9","type":"journal-article","created":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T19:29:21Z","timestamp":1790018961000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["SAFER: a simulation-based assessment tool for emergency robotic undocking with multisource validity evidence"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4026-0021","authenticated-orcid":false,"given":"Blake T.","family":"Beneville","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abigail J.","family":"Hatcher","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael M.","family":"Awad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,9,21]]},"reference":[{"key":"13329_CR1","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2025.109173","volume":"181","author":"AJ Hatcher","year":"2025","unstructured":"Hatcher AJ, Beneville BT, Awad MM (2025) The evolution of surgical skills simulation education: robotic skills. Surgery 181:109173. https:\/\/doi.org\/10.1016\/j.surg.2025.109173","journal-title":"Surgery"},{"issue":"8","key":"13329_CR2","doi-asserted-by":"publisher","first-page":"e1380","DOI":"10.3109\/0142159X.2012.733451","volume":"35","author":"G Chiniara","year":"2013","unstructured":"Chiniara G, Cole G, Brisbin K, Huffman D, Cragg B et al (2013) Simulation in healthcare: a taxonomy and a conceptual framework for instructional design and media selection. Med Teach 35(8):e1380\u2013e1395. https:\/\/doi.org\/10.3109\/0142159X.2012.733451","journal-title":"Med Teach"},{"issue":"3","key":"13329_CR3","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.4321","volume":"11","author":"DA Ballas","year":"2019","unstructured":"Ballas DA, Cesta M, Gothard D, Ahmed R (2019) Emergency undocking curriculum in robotic surgery. Cureus 11(3):e4321. https:\/\/doi.org\/10.7759\/cureus.4321","journal-title":"Cureus"},{"issue":"2","key":"13329_CR4","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1097\/SIH.0000000000000596","volume":"17","author":"R Melnyk","year":"2022","unstructured":"Melnyk R, Saba P, Holler T, Cameron K, Mithal P, Rappold P, Wu G, Cubillos J, Rashid H, Joseph JV, Ghazi AE (2022) Design and implementation of an emergency undocking curriculum for robotic surgery. Simul Healthc J Soc Simul Healthc 17(2):78\u201387. https:\/\/doi.org\/10.1097\/SIH.0000000000000596","journal-title":"Simul Healthc J Soc Simul Healthc"},{"issue":"9","key":"13329_CR5","doi-asserted-by":"publisher","first-page":"741","DOI":"10.1037\/0003-066X.50.9.741","volume":"50","author":"S Messick","year":"1995","unstructured":"Messick S (1995) Validity of psychological assessment: validation of inferences from persons\u2019 responses and performances as scientific inquiry into score meaning. Am Psychol 50(9):741\u2013749. https:\/\/doi.org\/10.1037\/0003-066X.50.9.741","journal-title":"Am Psychol"},{"issue":"2","key":"13329_CR6","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1046\/j.1365-2168.1997.02502.x","volume":"84","author":"JA Martin","year":"1997","unstructured":"Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84(2):273\u2013278. https:\/\/doi.org\/10.1046\/j.1365-2168.1997.02502.x","journal-title":"Br J Surg"},{"key":"13329_CR7","unstructured":"Beneville B, Hatcher A, Taylor J, Kepper P, Martinez Santos M, Katta M, Morris W, Awad M (2026) Emergency undocking in robotic surgery: what every OR team must know (video presentation). In: SAGES annual meeting, Tampa, FL, United States, 27 March 2026"},{"issue":"2","key":"13329_CR8","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","volume":"15","author":"TK Koo","year":"2016","unstructured":"Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15(2):155\u2013163. https:\/\/doi.org\/10.1016\/j.jcm.2016.02.012","journal-title":"J Chiropr Med"},{"issue":"1","key":"13329_CR9","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1186\/s12909-018-1421-x","volume":"18","author":"V Yazbeck Karam","year":"2018","unstructured":"Yazbeck Karam V, Park YS, Tekian A, Youssef N (2018) Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ 18(1):313. https:\/\/doi.org\/10.1186\/s12909-018-1421-x","journal-title":"BMC Med Educ"},{"issue":"1","key":"13329_CR10","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1016\/j.juro.2011.09.032","volume":"187","author":"AC Goh","year":"2012","unstructured":"Goh AC, Goldfarb DW, Sander JC, Miles BJ, Dunkin BJ (2012) Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J Urol 187(1):247\u2013252. https:\/\/doi.org\/10.1016\/j.juro.2011.09.032","journal-title":"J Urol"},{"issue":"11","key":"13329_CR11","doi-asserted-by":"publisher","first-page":"3261","DOI":"10.1007\/s00464-015-4070-8","volume":"29","author":"MA Aghazadeh","year":"2015","unstructured":"Aghazadeh MA, Jayaratna IS, Hung AJ, Pan MM, Desai MM, Gill IS, Goh AC (2015) External validation of Global Evaluative Assessment of Robotic Skills (GEARS). Surg Endosc 29(11):3261\u20133266. https:\/\/doi.org\/10.1007\/s00464-015-4070-8","journal-title":"Surg Endosc"},{"issue":"1","key":"13329_CR12","doi-asserted-by":"publisher","DOI":"10.1093\/bjs\/znad331","volume":"111","author":"MWE Boal","year":"2024","unstructured":"Boal MWE, Anastasiou D, Tesfai F, Ghamrawi W, Mazomenos E, Curtis N, Collins JW, Sridhar A, Kelly J, Stoyanov D, Francis NK (2024) Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review. Br J Surg 111(1):znad331. https:\/\/doi.org\/10.1093\/bjs\/znad331","journal-title":"Br J Surg"},{"issue":"2","key":"13329_CR13","doi-asserted-by":"publisher","first-page":"384","DOI":"10.1097\/SLA.0000000000003220","volume":"272","author":"RM Satava","year":"2020","unstructured":"Satava RM, Stefanidis D, Levy JS, Smith R, Martin JR, Monfared S, Timsina LR, Darzi AW, Moglia A, Brand TC, Dorin RP, Dumon KR, Francone TD, Georgiou E, Goh AC, Marcet JE, Martino MA, Sudan R, Vale J, Gallagher AG (2020) Proving the effectiveness of the fundamentals of robotic surgery (FRS) skills curriculum: a single-blinded, multispecialty, multi-institutional randomized control trial. Ann Surg 272(2):384\u2013392. https:\/\/doi.org\/10.1097\/SLA.0000000000003220","journal-title":"Ann Surg"},{"issue":"2","key":"13329_CR14","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1097\/SLA.0000000000000520","volume":"261","author":"I Ghaderi","year":"2015","unstructured":"Ghaderi I, Manji F, Park YS, Juul D, Ott M, Harris I, Farrell TM (2015) Technical skills assessment toolbox: a review using the unitary framework of validity. Ann Surg 261(2):251\u2013262. https:\/\/doi.org\/10.1097\/SLA.0000000000000520","journal-title":"Ann Surg"},{"issue":"4","key":"13329_CR15","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1037\/h0040957","volume":"52","author":"LJ Cronbach","year":"1955","unstructured":"Cronbach LJ, Meehl PE (1955) Construct validity in psychological tests. Psychol Bull 52(4):281\u2013302. https:\/\/doi.org\/10.1037\/h0040957","journal-title":"Psychol Bull"},{"issue":"9","key":"13329_CR16","doi-asserted-by":"publisher","first-page":"830","DOI":"10.1046\/j.1365-2923.2003.01594.x","volume":"37","author":"SM Downing","year":"2003","unstructured":"Downing SM (2003) Validity: on meaningful interpretation of assessment data. Med Educ 37(9):830\u2013837. https:\/\/doi.org\/10.1046\/j.1365-2923.2003.01594.x","journal-title":"Med Educ"}],"container-title":["Surgical Endoscopy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00464-026-13329-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00464-026-13329-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00464-026-13329-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T19:29:24Z","timestamp":1790018964000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00464-026-13329-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,21]]},"references-count":16,"alternative-id":["13329"],"URL":"https:\/\/doi.org\/10.1007\/s00464-026-13329-9","relation":{},"ISSN":["0930-2794","1432-2218"],"issn-type":[{"value":"0930-2794","type":"print"},{"value":"1432-2218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,21]]},"assertion":[{"value":"11 May 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 August 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 September 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Blake T. Beneville, Abigail J. Hatcher, and Michael M. Awad have no conflicts of interest or financial ties to disclose.","order":1,"name":"Ethics","label":"Disclosures","group":{"name":"EthicsHeading","label":"Ethics"}}]}}