{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T03:46:41Z","timestamp":1792813601501,"version":"4.5.0"},"reference-count":21,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2025,9,15]],"date-time":"2025-09-15T00:00:00Z","timestamp":1757894400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,9,15]],"date-time":"2025-09-15T00:00:00Z","timestamp":1757894400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100009898","name":"Defense Health Agency","doi-asserted-by":"publisher","award":["DS21RES39"],"award-info":[{"award-number":["DS21RES39"]}],"id":[{"id":"10.13039\/100009898","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Surg Endosc"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Robotic-assisted surgery has increased in prevalence, particularly in general surgery. The number of cases required to achieve adequate proficiency in robotic surgery, however, and the training metrics that correlate best with proficiency remain unclear. We sought to better define proficiency-based benchmarks in robotic-assisted cholecystectomies (RAC) and inguinal hernia repairs (RIHR) using a commercial crowd source based on competency platform.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Multi-institutional cohort study in which 48 surgeons (senior residents, fellows, and practicing physicians) submitted representative videos of themselves performing a RAC and\/or RIHR. Subjects subsequently underwent blinded case video reviews using the C-SATS platform, which utilizes the Global Evaluative Assessment of Robotic Skills (GEARS) rubric. Participating surgeons self-reported surgical case volume. Primary outcome was correlation of GEARS scores with historic procedure case volume. Secondary outcomes included construct validity of GEARS scores as an operative proficiency metric.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Total GEARS scores and historical case volume showed positive correlation for both RAC (\n                      <jats:italic>r<\/jats:italic>\n                      \u2009=\u20090.65,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.0001) and RIHR (\n                      <jats:italic>r<\/jats:italic>\n                      \u2009=\u20090.54,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.001) among all performers. On subgroup analysis, no correlation was seen for resident\/fellow physicians (\n                      <jats:italic>r<\/jats:italic>\n                      \u2009=\u20090.39,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.11 for RAC;\n                      <jats:italic>r<\/jats:italic>\n                      \u2009=\u20090.22,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.49 for RIHR) or those with\u2009&lt;\u200950 historic case volume (\n                      <jats:italic>r<\/jats:italic>\n                      \u2009=\u20090.14,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.55 for RAC;\n                      <jats:italic>r\u2009<\/jats:italic>\n                      =\u20090.21,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.54 for RIHR). No difference in total GEARS scores was seen between resident\/fellow and practicing physicians for either RAC (20.21 v 20.25,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.82) or RIHR (20.45 v 20.46,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.95), nor in those with\u2009&lt;\u200950 or\u2009\u2265\u200950 historic case volume in RAC (20.16 v 20.33,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.33) and RIHR (20.35 v 20.49,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.48). GEARS scores by domain (bimanual dexterity, depth perception, efficiency, force sensitivity, and robotic control) and surgical step (exposure of triangle of calot, clipping and division of cystic artery\/duct, and dissection of gallbladder; mobilizing peritoneal flap, hernia sac dissection, and mesh placement) were similar across both groups (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&gt;\u20090.05).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>C-SATS-derived GEARS scores correlated to overall surgeon historical case volume for RA cholecystectomy and IHR, but not among novice performers. This methodology was unable to differentiate between novice and expert performers for these procedures. There remains a need for high-fidelity and discerning robotic skills evaluation platforms for trainees and novice surgeons.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Graphical abstract<\/jats:title>\n                  <\/jats:sec>","DOI":"10.1007\/s00464-025-12150-0","type":"journal-article","created":{"date-parts":[[2025,9,15]],"date-time":"2025-09-15T15:55:15Z","timestamp":1757951715000},"page":"8099-8104","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Evaluating the evaluators: does C-SATS measure up?"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4092-5660","authenticated-orcid":false,"given":"Robert B.","family":"Laverty","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charles H.","family":"Chesnut","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph R.","family":"Karam","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph C.","family":"L\u2019Huillier","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Bonte","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julie M.","family":"Clanahan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jisuk","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Yoon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert W.","family":"Krell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,9,15]]},"reference":[{"key":"12150_CR1","doi-asserted-by":"publisher","DOI":"10.1001\/jamasurg.2017.0841","author":"JC Pradarelli","year":"2017","unstructured":"Pradarelli JC, Thornton JP, Dimick JB (2017) Who is responsible for the safe introduction of new surgical technology?: an important legal precedent from the da Vinci surgical system trials. JAMA Surg. https:\/\/doi.org\/10.1001\/jamasurg.2017.0841","journal-title":"JAMA Surg"},{"issue":"2","key":"12150_CR2","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1111\/jhq.12036","volume":"37","author":"MA Cooper","year":"2015","unstructured":"Cooper MA, Ibrahim A, Lyu H, Makary MA (2015) Underreporting of robotic surgery complications. J Healthc Qual 37(2):133\u2013138. https:\/\/doi.org\/10.1111\/jhq.12036","journal-title":"J Healthc Qual"},{"issue":"5","key":"12150_CR3","doi-asserted-by":"publisher","first-page":"2104","DOI":"10.1007\/s00464-020-07608-2","volume":"35","author":"EM Huffman","year":"2021","unstructured":"Huffman EM, Rosen SA, Levy JS, Martino MA, Stefanidis D (2021) Are current credentialing requirements for robotic surgery adequate to ensure surgeon proficiency? Surg Endosc 35(5):2104\u20132109. https:\/\/doi.org\/10.1007\/s00464-020-07608-2","journal-title":"Surg Endosc"},{"issue":"15","key":"12150_CR4","doi-asserted-by":"publisher","first-page":"1434","DOI":"10.1056\/NEJMsa1300625","volume":"369","author":"JD Birkmeyer","year":"2013","unstructured":"Birkmeyer JD, Finks JF, O\u2019Reilly A et al (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369(15):1434\u20131442. https:\/\/doi.org\/10.1056\/NEJMsa1300625","journal-title":"N Engl J Med"},{"issue":"3","key":"12150_CR5","doi-asserted-by":"publisher","first-page":"482","DOI":"10.1097\/SLA.0000000000001862","volume":"264","author":"ME Hogg","year":"2016","unstructured":"Hogg ME, Zenati M, Novak S et al (2016) Grading of surgeon technical performance predicts postoperative pancreatic fistula for pancreaticoduodenectomy independent of patient-related variables. Ann Surg 264(3):482\u2013491. https:\/\/doi.org\/10.1097\/SLA.0000000000001862","journal-title":"Ann Surg"},{"issue":"5","key":"12150_CR6","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1001\/jamasurg.2017.0025","volume":"152","author":"V Tam","year":"2017","unstructured":"Tam V, Zeh HJ, Hogg ME (2017) Incorporating metrics of surgical proficiency into credentialing and privileging pathways. JAMA Surg 152(5):494\u2013495. https:\/\/doi.org\/10.1001\/jamasurg.2017.0025","journal-title":"JAMA Surg"},{"issue":"4","key":"12150_CR7","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1016\/j.amjsurg.2018.07.053","volume":"217","author":"V Tam","year":"2019","unstructured":"Tam V, Borrebach J, Dunn SA, Bellon J, Zeh HJ, Hogg ME (2019) Proficiency-based training and credentialing can improve patient outcomes and decrease cost to a hospital system. Am J Surg 217(4):591\u2013596. https:\/\/doi.org\/10.1016\/j.amjsurg.2018.07.053","journal-title":"Am J Surg"},{"issue":"12","key":"12150_CR8","doi-asserted-by":"publisher","first-page":"4850","DOI":"10.1007\/s00464-018-6236-7","volume":"32","author":"F Muysoms","year":"2018","unstructured":"Muysoms F, Van Cleven S, Kyle-Leinhase I, Ballecer C, Ramaswamy A (2018) Robotic-assisted laparoscopic groin hernia repair: observational case-control study on the operative time during the learning curve. Surg Endosc 32(12):4850\u20134859. https:\/\/doi.org\/10.1007\/s00464-018-6236-7","journal-title":"Surg Endosc"},{"key":"12150_CR9","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1016\/j.jss.2018.09.070","volume":"235","author":"V Tam","year":"2019","unstructured":"Tam V, Rogers DE, Al-Abbas A et al (2019) Robotic inguinal hernia repair: a large health system\u2019s experience with the first 300 cases and review of the literature. J Surg Res 235:98\u2013104. https:\/\/doi.org\/10.1016\/j.jss.2018.09.070","journal-title":"J Surg Res"},{"issue":"11","key":"12150_CR10","doi-asserted-by":"publisher","first-page":"4583","DOI":"10.1007\/s00464-017-5520-2","volume":"31","author":"LIM Pernar","year":"2017","unstructured":"Pernar LIM, Robertson FC, Tavakkoli A, Sheu EG, Brooks DC, Smink DS (2017) An appraisal of the learning curve in robotic general surgery. Surg Endosc 31(11):4583\u20134596. https:\/\/doi.org\/10.1007\/s00464-017-5520-2","journal-title":"Surg Endosc"},{"issue":"9","key":"12150_CR11","doi-asserted-by":"publisher","first-page":"5303","DOI":"10.1007\/s00464-020-08019-z","volume":"35","author":"P Addison","year":"2021","unstructured":"Addison P, Yoo A, Duarte-Ramos J et al (2021) Correlation between operative time and crowd-sourced skills assessment for robotic bariatric surgery. Surg Endosc 35(9):5303\u20135309. https:\/\/doi.org\/10.1007\/s00464-020-08019-z","journal-title":"Surg Endosc"},{"issue":"3","key":"12150_CR12","doi-asserted-by":"publisher","first-page":"2281","DOI":"10.1007\/s00464-022-09466-6","volume":"37","author":"S Balvardi","year":"2023","unstructured":"Balvardi S, Semsar-Kazerooni K, Kaneva P et al (2023) Validity of video-based general and procedure-specific self-assessment tools for surgical trainees in laparoscopic cholecystectomy. Surg Endosc 37(3):2281\u20132289. https:\/\/doi.org\/10.1007\/s00464-022-09466-6","journal-title":"Surg Endosc"},{"issue":"11","key":"12150_CR13","doi-asserted-by":"publisher","first-page":"3261","DOI":"10.1007\/s00464-015-4070-8","volume":"29","author":"MA Aghazadeh","year":"2015","unstructured":"Aghazadeh MA, Jayaratna IS, Hung AJ et al (2015) External validation of global evaluative assessment of robotic skills (GEARS). Surg Endosc 29(11):3261\u20133266. https:\/\/doi.org\/10.1007\/s00464-015-4070-8","journal-title":"Surg Endosc"},{"issue":"3","key":"12150_CR14","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1007\/s11701-015-0513-4","volume":"9","author":"DJ Kiely","year":"2015","unstructured":"Kiely DJ, Gotlieb WH, Lau S et al (2015) Virtual reality robotic surgery simulation curriculum to teach robotic suturing: a randomized controlled trial. J Robot Surg 9(3):179\u2013186. https:\/\/doi.org\/10.1007\/s11701-015-0513-4","journal-title":"J Robot Surg"},{"issue":"1","key":"12150_CR15","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1016\/j.juro.2011.09.032","volume":"187","author":"AC Goh","year":"2012","unstructured":"Goh AC, Goldfarb DW, Sander JC, Miles BJ, Dunkin BJ (2012) Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J Urol 187(1):247\u2013252. https:\/\/doi.org\/10.1016\/j.juro.2011.09.032","journal-title":"J Urol"},{"issue":"10","key":"12150_CR16","doi-asserted-by":"publisher","first-page":"1183","DOI":"10.1089\/end.2015.0104","volume":"29","author":"D Holst","year":"2015","unstructured":"Holst D, Kowalewski TM, White LW et al (2015) Crowd-sourced assessment of technical skills: differentiating animate surgical skill through the wisdom of crowds. J Endourol 29(10):1183\u20131188. https:\/\/doi.org\/10.1089\/end.2015.0104","journal-title":"J Endourol"},{"issue":"1","key":"12150_CR17","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/j.jss.2013.09.024","volume":"187","author":"C Chen","year":"2014","unstructured":"Chen C, White L, Kowalewski T et al (2014) Crowd-sourced assessment of technical skills: a novel method to evaluate surgical performance. J Surg Res 187(1):65\u201371. https:\/\/doi.org\/10.1016\/j.jss.2013.09.024","journal-title":"J Surg Res"},{"key":"12150_CR18","doi-asserted-by":"publisher","DOI":"10.1136\/bcr-2017-222190","author":"L Dai","year":"2018","unstructured":"Dai L, Shah MM, Rosenblatt S (2018) Perforated gastric remnant ulcer after laparoscopic gastric bypass. BMJ Case Rep. https:\/\/doi.org\/10.1136\/bcr-2017-222190","journal-title":"BMJ Case Rep"},{"issue":"11","key":"12150_CR19","doi-asserted-by":"publisher","first-page":"1086","DOI":"10.1001\/jamasurg.2015.2405","volume":"150","author":"TS Lendvay","year":"2015","unstructured":"Lendvay TS, White L, Kowalewski T (2015) Crowdsourcing to assess surgical skill. JAMA Surg 150(11):1086\u20131087. https:\/\/doi.org\/10.1001\/jamasurg.2015.2405","journal-title":"JAMA Surg"},{"issue":"12","key":"12150_CR20","doi-asserted-by":"publisher","first-page":"1303","DOI":"10.1001\/jamasurg.2023.4389","volume":"158","author":"S Kalata","year":"2023","unstructured":"Kalata S, Thumma JR, Norton EC, Dimick JB, Sheetz KH (2023) Comparative safety of robotic-assisted vs laparoscopic cholecystectomy. JAMA Surg 158(12):1303\u20131310. https:\/\/doi.org\/10.1001\/jamasurg.2023.4389","journal-title":"JAMA Surg"},{"issue":"6","key":"12150_CR21","doi-asserted-by":"publisher","first-page":"971","DOI":"10.1097\/TA.0000000000004240","volume":"96","author":"S Greenberg","year":"2024","unstructured":"Greenberg S, Abou Assali M, Li Y et al (2024) Robotic care outcomes project for acute gallbladder pathology. J Trauma Acute Care Surg 96(6):971\u2013979. https:\/\/doi.org\/10.1097\/TA.0000000000004240","journal-title":"J Trauma Acute Care Surg"}],"container-title":["Surgical Endoscopy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00464-025-12150-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00464-025-12150-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00464-025-12150-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,16]],"date-time":"2025-12-16T20:44:35Z","timestamp":1765917875000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00464-025-12150-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,15]]},"references-count":21,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["12150"],"URL":"https:\/\/doi.org\/10.1007\/s00464-025-12150-0","relation":{},"ISSN":["0930-2794","1432-2218"],"issn-type":[{"value":"0930-2794","type":"print"},{"value":"1432-2218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,15]]},"assertion":[{"value":"24 October 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 August 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 September 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Dr. Joseph Karam serves as a proctor for Intuitive and Dr. Charles Chesnut receives consulting fees from Johnson & Johnson MedTech. The views expressed herein are those of the author(s) and do not reflect the official policy or position of Brooke Army Medical Center, the U.S. Army Medical Department, the U.S. Army Office of the Surgeon General, the Department of the Army, the Department of the Air Force, or the Department of Defense, or the U.S. Government. Drs. Robert Laverty, Robert Krell, Joseph L\u2019Huillier, Alexander Bonte, Julie Clanahan, Brian Yoon, and Jsiuk Park have no conflicts of interest or financial ties to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclosures"}}]}}