{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T21:56:08Z","timestamp":1766267768088,"version":"3.37.3"},"reference-count":18,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T00:00:00Z","timestamp":1657238400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T00:00:00Z","timestamp":1657238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007601","name":"Horizon 2020","doi-asserted-by":"publisher","award":["732515"],"award-info":[{"award-number":["732515"]}],"id":[{"id":"10.13039\/501100007601","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"Abstract<\/jats:title>\n \n Purpose<\/jats:bold>\n <\/jats:title>\n Advanced developments in the medical field have gradually increased the public demand for surgical skill evaluation. However, this assessment always depends on the direct observation of experienced surgeons, which is time-consuming and variable. The introduction of robot-assisted surgery provides a new possibility for this evaluation paradigm. This paper aims at evaluating surgeon performance automatically with novel evaluation metrics based on different surgical data.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:bold>\n <\/jats:title>\n Urologists ($$n=10$$<\/jats:tex-math>\n \n n<\/mml:mi>\n =<\/mml:mo>\n 10<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math><\/jats:alternatives><\/jats:inline-formula>) from a hospital were requested to perform a simplified neobladder reconstruction on an ex vivo setup twice with different camera modalities ($$n=2$$<\/jats:tex-math>\n \n n<\/mml:mi>\n =<\/mml:mo>\n 2<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math><\/jats:alternatives><\/jats:inline-formula>) randomly. They were divided into novices and experts ($$n=5$$<\/jats:tex-math>\n \n n<\/mml:mi>\n =<\/mml:mo>\n 5<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math><\/jats:alternatives><\/jats:inline-formula>, respectively) according to their experience in robot-assisted surgeries. Different performance metrics ($$n=2$$<\/jats:tex-math>\n \n n<\/mml:mi>\n =<\/mml:mo>\n 2<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math><\/jats:alternatives><\/jats:inline-formula>) are proposed to achieve the surgical skill evaluation, considering both instruments and endoscope. Also, nonparametric tests are adopted to check if there are significant differences when evaluating surgeons performance.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:bold>\n <\/jats:title>\n When grouping according to four stages of neobladder reconstruction, statistically significant differences can be appreciated in phase 1 ($$p=0.0284$$<\/jats:tex-math>\n \n p<\/mml:mi>\n =<\/mml:mo>\n 0.0284<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math><\/jats:alternatives><\/jats:inline-formula>) and phase 2 ($$p=0.01953$$<\/jats:tex-math>\n \n p<\/mml:mi>\n =<\/mml:mo>\n 0.01953<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math><\/jats:alternatives><\/jats:inline-formula>) with normalized time-related metrics and camera movement-related metrics, respectively. On the other hand, considering experience grouping shows that both metrics are able to highlight statistically significant differences between novice and expert performances in the control protocol. It also shows that the camera-related performance of experts is significantly different ($$p=0.003153$$<\/jats:tex-math>\n \n p<\/mml:mi>\n =<\/mml:mo>\n 0.003153<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math><\/jats:alternatives><\/jats:inline-formula>) when handling the endoscope manually and when it is automatic.<\/jats:p>\n <\/jats:sec>\n \n Conclusion<\/jats:bold>\n <\/jats:title>\n Surgical skill evaluation, using the approach in this paper, can effectively measure surgical procedures of surgeons with different experience. Preliminary results demonstrate that different surgical data can be fully utilized to improve the reliability of surgical evaluation. It also demonstrates its versatility and potential in the quantitative assessment of various surgical operations.<\/jats:p>\n <\/jats:sec>","DOI":"10.1007\/s11548-022-02712-1","type":"journal-article","created":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T11:02:54Z","timestamp":1657278174000},"page":"2315-2323","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Robot-assisted ex vivo neobladder reconstruction: preliminary results of surgical skill evaluation"],"prefix":"10.1007","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3077-822X","authenticated-orcid":false,"given":"Ziyang","family":"Chen","sequence":"first","affiliation":[]},{"given":"Serenella","family":"Terlizzi","sequence":"additional","affiliation":[]},{"given":"Tommaso","family":"Da Col","sequence":"additional","affiliation":[]},{"given":"Aldo","family":"Marzullo","sequence":"additional","affiliation":[]},{"given":"Michele","family":"Catellani","sequence":"additional","affiliation":[]},{"given":"Giancarlo","family":"Ferrigno","sequence":"additional","affiliation":[]},{"given":"Elena","family":"De Momi","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,7,8]]},"reference":[{"issue":"6","key":"2712_CR1","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.jsurg.2019.06.002","volume":"76","author":"S Shebrain","year":"2019","unstructured":"Shebrain S, Mahmood G, Munene G, Miller L, Collins J, Sawyer R (2019) The role of manual dexterity and cognitive functioning in enhancing resident operative autonomy. J Surg Educ 76(6):66\u201376","journal-title":"J Surg Educ"},{"issue":"2","key":"2712_CR2","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1007\/s00464-010-1190-z","volume":"25","author":"CE Reiley","year":"2011","unstructured":"Reiley CE, Lin HC, Yuh DD, Hager GD (2011) Review of methods for objective surgical skill evaluation. Surg Endosc 25(2):356\u2013366","journal-title":"Surg Endosc"},{"issue":"3","key":"2712_CR3","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1097\/SLA.0000000000002478","volume":"269","author":"DP Azari","year":"2019","unstructured":"Azari DP, Frasier LL, Quamme SRP, Greenberg CC, Pugh C, Greenberg JA, Radwin RG (2019) Modeling surgical technical skill using expert assessment for automated computer rating. Ann Surg 269(3):574","journal-title":"Ann Surg"},{"issue":"8","key":"2712_CR4","doi-asserted-by":"publisher","first-page":"1449","DOI":"10.1007\/s11548-019-01980-8","volume":"14","author":"S Kobayashi","year":"2019","unstructured":"Kobayashi S, Cho B, Huaulm\u00e9 A, Tatsugami K, Honda H, Jannin P, Hashizumea M, Eto M (2019) Assessment of surgical skills by using surgical navigation in robot-assisted partial nephrectomy. Int J Comput Assist Radiol Surg 14(8):1449\u20131459","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"5","key":"2712_CR5","doi-asserted-by":"publisher","first-page":"1348","DOI":"10.1016\/j.jsurg.2019.02.010","volume":"76","author":"D Azari","year":"2019","unstructured":"Azari D, Greenberg C, Pugh C, Wiegmann D, Radwin R (2019) In search of characterizing surgical skill. J Surg Educ 76(5):1348\u20131363","journal-title":"J Surg Educ"},{"issue":"4","key":"2712_CR6","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1007\/s10459-011-9322-3","volume":"17","author":"IW Ma","year":"2012","unstructured":"Ma IW, Zalunardo N, Pachev G, Beran T, Brown M, Hatala R, McLaughlin K (2012) Comparing the use of global rating scale with checklists for the assessment of central venous catheterization skills using simulation. Adv Health Sci Educ 17(4):457\u2013470","journal-title":"Adv Health Sci Educ"},{"issue":"3","key":"2712_CR7","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1016\/j.juro.2018.06.078","volume":"201","author":"J Chen","year":"2019","unstructured":"Chen J, Cheng N, Cacciamani G, Oh P, Lin-Brande M, Remulla D, Gill IS, Hung AJ (2019) Objective assessment of robotic surgical technical skill: a systematic review. Journal urol 201(3):461\u2013469","journal-title":"Journal urol"},{"issue":"8","key":"2712_CR8","first-page":"141","volume":"16","author":"R Nagyn\u00e9 Elek","year":"2019","unstructured":"Nagyn\u00e9 Elek R, Haidegger T (2019) Robot-assisted minimally invasive surgical skill assessment-manual and automated platforms. Acta Polytech Hung 16(8):141\u2013169","journal-title":"Acta Polytech Hung"},{"key":"2712_CR9","doi-asserted-by":"crossref","unstructured":"Zia A, Essa I (2018) Automated surgical skill assessment in rmis training. Int J Comput Assist Radiol Surg 13(5):731\u2013739","DOI":"10.1007\/s11548-018-1735-5"},{"key":"2712_CR10","doi-asserted-by":"crossref","unstructured":"Zia A, Sharma Y, Bettadapura V, Sarin EL, Clements MA, and Essa I (2015) Automated assessment of surgical skills using frequency analysis. In: International conference on medical image computing and computer-assisted intervention (pp. 430-438). Springer","DOI":"10.1007\/978-3-319-24553-9_53"},{"key":"2712_CR11","doi-asserted-by":"crossref","unstructured":"Da Col T, Mariani A, Deguet A, Menciassi A, Kazanzides P, and De Momi E (2020) Scan: System for camera autonomous navigation in robotic-assisted surgery. In: 2020 IEEE\/RSJ International conference on intelligent robots and systems (IROS) (pp. 2996-3002). IEEE","DOI":"10.1109\/IROS45743.2020.9341548"},{"key":"2712_CR12","doi-asserted-by":"crossref","unstructured":"Kazanzides P, Chen Z, Deguet A, Fischer GS, Taylor RH, and DiMaio SP (2014) An open-source research kit for the da Vinci\u00ae Surgical System. In: 2014 IEEE international conference on robotics and automation (ICRA) (pp. 6434-6439). IEEE","DOI":"10.1109\/ICRA.2014.6907809"},{"key":"2712_CR13","doi-asserted-by":"crossref","unstructured":"Vasconcelos F, Mazomenos E, Kelly J, Stoyanov D (2019) Rcm-slam: Visual localisation and mapping under remote centre of motion constraints. In: 2019 International conference on robotics and automation (ICRA), pp. 9278\u20139284","DOI":"10.1109\/ICRA.2019.8793931"},{"key":"2712_CR14","first-page":"371","volume":"I","author":"T Da Col","year":"2021","unstructured":"Da Col T, Caccianiga G, Catellani M, Mariani A, Ferro M, Cordima G, De Momi E, Ferrigno G, de Cobelli O (2021) Automating endoscope motion in robotic surgery: a usability study on da vinci-assisted ex vivo neobladder reconstruction. Front Robot A I:371","journal-title":"Front Robot A"},{"issue":"2","key":"2712_CR15","doi-asserted-by":"publisher","first-page":"1461","DOI":"10.1109\/LRA.2020.2965067","volume":"5","author":"A Mariani","year":"2020","unstructured":"Mariani A, Colaci G, Da Col T, Sanna N, Vendrame E, Menciassi A, De Momi E (2020) An experimental comparison towards autonomous camera navigation to optimize training in robot assisted surgery. IEEE Robot Autom Lett 5(2):1461\u20131467","journal-title":"IEEE Robot Autom Lett"},{"issue":"3","key":"2712_CR16","doi-asserted-by":"publisher","first-page":"1192","DOI":"10.1007\/s00464-016-5090-8","volume":"31","author":"AM Jarc","year":"2017","unstructured":"Jarc AM, Curet MJ (2017) Viewpoint matters: objective performance metrics for surgeon endoscope control during robot-assisted surgery. Surg Endosc 31(3):1192\u20131202","journal-title":"Surg Endosc"},{"issue":"1","key":"2712_CR17","doi-asserted-by":"publisher","first-page":"1850","DOI":"10.1002\/rcs.1850","volume":"14","author":"MJ Fard","year":"2018","unstructured":"Fard MJ, Ameri S, Darin Ellis R, Chinnam RB, Pandya AK, Klein MD (2018) Automated robot-assisted surgical skill evaluation: predictive analytics approach. Int J Med Robot Comput Assist Surg 14(1):1850","journal-title":"Int J Med Robot Comput Assist Surg"},{"issue":"4","key":"2712_CR18","doi-asserted-by":"publisher","first-page":"696","DOI":"10.1002\/asmb.2526","volume":"36","author":"MV Koutras","year":"2020","unstructured":"Koutras MV, Triantafyllou IS (2020) Wilcoxon-type rank-sum statistics for selecting the best population: some advances. Appl Stoch Models Bus Ind 36(4):696\u2013715","journal-title":"Appl Stoch Models Bus Ind"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-022-02712-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-022-02712-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-022-02712-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,11]],"date-time":"2022-11-11T14:14:17Z","timestamp":1668176057000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-022-02712-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,8]]},"references-count":18,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["2712"],"URL":"https:\/\/doi.org\/10.1007\/s11548-022-02712-1","relation":{},"ISSN":["1861-6429"],"issn-type":[{"type":"electronic","value":"1861-6429"}],"subject":[],"published":{"date-parts":[[2022,7,8]]},"assertion":[{"value":"6 February 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 June 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}},{"value":"The studies involving human participants were reviewed and approved by the Politecnico di Milano Ethical Committee. The patients\/participants provided their written informed consent to participate in this study. The animal study was reviewed and approved by the Politecnico di Milano Ethical Committee (authorization 16\/2020).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}