{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,26]],"date-time":"2026-04-26T17:10:04Z","timestamp":1777223404731,"version":"3.51.4"},"reference-count":74,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T00:00:00Z","timestamp":1716422400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T00:00:00Z","timestamp":1716422400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100019266","name":"Korea Medical Device Development Fund","doi-asserted-by":"publisher","award":["1711174462, RS-2020-KD000123"],"award-info":[{"award-number":["1711174462, RS-2020-KD000123"]}],"id":[{"id":"10.13039\/100019266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002551","name":"Seoul National University","doi-asserted-by":"publisher","award":["800-20230385"],"award-info":[{"award-number":["800-20230385"]}],"id":[{"id":"10.13039\/501100002551","id-type":"DOI","asserted-by":"publisher"}]},{"name":"SNUH Research Fund","award":["1920230020"],"award-info":[{"award-number":["1920230020"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Virtual Reality"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Robotic surgery is preferred over open or laparoscopic surgeries due to its intuitiveness and convenience. However, prolonged use of surgical robots can cause neck pain and joint fatigue in wrist and fingers. Also, input systems are bulky and difficult to maintain. To resolve these issues, we propose a novel input module based on real-time 3D hand tracking driven by RGB images and MediaPipe framework to control surgical robots such as patient side manipulator (PSM) and endoscopic camera manipulator (ECM) of da Vinci research kit. In this paper, we explore the mathematical basis of the proposed 3D hand tracking module and provide a proof-of-concept through user experience (UX) studies conducted in a virtual environment. End-to-end latencies for controlling PSM and ECM were 170 \u00b1 10 ms and 270 \u00b1 10 ms, respectively. Of fifteen novice participants recruited for the UX study, thirteen managed to reach a qualifiable level of proficiency after 50 min of practice and fatigue of hand and wrist were imperceivable. Therefore, we concluded that we have successfully developed a robust 3D hand tracking module for surgical robot control and in the future, it would hopefully reduce hardware cost and volume as well as resolve ergonomic problems. Furthermore, RGB image driven 3D hand tracking module developed in our study can be widely applicable to diverse fields such as extended reality (XR) development and remote robot control. In addition, we provide a new standard for evaluating novel input modalities of XR environments from a UX perspective.<\/jats:p>","DOI":"10.1007\/s10055-024-00986-1","type":"journal-article","created":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T04:01:55Z","timestamp":1716436915000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Unconstrained lightweight control interface for robot-assisted minimally invasive surgery using MediaPipe framework and head-mounted display"],"prefix":"10.1007","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7770-5760","authenticated-orcid":false,"given":"Wounsuk","family":"Rhee","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1231-9097","authenticated-orcid":false,"given":"Young Gyun","family":"Kim","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1989-5997","authenticated-orcid":false,"given":"Jong Hyeon","family":"Lee","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3940-1309","authenticated-orcid":false,"given":"Jae Woo","family":"Shim","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8767-9842","authenticated-orcid":false,"given":"Byeong Soo","family":"Kim","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5657-5984","authenticated-orcid":false,"given":"Dan","family":"Yoon","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2242-4747","authenticated-orcid":false,"given":"Minwoo","family":"Cho","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9318-849X","authenticated-orcid":false,"given":"Sungwan","family":"Kim","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,5,23]]},"reference":[{"key":"986_CR70","doi-asserted-by":"publisher","unstructured":"Amprimo G, Masi G, Pettiti G, Olmo G, Priano L, Ferraris C (2023). Hand tracking for clinical applications: validation of the Google MediaPipe Hand (GMH) and the depth-enhanced GMH-D frameworks. arXiv preprint arXiv:2308.01088. https:\/\/doi.org\/10.48550\/arXiv.2308.01088","DOI":"10.48550\/arXiv.2308.01088"},{"key":"986_CR58","doi-asserted-by":"publisher","first-page":"103368","DOI":"10.1016\/j.bspc.2021.103368","volume":"72","author":"MZ Amrani","year":"2022","unstructured":"Amrani MZ, Borst CW, Achour N (2022). Multi-sensory assessment for hand pattern recognition. Biomed Signal Process Control 72:103368. https:\/\/doi.org\/10.1016\/j.bspc.2021.103368","journal-title":"Biomedical Signal Processing and Control"},{"issue":"2","key":"986_CR1","doi-asserted-by":"publisher","first-page":"93","DOI":"10.3109\/10929080500228654","volume":"10","author":"M Anvari","year":"2005","unstructured":"Anvari M, Broderick T, Stein H, Chapman T, Ghodoussi M, Birch DW, Mckinley C, Trudeau P, Dutta S, Goldsmith CH (2005) The impact of latency on surgical precision and task completion during robotic-assisted remote telepresence surgery. Comput Aided Surg 10(2):93\u201399. https:\/\/doi.org\/10.3109\/10929080500228654","journal-title":"Comput Aided Surg"},{"issue":"3","key":"986_CR2","doi-asserted-by":"publisher","first-page":"e2014","DOI":"10.4293\/JSLS.2014.00399","volume":"18","author":"GM Badalato","year":"2014","unstructured":"Badalato GM, Shapiro E, Rothberg MB, Bergman A, RoyChoudhury A, Korets R, Patel T, Badani KK (2014) The Da Vinci robot system eliminates multispecialty surgical trainees\u2019 hand dominance in open and robotic surgical settings. JSLS 18(3):e2014. https:\/\/doi.org\/10.4293\/JSLS.2014.00399","journal-title":"JSLS"},{"issue":"3","key":"986_CR3","doi-asserted-by":"publisher","first-page":"114","DOI":"10.5555\/2835587.2835589","volume":"4","author":"A Bangor","year":"2009","unstructured":"Bangor A, Kortum P, Miller J (2009) Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud 4(3):114\u2013123. https:\/\/doi.org\/10.5555\/2835587.2835589","journal-title":"J Usability Stud"},{"issue":"6","key":"986_CR4","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1080\/10447310802205776","volume":"24","author":"A Bangor","year":"2008","unstructured":"Bangor A, Kortum PT, Miller JT (2008) An empirical evaluation of the system usability scale. Int J Hum\u2013Comput Interact 24(6):574\u2013594. https:\/\/doi.org\/10.1080\/10447310802205776","journal-title":"Int J Hum\u2013Comput Interact"},{"issue":"8","key":"986_CR5","doi-asserted-by":"publisher","first-page":"701","DOI":"10.1056\/NEJMp1006602","volume":"363","author":"GI Barbash","year":"2010","unstructured":"Barbash GI, Glied SA (2010) New technology and health care costs\u2013the case of robot-assisted surgery. N Engl J Med 363(8):701\u2013704. https:\/\/doi.org\/10.1056\/NEJMp1006602","journal-title":"N Engl J Med"},{"issue":"9","key":"986_CR6","doi-asserted-by":"publisher","first-page":"1362","DOI":"10.1002\/bjs.1800810936","volume":"81","author":"U Berggren","year":"1994","unstructured":"Berggren U, Gordh T, Grama D, Haglund U, Rastad J, Arvidsson D (1994) Laparoscopic versus open cholecystectomy: hospitalization, sick leave, analgesia and trauma responses. J Br Surg 81(9):1362\u20131365. https:\/\/doi.org\/10.1002\/bjs.1800810936","journal-title":"J Br Surg"},{"issue":"194","key":"986_CR7","first-page":"4","volume":"189","author":"J Brooke","year":"1996","unstructured":"Brooke J (1996) SUS-A quick and dirty usability scale. Usability Eval Ind 189(194):4\u20137","journal-title":"Usability Eval Ind"},{"key":"986_CR59","doi-asserted-by":"publisher","unstructured":"Buckingham G (2021). Hand tracking for immersive virtual reality: opportunities and challenges. Front Virtual Real 2:728461. https:\/\/doi.org\/10.3389\/frvir.2021.728461","DOI":"10.3389\/frvir.2021.728461"},{"issue":"15","key":"986_CR8","doi-asserted-by":"publisher","first-page":"1396","DOI":"10.1080\/10447318.2018.1533151","volume":"35","author":"NE Cagiltay","year":"2019","unstructured":"Cagiltay NE, Ozcelik E, Berker M, Dalveren GGM (2019) The underlying reasons of the navigation control effect on performance in a virtual reality endoscopic surgery training simulator. Int J Hum\u2013Comput Interact 35(15):1396\u20131403. https:\/\/doi.org\/10.1080\/10447318.2018.1533151","journal-title":"Int J Hum\u2013Comput Interact"},{"key":"986_CR9","doi-asserted-by":"publisher","unstructured":"Chen Z, Deguet A, Taylor RH, Kazanzides P (2017) Software architecture of the Da Vinci Research Kit. 2017 First IEEE Int Conf Robot Comput 180\u2013187. https:\/\/doi.org\/10.1109\/IRC.2017.69","DOI":"10.1109\/IRC.2017.69"},{"key":"986_CR10","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1016\/j.apergo.2017.11.016","volume":"68","author":"T Chihara","year":"2018","unstructured":"Chihara T, Seo A (2018) Evaluation of physical workload affected by mass and center of mass of head-mounted display. Appl Ergon 68:204\u2013212. https:\/\/doi.org\/10.1016\/j.apergo.2017.11.016","journal-title":"Appl Ergon"},{"key":"986_CR11","doi-asserted-by":"publisher","unstructured":"Codd-Downey R, Forooshani PM, Speers A, Wang H, Jenkin M (2014) From ROS to unity: leveraging robot and virtual environment middleware for immersive teleoperation. 2014 IEEE Int Conf Inf Autom 932\u2013936. https:\/\/doi.org\/10.1109\/ICInfA.2014.6932785","DOI":"10.1109\/ICInfA.2014.6932785"},{"issue":"6","key":"986_CR12","doi-asserted-by":"publisher","first-page":"e1218","DOI":"10.1097\/SLA.0000000000003805","volume":"274","author":"J Crippa","year":"2021","unstructured":"Crippa J, Grass F, Dozois EJ, Mathis KL, Merchea A, Colibaseanu DT, Kelley SR, Larson DW (2021) Robotic surgery for rectal cancer provides advantageous outcomes over laparoscopic approach: results from a large retrospective cohort. Ann Surg 274(6):e1218\u2013e1222. https:\/\/doi.org\/10.1097\/SLA.0000000000003805","journal-title":"Ann Surg"},{"issue":"1","key":"986_CR13","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1109\/MRA.2022.3141972","volume":"29","author":"A Danioni","year":"2022","unstructured":"Danioni A, Yavuz GC, Ozan DE, Momi ED, Koupparis A, Dogramadzi S (2022) A study on the dexterity of surgical robotic tools in a highly immersive virtual environment: assessing usability and efficacy. IEEE Robot Autom Mag 29(1):68\u201375. https:\/\/doi.org\/10.1109\/MRA.2022.3141972","journal-title":"IEEE Robot Autom Mag"},{"issue":"2","key":"986_CR14","doi-asserted-by":"publisher","first-page":"31","DOI":"10.3390\/robotics8020031","volume":"8","author":"T Dardona","year":"2019","unstructured":"Dardona T, Eslamian S, Reisner LA, Pandya A (2019) Remote presence: development and usability evaluation of a head-mounted display for camera control on the Da Vinci surgical system. Robotics 8(2):31. https:\/\/doi.org\/10.3390\/robotics8020031","journal-title":"Robotics"},{"key":"986_CR15","volume-title":"The Da Vinci surgical system. Surgical robotics: systems applications and visions","author":"S DiMaio","year":"2011","unstructured":"DiMaio S, Hanuschik M, Kreaden U (2011) The Da Vinci surgical system. Surgical robotics: systems applications and visions. Springer US, USA"},{"key":"986_CR16","volume-title":"The Da Vinci surgical system. Bariatric robotic surgery: a comprehensive guide","author":"J Douissard","year":"2019","unstructured":"Douissard J, Hagen ME, Morel P (2019) The Da Vinci surgical system. Bariatric robotic surgery: a comprehensive guide. Springer, Germany"},{"issue":"1","key":"986_CR17","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.eururo.2006.06.017","volume":"51","author":"V Ficarra","year":"2007","unstructured":"Ficarra V, Cavalleri S, Novara G, Aragona M, Artibani W (2007) Evidence from robot-assisted laparoscopic radical prostatectomy: a systematic review. Eur Urol 51(1):45\u201355. https:\/\/doi.org\/10.1016\/j.eururo.2006.06.017","journal-title":"Eur Urol"},{"issue":"2","key":"986_CR18","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1055\/s-2002-19857","volume":"34","author":"KH Fuchs","year":"2002","unstructured":"Fuchs KH (2002) Minimally invasive surgery. Endoscopy 34(2):154\u2013159. https:\/\/doi.org\/10.1055\/s-2002-19857","journal-title":"Endoscopy"},{"issue":"3","key":"986_CR19","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1016\/j.jmig.2013.11.010","volume":"21","author":"RB Gala","year":"2014","unstructured":"Gala RB, Margulies R, Steinberg A, Murphy M, Lukban J, Jeppson P, Aschkenazi S, Olivera C, South M, Lowenstein L, Schaffer J, Balk EM, Sung V (2014) Systematic review of robotic surgery in gynecology: robotic techniques compared with laparoscopy and laparotomy. J Minim Invasive Gynecol 21(3):353\u2013361. https:\/\/doi.org\/10.1016\/j.jmig.2013.11.010","journal-title":"J Minim Invasive Gynecol"},{"issue":"12","key":"986_CR20","doi-asserted-by":"publisher","first-page":"1461","DOI":"10.1002\/bjs.6015","volume":"94","author":"EH Gemmill","year":"2007","unstructured":"Gemmill EH, McCulloch P (2007) Systematic review of minimally invasive resection for gastro-oesophageal cancer. J Br Surg 94(12):1461\u20131467. https:\/\/doi.org\/10.1002\/bjs.6015","journal-title":"J Br Surg"},{"key":"986_CR60","doi-asserted-by":"publisher","unstructured":"Han S, Liu B, Cabezas R, Twigg CD, Zhang P, Petkau J., Yu TH, Tai CJ, Akbay M, Wang Z, Nitzan A, Dong G, Ye Y, Tao L, Wan C, and Wang, R. (2020). MEgATrack: monochrome egocentric articulated hand-tracking for virtual reality. ACM Transactions on Graphics (ToG), 39(4), 87-1. https:\/\/doi.org\/10.1145\/3386569.3392452","DOI":"10.1145\/3386569.3392452"},{"key":"986_CR61","doi-asserted-by":"publisher","unstructured":"Hong M, Rozenblit JW, and Hamilton AJ (2021). Simulation-based surgical training systems in laparoscopic surgery: a current review. Virtual Reality, 25, 491-510. https:\/\/doi.org\/10.1007\/s10055-020-00469-z","DOI":"10.1007\/s10055-020-00469-z"},{"issue":"3","key":"986_CR21","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1007\/s11517-018-1902-4","volume":"57","author":"N Hong","year":"2019","unstructured":"Hong N, Kim M, Lee C, Kim S (2019) Head-mounted interface for intuitive vision control and continuous surgical operation in a surgical robot system. Med Biol Eng Comput 57(3):601\u2013614. https:\/\/doi.org\/10.1007\/s11517-018-1902-4","journal-title":"Med Biol Eng Comput"},{"key":"986_CR62","unstructured":"HTC VIVE, https:\/\/www.vive.com\/us\/product\/vive-flow\/overview\/ (2022)."},{"issue":"2","key":"986_CR22","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1515\/iss-2017-0007","volume":"2","author":"CDPV Hullenaar","year":"2017","unstructured":"Hullenaar CDPV, Hermans B, Broeders IAMJ (2017) Ergonomic assessment of the Da Vinci console in robot-assisted surgery. Innov Surg Sci 2(2):97\u2013104. https:\/\/doi.org\/10.1515\/iss-2017-0007","journal-title":"Innov Surg Sci"},{"key":"986_CR23","doi-asserted-by":"publisher","unstructured":"Hussein A, Garc\u00eda F, Olaverri-Monreal C (2018) ROS and Unity based framework for intelligent vehicles control and simulation. 2018 IEEE Int Conf Veh Electron Saf 1\u20136. https:\/\/doi.org\/10.1109\/ICVES.2018.8519522","DOI":"10.1109\/ICVES.2018.8519522"},{"key":"986_CR63","doi-asserted-by":"publisher","unstructured":"Ito K, Tada M, Ujike H, and Hyodo K (2021). Effects of the weight and balance of head-mounted displays on physical load. Applied Sciences, 11(15), 6802. https:\/\/doi.org\/10.3390\/app11156802","DOI":"10.3390\/app11156802"},{"issue":"1","key":"986_CR24","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1007\/s12555-019-0244-9","volume":"18","author":"Y Jo","year":"2020","unstructured":"Jo Y, Kim YJ, Cho M, Lee C, Kim M, Moon HM, Kim S (2020) Virtual reality-based control of robotic endoscope in laparoscopic surgery. Int J Control Autom Syst 18(1):150\u2013162. https:\/\/doi.org\/10.1007\/s12555-019-0244-9","journal-title":"Int J Control Autom Syst"},{"key":"986_CR71","unstructured":"Kavana KM, Suma NR (2022). Recognization of Hand Gestures Using Mediapipe Hands. Int Res J Moderniz Eng Tech Sci 4(06)."},{"key":"986_CR25","doi-asserted-by":"publisher","unstructured":"Kazanzides P, Chen Z, Deguet A, Fischer GS, Taylor RH, DiMaio SP (2014) An open-source research kit for the da Vinci\u00ae Surgical System. 2014 IEEE Int Conf Robot Autom 6434\u20136439. https:\/\/doi.org\/10.1109\/ICRA.2014.6907809","DOI":"10.1109\/ICRA.2014.6907809"},{"issue":"9","key":"986_CR26","doi-asserted-by":"publisher","first-page":"2959","DOI":"10.1007\/s12555-021-1044-6","volume":"20","author":"YG Kim","year":"2022","unstructured":"Kim YG, Mun G, Kim M, Jeon B, Lee JH, Yoon D, Kim BS, Kong SH, Jeong CW, Lee KE, Cho M, Kim S (2022) A study on the VR Goggle-based vision system for robotic surgery. Int J Control Autom Syst 20(9):2959\u20132971. https:\/\/doi.org\/10.1007\/s12555-021-1044-6","journal-title":"Int J Control Autom Syst"},{"issue":"2","key":"986_CR27","first-page":"123","volume":"75","author":"JF Knight","year":"2004","unstructured":"Knight JF, Baber C (2004) Neck muscle activity and perceived pain and discomfort due to variations of head load and posture. Aviat Space Environ Med 75(2):123\u2013131","journal-title":"Aviat Space Environ Med"},{"issue":"5","key":"986_CR28","doi-asserted-by":"publisher","first-page":"797","DOI":"10.1518\/001872007X230172","volume":"49","author":"JF Knight","year":"2007","unstructured":"Knight JF, Baber C (2007) Effect of head-mounted displays on posture. Hum Factors 49(5):797\u2013807. https:\/\/doi.org\/10.1518\/001872007X230172","journal-title":"Hum Factors"},{"issue":"10","key":"986_CR29","doi-asserted-by":"publisher","first-page":"2970","DOI":"10.1007\/s00464-014-4030-8","volume":"29","author":"JK Koehn","year":"2015","unstructured":"Koehn JK, Kuchenbecker KJ (2015) Surgeons and non-surgeons prefer haptic feedback of instrument vibrations during robotic surgery. Surg Endosc 29(10):2970\u20132983. https:\/\/doi.org\/10.1007\/s00464-014-4030-8","journal-title":"Surg Endosc"},{"issue":"1","key":"986_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/S0968-090X(96)00025-3","volume":"5","author":"JDVD Laan","year":"1997","unstructured":"Laan JDVD, Heino A, Waard DD (1997) A simple procedure for the assessment of acceptance of advanced transport telematics. Transp Res Part C Emergng Technol 5(1):1\u201310. https:\/\/doi.org\/10.1016\/S0968-090X(96)00025-3","journal-title":"Transp Res Part C Emergng Technol"},{"issue":"1","key":"986_CR31","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1097\/01.sla.0000103020.19595.7d","volume":"239","author":"AR Lanfranco","year":"2004","unstructured":"Lanfranco AR, Castellanos AE, Desai JP, Meyers WC (2004) Robotic surgery: a current perspective. Ann Surg 239(1):14\u201321. https:\/\/doi.org\/10.1097\/01.sla.0000103020.19595.7d","journal-title":"Ann Surg"},{"key":"986_CR64","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1016\/j.avsg.2021.02.033","volume":"75","author":"F Lareyre","year":"2021","unstructured":"Lareyre F, Chaudhuri A, Adam C, Carrier M, Mialhe C, Raffort J (2021). Applications of head-mounted displays and smart glasses in vascular surgery. Ann Vasc Surg 75:497-512. https:\/\/doi.org\/10.1016\/j.avsg.2021.02.033","journal-title":"Annals of Vascular Surgery"},{"issue":"1","key":"986_CR32","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1007\/s11701-007-0016-z","volume":"1","author":"EH Lawson","year":"2007","unstructured":"Lawson EH, Curet MJ, Sanchez BR, Schuster R, Berguer R (2007) Postural ergonomics during robotic and laparoscopic gastric bypass surgery: a pilot project. J Robot Surg 1(1):61\u201367. https:\/\/doi.org\/10.1007\/s11701-007-0016-z","journal-title":"J Robot Surg"},{"issue":"4","key":"986_CR33","doi-asserted-by":"publisher","first-page":"1697","DOI":"10.1007\/s00464-016-5160-y","volume":"31","author":"GI Lee","year":"2017","unstructured":"Lee GI, Lee MR, Green I, Allaf M, Marohn MR (2017) Surgeons\u2019 physical discomfort and symptoms during robotic surgery: a comprehensive ergonomic survey study. Surg Endosc 31(4):1697\u20131706. https:\/\/doi.org\/10.1007\/s00464-016-5160-y","journal-title":"Surg Endosc"},{"issue":"7","key":"986_CR34","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1080\/10447318.2018.1455307","volume":"34","author":"JR Lewis","year":"2018","unstructured":"Lewis JR (2018) The system usability scale: past, present, and future. Int J Hum\u2013Comput Interact 34(7):577\u2013590. https:\/\/doi.org\/10.1080\/10447318.2018.1455307","journal-title":"Int J Hum\u2013Comput Interact"},{"key":"986_CR35","doi-asserted-by":"publisher","unstructured":"Lugaresi C, Tang J, Nash H, McClanahan C, Uboweja E, Hays M, Zhang F, Chang CL, Yong MG, Lee J, Chang WT, Hua W, Georg M, Grundmann M (2019) MediaPipe: a framework for building perception pipelines. arXiv preprint arXiv:1906.08172. https:\/\/doi.org\/10.48550\/arXiv.1906.08172","DOI":"10.48550\/arXiv.1906.08172"},{"key":"986_CR36","doi-asserted-by":"publisher","unstructured":"Lum MJH, Rosen J, King H, Friedman DCW, Lendvay TS, Wright AS, Sinanan MN, Hannaford B (2009) Teleoperation in surgical robotics\u2013network latency effects on surgical performance. 2009 Annu Int Conf IEEE Eng Med Biol Soc 6860\u20136863. https:\/\/doi.org\/10.1109\/IEMBS.2009.5333120","DOI":"10.1109\/IEMBS.2009.5333120"},{"issue":"3","key":"986_CR37","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1089\/end.2009.0197","volume":"24","author":"MM Lux","year":"2010","unstructured":"Lux MM, Marshall M, Erturk E, Joseph JV (2010) Ergonomic evaluation and guidelines for use of the daVinci Robot system. J Endourol 24(3):371\u2013375. https:\/\/doi.org\/10.1089\/end.2009.0197","journal-title":"J Endourol"},{"key":"986_CR38","doi-asserted-by":"publisher","DOI":"10.1017\/9781316661239","volume-title":"Modern Robotics","author":"KM Lynch","year":"2017","unstructured":"Lynch KM, Park FC (2017) Modern Robotics. Cambridge University Press, Cambridge"},{"issue":"5","key":"986_CR39","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1001\/jama.285.5.568","volume":"285","author":"MJ Mack","year":"2001","unstructured":"Mack MJ (2001) Minimally invasive and robotic surgery. JAMA 285(5):568\u2013572. https:\/\/doi.org\/10.1001\/jama.285.5.568","journal-title":"JAMA"},{"key":"986_CR65","doi-asserted-by":"publisher","unstructured":"Mart\u00edn-Barrio A, Rold\u00e1n JJ, Terrile S, Del Cerro J, and Barrientos A (2020). Application of immersive technologies and natural language to hyper-redundant robot teleoperation. Virtual Reality, 24, 541-555. https:\/\/doi.org\/10.1007\/s10055-019-00414-9","DOI":"10.1007\/s10055-019-00414-9"},{"issue":"4","key":"986_CR40","doi-asserted-by":"publisher","first-page":"e165665","DOI":"10.1001\/jamasurg.2016.5665","volume":"152","author":"A Mart\u00ednez-P\u00e9rez","year":"2017","unstructured":"Mart\u00ednez-P\u00e9rez A, Carra MC, Brunetti F, De\u2019Angelis N (2017) Pathologic outcomes of laparoscopic vs open mesorectal excision for rectal cancer: a systematic review and meta-analysis. JAMA Surg 152(4):e165665. https:\/\/doi.org\/10.1001\/jamasurg.2016.5665","journal-title":"JAMA Surg"},{"issue":"6","key":"986_CR41","doi-asserted-by":"publisher","first-page":"1180","DOI":"10.1007\/s00464-008-0298-x","volume":"23","author":"OAJVD Meijden","year":"2009","unstructured":"Meijden OAJVD, Schijven MP (2009) The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review. Surg Endosc 23(6):1180\u20131190. https:\/\/doi.org\/10.1007\/s00464-008-0298-x","journal-title":"Surg Endosc"},{"issue":"2","key":"986_CR42","doi-asserted-by":"publisher","first-page":"580","DOI":"10.1016\/j.juro.2013.02.3185","volume":"190","author":"JT Mills","year":"2013","unstructured":"Mills JT, Burris MB, Warburton DJ, Conaway MR, Schenkman NS, Krupski TL (2013) Positioning injuries associated with robotic assisted urological surgery. J Urol 190(2):580\u2013584. https:\/\/doi.org\/10.1016\/j.juro.2013.02.3185","journal-title":"J Urol"},{"issue":"1","key":"986_CR43","doi-asserted-by":"publisher","first-page":"8371","DOI":"10.1038\/s41598-019-44939-0","volume":"9","author":"S Miura","year":"2019","unstructured":"Miura S, Oshikiri T, Miura Y, Takiguchi G, Takase N, Hasegawa H, Yamamoto M, Kanaji S, Matsuda Y, Yamashita K, Matsuda T, Nakamura T, Suzuki S, Kakeji Y (2019) Optimal monitor positioning and camera rotation angle for mirror image: overcoming reverse alignment during laparoscopic colorectal surgery. Sci Rep 9(1):8371. https:\/\/doi.org\/10.1038\/s41598-019-44939-0","journal-title":"Sci Rep"},{"key":"986_CR72","doi-asserted-by":"publisher","unstructured":"Moreira AH, Queir\u00f3s S, Fonseca J, Rodrigues PL, Rodrigues NF, Vila\u00e7a JL (2014, May). Real-time hand tracking for rehabilitation and character animation. In 2014 IEEE SeGAH:1-8. https:\/\/doi.org\/10.1109\/SeGAH.2014.7067086","DOI":"10.1109\/SeGAH.2014.7067086"},{"issue":"3","key":"986_CR44","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1007\/s00221-016-4846-7","volume":"235","author":"J Munafo","year":"2017","unstructured":"Munafo J, Diedrick M, Stoffregen TA (2017) The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Exp Brain Res 235(3):889\u2013901. https:\/\/doi.org\/10.1007\/s00221-016-4846-7","journal-title":"Exp Brain Res"},{"issue":"2","key":"986_CR45","doi-asserted-by":"publisher","first-page":"S29","DOI":"10.1016\/j.ygyno.2008.07.025","volume":"111","author":"F Nezhat","year":"2008","unstructured":"Nezhat F (2008) Minimally invasive surgery in gynecologic oncology: laparoscopy versus robotics. Gynecol Oncol 111(2):S29\u2013S32. https:\/\/doi.org\/10.1016\/j.ygyno.2008.07.025","journal-title":"Gynecol Oncol"},{"key":"986_CR66","doi-asserted-by":"publisher","first-page":"622","DOI":"10.1016\/j.procs.2020.08.064","volume":"176","author":"A Nikitin","year":"2020","unstructured":"Nikitin A, Reshetnikova N, Sitnikov I, Karelova O (2020). VR Training for Railway Wagons Maintenance: architecture and implementation. Procedia Comput Sci 176:622-631. https:\/\/doi.org\/10.1016\/j.procs.2020.08.064","journal-title":"Procedia Computer Science"},{"issue":"6","key":"986_CR46","doi-asserted-by":"publisher","first-page":"656","DOI":"10.1089\/lap.2017.0662","volume":"28","author":"A Nouralizadeh","year":"2018","unstructured":"Nouralizadeh A, Tabatabaei S, Basiri A, Simforoosh N, Soleimani M, Javanmard B, Ansari A, Shemshaki H (2018) Comparison of open versus laparoscopic versus hand-assisted laparoscopic nephroureterectomy: a systematic review and meta-analysis. J Laparoendosc Adv Surg Tech 28(6):656\u2013681. https:\/\/doi.org\/10.1089\/lap.2017.0662","journal-title":"J Laparoendosc Adv Surg Tech"},{"key":"986_CR67","doi-asserted-by":"publisher","unstructured":"Palumbo A. (2022). Microsoft HoloLens 2 in medical and healthcare context: State of the art and future prospects. Sens 22(20):7709. https:\/\/doi.org\/10.3390\/s22207709","DOI":"10.3390\/s22207709"},{"issue":"1","key":"986_CR47","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/S0039-6060(03)00156-9","volume":"135","author":"JH Peters","year":"2004","unstructured":"Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B, Hoffman K, SAGES FLS Committee (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135(1):21\u201327. https:\/\/doi.org\/10.1016\/S0039-6060(03)00156-9","journal-title":"Surgery"},{"issue":"5","key":"986_CR48","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1049\/htl.2018.5065","volume":"5","author":"L Qian","year":"2018","unstructured":"Qian L, Deguet A, Kazanzides P (2018) ARssist: augmented reality on a head-mounted display for the first assistant in robotic surgery. Healthc Technol Lett 5(5):194\u2013200. https:\/\/doi.org\/10.1049\/htl.2018.5065","journal-title":"Healthc Technol Lett"},{"key":"986_CR49","doi-asserted-by":"publisher","unstructured":"Qian L, Deguet A, Kazanzides P (2019) dVRK-XR: mixed reality extension for Da Vinci Research Kit. https:\/\/doi.org\/10.31256\/HSMR2019.47. Hamlyn Symp Med Robot","DOI":"10.31256\/HSMR2019.47"},{"issue":"2","key":"986_CR50","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1177\/1553350607302329","volume":"14","author":"EM Ritter","year":"2007","unstructured":"Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14(2):107\u2013112. https:\/\/doi.org\/10.1177\/1553350607302329","journal-title":"Surg Innov"},{"issue":"1","key":"986_CR51","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1016\/j.amjsurg.2009.07.035","volume":"199","author":"G Sroka","year":"2010","unstructured":"Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room\u2014a randomized controlled trial. Am J Surg 199(1):115\u2013120. https:\/\/doi.org\/10.1016\/j.amjsurg.2009.07.035","journal-title":"Am J Surg"},{"key":"986_CR73","doi-asserted-by":"publisher","unstructured":"Suarez J, Murphy RR (2012, September). Hand gesture recognition with depth images: A review. In 2012 IEEE RO-MAN:411-417. https:\/\/doi.org\/10.1109\/ROMAN.2012.6343787","DOI":"10.1109\/ROMAN.2012.6343787"},{"key":"986_CR74","doi-asserted-by":"publisher","unstructured":"Sun Y, Pan B, Fu Y, Niu G (2019, December). Development of a Novel Hand-eye Coordination Algorithm for Robot Assisted Minimally Invasive Surgery. In 2019 IEEE ROBIO:1234-1239. https:\/\/doi.org\/10.1109\/ROBIO49542.2019.8961587","DOI":"10.1109\/ROBIO49542.2019.8961587"},{"key":"986_CR68","doi-asserted-by":"publisher","unstructured":"Tavakoli M, Patel RV, and Moallem M (2006). A haptic interface for computer-integrated endoscopic surgery and training. Virtual Reality, 9, 160-176. https:\/\/doi.org\/10.1007\/s10055-005-0017-z","DOI":"10.1007\/s10055-005-0017-z"},{"key":"986_CR52","volume-title":"Sabiston Textbook of Surgery","author":"CM Townsend","year":"2016","unstructured":"Townsend CM, Beauchamp RD, Evers BM, Mattox KL (2016) Sabiston Textbook of Surgery. Elsevier Health Sciences, Amsterdam"},{"issue":"3","key":"986_CR53","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1007\/s00464-011-1936-2","volume":"26","author":"G Turchetti","year":"2012","unstructured":"Turchetti G, Palla I, Pierotti F, Cuschieri A (2012) Economic evaluation of Da Vinci-assisted robotic surgery: a systematic review. Surg Endosc 26(3):598\u2013606. https:\/\/doi.org\/10.1007\/s00464-011-1936-2","journal-title":"Surg Endosc"},{"issue":"4","key":"986_CR54","doi-asserted-by":"publisher","first-page":"e2113","DOI":"10.1002\/rcs.2113","volume":"16","author":"IJY Wee","year":"2020","unstructured":"Wee IJY, Kuo LJ, Ngu JCY (2020) A systematic review of the true benefit of robotic surgery: ergonomics. Int J Med Robot Comput Assist Surg 16(4):e2113. https:\/\/doi.org\/10.1002\/rcs.2113","journal-title":"Int J Med Robot Comput Assist Surg"},{"issue":"9","key":"986_CR55","doi-asserted-by":"publisher","first-page":"2569","DOI":"10.1007\/s00464-014-3504-z","volume":"28","author":"S Xu","year":"2014","unstructured":"Xu S, Perez M, Yang K, Perrenot C, Felblinger J, Hubert J (2014) Determination of the latency effects on surgical performance and the acceptable latency levels in telesurgery using the dV-Trainer\u00ae simulator. Surg Endosc 28(9):2569\u20132576. https:\/\/doi.org\/10.1007\/s00464-014-3504-z","journal-title":"Surg Endosc"},{"key":"986_CR69","doi-asserted-by":"publisher","first-page":"e218","DOI":"10.7717\/peerj-cs.218","volume":"5","author":"Mais Yasen","year":"2019","unstructured":"Yasen M, Jusoh S (2019). A systematic review on hand gesture recognition techniques, challenges and applications. PeerJ Comput Sci 5:e218. https:\/\/doi.org\/10.7717\/peerj-cs.218","journal-title":"PeerJ Computer Science"},{"issue":"2","key":"986_CR56","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1007\/s00464-015-4233-7","volume":"30","author":"B Zendejas","year":"2016","unstructured":"Zendejas B, Ruparel RK, Cook DA (2016) Validity evidence for the fundamentals of laparoscopic surgery (FLS) program as an assessment tool: a systematic review. Surg Endosc 30(2):512\u2013520. https:\/\/doi.org\/10.1007\/s00464-015-4233-7","journal-title":"Surg Endosc"},{"key":"986_CR57","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2006.10214","author":"F Zhang","year":"2020","unstructured":"Zhang F, Bazarevsky V, Vakunov A, Tkachenka A, Sung G, Chang CL, Grundmann M (2020) MediaPipe hands: on-device real-time hand tracking. arXiv Preprint. https:\/\/doi.org\/10.48550\/arXiv.2006.10214. arXiv:2006.10214","journal-title":"arXiv Preprint"}],"container-title":["Virtual Reality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10055-024-00986-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10055-024-00986-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10055-024-00986-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T19:41:28Z","timestamp":1719517288000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10055-024-00986-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,23]]},"references-count":74,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["986"],"URL":"https:\/\/doi.org\/10.1007\/s10055-024-00986-1","relation":{},"ISSN":["1434-9957"],"issn-type":[{"value":"1434-9957","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,23]]},"assertion":[{"value":"7 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Approval of all ethical and experimental procedures and protocols was granted by the institutional review board (IRB) in Seoul National University Hospital (IRB No: H-2107-167-1236). Written consent was obtained from all participants.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"The authors declare that they have no conflict of interest.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"114"}}