{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T05:05:46Z","timestamp":1755839146691,"version":"3.41.0"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"EICS","license":[{"start":{"date-parts":[[2021,5,27]],"date-time":"2021-05-27T00:00:00Z","timestamp":1622073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,5,27]]},"abstract":"<jats:p>Gastroenterological endoscopic surgery needs complex surgical skills such as a sensation of body movement and manipulation of the endoscope that is hard to be explained verbally. Prior research reported that endoscopic surgery is one of the most challenging surgery to teach. Thus, surgeons need long-term practice to master the skills. To support learning such skills, we developed a surgical scene replay system. First, we surveyed 12 surgeons to reveal the reason for the difficulty and elicited three requirements for our system: (1) provide multiple videos that include an endoscope, a fluoroscopy, and hand manipulation for the endoscope to observe the surgery from multiple aspects; (2) visualize an experts' gaze position to understand experts' intention of hand manipulation, and (3) enlarge the size of the gazed video to inform learners where they should pay attention to. Our user study with the system indicates that participants could understand the experts' intentions and tacit knowledge easier than the existing video materials.<\/jats:p>","DOI":"10.1145\/3461726","type":"journal-article","created":{"date-parts":[[2021,5,30]],"date-time":"2021-05-30T01:31:19Z","timestamp":1622338279000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["A Surgical Scene Replay System for Learning Gastroenterological Endoscopic Surgery Skill by Multiple Synchronized-Video and Gaze Representation"],"prefix":"10.1145","volume":"5","author":[{"given":"Akira","family":"Matsuda","sequence":"first","affiliation":[{"name":"The University of Tokyo, Tokyo, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Toru","family":"Okuzono","sequence":"additional","affiliation":[{"name":"Sendai Kousei Hospital, Miyagi, Sendai, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hiromi","family":"Nakamura","sequence":"additional","affiliation":[{"name":"The University of Tokyo, Tokyo, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hideaki","family":"Kuzuoka","sequence":"additional","affiliation":[{"name":"The University of Tokyo, Bunkyo-ku, Tokyo, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Rekimoto","sequence":"additional","affiliation":[{"name":"The University of Tokyo &amp; Sony Computer Science Laboratories, Inc., Tokyo, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,5,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858127"},{"key":"e_1_2_1_2_1","volume-title":"Video-based coaching in surgical education: a systematic review and meta-analysis. Surgical Endoscopy 34 (02","author":"Augestad Knut","year":"2020","unstructured":"Knut Augestad , Khayam Butt , Dejan Ignjatovic , Deborah Keller , and Ravi Kiran . 2020. Video-based coaching in surgical education: a systematic review and meta-analysis. Surgical Endoscopy 34 (02 2020 ). https:\/\/doi.org\/10.1007\/s00464- 019-07265-0 10.1007\/s00464- Knut Augestad, Khayam Butt, Dejan Ignjatovic, Deborah Keller, and Ravi Kiran. 2020. Video-based coaching in surgical education: a systematic review and meta-analysis. Surgical Endoscopy 34 (02 2020). https:\/\/doi.org\/10.1007\/s00464- 019-07265-0"},{"key":"e_1_2_1_3_1","volume-title":"The \"Cost\" of Operative Training for Surgical Residents. Archives of Surgery 139, 4 (04","author":"Babineau Timothy J.","year":"2004","unstructured":"Timothy J. Babineau , James Becker , Gary Gibbons , Stephen Sentovich , Donald Hess , Sharon Robertson , and Michael Stone . 2004. The \"Cost\" of Operative Training for Surgical Residents. Archives of Surgery 139, 4 (04 2004 ), 366--370. https:\/\/doi.org\/10.1001\/archsurg.139.4.366 arXiv:https:\/\/jamanetwork.com\/journals\/jamasurgery\/articlepdf\/396495\/sne3006.pdf 10.1001\/archsurg.139.4.366 Timothy J. Babineau, James Becker, Gary Gibbons, Stephen Sentovich, Donald Hess, Sharon Robertson, and Michael Stone. 2004. The \"Cost\" of Operative Training for Surgical Residents. Archives of Surgery 139, 4 (04 2004), 366--370. https:\/\/doi.org\/10.1001\/archsurg.139.4.366 arXiv:https:\/\/jamanetwork.com\/journals\/jamasurgery\/articlepdf\/396495\/sne3006.pdf"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.21037\/atm.2016.12.24"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2829875.2829932"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0002-9610(98)00289-X"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2254556.2254663"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2655050"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502052"},{"key":"e_1_2_1_10_1","volume-title":"Multiple-video-based Elearning Platform for Physical Education. In 2009 Joint Conferences on Pervasive Computing (JCPC). 21--26","author":"Huang Chun-Hong","year":"2009","unstructured":"Chun-Hong Huang , T. L. Won , Chun-Yeh Liu , Yen-Da Chen , and Yung-Hui Chen . 2009 . Multiple-video-based Elearning Platform for Physical Education. In 2009 Joint Conferences on Pervasive Computing (JCPC). 21--26 . https: \/\/doi.org\/10.1109\/JCPC.2009.5420220 10.1109\/JCPC.2009.5420220 Chun-Hong Huang, T. L. Won, Chun-Yeh Liu, Yen-Da Chen, and Yung-Hui Chen. 2009. Multiple-video-based Elearning Platform for Physical Education. In 2009 Joint Conferences on Pervasive Computing (JCPC). 21--26. https: \/\/doi.org\/10.1109\/JCPC.2009.5420220"},{"key":"e_1_2_1_11_1","volume-title":"Effectiveness of box trainers in laparoscopic training. Journal of minimal access surgery 3 (04","author":"Dhariwal Anender","year":"2007","unstructured":"Anender Dhariwal , Ram Prabhu , Abhay Dalvi , and Avinash Supe . 2007. Effectiveness of box trainers in laparoscopic training. Journal of minimal access surgery 3 (04 2007 ), 57--63. https:\/\/doi.org\/10.4103\/0972--9941.33274 10.4103\/0972--9941.33274 Anender Dhariwal, Ram Prabhu, Abhay Dalvi, and Avinash Supe. 2007. Effectiveness of box trainers in laparoscopic training. Journal of minimal access surgery 3 (04 2007), 57--63. https:\/\/doi.org\/10.4103\/0972--9941.33274"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2011.02.007"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gie.2018.10.037"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1080\/13645706.2018.1539012"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1072-7515(01)01066-3"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11701-019-00950-1"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.16910\/jemr.6.4.4"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858438"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/2873003.2873007"},{"key":"e_1_2_1_20_1","volume-title":"Smink","author":"Hu Yue Yung","year":"2017","unstructured":"Yue Yung Hu , Laura M. Mazer , Steven J. Yule , Alexander F. Arriaga , Caprice C. Greenberg , Stuart R. Lipsitz , Atul A. Gawande , and Douglas S . Smink . 2017 . Complementing operating room teaching with video-based coaching. JAMA Surgery 152, 4 (1 April 2017), 318--325. https:\/\/doi.org\/10.1001\/jamasurg.2016.4619 10.1001\/jamasurg.2016.4619 Yue Yung Hu, Laura M. Mazer, Steven J. Yule, Alexander F. Arriaga, Caprice C. Greenberg, Stuart R. Lipsitz, Atul A. Gawande, and Douglas S. Smink. 2017. Complementing operating room teaching with video-based coaching. JAMA Surgery 152, 4 (1 April 2017), 318--325. https:\/\/doi.org\/10.1001\/jamasurg.2016.4619"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/166266.166289"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.11.002"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gie.2014.08.007"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858495"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2638728.2641695"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-012-2400-7"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2016.7591611"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/den.13240"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0097-8493(00)00070-4"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/968363.968370"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.sla.0000154552.89886.91"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3325480.3326576"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2466533.2466553"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376622"},{"key":"e_1_2_1_35_1","volume-title":"A Handbook of Reflective and Experiential Learning: Theory and Practice","author":"Moon Jennifer A.","unstructured":"Jennifer A. Moon . 2004. A Handbook of Reflective and Experiential Learning: Theory and Practice ( 1 st ed.). Routledge . Jennifer A. Moon. 2004. A Handbook of Reflective and Experiential Learning: Theory and Practice (1st ed.). Routledge.","edition":"1"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-4219-z"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/13573322.2011.613925"},{"key":"e_1_2_1_38_1","volume-title":"The Role of Haptic Feedback in Laparoscopic Simulation Training. The Journal of surgical research 156 (05","author":"Panait Lucian","year":"2009","unstructured":"Lucian Panait , Ehab Akkary , Robert Bell , Kurt Roberts , and Andrew Duffy . 2009. The Role of Haptic Feedback in Laparoscopic Simulation Training. The Journal of surgical research 156 (05 2009 ), 312--6. https:\/\/doi.org\/10.1016\/j.jss. 2009.04.018 10.1016\/j.jss Lucian Panait, Ehab Akkary, Robert Bell, Kurt Roberts, and Andrew Duffy. 2009. The Role of Haptic Feedback in Laparoscopic Simulation Training. The Journal of surgical research 156 (05 2009), 312--6. https:\/\/doi.org\/10.1016\/j.jss. 2009.04.018"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1177\/0895904805303201"},{"key":"e_1_2_1_40_1","volume-title":"The Relationship of Endoscopic Proficiency to Educational Expense for Virtual Reality Simulator Training Amongst Surgical Trainees. The American surgeon 81 (07","author":"Raque Jessica","year":"2015","unstructured":"Jessica Raque , Adam Goble , Veronica Jones , Lindsey Waldman , and Erica Sutton . 2015. The Relationship of Endoscopic Proficiency to Educational Expense for Virtual Reality Simulator Training Amongst Surgical Trainees. The American surgeon 81 (07 2015 ), 747--52. https:\/\/doi.org\/10.1177\/000313481508100727 10.1177\/000313481508100727 Jessica Raque, Adam Goble, Veronica Jones, Lindsey Waldman, and Erica Sutton. 2015. The Relationship of Endoscopic Proficiency to Educational Expense for Virtual Reality Simulator Training Amongst Surgical Trainees. The American surgeon 81 (07 2015), 747--52. https:\/\/doi.org\/10.1177\/000313481508100727"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359188"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0002-9610(00)00341-X"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0002-9610(98)00087-7"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1640233.1640264"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-003-9052-6"},{"key":"e_1_2_1_46_1","volume-title":"Virtual reality surgical laparoscopic simulators - How to choose. Surgical endoscopy 17 (01","author":"Schijven Marlies","year":"2004","unstructured":"Marlies Schijven and Jack Jakimowicz . 2004. Virtual reality surgical laparoscopic simulators - How to choose. Surgical endoscopy 17 (01 2004 ), 1943--50. https:\/\/doi.org\/10.1007\/s00464-003--9052--6 10.1007\/s00464-003--9052--6 Marlies Schijven and Jack Jakimowicz. 2004. Virtual reality surgical laparoscopic simulators - How to choose. Surgical endoscopy 17 (01 2004), 1943--50. https:\/\/doi.org\/10.1007\/s00464-003--9052--6"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174222"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00752437"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300514"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1080\/19346182.2008.9648449"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ETVIS.2016.7851158"},{"key":"e_1_2_1_52_1","volume-title":"Effect of Haptic Feedback in Laparoscopic Surgery Skill Acquisition. Virtual Technologies in Medicine (01","author":"Zhou M.","year":"2013","unstructured":"M. Zhou , S. Tse , A. DereviankoA, D.B. Jones , Steven Schwaitzberg , and Caroline Cao . 2013. Effect of Haptic Feedback in Laparoscopic Surgery Skill Acquisition. Virtual Technologies in Medicine (01 2013 ), 33--38. https:\/\/doi.org\/10.46594\/2687-0037_2013_1_33 10.46594\/2687-0037_2013_1_33 M. Zhou, S. Tse, A. DereviankoA, D.B. Jones, Steven Schwaitzberg, and Caroline Cao. 2013. Effect of Haptic Feedback in Laparoscopic Surgery Skill Acquisition. Virtual Technologies in Medicine (01 2013), 33--38. https:\/\/doi.org\/10.46594\/2687-0037_2013_1_33"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461726","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461726","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:06Z","timestamp":1750191426000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461726"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,27]]},"references-count":52,"journal-issue":{"issue":"EICS","published-print":{"date-parts":[[2021,5,27]]}},"alternative-id":["10.1145\/3461726"],"URL":"https:\/\/doi.org\/10.1145\/3461726","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2021,5,27]]},"assertion":[{"value":"2021-05-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}