{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T16:20:10Z","timestamp":1790785210458,"version":"4.1.0"},"reference-count":19,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T00:00:00Z","timestamp":1761177600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T00:00:00Z","timestamp":1761177600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004721","name":"The University of Tokyo","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004721","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Surg Endosc"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Intraoperative ultrasonography (IOUS) is essential in minimally invasive hepatobiliary\u2013pancreatic surgery but requires surgeons to alternate attention between laparoscopic and ultrasound monitors, disrupting workflow. We developed Flag AR, an augmented reality system that superimposes real-time ultrasound images onto laparoscopic displays using visual marker tracking.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This prospective observational study included 14 patients undergoing minimally invasive hepatobiliary\u2013pancreatic procedures between March and April 2025. Three experienced surgeons performed target identification tasks using both Flag AR and conventional IOUS. Eye-tracking analysis measured gaze shifts and visual focus time using wearable eye-tracking glasses.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Twenty-six anatomical targets were evaluated, including liver tumors (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u200913), gallbladder tumors (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u20094), and vascular structures (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u20099). Although task completion time showed no significant difference between modalities (23.8 vs. 22.1\u00a0s,\n                      <jats:italic>P<\/jats:italic>\n                      \u2009=\u20090.351), Flag AR significantly reduced gaze shifts compared to conventional IOUS (1.8 vs. 8.4 shifts,\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&lt;\u20090.001) and increased time focused on a single monitor (97.9% vs. 73.8%,\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&lt;\u20090.001).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Flag AR represents the first clinical application of purely visual marker-based ultrasound overlay technology in minimally invasive surgery. By enabling sustained visual focus on a single display, this system improves surgeon workflow efficiency during IOUS procedures without compromising task performance, potentially enhancing spatial visualization and reducing cognitive workload in complex surgical procedures.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s00464-025-12326-8","type":"journal-article","created":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T16:14:36Z","timestamp":1761236076000},"page":"8734-8740","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Visual marker-based augmented reality for intraoperative ultrasound in minimally invasive surgery"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0455-6412","authenticated-orcid":false,"given":"Takeshi","family":"Takamoto","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yusuke","family":"Kazami","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yujiro","family":"Nishioka","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Akihiko","family":"Ichida","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nobuhisa","family":"Akamatsu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoshikuni","family":"Kawaguchi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kiyoshi","family":"Hasegawa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,10,23]]},"reference":[{"key":"12326_CR1","doi-asserted-by":"publisher","first-page":"2491","DOI":"10.1002\/cncr.24291","volume":"115","author":"T Ishizawa","year":"2009","unstructured":"Ishizawa T, Fukushima N, Shibahara J, Masuda K, Tamura S, Aoki T, Hasegawa K, Beck Y, Fukayama M, Kokudo N (2009) Real-time identification of liver cancers by using indocyanine green fluorescent imaging. Cancer 115:2491\u20132504","journal-title":"Cancer"},{"key":"12326_CR2","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1007\/s00534-009-0197-0","volume":"17","author":"T Aoki","year":"2010","unstructured":"Aoki T, Murakami M, Yasuda D, Shimizu Y, Kusano T, Matsuda K, Niiya T, Kato H, Murai N, Otsuka K, Kusano M, Kato T (2010) Intraoperative fluorescent imaging using indocyanine green for liver mapping and cholangiography. J Hepatobiliary Pancreat Sci 17:590\u2013594","journal-title":"J Hepatobiliary Pancreat Sci"},{"key":"12326_CR3","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1007\/s00268-017-4210-5","volume":"42","author":"T Takamoto","year":"2018","unstructured":"Takamoto T, Mise Y, Satou S, Kobayashi Y, Miura K, Saiura A, Hasegawa K, Kokudo N, Makuuchi M (2018) Feasibility of intraoperative navigation for liver resection using real-time virtual sonography with novel automatic registration system. World J Surg 42:841\u2013848","journal-title":"World J Surg"},{"key":"12326_CR4","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1016\/S1055-3207(02)00084-4","volume":"12","author":"G Torzilli","year":"2003","unstructured":"Torzilli G, Makuuchi M (2003) Intraoperative ultrasonography in liver cancer. Surg Oncol Clin N Am 12:91\u2013103","journal-title":"Surg Oncol Clin N Am"},{"key":"12326_CR5","doi-asserted-by":"publisher","first-page":"831","DOI":"10.1097\/SLA.0b013e3181b0c4df","volume":"250","author":"KT Nguyen","year":"2009","unstructured":"Nguyen KT, Gamblin TC, Geller DA (2009) World review of laparoscopic liver resection-2,804 patients. Ann Surg 250:831\u2013841","journal-title":"Ann Surg"},{"key":"12326_CR6","doi-asserted-by":"publisher","first-page":"4071","DOI":"10.1007\/s00464-017-5854-9","volume":"32","author":"P Zhu","year":"2018","unstructured":"Zhu P, Liao W, Ding ZY, Luo HC, Zhang BH, Zhang WG, Zhang W, Zhang ZG, Zhang BX, Chen XP (2018) Intraoperative ultrasonography of robot-assisted laparoscopic hepatectomy: initial experiences from 110 consecutive cases. Surg Endosc 32:4071\u20134077","journal-title":"Surg Endosc"},{"key":"12326_CR7","first-page":"346","volume":"161","author":"M Makuuchi","year":"1985","unstructured":"Makuuchi M, Hasegawa H, Yamazaki S (1985) Ultrasonically guided subsegmentectomy. Surg Gynecol Obstet 161:346\u2013350","journal-title":"Surg Gynecol Obstet"},{"key":"12326_CR8","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1097\/00000658-198611000-00015","volume":"204","author":"D Castaing","year":"1986","unstructured":"Castaing D, Emond J, Kunstlinger F, Bismuth H (1986) Utility of operative ultrasound in the surgical management of liver tumors. Ann Surg 204:600\u2013605","journal-title":"Ann Surg"},{"key":"12326_CR9","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1097\/00000658-199412000-00002","volume":"220","author":"TG John","year":"1994","unstructured":"John TG, Greig JD, Crosbie JL, Anthony Miles WF, Garden OJ (1994) Superior staging of liver tumors with laparoscopy and laparoscopic ultrasound. Ann Surg 220:711\u2013719","journal-title":"Ann Surg"},{"key":"12326_CR10","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1016\/S0039-6060(05)80373-3","volume":"118","author":"K Kubota","year":"1995","unstructured":"Kubota K, Bandai Y, Sano K, Teruya M, Ishizaki Y, Makuuchi M (1995) Appraisal of intraoperative ultrasonography during laparoscopic cholecystectomy. Surgery 118:555\u2013561","journal-title":"Surgery"},{"key":"12326_CR11","doi-asserted-by":"publisher","first-page":"6174","DOI":"10.1038\/s41598-020-63131-3","volume":"10","author":"K Sakata","year":"2020","unstructured":"Sakata K, Kijima T, Arai O (2020) Initial report: a novel intraoperative navigation system for laparoscopic liver resection using real-time virtual sonography. Sci Rep 10:6174","journal-title":"Sci Rep"},{"key":"12326_CR12","doi-asserted-by":"publisher","first-page":"2359","DOI":"10.1007\/s00464-024-10772-4","volume":"38","author":"M Pavone","year":"2024","unstructured":"Pavone M, Seeliger B, Teodorico E, Goglia M, Taliento C, Bizzarri N, Lecointre L, Akladios C, Forgione A, Scambia G, Marescaux J, Testa AC, Querleu D (2024) Ultrasound-guided robotic surgical procedures: a systematic review. Surg Endosc 38:2359\u20132370","journal-title":"Surg Endosc"},{"key":"12326_CR13","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1097\/01.sla.0000264233.48306.99","volume":"246","author":"S Beller","year":"2007","unstructured":"Beller S, H\u00fcnerbein M, Eulenstein S, Lange T, Schlag PM (2007) Feasibility of navigated resection of liver tumors using multiplanar visualization of intraoperative 3-dimensional ultrasound data. Ann Surg 246:288\u2013294","journal-title":"Ann Surg"},{"key":"12326_CR14","doi-asserted-by":"publisher","first-page":"1951","DOI":"10.1007\/s11548-015-1236-8","volume":"10","author":"Y Song","year":"2015","unstructured":"Song Y, Totz J, Thompson S, Johnsen S, Barratt D, Schneider C, Gurusamy K, Davidson B, Ourselin S, Hawkes D, Clarkson MJ (2015) Locally rigid, vessel-based registration for laparoscopic liver surgery. Int J Comput Assist Radiol Surg 10:1951\u20131961","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"12326_CR15","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1089\/lap.2018.0183","volume":"29","author":"LW Lau","year":"2019","unstructured":"Lau LW, Liu X, Plishker W, Sharma K, Shekhar R, Kane TD (2019) Laparoscopic liver resection with augmented reality: a preclinical experience. J Laparoendosc Adv Surg Tech A 29:88\u201393","journal-title":"J Laparoendosc Adv Surg Tech A"},{"key":"12326_CR16","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1007\/s11548-024-03273-1","volume":"20","author":"Y Ji","year":"2025","unstructured":"Ji Y, Huang T, Wu Y, Li R, Wang P, Dong J, Liao H (2025) Real-time ultrasound AR 3D visualization toward better topological structure perception for hepatobiliary surgery. Int J Comput Assist Radiol Surg 20:613\u2013623","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"12326_CR17","doi-asserted-by":"publisher","first-page":"1905","DOI":"10.1007\/s11548-015-1279-x","volume":"10","author":"P Pratt","year":"2015","unstructured":"Pratt P, Jaeger A, Hughes-Hallett A, Mayer E, Vale J, Darzi A, Peters T, Yang G-Z (2015) Robust ultrasound probe tracking: initial clinical experiences during robot-assisted partial nephrectomy. Int J Comput Assist Radiol Surg 10:1905\u20131913","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"12326_CR18","doi-asserted-by":"publisher","first-page":"706","DOI":"10.1097\/SLA.0000000000002448","volume":"266","author":"IM Sauer","year":"2017","unstructured":"Sauer IM, Queisner M, Tang P, Moosburner S, Hoepfner O, Horner R, Lohmann R, Pratschke J (2017) Mixed reality in visceral surgery: development of a suitable workflow and evaluation of intraoperative use-cases. Ann Surg 266:706\u2013712","journal-title":"Ann Surg"},{"key":"12326_CR19","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1111\/ases.12696","volume":"13","author":"J Yasuda","year":"2020","unstructured":"Yasuda J, Okamoto T, Onda S, Fujioka S, Yanaga K, Suzuki N, Hattori A (2020) Application of image-guided navigation system for laparoscopic hepatobiliary surgery. Asian J Endosc Surg 13:39\u201345","journal-title":"Asian J Endosc Surg"}],"container-title":["Surgical Endoscopy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00464-025-12326-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00464-025-12326-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00464-025-12326-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,16]],"date-time":"2025-12-16T20:45:12Z","timestamp":1765917912000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00464-025-12326-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,23]]},"references-count":19,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["12326"],"URL":"https:\/\/doi.org\/10.1007\/s00464-025-12326-8","relation":{},"ISSN":["0930-2794","1432-2218"],"issn-type":[{"value":"0930-2794","type":"print"},{"value":"1432-2218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,23]]},"assertion":[{"value":"15 July 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 October 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 October 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Dr. Takeshi Takamoto, Dr. Yusuke Kazami, Yujiro Dr. Nishioka, Dr. Akihiko Ichida, Dr. Nobuhisa Akamatsu, Dr. Yoshikuni Kawaguchi, and Dr. Kiyoshi Hasegawa have no conflicts of interest or financial ties to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}