{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T11:43:49Z","timestamp":1783597429400,"version":"3.55.0"},"reference-count":33,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T00:00:00Z","timestamp":1717718400000},"content-version":"vor","delay-in-days":6,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100005089","name":"Beijing Municipal Natural Science Foundation","doi-asserted-by":"publisher","award":["L232065"],"award-info":[{"award-number":["L232065"]}],"id":[{"id":"10.13039\/501100005089","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["JCTD\u20102020\u201011"],"award-info":[{"award-number":["JCTD\u20102020\u201011"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Robotics Computer Surgery"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Endoscope retrograde cholangiopancreatography is a standard surgical treatment for gallbladder and pancreatic diseases. However, surgeons is at high risk and require sufficient surgical experience and skills.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>(1) The simultaneous localisation and mapping technique to reconstruct the surgical environment. (2) The preoperative 3D model is transformed into the intraoperative video environment to implement the multi\u2010modal fusion. (3) A framework for virtual\u2010to\u2010real projection based on hand\u2010eye alignment. For the purpose of projecting the 3D model onto the imaging plane of the camera, it uses position data from electromagnetic sensors.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Our AR\u2010assisted navigation system can accurately guide physicians, which means a distance of registration error to be restricted to under 5\u00a0mm and a projection error of 5.76\u00a0\u00b1\u00a02.13, and the intubation procedure is done at 30 frames per second.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Coupled with clinical validation and user studies, both the quantitative and qualitative results indicate that our navigation system has the potential to be highly useful in clinical practice.<\/jats:p><\/jats:sec>","DOI":"10.1002\/rcs.2649","type":"journal-article","created":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T10:06:59Z","timestamp":1717754819000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Augmented\u2010reality\u2010based surgical navigation for endoscope retrograde cholangiopancreatography: A phantom study"],"prefix":"10.1002","volume":"20","author":[{"given":"Zhipeng","family":"Lin","sequence":"first","affiliation":[{"name":"State Key Laboratory of Virtual Reality Technology and Systems Beihang University  Beijing China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhuoyue","family":"Yang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Virtual Reality Technology and Systems Beihang University  Beijing China"},{"name":"Peng Cheng Laboratory  Shenzhen China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ranyang","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Virtual Reality Technology and Systems Beihang University  Beijing China"},{"name":"Henan University of Technology School of Artificial Intelligence and Big Data  Zhengzhou China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shangyu","family":"Sun","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Virtual Reality Technology and Systems Beihang University  Beijing China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bin","family":"Yan","sequence":"additional","affiliation":[{"name":"Digestive Medicine Center Chines PLA General Hospital  Beijing China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yongming","family":"Yang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics ShenYang Institute of Automation Chinese Academy of Sciences  Shenyang China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8278-1263","authenticated-orcid":false,"given":"Hao","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics ShenYang Institute of Automation Chinese Academy of Sciences  Shenyang China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7991-9540","authenticated-orcid":false,"given":"Junjun","family":"Pan","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Virtual Reality Technology and Systems Beihang University  Beijing China"},{"name":"Peng Cheng Laboratory  Shenzhen China"},{"name":"Research Unit of Virtual Body and Virtual Surgery Technologies Chinese Academy of Medical Sciences  Beijing China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,6,7]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gie.2015.03.1589"},{"key":"e_1_2_9_3_1","doi-asserted-by":"publisher","DOI":"10.1055\/s\u20100043\u2010101697"},{"issue":"7","key":"e_1_2_9_4_1","first-page":"941","article-title":"Application of multi\u2010endoscopy combined surgery led by ERCP in diagnosis and treatment of biliary and pancreatic diseases","volume":"32","author":"Li X","year":"2020","journal-title":"Med J West China"},{"key":"e_1_2_9_5_1","doi-asserted-by":"crossref","unstructured":"PrabhleenC ToddHB.ERCP and EUS for Acute and Chronic Adverse Events of Pancreatic Surgery and Pancreatic Trauma. ERCP.3rd ed.;2019:432\u2010440.","DOI":"10.1016\/B978-0-323-48109-0.00045-6"},{"key":"e_1_2_9_6_1","article-title":"Management of common bile duct stones: controversies and future perspectives: presented at the 5th European Congress of the IHPBA, Istanbul, Turkey, 27\u201331 May 2003","author":"Eduardo M","year":"2004","journal-title":"Hpb"},{"issue":"003","key":"e_1_2_9_7_1","first-page":"021","article-title":"Risk factors for post\u2010endoscopic retrograde cholangiopancreatography(ERCP) abdominal pain in patients without post\u2010ERCP pancreatitis","author":"Chen MJ","year":"2022","journal-title":"Int J Hepatobiliary Pancreat Dis English Ed"},{"key":"e_1_2_9_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00464\u2010010\u20101226\u20104"},{"key":"e_1_2_9_9_1","doi-asserted-by":"publisher","DOI":"10.1038\/ajg.2017.100"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.1186\/s42492\u2010020\u201000057\u20107"},{"key":"e_1_2_9_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2020.105679"},{"key":"e_1_2_9_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/jbhi.2018.2885378"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00464\u2010019\u201007121\u20101"},{"key":"e_1_2_9_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/tmi.2020.3027442"},{"key":"e_1_2_9_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11548\u2010011\u20100631\u2010z"},{"key":"e_1_2_9_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.joms.2021.04.001"},{"key":"e_1_2_9_17_1","article-title":"Interventional status awareness based manipulating strategy for robotic soft endoscopy","author":"Jiang W","year":"2021","journal-title":"Int J Robot Appl Technol"},{"key":"e_1_2_9_18_1","unstructured":"NDI.Electromagnetic tracking technology.2022.https:\/\/www.ndigital.com"},{"key":"e_1_2_9_19_1","unstructured":"MimicsM.3D medical image segmentation software.2022.https:\/\/www.materialise.com\/en\/medical\/mimics\u2010innovation\u2010suite\/mimics"},{"key":"e_1_2_9_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629697"},{"key":"e_1_2_9_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dld.2004.09.030"},{"key":"e_1_2_9_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/0016\u20105085(88)90305\u20108"},{"key":"e_1_2_9_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/tro.2017.2705103"},{"key":"e_1_2_9_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2009.5152473"},{"key":"e_1_2_9_25_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21175850"},{"key":"e_1_2_9_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.121791"},{"key":"e_1_2_9_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545269"},{"key":"e_1_2_9_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.transproceed.2012.11.006"},{"key":"e_1_2_9_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmbbm.2011.05.030"},{"key":"e_1_2_9_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365\u20102982.1992.tb00090.x"},{"key":"e_1_2_9_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/s0021\u20109290(02)00084\u20102"},{"key":"e_1_2_9_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/70.34770"},{"key":"e_1_2_9_33_1","unstructured":"KoKen.Upper gastrointestinal endoscopy training model lm\u2010103.2022.https:\/\/www.kokenmpc.co.jp\/products\/life_simulation_models\/medical_education\/lm\u2010103\/index"},{"key":"e_1_2_9_34_1","unstructured":"CyberneticsM.2D image analysis software.2022.https:\/\/www.mediacy.com\/imageproplus"}],"container-title":["The International Journal of Medical Robotics and Computer Assisted Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/rcs.2649","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,26]],"date-time":"2024-06-26T12:45:30Z","timestamp":1719405930000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/rcs.2649"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6]]},"references-count":33,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["10.1002\/rcs.2649"],"URL":"https:\/\/doi.org\/10.1002\/rcs.2649","archive":["Portico"],"relation":{},"ISSN":["1478-5951","1478-596X"],"issn-type":[{"value":"1478-5951","type":"print"},{"value":"1478-596X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6]]},"assertion":[{"value":"2023-01-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-24","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2649"}}