{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,14]],"date-time":"2026-06-14T12:13:02Z","timestamp":1781439182241,"version":"3.54.1"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2024,3,25]],"date-time":"2024-03-25T00:00:00Z","timestamp":1711324800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,25]],"date-time":"2024-03-25T00:00:00Z","timestamp":1711324800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/R004080\/1"],"award-info":[{"award-number":["EP\/R004080\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/P012841\/1"],"award-info":[{"award-number":["EP\/P012841\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/W00805X\/1"],"award-info":[{"award-number":["EP\/W00805X\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/Y01958X\/1"],"award-info":[{"award-number":["EP\/Y01958X\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Endoscopic pituitary surgery entails navigating through the nasal cavity and sphenoid sinus to access the sella using an endoscope. This procedure is intricate due to the proximity of crucial anatomical structures (e.g. carotid arteries and optic nerves) to pituitary tumours, and any unintended damage can lead to severe complications including blindness and death. Intraoperative guidance during this surgery could support improved localization of the critical structures leading to reducing the risk of complications.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A deep learning network PitSurgRT is proposed for real-time localization of critical structures in endoscopic pituitary surgery. The network uses high-resolution net (HRNet) as a backbone with a multi-head for jointly localizing critical anatomical structures while segmenting larger structures simultaneously. Moreover, the trained model is optimized and accelerated by using TensorRT. Finally, the model predictions are shown to neurosurgeons, to test their guidance capabilities.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Compared with the state-of-the-art method, our model significantly reduces the mean error in landmark detection of the critical structures from 138.76 to 54.40 pixels in a 1280 <jats:inline-formula><jats:alternatives><jats:tex-math>$$\\times $$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mo>\u00d7<\/mml:mo>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula> 720-pixel image. Furthermore, the semantic segmentation of the most critical structure, sella, is improved by 4.39% IoU. The inference speed of the accelerated model achieves 298 frames per second with floating-point-16 precision. In the study of 15 neurosurgeons, 88.67% of predictions are considered accurate enough for real-time guidance.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>The results from the quantitative evaluation, real-time acceleration, and neurosurgeon study demonstrate the proposed method is highly promising in providing real-time intraoperative guidance of the critical anatomical structures in endoscopic pituitary surgery.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03094-2","type":"journal-article","created":{"date-parts":[[2024,3,25]],"date-time":"2024-03-25T21:40:13Z","timestamp":1711402813000},"page":"1053-1060","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["PitSurgRT: real-time localization of critical anatomical structures in endoscopic pituitary surgery"],"prefix":"10.1007","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9225-6318","authenticated-orcid":false,"given":"Zhehua","family":"Mao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adrito","family":"Das","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mobarakol","family":"Islam","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danyal Z.","family":"Khan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simon C.","family":"Williams","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John G.","family":"Hanrahan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anouk","family":"Borg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neil L.","family":"Dorward","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew J.","family":"Clarkson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danail","family":"Stoyanov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hani J.","family":"Marcus","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sophia","family":"Bano","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,3,25]]},"reference":[{"issue":"1","key":"3094_CR1","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.otc.2015.09.001","volume":"49","author":"CR Patel","year":"2016","unstructured":"Patel CR, Fernandez-Miranda JC, Wang W-H, Wang EW (2016) Skull base anatomy. Otolaryngol Clin N Am 49(1):9\u201320","journal-title":"Otolaryngol Clin N Am"},{"issue":"5","key":"3094_CR2","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1080\/17446651.2020.1800452","volume":"15","author":"K Abhinav","year":"2020","unstructured":"Abhinav K, Tyler M, MohyeldinA DaleOT, Fernandez-Miranda JC, Katznelson L (2020) Managing complications of endoscopic transsphenoidal surgery inpituitary adenomas. Expert Rev Endocrinol Metab 15(5):311\u2013319","journal-title":"Expert Rev Endocrinol Metab"},{"issue":"2","key":"3094_CR3","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1007\/s42000-019-00168-8","volume":"19","author":"Araujo-CastroM BerrocalVR","year":"2020","unstructured":"BerrocalVR Araujo-CastroM, Pascual-Corrales E (2020) Pituitary tumors: epidemiology and clinical presentation spectrum. Hormones 19(2):145\u2013155","journal-title":"Hormones"},{"key":"3094_CR4","doi-asserted-by":"publisher","first-page":"1222859","DOI":"10.3389\/fsurg.2023.1222859","volume":"10","author":"A Enkaoua","year":"2023","unstructured":"Enkaoua A, Islam M, Ramalhinho J, Dowrick T, Booker J, Khan DZ, Marcus HJ, Clarkson MJ (2023) Image-guidance in endoscopic pituitary surgery: an in-silico study of errors involved in tracker-based techniques. Front Surg 10:1222859. https:\/\/doi.org\/10.3389\/fsurg.2023.1222859","journal-title":"Front Surg"},{"issue":"6","key":"3094_CR5","doi-asserted-by":"publisher","first-page":"839","DOI":"10.1007\/s11102-021-01162-3","volume":"24","author":"HJ Marcus","year":"2021","unstructured":"Marcus HJ, Khan DZ, Borg A et al (2021) Pituitary society expert Delphi consensus: operative workflow in endoscopic transsphenoidal pituitary adenoma resection. Pituitary 24(6):839\u2013853","journal-title":"Pituitary"},{"issue":"7","key":"3094_CR6","first-page":"3523","volume":"44","author":"S Minaee","year":"2021","unstructured":"Minaee S, Boykov Y, Porikli F, Plaza A, Kehtarnavaz N, Terzopoulos D (2021) Image segmentation using deep learning: a survey. IEEE Trans Pattern Anal Mach Intell 44(7):3523\u20133542","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"2","key":"3094_CR7","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1097\/SLA.0000000000004594","volume":"276","author":"A Madani","year":"2022","unstructured":"Madani A, Namazi B, Altieri MS, Hashimoto DA, Rivera AM, Pucher PH, Navarrete-Welton A, Sankaranarayanan G, Brunt LM, Okrainec A, Alseidi A (2022) Artificial intelligence for intraoperative guidance: using semantic segmentation to identify surgical anatomy during laparoscopic cholecystectomy. Ann Surg 276(2):363\u2013369","journal-title":"Ann Surg"},{"issue":"4","key":"3094_CR8","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1093\/ons\/opab187","volume":"21","author":"VE Staartjes","year":"2021","unstructured":"Staartjes VE, Volokitin A, Regli L, Konukoglu E, Serra C (2021) Machine vision for real-time intraoperative anatomic guidance: a proof-of-concept study in endoscopic pituitary surgery. Oper Neurosurg 21(4):242\u2013247","journal-title":"Oper Neurosurg"},{"key":"3094_CR9","doi-asserted-by":"crossref","unstructured":"Das A, Khan DZ, Williams SC, Hanrahan JG, Borg A, Dorward NL, Bano S, Marcus HJ, Stoyanov D (2023) A multi-task network for anatomy identification in endoscopic pituitary surgery. In: International conference on medical image computing and computer-assisted intervention, pp 472\u2013482","DOI":"10.1007\/978-3-031-43996-4_45"},{"key":"3094_CR10","doi-asserted-by":"crossref","unstructured":"Zhou Z, Rahman\u00a0Siddiquee MM, Tajbakhsh N, Liang J (2018) Unet++: a nested u-net architecture for medical image segmentation. In: Deep learning in medical image analysis and multimodal learning for clinical decision support: 4th international workshop, DLMIA 2018, and 8th international workshop, ML-CDS 2018, pp 3\u201311","DOI":"10.1007\/978-3-030-00889-5_1"},{"key":"3094_CR11","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1007\/978-1-4842-6168-2_10","volume-title":"Image recognition and dataset categorization, convolutional neural networks with swift for tensorflow","author":"B Koonce","year":"2021","unstructured":"Koonce B, Koonce B (2021) Efficientnet. Image recognition and dataset categorization, convolutional neural networks with swift for tensorflow. Springer, Cham, pp 109\u2013123"},{"key":"3094_CR12","unstructured":"Holder CJ, Shafique M (2022) On efficient real-time semantic segmentation: a survey. arXiv preprint arXiv:2206.08605"},{"key":"3094_CR13","doi-asserted-by":"crossref","unstructured":"Li H, Xiong P, Fan H, Sun J (2019) Dfanet: deep feature aggregation for real-time semantic segmentation. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 9522\u20139531","DOI":"10.1109\/CVPR.2019.00975"},{"key":"3094_CR14","doi-asserted-by":"crossref","unstructured":"Zhang X, Zhou M, Sun J (2018) Shufflenet: an extremely efficient convolutional neural network for mobile devices. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6848\u20136856","DOI":"10.1109\/CVPR.2018.00716"},{"key":"3094_CR15","doi-asserted-by":"crossref","unstructured":"Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L-C (2018) Mobilenetv2: Inverted residuals and linear bottlenecks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4510\u20134520","DOI":"10.1109\/CVPR.2018.00474"},{"key":"3094_CR16","doi-asserted-by":"crossref","unstructured":"Wang J, Jin Y, Wang L, Cai S, Heng P-A, Qin J (2021) Efficient global-local memory for real-time instrument segmentation of robotic surgical video. In: Medical image computing and computer assisted intervention\u2013MICCAI 2021: 24th international conference, Strasbourg, France, September 27\u2013October 1, 2021, proceedings, Part IV 24, pp 341\u2013351","DOI":"10.1007\/978-3-030-87202-1_33"},{"key":"3094_CR17","doi-asserted-by":"publisher","first-page":"40496","DOI":"10.1109\/ACCESS.2021.3063716","volume":"9","author":"D Jha","year":"2021","unstructured":"Jha D, Ali S, Tomar NK, Johansen HD, Johansen D, Rittscher J, Riegler MA, Halvorsen P (2021) Real-time polyp detection, localization and segmentation in colonoscopy using deep learning. IEEE Access 9:40496\u201340510","journal-title":"IEEE Access"},{"issue":"5","key":"3094_CR18","doi-asserted-by":"publisher","first-page":"3203","DOI":"10.1109\/TCSVT.2021.3095970","volume":"32","author":"H Kirchhoffer","year":"2021","unstructured":"Kirchhoffer H, Haase P, Samek W, M\u00fcller K, Rezazadegan-Tavakoli H, Cricri F, Aksu EB, Hannuksela MM, Jiang W, Wang W, Liu S, Jain S, Hamidi-Rad S, Racap\u00e9 F, Bailer W (2021) Overview of the neural network compression and representation (NNR) standard. IEEE Trans Circuits Syst Video Technol 32(5):3203\u20133216","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"issue":"10","key":"3094_CR19","doi-asserted-by":"publisher","first-page":"3349","DOI":"10.1109\/TPAMI.2020.2983686","volume":"43","author":"J Wang","year":"2020","unstructured":"Wang J, Sun K, Cheng T, Jiang B, Deng C, Zhao Y, Liu D, Mu Y, Tan M, Wang X, Liu W, Xiao B (2020) Deep high-resolution representation learning for visual recognition. IEEE Trans Pattern Anal Mach Intell 43(10):3349\u20133364","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"3094_CR20","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Medical image computing and computer-assisted intervention\u2013MICCAI 2015, October 5-9, 2015, proceedings, part III 18, pp 234\u2013241","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"3094_CR21","unstructured":"Kervadec H, Bouchtiba C, Granger E, Dolz J, Ayed IB (2019) Boundary loss for highly unbalanced segmentation. In: International conference on medical imaging with deep learning PMLR"},{"key":"3094_CR22","doi-asserted-by":"crossref","unstructured":"Feng Z-H, Kittler J, Awais M, Huber P, Wu X-J (2018) Wing loss for robust facial landmark localisation with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2235\u20132245","DOI":"10.1109\/CVPR.2018.00238"},{"issue":"3","key":"3094_CR23","doi-asserted-by":"publisher","first-page":"517","DOI":"10.5603\/FM.a2018.0106","volume":"78","author":"L Taner","year":"2019","unstructured":"Taner L, Uzuner FD, Demirel O, G\u00fcngor K (2019) Volumetric and three-dimensional examination of sella turcica by cone-beam computed tomography: reference data for guidance to pathologic pituitary morphology. Folia Morphol 78(3):517\u2013523","journal-title":"Folia Morphol"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03094-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03094-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03094-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T11:23:18Z","timestamp":1718364198000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03094-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,25]]},"references-count":23,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["3094"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03094-2","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,25]]},"assertion":[{"value":"19 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Author DS is an employee of Digital Surgery, Medtronic, which is developing products related to the research described in this paper. No funding was issued for this study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Ethic approval (REC reference: 21\/SW\/0027) was granted for the data collected for this project via a regional ethics committee (IRAS 271696).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Informed written patient consent was obtained for the data used for AI model development.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}