{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T22:42:26Z","timestamp":1759963346629,"version":"3.37.3"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2024,4,10]],"date-time":"2024-04-10T00:00:00Z","timestamp":1712707200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,10]],"date-time":"2024-04-10T00:00:00Z","timestamp":1712707200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000288","name":"Royal Society","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000288","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Probe-based confocal laser endomicroscopy (pCLE) enables visualization of cellular tissue morphology during surgical procedures. To capture high-quality pCLE images during tissue scanning, it is important to maintain close contact between the probe and the tissue, while also keeping the probe perpendicular to the tissue surface. Existing robotic pCLE tissue scanning systems, which rely on macroscopic vision, struggle to accurately place the probe at the optimal position on the tissue surface. As a result, the need arises for regression of longitudinal distance and orientation via endomicroscopic vision.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Method<\/jats:title>\n                <jats:p>This paper introduces a novel method for automatically regressing the orientation between a pCLE probe and the tissue surface during robotic scanning, utilizing the fast Fourier vision transformer (FF-ViT) to extract local frequency representations and use them for probe orientation regression. Additionally, the FF-ViT incorporates a blur mapping attention (BMA) module to refine latent representations, which is combined with the pyramid angle regressor (PAR) to precisely estimate probe orientation.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Result<\/jats:title>\n                <jats:p>A first of its kind dataset for pCLE probe-tissue orientation (pCLE-PTO) has been created. The performance evaluation demonstrates that our proposed network surpasses other top regression networks in accuracy, stability, and generalizability, while maintaining low computational complexity (1.8G FLOPs) and high inference speed (90 fps).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>The performance evaluation study verifies the clinical value of the proposed framework and its potential to be integrated into surgical robotic platforms for intraoperative tissue scanning.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03113-2","type":"journal-article","created":{"date-parts":[[2024,4,10]],"date-time":"2024-04-10T12:01:51Z","timestamp":1712750511000},"page":"1137-1145","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["FF-ViT: probe orientation regression for robot-assisted endomicroscopy tissue scanning"],"prefix":"10.1007","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3530-2733","authenticated-orcid":false,"given":"Chi","family":"Xu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alfie","family":"Roddan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haozheng","family":"Xu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giannarou","family":"Stamatia","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,4,10]]},"reference":[{"key":"3113_CR1","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2019.00583","author":"P Charalampaki","year":"2019","unstructured":"Charalampaki P, Nakamura M, Athanasopoulos D, Heimann A (2019) Confocal-assisted multispectral fluorescent microscopy for brain tumor surgery. Front Oncol. https:\/\/doi.org\/10.3389\/fonc.2019.00583","journal-title":"Front Oncol"},{"key":"3113_CR2","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics12112697","author":"I Kakaletri","year":"2022","unstructured":"Kakaletri I, Linxweiler M, Ajlouni S, Charalampaki P (2022) Development, implementation and application of confocal laser endomicroscopy in brain, head and neck surgery-a review. Diagnostics. https:\/\/doi.org\/10.3390\/diagnostics12112697","journal-title":"Diagnostics"},{"key":"3113_CR3","doi-asserted-by":"publisher","unstructured":"Triantafyllou P, Wisanuvej P, Giannarou S, Liu J, Yang G-Z (2018) A framework for sensorless tissue motion tracking in robotic endomicroscopy scanning. In: ICRA. https:\/\/doi.org\/10.1109\/ICRA.2018.8462907","DOI":"10.1109\/ICRA.2018.8462907"},{"key":"3113_CR4","doi-asserted-by":"publisher","unstructured":"Xu C, Roddan A, Davids J, Weld A, Xu H, Giannarou S. (2022) Deep regression with spatial-frequency feature coupling and image synthesis for robot-assisted endomicroscopy. In: MICCAI. https:\/\/doi.org\/10.1007\/978-3-031-16449-1_16","DOI":"10.1007\/978-3-031-16449-1_16"},{"key":"3113_CR5","doi-asserted-by":"publisher","unstructured":"Wisanuvej P, Giataganas P, Leibrandt K, Liu J, Hughes M, Yang G-Z (2017) Three-dimensional robotic-assisted endomicroscopy with a force adaptive robotic arm. In: ICRA. https:\/\/doi.org\/10.1109\/ICRA.2017.7989276 . IEEE","DOI":"10.1109\/ICRA.2017.7989276"},{"key":"3113_CR6","doi-asserted-by":"publisher","unstructured":"Zhang L, Ye M, Giataganas P, Hughes M, Yang G-Z (2017) Autonomous scanning for endomicroscopic mosaicing and 3d fusion. In: ICRA. https:\/\/doi.org\/10.1109\/ICRA.2017.7989412","DOI":"10.1109\/ICRA.2017.7989412"},{"key":"3113_CR7","doi-asserted-by":"publisher","DOI":"10.1002\/rcs.2296","author":"S Sta","year":"2021","unstructured":"Sta S, Ogor J, Letissier H, Stindel E, Hamitouche C, Dardenne G (2021) Towards markerless computer assisted surgery: Application to total knee arthroplasty. IJCARS. https:\/\/doi.org\/10.1002\/rcs.2296","journal-title":"IJCARS"},{"key":"3113_CR8","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-021-02369-2","author":"J Hein","year":"2021","unstructured":"Hein J, Seibold M, Bogo F, Farshad M, Pollefeys M, F\u00fcrnstahl P, Navab N (2021) Towards markerless surgical tool and hand pose estimation. IJCARS. https:\/\/doi.org\/10.1007\/s11548-021-02369-2","journal-title":"IJCARS"},{"key":"3113_CR9","doi-asserted-by":"publisher","unstructured":"Yoshimura M, Marinho MM, Harada K, Mitsuishi M (2020) Single-shot pose estimation of surgical robot instruments\u2019 shafts from monocular endoscopic images. In: ICRA. https:\/\/doi.org\/10.1109\/ICRA40945.2020.9196779","DOI":"10.1109\/ICRA40945.2020.9196779"},{"key":"3113_CR10","unstructured":"Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S, Uszkoreit J, Houlsby J (2020) An image is worth 16x16 words: transformers for image recognition at scale"},{"key":"3113_CR11","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3224044","author":"S Lee","year":"2022","unstructured":"Lee S, Lee S, Song BC (2022) Improving vision transformers to learn small-size dataset from scratch. IEEE Access. https:\/\/doi.org\/10.1109\/ACCESS.2022.3224044","journal-title":"IEEE Access"},{"key":"3113_CR12","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-019-02074-1","author":"D Zhang","year":"2020","unstructured":"Zhang D, Chen J, Li W, Bautista Salinas D, Yang G-Z (2020) A microsurgical robot research platform for robot-assisted microsurgery research and training. IJCARS. https:\/\/doi.org\/10.1007\/s11548-019-02074-1","journal-title":"IJCARS"},{"key":"3113_CR13","doi-asserted-by":"publisher","unstructured":"Pitk\u00e4aho T, Manninen A, Naughton TJ (2017). Performance of autofocus capability of deep convolutional neural networks in digital holographic microscopy. https:\/\/doi.org\/10.1364\/DH.2017.W2A.5. Optical Society of America","DOI":"10.1364\/DH.2017.W2A.5."},{"key":"3113_CR14","doi-asserted-by":"publisher","unstructured":"Ren Z, Xu Z, Lam EY (2018) Learning-based nonparametric autofocusing for digital holography. Optica. https:\/\/doi.org\/10.1364\/OPTICA.5.000337","DOI":"10.1364\/OPTICA.5.000337"},{"key":"3113_CR15","doi-asserted-by":"publisher","DOI":"10.1364\/BOE.9.001601","author":"S Jiang","year":"2018","unstructured":"Jiang S, Liao J, Bian Z, Guo K, Zhang Y, Zheng G (2018) Transform-and multi-domain deep learning for single-frame rapid autofocusing in whole slide imaging. Biomed Opt Express. https:\/\/doi.org\/10.1364\/BOE.9.001601","journal-title":"Biomed Opt Express"},{"key":"3113_CR16","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3061333","author":"C Zhang","year":"2021","unstructured":"Zhang C, Gu Y, Yang J, Yang G-Z (2021) Diversity-aware label distribution learning for microscopy auto focusing. RAL. https:\/\/doi.org\/10.1109\/LRA.2021.3061333","journal-title":"RAL"},{"key":"3113_CR17","doi-asserted-by":"publisher","unstructured":"Crete F, Dolmiere T, Ladret P, Nicolas M (2007) The blur effect: perception and estimation with a new no-reference perceptual blur metric. Human vision and electronic imaging XII, SPIE. https:\/\/doi.org\/10.1117\/12.702790","DOI":"10.1117\/12.702790"},{"key":"3113_CR18","doi-asserted-by":"publisher","DOI":"10.2307\/2003354","author":"JW Cooley","year":"1965","unstructured":"Cooley JW, Tukey JW (1965) An algorithm for the machine calculation of complex fourier series. Math Comput. https:\/\/doi.org\/10.2307\/2003354","journal-title":"Math Comput"},{"key":"3113_CR19","unstructured":"Chi L, Jiang B, Mu Y (2020) Fast fourier convolution. NeurIPS"},{"key":"3113_CR20","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I (2017) Attention is all you need. NeurIPS"},{"key":"3113_CR21","unstructured":"Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, Lin Z, Desmaison A, Antiga L, Lerer A (2017) Automatic differentiation in pytorch. NeurIPS 2017 Workshop"},{"key":"3113_CR22","unstructured":"Loshchilov I, Hutter F (2019) Decoupled weight decay regularization. ICLR"},{"key":"3113_CR23","doi-asserted-by":"publisher","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: CVPR. https:\/\/doi.org\/10.1109\/CVPR.2016.90","DOI":"10.1109\/CVPR.2016.90"},{"key":"3113_CR24","doi-asserted-by":"publisher","unstructured":"Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, Lin S, Guo B (2021) Swin transformer: Hierarchical vision transformer using shifted windows. In: ICCV. https:\/\/doi.org\/10.1109\/ICCV48922.2021.00986","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"3113_CR25","unstructured":"Ali A, Touvron H, Caron M, Bojanowski P, Douze M, Joulin A, Laptev I, Neverova N, Synnaeve G, Verbeek J, J\u00e9gou H (2021) Xcit: Cross-covariance image transformers. NeurIPS"},{"key":"3113_CR26","doi-asserted-by":"publisher","unstructured":"Liu Z, Mao H, Wu C-Y, Feichtenhofer C, Darrell T, Xie S (2022) A convnet for the 2020s. In: CVPR. https:\/\/doi.org\/10.1109\/CVPR52688.2022.01167","DOI":"10.1109\/CVPR52688.2022.01167"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03113-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03113-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03113-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T13:13:42Z","timestamp":1732194822000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03113-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,10]]},"references-count":26,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["3113"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03113-2","relation":{},"ISSN":["1861-6429"],"issn-type":[{"type":"electronic","value":"1861-6429"}],"subject":[],"published":{"date-parts":[[2024,4,10]]},"assertion":[{"value":"8 March 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"No ethical approval is needed for this study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"No informed consent is required as the study does not involve human subjects.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}