{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T19:17:50Z","timestamp":1774293470720,"version":"3.50.1"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T00:00:00Z","timestamp":1702252800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T00:00:00Z","timestamp":1702252800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National Natural Science Foundation of China, the \u201cDouble Creation\u201d Plan of Jiangsu Province","award":["62172190"],"award-info":[{"award-number":["62172190"]}]},{"name":"\u201cTaihu Talent-Innovative Leading Talent\u201d Plan of Wuxi City","award":["202110"],"award-info":[{"award-number":["202110"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis. Comput. Ind. Biomed. Art"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The traditional feature-extraction method of oriented FAST and rotated BRIEF (ORB) detects image features based on a fixed threshold; however, ORB descriptors do not distinguish features well in capsule endoscopy images. Therefore, a new feature detector that uses a new method for setting thresholds, called the adaptive threshold FAST and FREAK in capsule endoscopy images (AFFCEI), is proposed. This method, first constructs an image pyramid and then calculates the thresholds of pixels based on the gray value contrast of all pixels in the local neighborhood of the image, to achieve adaptive image feature extraction in each layer of the pyramid. Subsequently, the features are expressed by the FREAK descriptor, which can enhance the discrimination of the features extracted from the stomach image. Finally, a refined matching is obtained by applying the grid-based motion statistics algorithm to the result of Hamming distance, whereby mismatches are rejected using the RANSAC algorithm. Compared with the ASIFT method, which previously had the best performance, the average running time of AFFCEI was 4\/5 that of ASIFT, and the average matching score improved by 5% when tracking features in a moving capsule endoscope.<\/jats:p>","DOI":"10.1186\/s42492-023-00151-6","type":"journal-article","created":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T04:08:53Z","timestamp":1702267733000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Adaptive feature extraction method for capsule endoscopy images"],"prefix":"10.1186","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-8401-8893","authenticated-orcid":false,"given":"Dingchang","family":"Wu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yinghui","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haomiao","family":"Ma","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lingyu","family":"Ai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinlong","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaojie","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,12,11]]},"reference":[{"key":"151_CR1","doi-asserted-by":"publisher","unstructured":"Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91\u2013110. https:\/\/doi.org\/10.1023\/B:VISI.0000029664.99615.94","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"151_CR2","doi-asserted-by":"publisher","unstructured":"Bay H, Tuytelaars T, Van Gool L (2006) SURF: speeded up robust features. In: Leonardis A, Bischof H, Pinz A (eds) Computer vision - ECCV 2006. 9th European conference on computer vision, Graz, May 7-13, 2006. Lecture notes in computer science, vol 3951. Springer, Heidelberg, pp 404\u2013417. https:\/\/doi.org\/10.1007\/11744023_32","DOI":"10.1007\/11744023_32"},{"key":"151_CR3","doi-asserted-by":"publisher","unstructured":"Rosten E, Porter R, Drummond T (2010) Faster and better: a machine learning approach to corner detection. IEEE Trans Pattern Anal Mach Intell 32(1):105\u2013119. https:\/\/doi.org\/10.1109\/TPAMI.2008.275","DOI":"10.1109\/TPAMI.2008.275"},{"key":"151_CR4","doi-asserted-by":"publisher","unstructured":"Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: an efficient alternative to SIFT or SURF. In: Proceedings of 2011 international conference on computer vision, IEEE, Barcelona, 6-13 November 2011. https:\/\/doi.org\/10.1109\/ICCV.2011.6126544","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"151_CR5","doi-asserted-by":"publisher","unstructured":"Sch\u00f6nberger JL, Frahm JM (2016) Structure-from-motion revisited. In: Proceedings of 2016 IEEE conference on computer vision and pattern recognition, IEEE, Las Vegas, 27-30 June 2016. https:\/\/doi.org\/10.1109\/CVPR.2016.445","DOI":"10.1109\/CVPR.2016.445"},{"key":"151_CR6","unstructured":"Vijayanarasimhan S, Ricco S, Schmid C, Sukthankar R, Fragkiadaki K (2017) SfM-Net: learning of structure and motion from video. arXiv preprint arXiv: 1704.07804"},{"key":"151_CR7","doi-asserted-by":"publisher","unstructured":"Mildenhall B, Srinivasan PP, Tancik M, Barron JT, Ramamoorthi R, Ng R (2022) NeRF: representing scenes as neural radiance fields for view synthesis. Commun ACM 65(1):99\u2013106. https:\/\/doi.org\/10.1145\/3503250","DOI":"10.1145\/3503250"},{"key":"151_CR8","doi-asserted-by":"publisher","unstructured":"Lurie KL, Angst R, Zlatev DV, Liao JC, Bowden AKE (2017) 3D reconstruction of cystoscopy videos for comprehensive bladder records. Biomed Opt Express 8(4):2106\u20132123. https:\/\/doi.org\/10.1364\/BOE.8.002106","DOI":"10.1364\/BOE.8.002106"},{"key":"151_CR9","doi-asserted-by":"publisher","unstructured":"Song JW, Wang J, Zhao L, Huang SD, Dissanayake G (2018) MIS-SLAM: real-time large-scale dense deformable SLAM system in minimal invasive surgery based on heterogeneous computing. IEEE Robot Autom Lett 3(4):4068\u20134075. https:\/\/doi.org\/10.1109\/LRA.2018.2856519","DOI":"10.1109\/LRA.2018.2856519"},{"key":"151_CR10","doi-asserted-by":"publisher","unstructured":"Liu XT, Zheng YP, Killeen B, Ishii M, Hager GD, Taylor RH et al (2020) Extremely dense point correspondences using a learned feature descriptor. In: Proceedings of 2020 IEEE\/CVF conference on computer vision and pattern recognition, IEEE, Seattle, 13-19 June 2020. https:\/\/doi.org\/10.1109\/CVPR42600.2020.00490","DOI":"10.1109\/CVPR42600.2020.00490"},{"key":"151_CR11","doi-asserted-by":"publisher","unstructured":"Furukawa R, Morinaga H, Sanomura Y, Tanaka S, Yoshida S, Kawasaki H (2016) Shape acquisition and registration for 3D endoscope based on grid pattern projection. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision - ECCV 2016. 14th European conference, Amsterdam, October 11-14, 2016.\u00a0Lecture notes in computer science, vol 9910. Springer, Heidelberg, pp 399\u2013415. https:\/\/doi.org\/10.1007\/978-3-319-46466-4_24","DOI":"10.1007\/978-3-319-46466-4_24"},{"key":"151_CR12","doi-asserted-by":"publisher","unstructured":"Widya AR, Monno Y, Okutomi M, Suzuki S, Gotoda T, Miki K (2019) Whole stomach 3D reconstruction and frame localization from monocular endoscope video. IEEE J Transl Eng Health Med 7:3300310. https:\/\/doi.org\/10.1109\/JTEHM.2019.2946802","DOI":"10.1109\/JTEHM.2019.2946802"},{"key":"151_CR13","doi-asserted-by":"publisher","unstructured":"Widya AR, Monno Y, Imahori K, Okutomi M, Suzuki S, Gotoda T et al (2019) 3D reconstruction of whole stomach from endoscope video using structure-from-motion. In: Proceedings of the 41st annual international conference of the IEEE engineering in medicine and biology society, IEEE, Berlin, 23-27 July 2019. https:\/\/doi.org\/10.1109\/EMBC.2019.8857964","DOI":"10.1109\/EMBC.2019.8857964"},{"key":"151_CR14","doi-asserted-by":"publisher","unstructured":"Ozyoruk KB, Gokceler GI, Bobrow TL, Coskun G, Incetan K, Almalioglu Y et al (2021) EndoSLAM dataset and an unsupervised monocular visual odometry and depth estimation approach for endoscopic videos. Med Image Anal 71:102058. https:\/\/doi.org\/10.1016\/j.media.2021.102058","DOI":"10.1016\/j.media.2021.102058"},{"key":"151_CR15","doi-asserted-by":"publisher","unstructured":"Alahi A, Ortiz R, Vandergheynst P (2012) FREAK: fast retina keypoint. In: Proceedings of 2012 IEEE conference on computer vision and pattern recognition, IEEE, Providence, 16-21 June 2012. https:\/\/doi.org\/10.1109\/CVPR.2012.6247715","DOI":"10.1109\/CVPR.2012.6247715"},{"key":"151_CR16","unstructured":"Ke Y, Sukthankar R (2004) PCA-SIFT: a more distinctive representation for local image descriptors. In: Proceedings of 2004 IEEE computer society conference on computer vision and pattern recognition, IEEE, Washington, 27 June-2 July"},{"key":"151_CR17","doi-asserted-by":"publisher","unstructured":"Peker KA (2011) Binary SIFT: fast image retrieval using binary quantized SIFT features. In: Proceedings of the 9th international workshop on content-based multimedia indexing, IEEE, Madrid, 13-15 June 2011. https:\/\/doi.org\/10.1109\/CBMI.2011.5972548","DOI":"10.1109\/CBMI.2011.5972548"},{"key":"151_CR18","doi-asserted-by":"publisher","unstructured":"Song JW, Wang J, Zhao L, Huang SD, Dissanayake G (2018) Dynamic reconstruction of deformable soft-tissue with stereo scope in minimal invasive surgery. IEEE Robot Autom Lett 3(1):155\u2013162. https:\/\/doi.org\/10.1109\/LRA.2017.2735487","DOI":"10.1109\/LRA.2017.2735487"},{"key":"151_CR19","doi-asserted-by":"publisher","unstructured":"Liu Y, Tian JW, Hu RR, Yang B, Liu S, Yin LR et al (2022) Improved feature point pair purification algorithm based on sift during endoscope image stitching. Front Neurorobot 16:840594. https:\/\/doi.org\/10.3389\/fnbot.2022.840594","DOI":"10.3389\/fnbot.2022.840594"},{"key":"151_CR20","doi-asserted-by":"publisher","unstructured":"Yang GC, Chen ZJ, Li Y, Su ZD (2019) Rapid relocation method for mobile robot based on improved ORB-SLAM2 algorithm. Remote Sens 11(2):149. https:\/\/doi.org\/10.3390\/rs11020149","DOI":"10.3390\/rs11020149"},{"key":"151_CR21","doi-asserted-by":"publisher","unstructured":"Calonder M, Lepetit V, Strecha C, Fua P (2010) BRIEF: binary robust independent elementary features. In: Daniilidis K, Maragos P, Paragios N (eds) Computer vision - ECCV 2010. 11th European conference on computer vision, Heraklion, Crete, September 5-11, 2010. Lecture notes in computer science, vol 6314. Springer, Heidelberg, pp 778\u2013792.\u00a0https:\/\/doi.org\/10.1007\/978-3-642-15561-1_56","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"151_CR22","doi-asserted-by":"publisher","unstructured":"Zhang ZY, Wang LX, Zheng WF, Yin LR, Hu RR, Yang B (2022) Endoscope image mosaic based on pyramid ORB. Biomed Signal Proc Control 71:103261. https:\/\/doi.org\/10.1016\/j.bspc.2021.103261","DOI":"10.1016\/j.bspc.2021.103261"},{"key":"151_CR23","doi-asserted-by":"publisher","unstructured":"Spyrou E, Iakovidis DK (2014) Video-based measurements for wireless capsule endoscope tracking. Meas Sci Technol 25(1):015002. https:\/\/doi.org\/10.1088\/0957-0233\/25\/1\/015002","DOI":"10.1088\/0957-0233\/25\/1\/015002"},{"key":"151_CR24","doi-asserted-by":"publisher","unstructured":"Mur-Artal R, Tard\u00f3s JD (2017) ORB-SLAM2: an open-source SLAM system for monocular, stereo, and RGB-D cameras. IEEE Trans Robot 33(5):1255\u20131262.\u00a0https:\/\/doi.org\/10.1109\/TRO.2017.2705103","DOI":"10.1109\/TRO.2017.2705103"},{"key":"151_CR25","doi-asserted-by":"publisher","unstructured":"Ma CQ, Hu XG, Xiao J, Zhang GF (2021) Homogenized ORB algorithm using dynamic threshold and improved quadtree. Math Probl Eng 2021:6693627. https:\/\/doi.org\/10.1155\/2021\/6693627","DOI":"10.1155\/2021\/6693627"},{"key":"151_CR26","doi-asserted-by":"publisher","unstructured":"Yi KM, Trulls E, Lepetit V, Fua P (216) LIFT: Learned invariant feature transform. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision - ECCV 2016. 14th European conference, Amsterdam, October 11-14. Lecture notes in computer science, vol 9910. Springer, Heidelberg, pp 467\u2013483. https:\/\/doi.org\/10.1007\/978-3-319-46466-4_28","DOI":"10.1007\/978-3-319-46466-4_28"},{"key":"151_CR27","doi-asserted-by":"publisher","unstructured":"Dusmanu M, Rocco I, Pajdla T, Pollefeys M, Sivic J, Torii A et al (2019) D2-Net: a trainable CNN for joint description and detection of local features. In: Proceedings of 2019 IEEE\/CVF conference on computer vision and pattern recognition, IEEE, Long Beach, 15-20 June 2019. https:\/\/doi.org\/10.1109\/CVPR.2019.00828","DOI":"10.1109\/CVPR.2019.00828"},{"key":"151_CR28","doi-asserted-by":"publisher","unstructured":"Sun JM, Shen ZH, Wang Y, Bao HJ, Zhou XW (2021) LoFTR: detector-free local feature matching with transformers. In: Proceedings of 2021 IEEE\/CVF conference on computer vision and pattern recognition, IEEE, Nashville, 20-25 June 2021. https:\/\/doi.org\/10.1109\/CVPR46437.2021.00881","DOI":"10.1109\/CVPR46437.2021.00881"},{"key":"151_CR29","doi-asserted-by":"publisher","unstructured":"Ma JY, Jiang XY, Fan AX, Jiang JJ, Yan JC (2021) Image matching from handcrafted to deep features: a survey. Int J Comput Vis 129(1):23\u201379. https:\/\/doi.org\/10.1007\/s11263-020-01359-2","DOI":"10.1007\/s11263-020-01359-2"},{"key":"151_CR30","doi-asserted-by":"publisher","unstructured":"DeTone D, Malisiewicz T, Rabinovich A (2018) SuperPoint: self-supervised interest point detection and description. In: Proceedings of 2018 IEEE\/CVF conference on computer vision and pattern recognition workshops, IEEE, Salt Lake City, 18-22 June 2018. https:\/\/doi.org\/10.1109\/CVPRW.2018.00060","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"151_CR31","doi-asserted-by":"publisher","unstructured":"Bian JW, Lin WY, Matsushita Y, Yeung SK, Nguyen TD, Cheng MM (2017) GMS: grid-based motion statistics for fast, ultra-robust feature correspondence. In: Proceedings of 2017 IEEE conference on computer vision and pattern recognition, IEEE, Honolulu, 21-26 July 2017. https:\/\/doi.org\/10.1109\/CVPR.2017.302","DOI":"10.1109\/CVPR.2017.302"},{"key":"151_CR32","doi-asserted-by":"publisher","unstructured":"\u0130ncetan K, Celik IO, Obeid A, Gokceler GI, Ozyoruk KB, Almalioglu Y et al (2021) VR-caps: a virtual environment for capsule endoscopy. Med Image Anal 70:101990. https:\/\/doi.org\/10.1016\/j.media.2021.101990","DOI":"10.1016\/j.media.2021.101990"}],"container-title":["Visual Computing for Industry, Biomedicine, and Art"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42492-023-00151-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s42492-023-00151-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42492-023-00151-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T04:15:23Z","timestamp":1702268123000},"score":1,"resource":{"primary":{"URL":"https:\/\/vciba.springeropen.com\/articles\/10.1186\/s42492-023-00151-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,11]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["151"],"URL":"https:\/\/doi.org\/10.1186\/s42492-023-00151-6","relation":{},"ISSN":["2524-4442"],"issn-type":[{"value":"2524-4442","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,11]]},"assertion":[{"value":"23 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 December 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Written informed consent was obtained from all the participants before their inclusion in the study. All participants were provided with detailed information about the study, including its purpose, procedures, potential risks and benefits, and right to withdraw at any time.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Written informed consent was obtained from all participants included in this study for the use of their data and images in any publications resulting from the study. The participants were informed that their participation was voluntary and that they could withdraw from the study at any time without penalty.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no conflicts of interest.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"24"}}