{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T03:44:04Z","timestamp":1776397444227,"version":"3.51.2"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T00:00:00Z","timestamp":1766102400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T00:00:00Z","timestamp":1766102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Air Force Institute of Tech. Library (ENWL) D'Azzo Research Library"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Machine Vision and Applications"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Estimating the position and orientation of a rigid object from an image is critical for situational awareness in robotics and autonomous systems. This study explores relative pose estimation using an ultra-wide fisheye camera for unmanned aircraft inspection vehicles. Ultra-wide fisheye lenses introduce radial distortion and capture features beyond the rectilinear image plane, rendering rectilinear Perspective-n-Point (PnP) algorithms inadequate. Designing a bespoke ultra-wide fisheye localization algorithm requires consideration of both the feature detection method and the pose estimator itself. This study proposes a novel method that combines (1) a fisheye-to-cubemap reprojection, (2) a You Only Look Once (YOLO) convolutional neural network trained for arbitrary airborne perspectives, and (3) an Angle-Agnostic and Multiple-Frame PnP (AMP) pose estimation algorithm. Our pipeline achieves a 97% success rate for valid pose estimates, with a mean absolute translational error of less than 12\u00a0cm on real ultra-wide fisheye imagery, outperforming conventional techniques, including OpenCV.<\/jats:p>","DOI":"10.1007\/s00138-025-01768-8","type":"journal-article","created":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T02:10:41Z","timestamp":1766110241000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Amp: single-shot ultra-wide fisheye-to-cubemap PnP pose estimation"],"prefix":"10.1007","volume":"37","author":[{"given":"Ryan M.","family":"Raettig","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard R.","family":"Nyquist","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Scott L.","family":"Nykl","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Clark N.","family":"Taylor","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christine M.","family":"Schubert Kabban","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,12,19]]},"reference":[{"key":"1768_CR1","unstructured":"Air Force Institute of Technology: Autonomy and navigation technology (ant) center. https:\/\/www.afit.edu\/ANT\/ (2025). Accessed 04 April 2025"},{"issue":"2","key":"1768_CR2","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/s00138-022-01279-w","volume":"33","author":"JD Anderson","year":"2022","unstructured":"Anderson, J.D., Raettig, R.M., Larson, J., Nykl, S.L., Taylor, C.N., Wischgoll, T.: Delaunay walk for fast nearest neighbor: accelerating correspondence matching for icp. Mach. Vis. Appl. 33(2), 31 (2022)","journal-title":"Mach. Vis. Appl."},{"key":"1768_CR3","unstructured":"Artec 3D: Artec Leo 3D Scanner [Scanner]. Artec 3D. https:\/\/www.artec3d.com\/portable-3d-scanners\/artec-leo (2023)"},{"key":"1768_CR4","unstructured":"Bradski, G.: The OpenCV Library. Dr. Dobb\u2019s Journal of Software Tools (2000)"},{"issue":"3","key":"1768_CR5","doi-asserted-by":"publisher","first-page":"1261","DOI":"10.1007\/s00521-023-09094-8","volume":"36","author":"J Choate","year":"2024","unstructured":"Choate, J., Worth, D., Nykl, S., Taylor, C., Borghetti, B., Schubert Kabban, C.: An analysis of precision: occlusion and perspective geometry\u2019s role in 6d pose estimation. Neural Comput. Appl. 36(3), 1261 (2024)","journal-title":"Neural Comput. Appl."},{"key":"1768_CR6","doi-asserted-by":"crossref","unstructured":"Choate, J., Worth, D., Nykl, S., Taylor, C., Borghetti, B., Schubert\u00a0Kabban, C., Raettig, R.: From simulation to reality: transfer learning for automating pseudo-labeling of real and infrared imagery. unpublished manuscript (2024)","DOI":"10.1002\/aisy.202400575"},{"issue":"1","key":"1768_CR7","first-page":"2","volume":"4","author":"KG Derpanis","year":"2010","unstructured":"Derpanis, K.G.: Overview of the ransac algorithm. Image Rochester NY 4(1), 2\u20133 (2010)","journal-title":"Image Rochester NY"},{"issue":"2","key":"1768_CR8","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1109\/MRA.2006.1638022","volume":"13","author":"H Durrant-Whyte","year":"2006","unstructured":"Durrant-Whyte, H., Bailey, T.: Simultaneous localization and mapping: part i. IEEE Robot. Autom. Mag. 13(2), 99\u2013110 (2006)","journal-title":"IEEE Robot. Autom. Mag."},{"key":"1768_CR9","doi-asserted-by":"crossref","unstructured":"Faure, B., Odic, N., Haggui, O., Magnier, B.: Performance of recent tiny\/small yolo versions in the context of top-view fisheye images. In: International Conference on Image Analysis and Processing, pp. 246\u2013257. Springer (2022)","DOI":"10.1007\/978-3-031-13321-3_22"},{"key":"1768_CR10","doi-asserted-by":"publisher","unstructured":"Fernandez, R.F., Keller, K., Robins, J.: Design of a system for aircraft fuselage inspection. In: 2016 IEEE Systems and Information Engineering Design Symposium (SIEDS), pp. 283\u2013288 (2016). https:\/\/doi.org\/10.1109\/SIEDS.2016.7489315","DOI":"10.1109\/SIEDS.2016.7489315"},{"issue":"6","key":"1768_CR11","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1145\/358669.358692","volume":"24","author":"MA Fischler","year":"1981","unstructured":"Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381\u2013395 (1981)","journal-title":"Commun. ACM"},{"key":"1768_CR12","unstructured":"Friesenhahn, D.: Comparing yolov8 to yolov5 for pose estimation supporting automated aerial refueling. In: Thesis defense slides (2024)"},{"issue":"8","key":"1768_CR13","doi-asserted-by":"publisher","first-page":"930","DOI":"10.1109\/TPAMI.2003.1217599","volume":"25","author":"XS Gao","year":"2003","unstructured":"Gao, X.S., Hou, X.R., Tang, J., Cheng, H.F.: Complete solution classification for the perspective-three-point problem. IEEE Trans. Pattern Anal. Mach. Intell. 25(8), 930\u2013943 (2003)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"1768_CR14","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1007\/BF02028352","volume":"13","author":"BM Haralick","year":"1994","unstructured":"Haralick, B.M., Lee, C.N., Ottenberg, K., N\u00f6lle, M.: Review and analysis of solutions of the three point perspective pose estimation problem. Int. J. Comput. Vision 13, 331\u2013356 (1994)","journal-title":"Int. J. Comput. Vision"},{"key":"1768_CR15","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1007\/BF02028352","volume":"13","author":"BM Haralick","year":"1994","unstructured":"Haralick, B.M., Lee, C.N., Ottenberg, K., N\u00f6lle, M.: Review and analysis of solutions of the three point perspective pose estimation problem. Int. J. Comput. Vision 13, 331\u2013356 (1994)","journal-title":"Int. J. Comput. Vision"},{"issue":"4","key":"1768_CR16","doi-asserted-by":"publisher","first-page":"629","DOI":"10.1364\/JOSAA.4.000629","volume":"4","author":"BK Horn","year":"1987","unstructured":"Horn, B.K.: Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A 4(4), 629\u2013642 (1987)","journal-title":"J. Opt. Soc. Am. A"},{"key":"1768_CR17","doi-asserted-by":"publisher","first-page":"1066","DOI":"10.1016\/j.procs.2022.01.135","volume":"199","author":"P Jiang","year":"2022","unstructured":"Jiang, P., Ergu, D., Liu, F., Cai, Y., Ma, B.: A review of yolo algorithm developments. Procedia Comput. Sci. 199, 1066\u20131073 (2022)","journal-title":"Procedia Comput. Sci."},{"key":"1768_CR18","doi-asserted-by":"publisher","unstructured":"Jocher, G.: Ultralytics yolov5 (2020https:\/\/doi.org\/10.5281\/zenodo.3908559, https:\/\/github.com\/ultralytics\/yolov5","DOI":"10.5281\/zenodo.3908559"},{"key":"1768_CR19","unstructured":"Krutz, J.: Cargo ramp estimation using point cloud segmentation (2024)"},{"key":"1768_CR20","doi-asserted-by":"publisher","first-page":"431","DOI":"10.5194\/isprs-archives-XLIII-B1-2022-431-2022","volume":"43","author":"UG Lee","year":"2022","unstructured":"Lee, U.G., Park, S.Y.: Visual odometry of a mobile palette robot using ground plane image from a fisheye camera. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 43, 431\u2013436 (2022)","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"issue":"2","key":"1768_CR21","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","volume":"81","author":"V Lepetit","year":"2009","unstructured":"Lepetit, V., Moreno-Noguer, F., Fua, P.: Epnp: An accurate o(n) solution to the pnp problem. Int. J. Comput. Vision 81(2), 155\u2013166 (2009)","journal-title":"Int. J. Comput. Vision"},{"issue":"2","key":"1768_CR22","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1137\/0111030","volume":"11","author":"DW Marquardt","year":"1963","unstructured":"Marquardt, D.W.: An algorithm for least-squares estimation of nonlinear parameters. J. Soc. Ind. Appl. Math. 11(2), 431\u2013441 (1963). https:\/\/doi.org\/10.1137\/0111030","journal-title":"J. Soc. Ind. Appl. Math."},{"key":"1768_CR23","doi-asserted-by":"crossref","unstructured":"Na, W., Jeong, J., Jo, S., Oh, Y., Chon, E.: Hardware accelerator for vslam using fisheye image in embedded system. In: 2023 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), pp. 1\u20134. IEEE (2023)","DOI":"10.1109\/ICCE-Asia59966.2023.10326418"},{"key":"1768_CR24","unstructured":"Nakano, G.: A simple direct solution to the perspective-three-point problem. In: BMVC. 26 (2019)"},{"key":"1768_CR25","doi-asserted-by":"crossref","unstructured":"Nykl, S., Mourning, C., Leitch, M., Chelberg, D., Franklin, T., Liu, C.: An overview of the steamie educational game engine. In: 2008 38th Annual Frontiers in Education Conference, pp. F3B\u201321. IEEE (2008)","DOI":"10.1109\/FIE.2008.4720454"},{"key":"1768_CR26","unstructured":"Nyquist, R.: Amp: Single-shot ultra-wide fisheye-to-cubemap pnp pose estimation. https:\/\/youtu.be\/6IRoCIVQHAs (2025). Accessed 04 April 2025"},{"key":"1768_CR27","unstructured":"Nyquist, R., Raettig, R., Taylor, C., Nykl, S.: Real time feature detection and localization using a fisheye camera. In: ION GNSS+ 2024. Baltimore, Maryland, USA (September 16\u201320 2024)"},{"key":"1768_CR28","unstructured":"OpenCV: solvepnp implementation for fisheye camera model. https:\/\/github.com\/opencv\/opencv\/pull\/25028 (2024). Accessed 30 Sept 2024"},{"key":"1768_CR29","unstructured":"Optics, E.: 8.5mm c series fixed focal length lens. https:\/\/www.edmundoptics.com\/p\/85mm-c-series-fixed-focal-length-lens\/14947\/ (2025). Accessed 14 Feb 2025"},{"key":"1768_CR30","unstructured":"Optics, E.: Allied vision alvium g1-811c 23 8.1mp c-mount gige poe color camera. https:\/\/www.edmundoptics.com\/p\/allied-vision-alvium-g1-811c-23-81mp-c-mount-gige-poe-color-camera\/49036\/ (2025) . Accessed 14 Feb 2025"},{"key":"1768_CR31","unstructured":"Owens, A., Boyd, L., Nykl, S.: Identification and localization of austere runways using computer vision. In: Proceedings of the ION Joint Navigation Conference (JNC). Air Force Institute of Technology (2024), session F3: M&S: Platform and Environmental Considerations, Location: Ballroom E, Date: June 3, 2024, Time: 2:50 p.m"},{"key":"1768_CR32","unstructured":"Panteleev, M., Bettahar, H.: Depth estimation analysis of orthogonally divergent fisheye cameras with distortion removal. Preprint at arXiv:2307.03602 (2023)"},{"key":"1768_CR33","unstructured":"Raettig, R.M.: Accelerating point set registration for automated aerial refueling. In: Master\u2019s thesis, Air Force Institute of Technology (2021)"},{"key":"1768_CR34","first-page":"154851292211504","volume":"21","author":"RM Raettig","year":"2023","unstructured":"Raettig, R.M., Anderson, J.D., Nykl, S.L., Merkle, L.D.: Accelerated point set registration method. J. Def. Model. Simul. 21, 15485129221150454 (2023)","journal-title":"J. Def. Model. Simul."},{"key":"1768_CR35","unstructured":"Rashed, H., Mohamed, E., Sistu, G., Kumar, V.R., Eising, C., El-Sallab, A., Yogamani, S.: Fisheyeyolo: object detection on fisheye cameras for autonomous driving. In: Proceedings of the Machine Learning for Autonomous Driving NeurIPS 2020 Virtual Workshop, Virtual. 11, 1 (2020)"},{"key":"1768_CR36","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)","DOI":"10.1109\/CVPR.2016.91"},{"key":"1768_CR37","doi-asserted-by":"publisher","DOI":"10.1016\/j.rineng.2024.102330","volume":"22","author":"DA Rodr\u00edguez","year":"2024","unstructured":"Rodr\u00edguez, D.A., Tafur, C.L., Daza, P.F.M., Vidales, J.A.V., Rinc\u00f3n, J.C.D.: Inspection of aircrafts and airports using uas: a review. Results Eng. 22, 102330 (2024)","journal-title":"Results Eng."},{"key":"1768_CR38","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: Orb: an efficient alternative to sift or surf. In: 2011 International conference on computer vision, pp. 2564\u20132571. IEEE (2011)","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"1768_CR39","doi-asserted-by":"crossref","unstructured":"Shao, S., Li, Z., Zhang, T., Peng, C., Yu, G., Zhang, X., Li, J., Sun, J.: Objects365: a large-scale, high-quality dataset for object detection. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV) (2019)","DOI":"10.1109\/ICCV.2019.00852"},{"key":"1768_CR40","doi-asserted-by":"crossref","unstructured":"Tappe, M., Dose, D., Oelsch, M., Karimi, M., H\u00f6sch, L., Heller, L., Knufinke, J., Alpen, M., Horn, J., Bachmeir, C.: Uas-based autonomous visual inspection of airplane surface defects. In: NDE 4.0, Predictive Maintenance, and Communication and Energy Systems in a Globally Networked World. 12049, 8\u201321. SPIE (2022)","DOI":"10.1117\/12.2612579"},{"key":"1768_CR41","unstructured":"Tian, Y., Ye, Q., Doermann, D.: Yolov12: attention-centric real-time object detectors. Preprint at arXiv:2502.12524 (2025)"},{"key":"1768_CR42","unstructured":"Tian, Y., Ye, Q., Doermann, D.: Yolov12: Attention-centric real-time object detectors (2025), https:\/\/github.com\/sunsmarterjie\/yolov12"},{"key":"1768_CR43","unstructured":"Video, B.P.: Fujinon fe185c057ha-1 2\/3\" 1.8mm f\/1.4 lens. https:\/\/www.bhphotovideo.com\/c\/product\/404281-REG\/Fujinon_FE185C057HA1_FE185C057HA_1_2_3_1_8mm_F_1_4.html (2025). Accessed 14 Feb 2025"},{"key":"1768_CR44","doi-asserted-by":"crossref","unstructured":"Wang, Y., Cai, S., Li, S.J., Liu, Y., Guo, Y., Li, T., Cheng, M.M.: Cubemapslam: a piecewise-pinhole monocular fisheye slam system. In: Asian Conference on Computer Vision, pp. 34\u201349. Springer (2018)","DOI":"10.1007\/978-3-030-20876-9_3"},{"issue":"01","key":"1768_CR45","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1109\/34.67632","volume":"13","author":"WJ Wolfe","year":"1991","unstructured":"Wolfe, W.J., Mathis, D., Sklair, C.W., Magee, M.: The perspective view of three points. IEEE Trans. Pattern Anal. Mach. Intell. 13(01), 66\u201373 (1991)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"1768_CR46","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00521-024-09589-y","volume":"36","author":"D Worth","year":"2024","unstructured":"Worth, D., Choate, J., Lynch, J., Nykl, S., Taylor, C.: Relative vectoring using dual object detection for autonomous aerial refueling. Neural Comput. Appl. 36, 1\u201321 (2024)","journal-title":"Neural Comput. Appl."},{"issue":"1","key":"1768_CR47","doi-asserted-by":"publisher","first-page":"44","DOI":"10.3390\/app14010044","volume":"14","author":"D Yang","year":"2023","unstructured":"Yang, D., Zhou, J., Song, T., Zhang, X., Song, Y.: Pgds-yolov8s: an improved yolov8s model for object detection in fisheye images. Appl. Sci. 14(1), 44 (2023)","journal-title":"Appl. Sci."}],"container-title":["Machine Vision and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00138-025-01768-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00138-025-01768-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00138-025-01768-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T02:50:21Z","timestamp":1776394221000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00138-025-01768-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,19]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["1768"],"URL":"https:\/\/doi.org\/10.1007\/s00138-025-01768-8","relation":{},"ISSN":["0932-8092","1432-1769"],"issn-type":[{"value":"0932-8092","type":"print"},{"value":"1432-1769","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,19]]},"assertion":[{"value":"8 April 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 August 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 November 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 December 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"18"}}