{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T11:33:54Z","timestamp":1784288034216,"version":"3.55.0"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T00:00:00Z","timestamp":1732233600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T00:00:00Z","timestamp":1732233600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Machine Vision and Applications"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Image-based unmanned aerial vehicle (UAV) pose estimation is carried out by deep learning (DL) to automate the UAV aim-point selection for a laser beam control research testbed (LBCRT). DL models are proposed to estimate the UAV pose from available UAV target images and serve as a new sensor within the testbed. Such models are designed to address the problem of pose ambiguity, which arises from different 3D UAV poses looking similar in a 2D image plane. The models are trained under three datasets: synthetic data, synthetic data combined with real-world data, and real-world data. Afterward, the models are compared based on their ability to infer a real-world UAV trajectory in order to analyze the impact of using synthetic data during training. Quantitative results show that the proposed DL models solve the pose ambiguity problem when trained with appropriate data. In average, the models trained on real-world data had the lowest mean angle error, followed by those trained on combined data, and those trained solely on synthetic data. This shows that synthetic data should be carefully selected to bridge the gap when real-world data is unavailable or scarce. Customized real-world and synthetic data were created for the research. Real-world data are short wave infra-red (SWIR) images of a 3D printed UAV model with varying poses and associated pose labels. In addition, synthetic data are UAV images with varying poses and associated labels created by simulation. For this research, 77,077 real-world and 100,000 synthetic data were created.<\/jats:p>","DOI":"10.1007\/s00138-024-01630-3","type":"journal-article","created":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T03:23:02Z","timestamp":1732245782000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Deep learning for unambiguous pose estimation of a non-cooperative fixed-wing UAV"],"prefix":"10.1007","volume":"36","author":[{"given":"Leonardo","family":"Herrera","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jae Jun","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brij N.","family":"Agrawal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,11,22]]},"reference":[{"issue":"1","key":"1630_CR1","doi-asserted-by":"publisher","first-page":"7389652","DOI":"10.1155\/2019\/7389652","volume":"2019","author":"D Fu","year":"2019","unstructured":"Fu, D., Li, W., Han, S., Zhang, X., Zhan, Z., Yang, M.: The aircraft pose estimation based on a convolutional neural network. Math. Probl. Eng. 2019(1), 7389652 (2019)","journal-title":"Math. Probl. Eng."},{"key":"1630_CR2","doi-asserted-by":"crossref","unstructured":"Phisannupawong, T., Kamsing, P., Tortceka, P., Yooyen, S.: Vision-based attitude estimation for spacecraft docking operation through deep learning algorithm. In: 2020 22nd International Conference on Advanced Communication Technology (ICACT), IEEE. pp. 280\u2013284 (2020)","DOI":"10.23919\/ICACT48636.2020.9061445"},{"key":"1630_CR3","doi-asserted-by":"crossref","unstructured":"Proen\u00e7a, P.F., Gao, Y.: Deep learning for spacecraft pose estimation from photorealistic rendering. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), IEEE. pp. 6007\u20136013 (2020)","DOI":"10.1109\/ICRA40945.2020.9197244"},{"key":"1630_CR4","doi-asserted-by":"crossref","unstructured":"Sharma, S., Beierle, C., D\u2019Amico, S.: Pose estimation for non-cooperative spacecraft rendezvous using convolutional neural networks. In: 2018 IEEE Aerospace Conference, IEEE. pp. 1\u201312 (2018)","DOI":"10.1109\/AERO.2018.8396425"},{"issue":"7","key":"1630_CR5","doi-asserted-by":"publisher","first-page":"424","DOI":"10.3390\/pr7070424","volume":"7","author":"LA Giefer","year":"2019","unstructured":"Giefer, L.A., Arango Castellanos, J.D., Babr, M.M., Freitag, M.: Deep learning-based pose estimation of apples for inspection in logistic centers using single-perspective imaging. Processes 7(7), 424 (2019)","journal-title":"Processes"},{"key":"1630_CR6","doi-asserted-by":"crossref","unstructured":"Br\u00e4ndle, M.: Pointing\/tracking control design for a high energy laser system. In 2014 IEEE\/ASME International Conference on Advanced Intelligent Mechatronics, IEEE. pp. 676\u2013682 (2014)","DOI":"10.1109\/AIM.2014.6878157"},{"key":"1630_CR7","doi-asserted-by":"crossref","unstructured":"Kim, D., Kim, J.J., Frist, D., Nagashima, M., Agrawal, B.: High energy laser testbed for accurate beam pointing control. In: Free-Space Laser Communication Technologies XXII, SPIE, vol. 7587, pp. 137\u2013155 (2010)","DOI":"10.1117\/12.842212"},{"issue":"4","key":"1630_CR8","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1364\/AO.5.000517","volume":"5","author":"R Lucy","year":"1966","unstructured":"Lucy, R., Peters, C., McGann, E., Lang, K.: Precision laser automatic tracking system. Appl. Opt. 5(4), 517\u2013524 (1966)","journal-title":"Appl. Opt."},{"key":"1630_CR9","doi-asserted-by":"crossref","unstructured":"Xiang, Y., Schmidt, T., Narayanan, V., Fox, D.: PoseCNN: A convolutional neural network for 6d object pose estimation in cluttered scenes. arXiv preprint arXiv:1711.00199 (2017)","DOI":"10.15607\/RSS.2018.XIV.019"},{"key":"1630_CR10","doi-asserted-by":"crossref","unstructured":"Jau, Y.Y., Zhu, R., Su, H., Chandraker, M.: Deep keypoint-based camera pose estimation with geometric constraints. In: 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE. pp. 4950\u20134957 (2020)","DOI":"10.1109\/IROS45743.2020.9341229"},{"key":"1630_CR11","doi-asserted-by":"crossref","unstructured":"Tekin, B., Sinha, S.N., Fua, P.: Real-time seamless single shot 6d object pose prediction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 292\u2013301 (2018)","DOI":"10.1109\/CVPR.2018.00038"},{"key":"1630_CR12","doi-asserted-by":"crossref","unstructured":"Kendall, A., Grimes, M., Cipolla, R.: Posenet: a convolutional network for real-time 6-dof camera relocalization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2938\u20132946 (2015)","DOI":"10.1109\/ICCV.2015.336"},{"key":"1630_CR13","doi-asserted-by":"crossref","unstructured":"Pavlakos, G., Zhou, X., Chan, A., Derpanis, K.G., Daniilidis, K.: 6-dof object pose from semantic keypoints. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), IEEE. pp. 2011\u20132018 (2017)","DOI":"10.1109\/ICRA.2017.7989233"},{"key":"1630_CR14","doi-asserted-by":"crossref","unstructured":"Chen, H., Wang, P., Wang, F., Tian, W., Xiong, L., Li, H.: EPro-PnP: generalized end-to-end probabilistic perspective-n-points for monocular object pose estimation. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. pp. 2781\u20132790 (2022)","DOI":"10.1109\/CVPR52688.2022.00280"},{"key":"1630_CR15","unstructured":"Mahendran, S., Lu, M.Y., Ali, H., Vidal, R.: Monocular object orientation estimation using Riemannian regression and classification networks. arXiv preprint arXiv:1807.07226 (2018)"},{"key":"1630_CR16","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., Girshick, R.: Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961\u20132969 (2017)","DOI":"10.1109\/ICCV.2017.322"},{"key":"1630_CR17","doi-asserted-by":"crossref","unstructured":"Newell, A., Yang, K., Deng, J.: Stacked hourglass networks for human pose estimation. In: European Conference on Computer Vision, Springer. pp. 483\u2013499 (2016)","DOI":"10.1007\/978-3-319-46484-8_29"},{"key":"1630_CR18","doi-asserted-by":"crossref","unstructured":"Sun, K., Xiao, B., Liu, D., Wang, J.: Deep high-resolution representation learning for human pose estimation. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. pp. 5693\u20135703 (2019)","DOI":"10.1109\/CVPR.2019.00584"},{"issue":"12","key":"1630_CR19","doi-asserted-by":"publisher","first-page":"2024","DOI":"10.1109\/TPAMI.2006.252","volume":"28","author":"G Schweighofer","year":"2006","unstructured":"Schweighofer, G., Pinz, A.: Robust pose estimation from a planar target. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2024\u20132030 (2006)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"1630_CR20","doi-asserted-by":"crossref","unstructured":"Manhardt, F., Arroyo, D.M., Rupprecht, C., Busam, B., Birdal, T., Navab, N., Tombari, F.: Explaining the ambiguity of object detection and 6d pose from visual data. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision. pp. 6841\u20136850 (2019)","DOI":"10.1109\/ICCV.2019.00694"},{"issue":"1","key":"1630_CR21","doi-asserted-by":"publisher","first-page":"2151191","DOI":"10.1080\/08839514.2022.2151191","volume":"37","author":"L Herrera","year":"2022","unstructured":"Herrera, L., Jae Jun, K., Baker, J., Agrawal, B.N.: Deep learning based object attitude estimation for a laser beam control research testbed. Appl. Artif. Intell. 37(1), 2151191 (2022)","journal-title":"Appl. Artif. Intell."},{"key":"1630_CR22","doi-asserted-by":"publisher","DOI":"10.1002\/0470099720","volume-title":"Global Positioning Systems, Inertial Navigation, and Integration","author":"MS Grewal","year":"2007","unstructured":"Grewal, M.S., Weill, L.R., Andrews, A.P.: Global Positioning Systems, Inertial Navigation, and Integration. John Wiley & Sons, Hoboken (2007)"},{"key":"1630_CR23","volume-title":"Aided Navigation: GPS With High Rate Sensors","author":"J Farrell","year":"2008","unstructured":"Farrell, J.: Aided Navigation: GPS With High Rate Sensors. McGraw-Hill Inc (2008)"}],"container-title":["Machine Vision and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00138-024-01630-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00138-024-01630-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00138-024-01630-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,18]],"date-time":"2025-01-18T10:28:53Z","timestamp":1737196133000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00138-024-01630-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,22]]},"references-count":23,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["1630"],"URL":"https:\/\/doi.org\/10.1007\/s00138-024-01630-3","relation":{},"ISSN":["0932-8092","1432-1769"],"issn-type":[{"value":"0932-8092","type":"print"},{"value":"1432-1769","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,22]]},"assertion":[{"value":"18 June 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 October 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 November 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"5"}}