{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T10:17:52Z","timestamp":1770977872578,"version":"3.50.1"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,9,29]],"date-time":"2021-09-29T00:00:00Z","timestamp":1632873600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,9,29]],"date-time":"2021-09-29T00:00:00Z","timestamp":1632873600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100014440","name":"ministerio de ciencia, innovaci\u00f3n y universidades","doi-asserted-by":"publisher","award":["PID2020-116418RB-I00"],"award-info":[{"award-number":["PID2020-116418RB-I00"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Universidad Miguel Hern\u00e1ndez"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"published-print":{"date-parts":[[2022,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper reports and evaluates the adaption and re-training of a Convolutional Neural Network (CNN) with the aim of tackling the visual localization of a mobile robot by means of a hierarchical approach. The proposed method addresses the localization problem from the information captured by a catadioptric vision sensor mounted on the mobile robot. A CNN is adapted and evaluated with a twofold purpose. First, to perform a rough localization step (room retrieval) by means of the output layer. Second, to refine this localization in the retrieved room (fine localization step) by means of holistic descriptors obtained from intermediate layers of the same CNN. The robot estimates its position within the selected room\/s through a nearest neighbour search by comparing the obtained holistic descriptor with the visual model of the retrieved room\/s. Additionally, this method takes advantage of the likelihood information provided by the output layer of the CNN. This likelihood is helpful to determine which rooms should be considered in the fine localization process. This novel hierarchical localization method constitutes an efficient and robust solution, as shown in the experimental section even in presence of severe changes of the lighting conditions.<\/jats:p>","DOI":"10.1007\/s10462-021-10076-2","type":"journal-article","created":{"date-parts":[[2021,9,29]],"date-time":"2021-09-29T13:05:54Z","timestamp":1632920754000},"page":"2847-2874","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Development and use of a convolutional neural network for hierarchical appearance-based localization"],"prefix":"10.1007","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4047-3841","authenticated-orcid":false,"given":"S.","family":"Cebollada","sequence":"first","affiliation":[]},{"given":"L.","family":"Pay\u00e1","sequence":"additional","affiliation":[]},{"given":"X.","family":"Jiang","sequence":"additional","affiliation":[]},{"given":"O.","family":"Reinoso","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,9,29]]},"reference":[{"key":"10076_CR1","unstructured":"Abadi MHB, Oskoei MA, Fakharian A (2015) Mobile robot navigation using sonar vision algorithm applied to omnidirectional vision. In: 2015 AI and Robotics (IRANOPEN), IEEE, pp 1\u20136"},{"key":"10076_CR2","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1016\/j.eswa.2018.02.042","volume":"102","author":"F Amor\u00f3s","year":"2018","unstructured":"Amor\u00f3s F, Pay\u00e1 L, Mar\u00edn JM, Reinoso O (2018) Trajectory estimation and optimization through loop closure detection, using omnidirectional imaging and global-appearance descriptors. Exp Syst Appl 102:273\u2013290","journal-title":"Exp Syst Appl"},{"key":"10076_CR3","doi-asserted-by":"publisher","unstructured":"Arroyo R, Alcantarilla PF, Bergasa LM, Romera E (2016) Fusion and binarization of cnn features for robust topological localization across seasons. In: 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 4656\u20134663, https:\/\/doi.org\/10.1109\/IROS.2016.7759685","DOI":"10.1109\/IROS.2016.7759685"},{"issue":"3","key":"10076_CR4","doi-asserted-by":"publisher","first-page":"377","DOI":"10.3390\/app9030377","volume":"9","author":"S Cebollada","year":"2019","unstructured":"Cebollada S, Pay\u00e1 L, Mayol W, Reinoso O (2019a) Evaluation of clustering methods in compression of topological models and visual place recognition using global appearance descriptors. Appl Sci 9(3):377","journal-title":"Appl Sci"},{"key":"10076_CR5","doi-asserted-by":"publisher","first-page":"49580","DOI":"10.1109\/ACCESS.2019.2910581","volume":"7","author":"S Cebollada","year":"2019","unstructured":"Cebollada S, Pay\u00e1 L, Rom\u00e1n V, Reinoso O (2019b) Hierarchical localization in topological models under varying illumination using holistic visual descriptors. IEEE Access 7:49580\u201349595. https:\/\/doi.org\/10.1109\/ACCESS.2019.2910581","journal-title":"IEEE Access"},{"key":"10076_CR6","doi-asserted-by":"crossref","unstructured":"Cebollada S, Pay\u00e1 L, Valiente D, Jiang X, Reinoso O (2019c) An evaluation between global appearance descriptors based on analytic methods and deep learning techniques for localization in autonomous mobile robots. In: ICINCO 2019, 16th International Conference on Informatics in Control, Automation and Robotics (Prague, Czech Republic, 29-31 July, 2019), Ed. INSTICC, pp 284\u2013291","DOI":"10.5220\/0007837102840291"},{"key":"10076_CR7","doi-asserted-by":"crossref","unstructured":"Cebollada S, Pay\u00e1 L, Flores M, Rom\u00e1n V, Peidr\u00f3 A, Reinoso O (2020) A deep learning tool to solve localization in mobile autonomous robotics. In: ICINCO 2020, 17th International Conference on Informatics in Control, Automation and Robotics (Lieusaint-Paris, France, 7-9 July, 2020), Ed. INSTICC","DOI":"10.5220\/0009767102320241"},{"key":"10076_CR8","doi-asserted-by":"publisher","first-page":"114195","DOI":"10.1016\/j.eswa.2020.114195","volume":"167","author":"S Cebollada","year":"2021","unstructured":"Cebollada S, Pay\u00e1 L, Flores M, Peidr\u00f3 A, Reinoso O (2021) A state-of-the-art review on mobile robotics tasks using artificial intelligence and visual data. Exp Syst Appl 167:114195. https:\/\/doi.org\/10.1016\/j.eswa.2020.114195","journal-title":"Exp Syst Appl"},{"key":"10076_CR9","doi-asserted-by":"crossref","unstructured":"\u00c7evik N, \u00c7evik T (2019) A novel high-performance holistic descriptor for face retrieval. Pattern Analysis and Applications pp 1\u201313","DOI":"10.1007\/s10044-019-00803-5"},{"key":"10076_CR10","doi-asserted-by":"crossref","unstructured":"Chaves D, Ruiz-Sarmiento J, Petkov N, Gonzalez-Jimenez J (2019) Integration of cnn into a robotic architecture to build semantic maps of indoor environments. In: International Work-Conference on Artificial Neural Networks, Springer, pp 313\u2013324","DOI":"10.1007\/978-3-030-20518-8_27"},{"key":"10076_CR11","doi-asserted-by":"crossref","unstructured":"Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego, USA. Vol. II, pp. 886-893","DOI":"10.1109\/CVPR.2005.177"},{"issue":"3","key":"10076_CR12","first-page":"364","volume":"13","author":"J Ding","year":"2016","unstructured":"Ding J, Chen B, Liu H, Huang M (2016) Convolutional neural network with data augmentation for sar target recognition. IEEE Geosci Remote Sens Lett 13(3):364\u2013368","journal-title":"IEEE Geosci Remote Sens Lett"},{"key":"10076_CR13","doi-asserted-by":"publisher","unstructured":"Dong-Won\u00a0S ESK Yo-Sung\u00a0H (2019) Loop closure detection in simultaneous localization and mapping using descriptor from generative adversarial network. Journal of Electronic Imaging 28(1):1 \u2013 13 \u2013 13, https:\/\/doi.org\/10.1117\/1.JEI.28.1.013014","DOI":"10.1117\/1.JEI.28.1.013014"},{"key":"10076_CR14","doi-asserted-by":"publisher","unstructured":"Dymczyk M, Gilitschenski I, Nieto J, Lynen S, Zeisl B, Siegwart R (2018) Landmarkboost: Efficient visualcontext classifiers for robust localization. In: 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 677\u2013684, https:\/\/doi.org\/10.1109\/IROS.2018.8594100","DOI":"10.1109\/IROS.2018.8594100"},{"issue":"2","key":"10076_CR15","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1002\/rob.21736","volume":"35","author":"R Gonzalez","year":"2018","unstructured":"Gonzalez R, Apostolopoulos D, Iagnemma K (2018) Slippage and immobilization detection for planetary exploration rovers via machine learning and proprioceptive sensing. J Field Robot 35(2):231\u2013247","journal-title":"J Field Robot"},{"key":"10076_CR16","unstructured":"Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT press"},{"key":"10076_CR17","unstructured":"Guo J, Gould S (2015) Deep cnn ensemble with data augmentation for object detection. arXiv preprint arXiv:150607224"},{"key":"10076_CR18","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.eswa.2017.11.028","volume":"95","author":"D Han","year":"2018","unstructured":"Han D, Liu Q, Fan W (2018) A new image classification method using cnn transfer learning and web data augmentation. Exp Syst Appl 95:43\u201356","journal-title":"Exp Syst Appl"},{"key":"10076_CR19","doi-asserted-by":"crossref","unstructured":"He K, Lu Y, Sclaroff S (2018) Local descriptors optimized for average precision. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","DOI":"10.1109\/CVPR.2018.00069"},{"key":"10076_CR20","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097\u20131105"},{"issue":"4\u20135","key":"10076_CR21","doi-asserted-by":"publisher","first-page":"705","DOI":"10.1177\/0278364914549607","volume":"34","author":"I Lenz","year":"2015","unstructured":"Lenz I, Lee H, Saxena A (2015) Deep learning for detecting robotic grasps. Int J Robot Res 34(4\u20135):705\u2013724","journal-title":"Int J Robot Res"},{"issue":"4\u20135","key":"10076_CR22","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1177\/0278364917710318","volume":"37","author":"S Levine","year":"2018","unstructured":"Levine S, Pastor P, Krizhevsky A, Ibarz J, Quillen D (2018) Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection. Int J Robot Res 37(4\u20135):421\u2013436","journal-title":"Int J Robot Res"},{"issue":"3","key":"10076_CR23","first-page":"1021","volume":"31","author":"S Li","year":"2019","unstructured":"Li S, Chou L, Chang T, Yang C, Chang Y (2019) Obstacle avoidance of mobile robot based on hyperomni vision. Sens Mater 31(3):1021\u20131036","journal-title":"Sens Mater"},{"key":"10076_CR24","doi-asserted-by":"crossref","unstructured":"Liu R, Zhang J, Yin K, Pan Z, Lin R, Chen S (2018) Absolute orientation and localization estimation from an omnidirectional image. In: Pacific Rim International Conference on Artificial Intelligence, Springer, pp 309\u2013316","DOI":"10.1007\/978-3-319-97310-4_35"},{"key":"10076_CR25","doi-asserted-by":"crossref","unstructured":"Luo Z, Shen T, Zhou L, Zhu S, Zhang R, Yao Y, Fang T, Quan L (2018) Geodesc: Learning local descriptors by integrating geometry constraints. In: The European Conference on Computer Vision (ECCV)","DOI":"10.1007\/978-3-030-01240-3_11"},{"issue":"3","key":"10076_CR26","doi-asserted-by":"publisher","first-page":"1794","DOI":"10.1109\/LRA.2017.2705282","volume":"2","author":"M Mancini","year":"2017","unstructured":"Mancini M, Bul\u00f2 SR, Ricci E, Caputo B (2017) Learning deep nbnn representations for robust place categorization. IEEE Robot Automation Lett 2(3):1794\u20131801","journal-title":"IEEE Robot Automation Lett"},{"issue":"7","key":"10076_CR27","doi-asserted-by":"publisher","first-page":"1149","DOI":"10.1109\/TCPMT.2018.2799987","volume":"8","author":"R Meattini","year":"2018","unstructured":"Meattini R, Benatti S, Scarcia U, De Gregorio D, Benini L, Melchiorri C (2018) An semg-based human-robot interface for robotic hands using machine learning and synergies. IEEE Trans Component Packag Manufact Technol 8(7):1149\u20131158. https:\/\/doi.org\/10.1109\/TCPMT.2018.2799987","journal-title":"IEEE Trans Component Packag Manufact Technol"},{"issue":"1","key":"10076_CR28","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1109\/TRO.2012.2220211","volume":"29","author":"AC Murillo","year":"2012","unstructured":"Murillo AC, Singh G, Kosecka J, Guerrero JJ (2012) Localization in urban environments using a panoramic gist descriptor. IEEE Trans Robot 29(1):146\u2013160","journal-title":"IEEE Trans Robot"},{"key":"10076_CR29","doi-asserted-by":"crossref","unstructured":"Oliva A, Torralba A (2006) Building the gist of ascene: the role of global image features in recognition. In: Progress in Brain Reasearch: Special Issue on Visual Perception.Vol. 155","DOI":"10.1016\/S0079-6123(06)55002-2"},{"key":"10076_CR30","doi-asserted-by":"crossref","unstructured":"Pay\u00e1 L, Reinoso O, Berenguer Y, \u00dabeda D (2016) Using omnidirectional vision to create a model of the environment: A comparative evaluation of global-appearance descriptors. Journal of Sensors","DOI":"10.1155\/2016\/1209507"},{"issue":"4","key":"10076_CR31","doi-asserted-by":"publisher","first-page":"522","DOI":"10.3390\/rs10040522","volume":"10","author":"L Pay\u00e1","year":"2018","unstructured":"Pay\u00e1 L, Peidr\u00f3 A, Amor\u00f3s F, Valiente D, Reinoso O (2018) Modeling environments hierarchically with omnidirectional imaging and global-appearance descriptors. Remote Sens 10(4):522","journal-title":"Remote Sens"},{"key":"10076_CR32","unstructured":"Perez L, Wang J (2017) The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:171204621"},{"key":"10076_CR33","doi-asserted-by":"publisher","unstructured":"Pronobis A, Caputo B (2009) COLD: COsy Localization Database. The International Journal of Robotics Research (IJRR) 28(5):588\u2013594 https:\/\/doi.org\/10.1177\/0278364909103912, http:\/\/www.pronobis.pro\/publications\/pronobis2009ijrr","DOI":"10.1177\/0278364909103912"},{"issue":"3","key":"10076_CR34","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1109\/LSP.2017.2657381","volume":"24","author":"J Salamon","year":"2017","unstructured":"Salamon J, Bello JP (2017) Deep convolutional neural networks and data augmentation for environmental sound classification. IEEE Signal Process Lett 24(3):279\u2013283. https:\/\/doi.org\/10.1109\/LSP.2017.2657381","journal-title":"IEEE Signal Process Lett"},{"issue":"1","key":"10076_CR35","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1186\/s40537-019-0197-0","volume":"6","author":"C Shorten","year":"2019","unstructured":"Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data 6(1):60","journal-title":"J Big Data"},{"key":"10076_CR36","doi-asserted-by":"publisher","unstructured":"Shvets AA, Rakhlin A, Kalinin AA, Iglovikov VI (2018) Automatic instrument segmentation in robot-assisted surgery using deep learning. In: 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), pp 624\u2013628, https:\/\/doi.org\/10.1109\/ICMLA.2018.00100","DOI":"10.1109\/ICMLA.2018.00100"},{"key":"10076_CR37","doi-asserted-by":"publisher","unstructured":"Sinha H, Patrikar J, Dhekane EG, Pandey G, Kothari M (2018) Convolutional neural network based sensors for mobile robot relocalization. In: 2018 23rd International Conference on Methods Models in Automation Robotics (MMAR), pp 774\u2013779, https:\/\/doi.org\/10.1109\/MMAR.2018.8485921","DOI":"10.1109\/MMAR.2018.8485921"},{"issue":"7","key":"10076_CR38","doi-asserted-by":"publisher","first-page":"2041","DOI":"10.3390\/s18072041","volume":"18","author":"D Valiente","year":"2018","unstructured":"Valiente D, Pay\u00e1 L, Jim\u00e9nez LM, Sebasti\u00e1n JM, Reinoso \u00d3 (2018) Visual information fusion through bayesian inference for adaptive probability-oriented feature matching. Sensors 18(7):2041","journal-title":"Sensors"},{"key":"10076_CR39","doi-asserted-by":"crossref","unstructured":"Voulodimos A, Doulamis N, Doulamis A (2018) Protopapadakis E (2018) Deep learning for computer vision: A brief review. Computational intelligence and neuroscience","DOI":"10.1155\/2018\/7068349"},{"key":"10076_CR40","doi-asserted-by":"crossref","unstructured":"Wozniak P, Afrisal H, Esparza RG, Kwolek B (2018) Scene recognition for indoor localization of mobile robots using deep cnn. In: International Conference on Computer Vision and Graphics, Springer, pp 137\u2013147","DOI":"10.1007\/978-3-030-00692-1_13"},{"key":"10076_CR41","unstructured":"Zhou B, Lapedriza A, Xiao J, Torralba A, Oliva A (2014) Learning deep features for scene recognition using places database. In: Advances in neural information processing systems, pp 487\u2013495"},{"key":"10076_CR42","doi-asserted-by":"publisher","unstructured":"Zhu Y, Mottaghi R, Kolve E, Lim JJ, Gupta A, Fei-Fei L, Farhadi A (2017) Target-driven visual navigation in indoor scenes using deep reinforcement learning. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp 3357\u20133364, https:\/\/doi.org\/10.1109\/ICRA.2017.7989381","DOI":"10.1109\/ICRA.2017.7989381"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-021-10076-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-021-10076-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-021-10076-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T07:32:50Z","timestamp":1648539170000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-021-10076-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,29]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,4]]}},"alternative-id":["10076"],"URL":"https:\/\/doi.org\/10.1007\/s10462-021-10076-2","relation":{},"ISSN":["0269-2821","1573-7462"],"issn-type":[{"value":"0269-2821","type":"print"},{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,29]]},"assertion":[{"value":"29 September 2021","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}}]}}