{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T18:27:34Z","timestamp":1783708054703,"version":"3.55.0"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,1,2]],"date-time":"2025-01-02T00:00:00Z","timestamp":1735776000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,2]],"date-time":"2025-01-02T00:00:00Z","timestamp":1735776000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100023561","name":"Ministerio de Universidades","doi-asserted-by":"publisher","award":["FPU21\/01438"],"award-info":[{"award-number":["FPU21\/01438"]}],"id":[{"id":"10.13039\/501100023561","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011033","name":"Agencia Estatal de Investigaci\u00f3n","doi-asserted-by":"publisher","award":["PID2021-126592OB-C21"],"award-info":[{"award-number":["PID2021-126592OB-C21"]}],"id":[{"id":"10.13039\/501100011033","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["PID2021-126592OB-C21"],"award-info":[{"award-number":["PID2021-126592OB-C21"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100008530","name":"European Regional Development Fund","doi-asserted-by":"publisher","award":["PID2021-126592OB-C21"],"award-info":[{"award-number":["PID2021-126592OB-C21"]}],"id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Symbolic anchoring is an important topic in robotics, as it enables robots to obtain symbolic knowledge from the perceptual information acquired through their sensors and maintain the link between that knowledge and the sensory data. In cognitive-based robots, this process of transforming sub-symbolic data generated by sensors to obtain and maintain symbolic knowledge is still an open problem. To address this issue, this paper presents SAILOR, a framework for symbolic anchoring integrated into ROS 2. SAILOR aims to maintain the link between symbolic data and perceptual data in real robots over time. It provides a semantic world modeling approach using two deep learning-based sub-symbolic robotic skills: object recognition and matching function. The object recognition skill allows the robot to recognize and identify objects in its environment, while the matching function enables the robot to decide if new perceptual data corresponds to existing symbolic data. This paper describes the proposed method and the development of the framework, as well as its integration in MERLIN2 (a hybrid cognitive architecture fully functional in robots running ROS 2) and the validation of SAILOR using public datasets and a real-world scenario.<\/jats:p>","DOI":"10.1038\/s41598-024-84071-2","type":"journal-article","created":{"date-parts":[[2025,1,3]],"date-time":"2025-01-03T02:49:18Z","timestamp":1735872558000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["SAILOR: perceptual anchoring for robotic cognitive architectures"],"prefix":"10.1038","volume":"15","author":[{"given":"Miguel \u00c1.","family":"Gonz\u00e1lez-Santamarta","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Francisco J.","family":"Rodr\u0131guez-Lera","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vicente","family":"Matellan-Olivera","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Virginia Riego","family":"del Castillo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lidia","family":"S\u00e1nchez-Gonz\u00e1lez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,1,2]]},"reference":[{"key":"84071_CR1","doi-asserted-by":"publisher","first-page":"3280","DOI":"10.1109\/TCYB.2018.2857704","volume":"48","author":"P Ye","year":"2018","unstructured":"Ye, P., Wang, T. & Wang, F.-Y. A survey of cognitive architectures in the past 20 years. IEEE Trans. Cybern. 48, 3280\u20133290 (2018).","journal-title":"IEEE Trans. Cybern."},{"key":"84071_CR2","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1007\/s10462-018-9646-y","volume":"53","author":"I Kotseruba","year":"2020","unstructured":"Kotseruba, I. & Tsotsos, J. K. 40 years of cognitive architectures: Core cognitive abilities and practical applications. Artif. Intell. Rev. 53, 17\u201394 (2020).","journal-title":"Artif. Intell. Rev."},{"key":"84071_CR3","unstructured":"Kotseruba, I., Gonzalez, O. J.\u00a0A. & Tsotsos, J.\u00a0K. A review of 40 years of cognitive architecture research: Focus on perception, attention, learning and applications. arXiv preprint arXiv:1610.08602 1\u201374 (2016)."},{"key":"84071_CR4","doi-asserted-by":"crossref","unstructured":"Fox, M. & Long, D. Pddl2. 1: An extension to pddl for expressing temporal planning domains. J. Artif. Intell. Res. 20, 61\u2013124 (2003).","DOI":"10.1613\/jair.1129"},{"key":"84071_CR5","unstructured":"Quigley, M. et al. Ros: An open-source robot operating system. In ICRA Workshop on Open Source Software. Vol.\u00a03. 5 (2009)."},{"key":"84071_CR6","first-page":"333","volume":"25","author":"M Cashmore","year":"2015","unstructured":"Cashmore, M. et al. Rosplan: Planning in the robot operating system. Proc. Int. Conf. Autom. Plan. Scheduling 25, 333\u2013341 (2015).","journal-title":"Proc. Int. Conf. Autom. Plan. Scheduling"},{"key":"84071_CR7","doi-asserted-by":"crossref","unstructured":"Mart\u00edn, F., Clavero, J.\u00a0G., Matell\u00e1n, V. & Rodr\u00edguez, F.\u00a0J. Plansys2: A planning system framework for ros2. In 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS). 9742\u20139749 (IEEE, 2021).","DOI":"10.1109\/IROS51168.2021.9636544"},{"key":"84071_CR8","first-page":"42","volume":"20","author":"A Coles","year":"2010","unstructured":"Coles, A., Coles, A., Fox, M. & Long, D. Forward-chaining partial-order planning. Proc. Int. Conf. Autom. Plan. Scheduling 20, 42\u201349 (2010).","journal-title":"Proc. Int. Conf. Autom. Plan. Scheduling"},{"key":"84071_CR9","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/S0921-8890(03)00021-6","volume":"43","author":"S Coradeschi","year":"2003","unstructured":"Coradeschi, S. & Saffiotti, A. An introduction to the anchoring problem. Robot. Auton. Syst. 43, 85\u201396 (2003).","journal-title":"Robot. Auton. Syst."},{"key":"84071_CR10","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1016\/0167-2789(90)90087-6","volume":"42","author":"S Harnad","year":"1990","unstructured":"Harnad, S. The symbol grounding problem. Phys. D Nonlinear Phenom. 42, 335\u2013346 (1990).","journal-title":"Phys. D Nonlinear Phenom."},{"key":"84071_CR11","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1016\/S1389-0417(02)00051-7","volume":"3","author":"P Vogt","year":"2002","unstructured":"Vogt, P. The physical symbol grounding problem. Cognit. Syst. Res. 3, 429\u2013457 (2002).","journal-title":"Cognit. Syst. Res."},{"key":"84071_CR12","doi-asserted-by":"crossref","unstructured":"Coradeschi, S. & Saffiotti, A. Anchoring symbols to vision data by fuzzy logic. In Symbolic and Quantitative Approaches to Reasoning and Uncertainty 5. 104\u2013115 (Springer, 1999).","DOI":"10.1007\/3-540-48747-6_10"},{"key":"84071_CR13","doi-asserted-by":"publisher","first-page":"311","DOI":"10.3233\/AIS-2009-0040","volume":"1","author":"M Daoutis","year":"2009","unstructured":"Daoutis, M., Coradeshi, S. & Loutfi, A. Grounding commonsense knowledge in intelligent systems. J. Ambient Intell. Smart Environ. 1, 311\u2013321 (2009).","journal-title":"J. Ambient Intell. Smart Environ."},{"key":"84071_CR14","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","volume":"60","author":"DG Lowe","year":"2004","unstructured":"Lowe, D. G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91\u2013110 (2004).","journal-title":"Int. J. Comput. Vis."},{"key":"84071_CR15","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.robot.2012.11.005","volume":"61","author":"J Elfring","year":"2013","unstructured":"Elfring, J., van den Dries, S., Van De Molengraft, M. & Steinbuch, M. Semantic world modeling using probabilistic multiple hypothesis anchoring. Robot. Auton. Syst. 61, 95\u2013105 (2013).","journal-title":"Robot. Auton. Syst."},{"key":"84071_CR16","doi-asserted-by":"publisher","first-page":"76","DOI":"10.3389\/frobt.2016.00076","volume":"3","author":"A Persson","year":"2017","unstructured":"Persson, A., L\u00e4ngkvist, M. & Loutfi, A. Learning actions to improve the perceptual anchoring of objects. Front. Robot. AI 3, 76 (2017).","journal-title":"Front. Robot. AI"},{"key":"84071_CR17","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.robot.2018.08.016","volume":"110","author":"M G\u00fcnther","year":"2018","unstructured":"G\u00fcnther, M., Ruiz-Sarmiento, J., Galindo, C., Gonz\u00e1lez-Jim\u00e9nez, J. & Hertzberg, J. Context-aware 3D object anchoring for mobile robots. Robot. Auton. Syst. 110, 12\u201332 (2018).","journal-title":"Robot. Auton. Syst."},{"key":"84071_CR18","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1002\/nav.3800020109","volume":"2","author":"HW Kuhn","year":"1955","unstructured":"Kuhn, H. W. The Hungarian method for the assignment problem. Naval Res. Logist. Q. 2, 83\u201397 (1955).","journal-title":"Naval Res. Logist. Q."},{"key":"84071_CR19","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1109\/TCDS.2019.2915763","volume":"12","author":"A Persson","year":"2019","unstructured":"Persson, A., Dos Martires, P. Z., De Raedt, L. & Loutfi, A. Semantic relational object tracking. IEEE Trans. Cognit. Dev. Syst. 12, 84\u201397 (2019).","journal-title":"IEEE Trans. Cognit. Dev. Syst."},{"key":"84071_CR20","doi-asserted-by":"crossref","unstructured":"Amjoud, A.\u00a0B. & Amrouch, M. Object detection using deep learning, CNNS and vision transformers: A review. In IEEE Access (2023).","DOI":"10.1109\/ACCESS.2023.3266093"},{"key":"84071_CR21","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","volume":"60","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. Commun. ACM 60, 84\u201390 (2017).","journal-title":"Commun. ACM"},{"key":"84071_CR22","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770\u2013778 (2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"84071_CR23","unstructured":"Ren, S., He, K., Girshick, R. & Sun, J. Faster r-cnn: Towards real-time object detection with region proposal networks. Adv. Neural Inf. Process. Syst. 28 (2015)."},{"key":"84071_CR24","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R. & Farhadi, A. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 779\u2013788 (2016).","DOI":"10.1109\/CVPR.2016.91"},{"key":"84071_CR25","doi-asserted-by":"crossref","unstructured":"Carion, N. et al. End-to-end object detection with transformers. In Computer Vision\u2014ECCV 2020: 16th European Conference, Glasgow, UK, August 23\u201328, 2020, Proceedings, Part I 16. 213\u2013229 (Springer, 2020).","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"84071_CR26","unstructured":"Jocher, G., Chaurasia, A. & Qiu, J. YOLO by Ultralytics (2023)."},{"key":"84071_CR27","doi-asserted-by":"crossref","unstructured":"Yilmaz, A., Javed, O. & Shah, M. Object tracking: A survey. ACM Comput. Surv. (CSUR) 38, 13\u2013es (2006).","DOI":"10.1145\/1177352.1177355"},{"key":"84071_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1348246.1348248","volume":"40","author":"R Datta","year":"2008","unstructured":"Datta, R., Joshi, D., Li, J. & Wang, J. Z. Image retrieval: Ideas, influences, and trends of the new age. ACM Comput. Surv. (Csur) 40, 1\u201360 (2008).","journal-title":"ACM Comput. Surv. (Csur)"},{"key":"84071_CR29","doi-asserted-by":"crossref","unstructured":"Melekhov, I., Kannala, J. & Rahtu, E. Siamese network features for image matching. In 2016 23rd International Conference on Pattern Recognition (ICPR). 378\u2013383 (IEEE, 2016).","DOI":"10.1109\/ICPR.2016.7899663"},{"key":"84071_CR30","doi-asserted-by":"crossref","unstructured":"Qi, Y., Song, Y.-Z., Zhang, H. & Liu, J. Sketch-based image retrieval via siamese convolutional neural network. In 2016 IEEE international conference on image processing (ICIP). 2460\u20132464 (IEEE, 2016).","DOI":"10.1109\/ICIP.2016.7532801"},{"key":"84071_CR31","first-page":"2680","volume":"34","author":"A Rahman","year":"2022","unstructured":"Rahman, A., Winarko, E. & Mustofa, K. Product image retrieval using category-aware siamese convolutional neural network feature. J. King Saud Univ.-Comput. Inf. Sci. 34, 2680\u20132687 (2022).","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"84071_CR32","doi-asserted-by":"publisher","first-page":"11484","DOI":"10.3390\/su141811484","volume":"14","author":"N Sharma","year":"2022","unstructured":"Sharma, N. et al. Siamese convolutional neural network-based twin structure model for independent offline signature verification. Sustainability 14, 11484 (2022).","journal-title":"Sustainability"},{"key":"84071_CR33","doi-asserted-by":"publisher","first-page":"105096","DOI":"10.1016\/j.compbiomed.2021.105096","volume":"140","author":"K Zhang","year":"2022","unstructured":"Zhang, K. et al. Content-based image retrieval with a convolutional siamese neural network: Distinguishing lung cancer and tuberculosis in ct images. Comput. Biol. Med. 140, 105096 (2022).","journal-title":"Comput. Biol. Med."},{"key":"84071_CR34","unstructured":"Coradeschi, S. & Saffiotti, A. Anchoring symbols to sensor data: Preliminary report. In AAAI\/IAAI. 129\u2013135 (2000)."},{"key":"84071_CR35","doi-asserted-by":"crossref","unstructured":"Coradeschi, S., Driankov, D., Karlsson, L. & Saffiotti, A. Fuzzy anchoring. In 10th IEEE International Conference on Fuzzy Systems (Cat. No. 01CH37297). Vol.\u00a01. 111\u2013114 (IEEE, 2001).","DOI":"10.1109\/FUZZ.2001.1007259"},{"key":"84071_CR36","unstructured":"Loutfi, A., Coradeschi, S. & Saffiotti, A. Maintaining coherent perceptual information using anchoring. Int. Joint Conf. Artif. Intell. 19, 1477 (Lawrence Erlbaum Associates Ltd, 2005)."},{"key":"84071_CR37","doi-asserted-by":"crossref","unstructured":"Zhang, Y. et al. Bytetrack: Multi-object tracking by associating every detection box. In Computer Vision\u2014ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23\u201327, 2022, Proceedings, Part XXII. 1\u201321 (Springer, 2022).","DOI":"10.1007\/978-3-031-20047-2_1"},{"key":"84071_CR38","unstructured":"Targ, S., Almeida, D. & Lyman, K. Resnet in resnet: Generalizing residual architectures. arXiv preprint arXiv:1603.08029 (2016)."},{"key":"84071_CR39","doi-asserted-by":"publisher","unstructured":"Kingma, D.\u00a0P. & Ba, J. Adam: A method for stochastic optimization. Cornell Univ. [SPACE]https:\/\/doi.org\/10.48550\/arxiv.1412.6980 (2015).","DOI":"10.48550\/arxiv.1412.6980"},{"key":"84071_CR40","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez-Santamarta, M.\u00a0\u00c1., Rodr\u00edguez-Lera, F.\u00a0J., Mart\u00edn, F., Fern\u00e1ndez, C. & Matell\u00e1n, V. Kant: A tool for grounding and knowledge management. In Bio-inspired Systems and Applications: From Robotics to Ambient Intelligence (Ferr\u00e1ndez Vicente, J.\u00a0M., \u00c1lvarez-S\u00e1nchez, J.\u00a0R., de la Paz L\u00f3pez, F. & Adeli, H. eds.). 452\u2013461 (Springer, 2022).","DOI":"10.1007\/978-3-031-06527-9_45"},{"key":"84071_CR41","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez-Lera, F.\u00a0J., Mart\u00edn-Rico, F. & Matell\u00e1n-Olivera, V. Generating symbolic representation from sensor data: Inferring knowledge in robotics competitions. In 2018 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC). 261\u2013266 (IEEE, 2018).","DOI":"10.1109\/ICARSC.2018.8374193"},{"key":"84071_CR42","doi-asserted-by":"publisher","first-page":"100477","DOI":"10.1016\/j.simpa.2023.100477","volume":"15","author":"MA Gonz\u00e1lez-Santmarta","year":"2023","unstructured":"Gonz\u00e1lez-Santmarta, M. A., Rodr\u00edguez-Lera, F. J., Fern\u00e1ndez-Llamas, C. & Matell\u00e1n-Olivera, V. Merlin2: Machined ros 2 planing. Softw. Impacts 15, 100477. https:\/\/doi.org\/10.1016\/j.simpa.2023.100477 (2023).","journal-title":"Softw. Impacts"},{"key":"84071_CR43","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., Stiller, C. & Urtasun, R. Vision meets robotics: The kitti dataset. Int. J. Robot. Res. (IJRR) (2013).","DOI":"10.1177\/0278364913491297"},{"key":"84071_CR44","doi-asserted-by":"crossref","unstructured":"Caesar, H. et al. nuscenes: A multimodal dataset for autonomous driving. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 11621\u201311631 (2020).","DOI":"10.1109\/CVPR42600.2020.01164"},{"key":"84071_CR45","unstructured":"Schmauser, D., Qiu, Z., M\u00fcller, N. & Nie\u00dfner, M. 3D multi-object tracking with differentiable pose estimation. arXiv preprint arXiv:2206.13785 (2022)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-024-84071-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-024-84071-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-024-84071-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,3]],"date-time":"2025-01-03T22:03:32Z","timestamp":1735941812000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-024-84071-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,2]]},"references-count":45,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["84071"],"URL":"https:\/\/doi.org\/10.1038\/s41598-024-84071-2","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,2]]},"assertion":[{"value":"8 February 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 January 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"The authors confirm that they have complied with the publication ethics and state that this work is original and has not been used for publication anywhere before.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}}],"article-number":"113"}}