{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T10:51:43Z","timestamp":1762253503154,"version":"build-2065373602"},"reference-count":52,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2020,8,15]],"date-time":"2020-08-15T00:00:00Z","timestamp":1597449600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"BAESA, ENERCAN, and FOZ DO CHAPEC\u00d3, under supervision of ANEEL","award":["PD 03936-2607\/2017"],"award-info":[{"award-number":["PD 03936-2607\/2017"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Big construction enterprises, such as electrical power generation dams and mining slopes, demand continuous visual inspections. The sizes of these structures and the necessary level of detail in each mission requires a conflicting set of multi-objective goals, such as performance, quality, and safety. It is challenging for human operators, or simple autonomous path-following drones, to process all this information, and thus, it is common that a mission must be repeated several times until it succeeds. This paper deals with this problem by developing a new cognitive architecture based on a collaborative environment between the unmanned aerial vehicles (UAVs) and other agents focusing on optimizing the data gathering, information processing, and decision-making. The proposed architecture breaks the problem into independent units ranging from sensors and actuators up to high-level intelligence processes. It organizes the structures into data and information; each agent may request an individual behavior from the system. To deal with conflicting behaviors, a supervisory agent analyzes all requests and defines the final planning. This architecture enables real-time decision-making with intelligent social behavior among the agents. Thus, it is possible to process and make decisions about the best way to accomplish the mission. To present the methodology, slope inspection scenarios are shown.<\/jats:p>","DOI":"10.3390\/s20164579","type":"journal-article","created":{"date-parts":[[2020,8,17]],"date-time":"2020-08-17T04:35:51Z","timestamp":1597638951000},"page":"4579","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["A Robotic Cognitive Architecture for Slope and Dam Inspections"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6916-700X","authenticated-orcid":false,"given":"Milena F.","family":"Pinto","sequence":"first","affiliation":[{"name":"Electronics Department, Federal Center for Technological Education of Rio de Janeiro, Rio de Janeiro CEP 20271, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2735-4792","authenticated-orcid":false,"given":"Leonardo M.","family":"Honorio","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Federal University of Juiz de Fora, Juiz de Fora CEP 36036, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8227-6462","authenticated-orcid":false,"given":"Aur\u00e9lio","family":"Melo","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Federal University of Juiz de Fora, Juiz de Fora CEP 36036, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9171-3089","authenticated-orcid":false,"given":"Andre L. M.","family":"Marcato","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Federal University of Juiz de Fora, Juiz de Fora CEP 36036, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1016\/j.advengsoft.2008.10.009","article-title":"Development of dam safety management system","volume":"40","author":"Jeon","year":"2009","journal-title":"Adv. Eng. Softw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1007\/s12555-016-0742-y","article-title":"Generating Homogeneous Map with Targets and Paths for Coordinated Search","volume":"16","author":"Min","year":"2018","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.engappai.2018.11.008","article-title":"TERRA: A path planning algorithm for cooperative UGV\u2013UAV exploration","volume":"78","author":"Ropero","year":"2019","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Seleck\u1ef3, M., Rollo, M., Losiewicz, P., Reade, J., and Maida, N. (2015, January 21\u201323). Framework for incremental development of complex unmanned aircraft systems. Proceedings of the Integrated Communication, Navigation, and Surveillance Conference (ICNS), Herdon, VA, USA.","DOI":"10.1109\/ICNSURV.2015.7121234"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1016\/j.bushor.2018.03.007","article-title":"Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making","volume":"61","author":"Jarrahi","year":"2018","journal-title":"Bus. Horizons"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1177\/0959354303136005","article-title":"Symbolic and sub-symbolic representations in computational models of human cognition: What can be learned from biology?","volume":"13","author":"Kelley","year":"2003","journal-title":"Theory Psychol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1458","DOI":"10.1016\/j.engappai.2013.03.001","article-title":"Multi-objective optimization for dynamic task allocation in a multi-robot system","volume":"26","author":"Tolmidis","year":"2013","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_8","first-page":"554","article-title":"Development of dam safety management system","volume":"40","author":"Tao","year":"2011","journal-title":"Dam Saf."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1007\/s11069-008-9227-5","article-title":"Methods for the estimation of loss of life due to floods: A literature review and a proposal for a new method","volume":"46","author":"Jonkman","year":"2008","journal-title":"Nat. Hazards"},{"key":"ref_10","unstructured":"Bowles, D.S. (2004, January 12\u201314). Estimating Life Loss for Dam Safety Risk Assessment\u2014A Review and New Approach. Proceedings of the USENIX Security Symposium, Boston, MA, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5866","DOI":"10.3390\/s8095866","article-title":"A New Approach for Structural Monitoring of Large Dams with a Three-Dimensional Laser Scanner","volume":"8","year":"2008","journal-title":"Sensors"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1007\/s12555-015-0110-3","article-title":"Design of feedback control for quadrotors considering signal transmission delays","volume":"14","author":"Armah","year":"2016","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/s12555-015-0289-3","article-title":"Trajectory tracking control of multirotors from modelling to experiments: A survey","volume":"15","author":"Lee","year":"2017","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"31","DOI":"10.3389\/fbuil.2018.00031","article-title":"Utilizing UAV and 3D Computer Vision for Visual Inspection of a Large Gravity Dam","volume":"4","author":"Khaloo","year":"2018","journal-title":"Front. Built Environ."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1562","DOI":"10.1080\/19475705.2017.1362039","article-title":"Survey of the Ridracoli Dam: UAV\u2013based photogrammetry and traditional topographic techniques in the inspection of vertical structures","volume":"8","author":"Buffi","year":"2017","journal-title":"Geomat. Nat. Hazards Risk"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/978-3-319-07488-7_9","article-title":"Inspection of Penstocks and Featureless Tunnel-like Environments Using Micro UAVs","volume":"Volume 105","author":"Shen","year":"2015","journal-title":"Field and Service Robotics: Results of the 9th International Conference"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"806","DOI":"10.1007\/s12555-012-0417-2","article-title":"A cognitive agent based manufacturing system adapting to disturbances","volume":"10","author":"Park","year":"2012","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.engappai.2014.11.008","article-title":"Route evaluation for unmanned aerial vehicle based on type-2 fuzzy sets","volume":"39","author":"Sun","year":"2015","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Sampedro, C., Bavle, H., Sanchez Lopez, J.L., Suarez Fernandez, R., Rodriguez Ramos, A., Molina, M., and Campoy Cervera, P. (2016, January 7\u201310). A flexible and dynamic mission planning architecture for uav swarm coordination. Proceedings of the 2016 International Conference on Unmanned Aircraft Systems (ICUAS), Arlington, VA, USA.","DOI":"10.1109\/ICUAS.2016.7502669"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/MAES.2013.6516147","article-title":"An experimental UAV system for search and rescue challenge","volume":"28","author":"Erdos","year":"2013","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3013","DOI":"10.1007\/s12555-018-0017-x","article-title":"Autonomous Vision-based Target Detection and Safe Landing for UAV 2","volume":"16","author":"Rabah","year":"2018","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/s10846-013-9946-z","article-title":"Stability analysis of a vision-based UAV controller","volume":"74","author":"Ramirez","year":"2014","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MCOM.2018.1700422","article-title":"Multiple moving targets surveillance based on a cooperative network for multi-UAV","volume":"56","author":"Gu","year":"2018","journal-title":"IEEE Commun. Mag."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1016\/j.engappai.2004.12.007","article-title":"A class of intelligent agents for coordinated control of outdoor terrain mapping UGVs","volume":"18","author":"Fregene","year":"2005","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1109\/LRA.2018.2794608","article-title":"Anytime Planning for Decentralized Multirobot Active Information Gathering","volume":"3","author":"Schlotfeldt","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.cogsys.2015.12.008","article-title":"Multilayer cognitive architecture for UAV control","volume":"39","author":"Makarov","year":"2016","journal-title":"Cogn. Syst. Res."},{"key":"ref_27","unstructured":"Ball, J.T. (2013, January 11\u201314). Advantages of ACT-R over prolog for natural language analysis. Proceedings of the 22nd Annual Conference on Behavior Representation in Modeling and Simulation, Ottawa, ON, Canada."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Insaurralde, C.C. (2014, January 5\u20139). Service-oriented agent architecture for unmanned air vehicles. Proceedings of the 2014 IEEE\/AIAA 33rd Digital Avionics Systems Conference (DASC), Colorado Springs, CO, USA.","DOI":"10.1109\/DASC.2014.6979535"},{"key":"ref_29","unstructured":"Kothakota, S.K., and Angulo Bah\u00f3n, C. (2015, January 23\u201327). Integracion de la Arquitectura Cognitiva SOAR en un Entorno ROS sobre un Parrot AR. Drone 2.0. Proceedings of the JARCA 2015 Actas de las XVII Jornadas de ARCA Sistemas Cualitativos y sus Aplicaciones en Diagnosis, Rob\u00f3tica, Inteligencia Ambiental y Ciudades Inteligentes, Vinar\u00f2s, Spain."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Xiang, T., Jiang, F., Lan, G., Sun, J., Liu, G., Hao, Q., and Wang, C. (2017, January 19\u201321). Uav based target tracking and recognition. Proceedings of the 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), Baden-Baden, Germany.","DOI":"10.1109\/MFI.2016.7849521"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.autcon.2018.10.019","article-title":"A survey of automation-enabled human-in-the-loop systems for infrastructure visual inspection","volume":"97","author":"Agnisarman","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"167438","DOI":"10.1109\/ACCESS.2019.2953900","article-title":"The state-of-the-art of human\u2013drone interaction: A survey","volume":"7","author":"Tezza","year":"2019","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1038\/s41578-018-0011-1","article-title":"Human-in-the-loop development of soft wearable robots","volume":"3","author":"Walsh","year":"2018","journal-title":"Nat. Rev. Mater."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Orsag, M., Haus, T., Toli\u0107, D., Ivanovic, A., Car, M., Palunko, I., and Bogdan, S. (July, January 29). Human-in-the-loop control of multi-agent aerial systems. Proceedings of the 2016 European Control Conference (ECC), Aalborg, Denmark.","DOI":"10.1109\/ECC.2016.7810608"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.isatra.2017.03.023","article-title":"Robust guaranteed cost tracking control of quadrotor UAV with uncertainties","volume":"69","author":"Xu","year":"2017","journal-title":"ISA Trans."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1007\/s10846-016-0348-x","article-title":"Coverage path planning for UAVs photogrammetry with energy and resolution constraints","volume":"83","author":"Buttazzo","year":"2016","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2019\/7497924","article-title":"A Framework for Analyzing Fog-Cloud Computing Cooperation Applied to Information Processing of UAVs","volume":"2019","author":"Pinto","year":"2019","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1016\/j.isatra.2018.05.022","article-title":"Multi-objective control for cooperative payload transport with rotorcraft UAVs","volume":"80","author":"Gimenez","year":"2018","journal-title":"ISA Trans."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1016\/j.isatra.2019.01.019","article-title":"Avoiding obstacles in cooperative load transportation","volume":"91","author":"Pizetta","year":"2019","journal-title":"ISA Trans."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1016\/j.isatra.2014.01.004","article-title":"Position and attitude tracking control for a quadrotor UAV","volume":"53","author":"Xiong","year":"2014","journal-title":"ISA Trans."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1007\/s10458-019-09401-5","article-title":"Systemic design of distributed multi-UAV cooperative decision-making for multi-target tracking","volume":"33","author":"Zhao","year":"2019","journal-title":"Auton. Agents Multi-Agent Syst."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Paredes, R., Tzou, P.L., Van Zyl, G., Barrow, G., Camacho, R., Carmona, S., Grant, P.M., Gupta, R.K., Hamers, R.L., and Harrigan, P.R. (2017). Collaborative update of a rule-based expert system for HIV-1 genotypic resistance test interpretation. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0181357"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2744","DOI":"10.1007\/s12555-016-0432-9","article-title":"Egocentric teleoperation approach","volume":"15","author":"Lee","year":"2017","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"7053","DOI":"10.1007\/s00500-016-2247-2","article-title":"SVM or deep learning? A comparative study on remote sensing image classification","volume":"21","author":"Liu","year":"2017","journal-title":"Soft Comput."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., and Frahm, J.M. (2016, January 27\u201330). Structure-from-motion revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"T\u00e9llez, R.A., and Angulo, C. (2007). Embodying cognitive abilities: categorization. International Work-Conference on Artificial Neural Networks, Springer.","DOI":"10.1007\/978-3-540-73007-1_95"},{"key":"ref_47","unstructured":"T\u00e9llez, R.A., and Angulo, C. (2007, January 10). Acquisition of meaning through distributed robot control. Proceedings of the ICRA workshop Semantic Information in Robotics, Rome, Italy."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2474","DOI":"10.1162\/NECO_a_00893","article-title":"Continuous online sequence learning with an unsupervised neural network model","volume":"28","author":"Cui","year":"2016","journal-title":"Neural Comput."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2010, January 2\u20135). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, San Jose, CA, USA.","DOI":"10.1145\/1869790.1869829"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep feature extraction and classification of hyperspectral images based on convolutional neural networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Pinto, M.F., Melo, A.G., Marcato, A.L., and Urdiales, C. (2017, January 19\u201321). Case-based reasoning approach applied to surveillance system using an autonomous unmanned aerial vehicle. Proceedings of the 2017 IEEE 26th International Symposium on Industrial Electronics (ISIE), Edinburgh, UK.","DOI":"10.1109\/ISIE.2017.8001437"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/s10846-012-9778-2","article-title":"UAV path planning for structure inspection in windy environments","volume":"69","author":"Guerrero","year":"2013","journal-title":"J. Intell. Robot. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/16\/4579\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:01:22Z","timestamp":1760176882000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/16\/4579"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,15]]},"references-count":52,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["s20164579"],"URL":"https:\/\/doi.org\/10.3390\/s20164579","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,8,15]]}}}