{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T17:58:59Z","timestamp":1783619939800,"version":"3.55.0"},"reference-count":88,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,23]],"date-time":"2024-02-23T00:00:00Z","timestamp":1708646400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,23]],"date-time":"2024-02-23T00:00:00Z","timestamp":1708646400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"crossref","award":["315468\/2021-1"],"award-info":[{"award-number":["315468\/2021-1"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"crossref"}]},{"name":"PPI Softex MCTI","award":["01245.013778\/2020-21"],"award-info":[{"award-number":["01245.013778\/2020-21"]}]},{"name":"CEPID\/BRAINN FAPESP","award":["2013\/07559-3\/2020-21"],"award-info":[{"award-number":["2013\/07559-3\/2020-21"]}]},{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"crossref","award":["315468\/2021-1"],"award-info":[{"award-number":["315468\/2021-1"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Robot Syst"],"published-print":{"date-parts":[[2024,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Recent advancements in AI and deep learning have created a growing demand for artificial agents capable of performing tasks within increasingly complex environments. To address the challenges associated with continuous learning constraints and knowledge capacity in this context, cognitive architectures inspired by human cognition have gained significance. This study contributes to existing research by introducing a cognitive-attentional system employing a constructive neural network-based learning approach for continuous acquisition of procedural knowledge. We replace an incremental tabular Reinforcement Learning algorithm with a constructive neural network deep reinforcement learning mechanism for continuous sensorimotor knowledge acquisition, thereby enhancing the overall learning capacity. The primary emphasis of this modification centers on optimizing memory utilization and reducing training time. Our study presents a learning strategy that amalgamates deep reinforcement learning with procedural learning, mirroring the incremental learning process observed in human sensorimotor development. This approach is embedded within the CONAIM cognitive-attentional architecture, leveraging the cognitive tools of CST. The proposed learning mechanism allows the model to dynamically create and modify elements in its procedural memory, facilitating the reuse of previously acquired functions and procedures. Additionally, it equips the model with the capability to combine learned elements to effectively adapt to complex scenarios. A constructive neural network was employed, initiating with an initial hidden layer comprising one neuron. However, it possesses the capacity to adapt its internal architecture in response to its performance in procedural and sensorimotor learning tasks, inserting new hidden layers or neurons. Experimentation conducted through simulations involving a humanoid robot demonstrates the successful resolution of tasks that were previously unsolved through incremental knowledge acquisition. Throughout the training phase, the constructive agent achieved a minimum of 40% greater rewards and executed 8% more actions when compared to other agents. In the subsequent testing phase, the constructive agent exhibited a 15% increase in the number of actions performed in contrast to its counterparts.<\/jats:p>","DOI":"10.1007\/s10846-024-02064-9","type":"journal-article","created":{"date-parts":[[2024,2,23]],"date-time":"2024-02-23T11:03:26Z","timestamp":1708686206000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Procedural Constructive Learning Mechanism with Deep Reinforcement Learning for Cognitive Agents"],"prefix":"10.1007","volume":"110","author":[{"given":"Leonardo","family":"de\u00a0Lellis\u00a0Rossi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric","family":"Rohmer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paula","family":"Dornhofer\u00a0Paro\u00a0Costa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Esther\u00a0Luna","family":"Colombini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandre","family":"da\u00a0Silva\u00a0Sim\u00f5es","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ricardo\u00a0Ribeiro","family":"Gudwin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,2,23]]},"reference":[{"issue":"4","key":"2064_CR1","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1080\/09540090310001655110","volume":"15","author":"M Lungarella","year":"2003","unstructured":"Lungarella, M., Sandini, G., Pfeifer, R.: Developmental robotics: A survey. Connect. Sci. 15(4), 151\u2013190 (2003). https:\/\/doi.org\/10.1080\/09540090310001655110","journal-title":"Connect. Sci."},{"key":"2064_CR2","doi-asserted-by":"crossref","unstructured":"Cangelosi, A., Schlesinger, M.: Developmental Robotics: From Babies to Robots. The MIT Press, Cambridge, MA (2014). https:\/\/mitpress.mit.edu\/books\/developmental-robotics","DOI":"10.7551\/mitpress\/9320.001.0001"},{"issue":"3","key":"2064_CR3","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1080\/0951508042000286721","volume":"17","author":"R Sun","year":"2004","unstructured":"Sun, R.: Desiderata for cognitive architectures. Philos. Psychol. 17(3), 341\u2013373 (2004). https:\/\/doi.org\/10.1080\/0951508042000286721","journal-title":"Philos. Psychol."},{"key":"2064_CR4","unstructured":"Franklin, S.: The mind according to lida \u2014 a brief account, 20 (2012)"},{"key":"2064_CR5","doi-asserted-by":"crossref","unstructured":"Laird, J.E.: Extending the soar cognitive architecture. In: Proceedings of the first AGI conference - frontiers in artificial intelligence and applications, pp. 224\u2013235. Artificial General Intelligence by Wang, P., Goertzel, B., Franklin S, Amsterdam, Netherlands (2008). https:\/\/www.researchgate.net\/publication\/221328941_Extending_the_Soar_Cognitive_Architecture","DOI":"10.21236\/ADA473738"},{"key":"2064_CR6","unstructured":"Thomson, R., Bennati, S., Lebiere, C.: Extending the influence of contextual information in act-r using buffer decay. In: Proceedings of the annual meeting of the cognitive science society, p. 6 (2014). www.researchgate.net\/publication\/268520256_Extending_the_Influence_of_Contextual_Information_in_ACT-R_using_Buffer_Decay"},{"key":"2064_CR7","doi-asserted-by":"crossref","unstructured":"Reggia, J.A.: The rise of machine consciousness: studying consciousness with computational models. Neural Netw. 44 (2013)","DOI":"10.1016\/j.neunet.2013.03.011"},{"key":"2064_CR8","unstructured":"Sim\u00f5es, A.S.: Um modelo cognitivo baseado na aten\u00e7\u00e3o para consci\u00eancia em rob\u00f4s inteligentes. Universidade Estadual Paulista (Tese de Livre-Doc\u00eancia) (2015)"},{"key":"2064_CR9","doi-asserted-by":"publisher","DOI":"10.1038\/nature14539","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature (2015). https:\/\/doi.org\/10.1038\/nature14539","journal-title":"Nature"},{"key":"2064_CR10","unstructured":"Rossi, L.d.L.: Aprendizado sens\u00f3rio-motor em rob\u00f4s cognitivos utilizando modelo cst-conaim. Master\u2019s thesis, Universidade Estadual Paulista \"J\u00falio de Mesquita Filho\" (Unesp) - Instituto de Ci\u00eancia e Tecnologia de Sorocaba (2021). https:\/\/repositorio.unesp.br\/handle\/11449\/214316"},{"key":"2064_CR11","unstructured":"Rossi, L.L., Berto, L.M., Rohmer, E., Costa, P.D.P., Simoes, A.S., Gudwin, R.R., Colombini, E.L.: Incremental procedural and sensorimotor learning in cognitive humanoid robots. (Submitted to) IEEE Trans. Cogn. Dev. Syst. (2023)"},{"key":"2064_CR12","doi-asserted-by":"publisher","unstructured":"Silva\u00a0Simoes, A.d., Colombini, E.L., Costa\u00a0Ribeiro, C.H.: CONAIM: A Conscious Attention-Based Integrated Model for Human-Like Robots. IEEE Syst. J. 11(3), 1296\u20131307 (2017). https:\/\/doi.org\/10.1109\/JSYST.2015.2498542","DOI":"10.1109\/JSYST.2015.2498542"},{"key":"2064_CR13","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/j.bica.2016.07.005","volume":"17","author":"ALO Paraense","year":"2016","unstructured":"Paraense, A.L.O., Raizer, K., Paula, S.M., Gudwin, R.R., Rohmer, E.: The cognitive systems toolkit and the cst reference cognitive architecture. Biologically Inspired Cogn. Architectures 17, 32\u201348 (2016). https:\/\/doi.org\/10.1016\/j.bica.2016.07.005","journal-title":"Biologically Inspired Cogn. Architectures"},{"key":"2064_CR14","volume-title":"Reinforcement Learning: An Introduction","author":"R Sutton","year":"1998","unstructured":"Sutton, R., Barto, A.: Reinforcement Learning: An Introduction. MIT Press, Cambridge, Massachussetts (1998)"},{"key":"2064_CR15","doi-asserted-by":"publisher","unstructured":"Piaget, J.: The Origins of Intelligence in Children. The origins of intelligence in children. W Norton and Co, New York, NY, US (1952). https:\/\/doi.org\/10.1037\/11494-000","DOI":"10.1037\/11494-000"},{"key":"2064_CR16","doi-asserted-by":"publisher","unstructured":"Arulkumaran, K., Deisenroth, M.P., Brundage, M., Bharath, A.A.: Deep reinforcement learning: A brief survey 34(6), 26\u201338 https:\/\/doi.org\/10.1109\/MSP.2017.2743240 . Accessed 2023-01-25","DOI":"10.1109\/MSP.2017.2743240"},{"key":"2064_CR17","unstructured":"Fan, J., Wang, Z., Xie, Y., Yang, Z.: A theoretical analysis of deep q-learning. Proceedings of the 2nd Conference on Learning for Dynamics and Control, PMLR 120, 486\u2013489 (2020)"},{"key":"2064_CR18","doi-asserted-by":"publisher","unstructured":"Hester, T., Vecerik, M., Pietquin, O., Lanctot, M., Schaul, T., Piot, B., Horgan, D., Quan, J., Sendonaris, A., Osband, I., Dulac-Arnold, G., Agapiou, J., Leibo, J., Gruslys, A.: Deep q-learning from demonstrations. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1). (2018) https:\/\/doi.org\/10.1609\/aaai.v32i1.11757","DOI":"10.1609\/aaai.v32i1.11757"},{"key":"2064_CR19","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., Riedmiller, M.: Playing atari with deep reinforcement learning. DeepMind Technologies (2013)"},{"key":"2064_CR20","volume-title":"Hands-on Reinforcement Learning with Python: Master Reinforcement and Deep Reinforcement Learning Using OpenAI Gym and TensorFlow","author":"S Ravichandiran","year":"2018","unstructured":"Ravichandiran, S.: Hands-on Reinforcement Learning with Python: Master Reinforcement and Deep Reinforcement Learning Using OpenAI Gym and TensorFlow. Packt Publishing Ltd, United Kingdom (2018)"},{"issue":"1","key":"2064_CR21","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1515\/comp-2016-0005","volume":"6","author":"CSK Dash","year":"2016","unstructured":"Dash, C.S.K., Behera, A.K., Dehuri, S., Cho, S.-B.: Radial basis function neural networks: a topical state-of-the-art survey. Open Computer Science 6(1), 33\u201363 (2016). https:\/\/doi.org\/10.1515\/comp-2016-0005","journal-title":"Open Computer Science"},{"key":"2064_CR22","unstructured":"Que, Q., Belkin, M.: Back to the future: Radial basis function networks revisited. Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, PMLR 51, 1375-1383, 1375\u20131383 (2016)"},{"issue":"7","key":"2064_CR23","doi-asserted-by":"publisher","first-page":"3366","DOI":"10.1109\/TPAMI.2021.3057446","volume":"44","author":"M De Lange","year":"2022","unstructured":"De Lange, M., Aljundi, R., Masana, M., Parisot, S., Jia, X., Leonardis, A., Slabaugh, G., Tuytelaars, T.: A continual learning survey: Defying forgetting in classification tasks. IEEE Trans. Pattern Anal. Mach. Intell. 44(7), 3366\u20133385 (2022). https:\/\/doi.org\/10.1109\/TPAMI.2021.3057446","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2064_CR24","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.neunet.2019.01.012","volume":"113","author":"GI Parisi","year":"2019","unstructured":"Parisi, G.I., Kemker, R., Part, J.L., Kanan, C., Wermter, S.: Continual lifelong learning with neural networks: A review. Neural Netw. 113, 54\u201371 (2019)","journal-title":"Neural Netw."},{"key":"2064_CR25","unstructured":"Gudwin, R.R., Raizer, K., Paraense, A.L.O., Paula, S.M., Figueiredo, V.A., Castro, E.C., Fr\u00f3es, E., Gibaut, W.S.P.: CST - The Cognitive Systems Toolkit (2013). https:\/\/www.cst.fee.unicamp.br"},{"key":"2064_CR26","unstructured":"Konduit: Deeplearning4j (2022). https:\/\/deeplearning4j.konduit.ai"},{"key":"2064_CR27","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/j.bica.2015.10.001","volume":"15","author":"ALO Paraense","year":"2016","unstructured":"Paraense, A.L.O., Raizer, K., Gudwin, R.R.: A machine consciousness approach to urban traffic control. Biologically Inspired Cognitive Architectures 15, 61\u201373 (2016). https:\/\/doi.org\/10.1016\/j.bica.2015.10.001","journal-title":"Biologically Inspired Cognitive Architectures"},{"key":"2064_CR28","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2021.3104881","author":"F Gama","year":"2021","unstructured":"Gama, F., Shcherban, M., Rolf, M., Hoffmann, M.: Goal-directed tactile exploration for body model learning through self-touch on a humanoid robot. IEEE Transactions on Cognitive and Developmental Systems (2021). https:\/\/doi.org\/10.1109\/TCDS.2021.3104881","journal-title":"IEEE Transactions on Cognitive and Developmental Systems"},{"key":"2064_CR29","doi-asserted-by":"publisher","unstructured":"Stoytchev, A.: Some basic principles of developmental robotics. IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT 1 (2009) https:\/\/doi.org\/10.1109\/TAMD.2009.2029989","DOI":"10.1109\/TAMD.2009.2029989"},{"key":"2064_CR30","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1016\/j.bica.2016.10.004","volume":"18","author":"D Vernon","year":"2016","unstructured":"Vernon, D., Hofsten, C., Fadiga, L.: Desiderata for developmental cognitive architectures. Biologically Inspired Cognitive Architectures 18, 116\u2013127 (2016). https:\/\/doi.org\/10.1016\/j.bica.2016.10.004","journal-title":"Biologically Inspired Cognitive Architectures"},{"key":"2064_CR31","doi-asserted-by":"publisher","unstructured":"Piaget, J.: Science of Education and the Psychology of the Child. Penguin Books, London, United Kingdom. (1971). https:\/\/doi.org\/10.1037\/11494-000","DOI":"10.1037\/11494-000"},{"key":"2064_CR32","doi-asserted-by":"crossref","unstructured":"Armstrong, K.H., Ogg, J., A., S.-W., A., W.: Early Child Development Theories. Evidence-Based Interventions for Children with Challenging Behavior. Springer, New York (2014)","DOI":"10.1007\/978-1-4614-7807-2_2"},{"key":"2064_CR33","unstructured":"Piaget, J.: Seis Estudos da Psicologia. Forense Universit\u00e1ria, ??? (1999)"},{"key":"2064_CR34","unstructured":"Cook, J.L., Cook, G.: Child Development. London: Pearson education: Allyn and Bacon., London, United Kingdom (2005)"},{"key":"2064_CR35","volume-title":"Teorias da Aprendizagem","author":"GR Lefran\u00e7oi","year":"2008","unstructured":"Lefran\u00e7oi, G.R.: Teorias da Aprendizagem. Cengage Learning, Boston, MA, USA (2008)"},{"key":"2064_CR36","volume-title":"Educational Psychology","author":"AE Woolfolk","year":"2010","unstructured":"Woolfolk, A.E., Winne, P.H., Perry, N.E.: Educational Psychology. Pearson Education Canada Inc, Allyn and Bacon, Inc Needham Height, MA, Canada (2010)"},{"key":"2064_CR37","volume-title":"Piaget\u2019s stages of cognitive development","author":"KC Wood","year":"2011","unstructured":"Wood, K.C., Smith, H., Grossniklaus, D.: Piaget\u2019s stages of cognitive development. University of Georgia, Department of Educational Psychology and Instructional Technology (2011)"},{"key":"2064_CR38","unstructured":"Papalia, D.E., Feldman, R.D.: Desenvolvimento Humano. vol. 12. Mcgraw Hill - Artmed, Brazil. (2013)"},{"key":"2064_CR39","doi-asserted-by":"publisher","unstructured":"Berto, L.M.: Exploring cognitive functions in robotics. Master\u2019s thesis, Univeristy of Campinas (2020). https:\/\/doi.org\/10.47749\/T\/UNICAMP.2020.1129257 . http:\/\/repositorio.unicamp.br\/Acervo\/Detalhe\/1129257","DOI":"10.47749\/T\/UNICAMP.2020.1129257"},{"key":"2064_CR40","doi-asserted-by":"publisher","unstructured":"Berto, L.M., Rossi, L.L., ROHMER, E., COSTA, P.D.P., Simoes, A.S., Gudwin, R.R., COLOMBINI, E.L.: Piagetian experiments to devrobotics. Cogn. Syst. Res. J. (2023). https:\/\/doi.org\/10.1016\/j.cogsys.2023.101170","DOI":"10.1016\/j.cogsys.2023.101170"},{"key":"2064_CR41","doi-asserted-by":"publisher","unstructured":"Michalec, D.: In: Goldstein, S., Naglieri, J.A. (eds.) Bayley Scales of Infant Development: Third Edition, pp. 215\u2013215. Springer, Boston, MA (2011). https:\/\/doi.org\/10.1007\/978-0-387-79061-9_295","DOI":"10.1007\/978-0-387-79061-9_295"},{"key":"2064_CR42","unstructured":"Boyd, D., Bee, H.: A Crian\u00e7a em Crescimento. ARTMED, Brazil (2011)"},{"issue":"1","key":"2064_CR43","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/TAMD.2012.2209879","volume":"5","author":"F Guerin","year":"2013","unstructured":"Guerin, F., Kruger, N., Kraft, D.: A Survey of the Ontogeny of Tool Use: From Sensorimotor Experience to Planning. IEEE Trans. Auton. Ment. Dev. 5(1), 18\u201345 (2013). https:\/\/doi.org\/10.1109\/TAMD.2012.2209879","journal-title":"IEEE Trans. Auton. Ment. Dev."},{"key":"2064_CR44","unstructured":"Arrabales, R.: ConsScale - A Machine Consciousness Scale (2020). https:\/\/www.conscious-robots.com\/consscale\/index.html"},{"key":"2064_CR45","volume-title":"Sapiens - Uma Breve Hist\u00f3ria da Humanidade","author":"YN Harari","year":"2011","unstructured":"Harari, Y.N.: Sapiens - Uma Breve Hist\u00f3ria da Humanidade. Harper, New York, NY, US (2011)"},{"key":"2064_CR46","doi-asserted-by":"publisher","unstructured":"Harris, C.L.: Language and cognition. In: L., N. (ed.) Encyclopedia of Cognitive Science, pp. 1\u20136. Wiley, ??? (2006). https:\/\/doi.org\/10.1002\/0470018860.s00559","DOI":"10.1002\/0470018860.s00559"},{"key":"2064_CR47","doi-asserted-by":"crossref","unstructured":"Kotseruba, I., Tsotsos, J.K.: 40 years of cognitive architectures: core cognitive abilities and practical applications. Artif. Intell. Rev. 53 (2020)","DOI":"10.1007\/s10462-018-9646-y"},{"issue":"2","key":"2064_CR48","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1080\/09540090600806631","volume":"18","author":"LA Meeden","year":"2006","unstructured":"Meeden, L.A., Blank, D.S.: Introduction to developmental robotics. Connect. Sci. 18(2), 93\u201396 (2006). https:\/\/doi.org\/10.1080\/09540090600806631","journal-title":"Connect. Sci."},{"key":"2064_CR49","unstructured":"Anderson, J., Lebiere, C.: The newell test for a theory of mind. Carnegie Mellon University (1998)"},{"key":"2064_CR50","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7688.001.0001","volume-title":"The Soar Cognitive Architecture","author":"J Laird","year":"2012","unstructured":"Laird, J.: The Soar Cognitive Architecture. MIT Press, Cambridge, Mass.; London, England (2012)"},{"key":"2064_CR51","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7688.001.0001","volume-title":"Cognitive robotics using the soar cognitive architecture","author":"JE Laird","year":"2012","unstructured":"Laird, J.E., Kinkade, K.R., Mohan, S., Xu, J.Z.: Cognitive robotics using the soar cognitive architecture. Cogn. Robot. AAAI Tech, Rep (2012)"},{"key":"2064_CR52","volume-title":"Interactively learning strategies for handling references to unseen or unknown objects","author":"A Mininger","year":"2016","unstructured":"Mininger, A., Laird, J.: Interactively learning strategies for handling references to unseen or unknown objects. Adv. Cogn, Syst (2016)"},{"key":"2064_CR53","unstructured":"Licato, J., Marton, N., Dong, B., Sun, R., Bringsjord, S.: Modeling the creation and development of cause-effect pairs for explanation generation in a cognitive architecture. In: International workshop on artificial intelligence and cognition, Torino, Italy, pp. 29\u201339 (2015)"},{"key":"2064_CR54","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0157343","author":"T Madl","year":"2016","unstructured":"Madl, T., Franklin, S., Chen, K., Trappl, R., Montaldi, D.: Exploring the structure of spatial representations. PLoS ONE (2016). https:\/\/doi.org\/10.1371\/journal.pone.0157343","journal-title":"PLoS ONE"},{"key":"2064_CR55","unstructured":"Colombini, E.L.: An attentional model for intelligent robotics agents. Instituto Tecnol\u00f3gico de Aeron\u00e1utica, S\u00e3o Jos\u00e9 dos Campos (PhD Thesis) (2014)"},{"key":"2064_CR56","doi-asserted-by":"publisher","unstructured":"Colombini, E.L., Sim\u00f5es, A.d.S., Ribeiro, C.H.C.: An attentional model for autonomous mobile robots. IEEE Syst. J. 11(3), 1308\u20131319 (2017) https:\/\/doi.org\/10.1109\/JSYST.2015.2499304","DOI":"10.1109\/JSYST.2015.2499304"},{"key":"2064_CR57","doi-asserted-by":"publisher","unstructured":"Sim\u00f5es, A.d.S., Colombini, E.L., Ribeiro, C.H.C.: Conaim: A conscious attention-based integrated model for human-like robots. IEEE Syst. J. (2016) https:\/\/doi.org\/10.1109\/JSYST.2015.2498542","DOI":"10.1109\/JSYST.2015.2498542"},{"key":"2064_CR58","volume-title":"A Cognitive Theory of Consciousness","author":"JB Baars","year":"1998","unstructured":"Baars, J.B.: A Cognitive Theory of Consciousness. Cambridge University Press, United Kingdom (1998)"},{"key":"2064_CR59","volume-title":"The consciousness prior","author":"Y Bengio","year":"2017","unstructured":"Bengio, Y.: The consciousness prior. Universit\u00e9 de Montr\u00e9al, Mila (2017)"},{"key":"2064_CR60","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/11171.001.0001","volume-title":"Deep Learning","author":"JD Kelleher","year":"2019","unstructured":"Kelleher, J.D.: Deep Learning. MIT press, Cambridge, MA (2019)"},{"key":"2064_CR61","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/S0962492900000015","volume":"9","author":"MD Buhmann","year":"2000","unstructured":"Buhmann, M.D.: Radial basis functions. Acta numerica 9, 1\u201338 (2000)","journal-title":"Radial basis functions. Acta numerica"},{"issue":"8","key":"2064_CR62","doi-asserted-by":"publisher","first-page":"6696","DOI":"10.1609\/aaai.v35i8.16828","volume":"35","author":"K Asadi","year":"2021","unstructured":"Asadi, K., Parikh, N., Parr, R.E., Konidaris, G.D., Littman, M.L.: Deep radial-basis value functions for continuous control. Proceedings of the AAAI Conference on Artificial Intelligence 35(8), 6696\u20136704 (2021). https:\/\/doi.org\/10.1609\/aaai.v35i8.16828","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"2064_CR63","volume-title":"Reinforcement learning using augmented neural networks","author":"J Shannon","year":"2018","unstructured":"Shannon, J., Grzes, M.: Reinforcement learning using augmented neural networks. University of Kent, UK, School of Computing (2018)"},{"key":"2064_CR64","doi-asserted-by":"publisher","unstructured":"Ouyang, Y., He, W., Li, X.: Reinforcement learning control of a single-link flexible robotic manipulator. Institution of Engineering and Technology (IET) - Control Theory and Applications (2017). https:\/\/doi.org\/10.1049\/iet-cta.2016.1540","DOI":"10.1049\/iet-cta.2016.1540"},{"key":"2064_CR65","unstructured":"Almeida, A.C.: Sistema de mem\u00f3rias complementares e neurog\u00eanese aplicado \u00e1 problemnas de aprendizado por refor\u00e7o cont\u00ednuo. Centro Universit\u00e1rio FEI (PhD. dissertation) (2022)"},{"key":"2064_CR66","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1109\/tcyb.2017.2771463","volume":"4","author":"S Lin","year":"2018","unstructured":"Lin, S., Zeng, J., Zhang, X.: Constructive neural network learning. IEEE Trans. Cybern. 4, 221\u2013232 (2018). https:\/\/doi.org\/10.1109\/tcyb.2017.2771463","journal-title":"IEEE Trans. Cybern."},{"key":"2064_CR67","doi-asserted-by":"publisher","unstructured":"Parekh, R., Yang, J., Honavar, V.: Constructive neural-network learning algorithms for pattern classification 11(2), 436\u2013451 https:\/\/doi.org\/10.1109\/72.839013 . 330. Accessed 20 Jan 2023","DOI":"10.1109\/72.839013"},{"key":"2064_CR68","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1016\/j.neucom.2017.02.038","volume":"242","author":"H-G Han","year":"2017","unstructured":"Han, H.-G., Zhang, S., Qiao, J.-F.: An adaptive growing and pruning algorithm for designing recurrent neural network. Neurocomputing 242, 51\u201362 (2017)","journal-title":"Neurocomputing"},{"issue":"1","key":"2064_CR69","first-page":"1","volume":"11","author":"RM Luque-Baena","year":"2014","unstructured":"Luque-Baena, R.M., Urda, D., Subirats, J.L., Franco, L., Jerez, J.M.: Application of genetic algorithms and constructive neural networks for the analysis of microarray cancer data. Theor. Biol. Med. Model. 11(1), 1\u201318 (2014)","journal-title":"Theor. Biol. Med. Model."},{"key":"2064_CR70","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1016\/j.neucom.2015.12.003","volume":"182","author":"J Qiao","year":"2016","unstructured":"Qiao, J., Li, F., Han, H., Li, W.: Constructive algorithm for fully connected cascade feedforward neural networks. Neurocomputing 182, 154\u2013164 (2016)","journal-title":"Neurocomputing"},{"key":"2064_CR71","unstructured":"Von\u00a0Zuben, F.J.: Modelos param\u00e9tricos e n\u00e2o-param\u00e9tricos de redes neurais artificiais e aplica\u00e7\u00f5es. Faculdade de Engenharia El\u00e9trica da Unicamp - FEE-Unicamp - (PhD. dissertation) (1996)"},{"key":"2064_CR72","doi-asserted-by":"crossref","unstructured":"Hajirahimi, Z., Khashei, M.: Hybrid structures in time series modeling and forecasting: A review. Eng. Appl. Artif. Intell. 86, 83\u2013106 (2019)","DOI":"10.1016\/j.engappai.2019.08.018"},{"key":"2064_CR73","doi-asserted-by":"crossref","unstructured":"Muzhou, H., Taohua, L., Yunlei, Y., Hao, Z., Hongjuan, L., Xiugui, Y., Xinge, L.: A new hybrid constructive neural network method for impacting and its application on tungsten price prediction. Appl. Intell. 47(1), 28\u201343 (2017)","DOI":"10.1007\/s10489-016-0882-z"},{"key":"2064_CR74","unstructured":"Sun, R., Wilson, N., Lynch, M.: CLARION Cognitive Architecture Project (2019). http:\/\/www.clarioncognitivearchitecture.com\/"},{"key":"2064_CR75","doi-asserted-by":"crossref","unstructured":"Sun, R., Franklin, S.: Computational models of consciousness. Cambridge handbook of consciousness. Cambridge: Cambridge University Press., 151\u2013174 (2007)","DOI":"10.1017\/CBO9780511816789.008"},{"key":"2064_CR76","unstructured":"Snaider, J., McCall, R., Strain, S., Franklin, S.: The LIDA Tutorial Version 1.0 (2012). http:\/\/ccrg.cs.memphis.edu\/assets\/framework\/The-LIDA-Tutorial.pdf"},{"key":"2064_CR77","unstructured":"Snaider, J., McCall, R., Strain, S., Franklin, S.: LIDA Software Framework (2012). http:\/\/ccrg.cs.memphis.edu\/framework.html"},{"key":"2064_CR78","unstructured":"Laird, J.E., Congdon, C.B., Assanie, M., Derbinsky, N., Xu, J.: Manual Soar User Version 9.6.0 (2017). https:\/\/soar.eecs.umich.edu\/downloads\/SoarManual.pdf"},{"key":"2064_CR79","unstructured":"Laird, J.E., Rosenbloom, P.S., Newell, A.: Towards chunking as a general learning mechanism. In: AAAI (1984). https:\/\/www.semanticscholar.org\/paper\/Towards-Chunking-as-a-General-Learning-Mechanism-Laird-Rosenbloom\/9bf4cd11fc0053337fca66b29831e0db3922ce2b"},{"key":"2064_CR80","doi-asserted-by":"publisher","unstructured":"Metta, G., Sandini, G., Vernon, D., Natale, L., Nori, F.: The iCub humanoid robot: an open platform for research in embodied cognition. In: Proceedings of the 8th workshop on performance metrics for intelligent Systems - PerMIS \u201908, p. 50. ACM Press, Gaithersburg, Maryland (2008). https:\/\/doi.org\/10.1145\/1774674.1774683. http:\/\/portal.acm.org\/citation.cfm?doid=1774674.1774683. Accessed 23 Aug 2018","DOI":"10.1145\/1774674.1774683"},{"key":"2064_CR81","doi-asserted-by":"publisher","unstructured":"Metta, G., Natale, L., Nori, F., Sandini, G., Vernon, D., Fadiga, L., Hofsten, C., Rosander, K., Lopes, M., Santos-Victor, J., Bernardino, A., Montesano, L.: The iCub humanoid robot: An open-systems platform for research in cognitive development. Neural Netw. 23(8\u20139), 1125\u20131134 (2010). https:\/\/doi.org\/10.1016\/j.neunet.2010.08.010. Accessed 23 Aug 2018","DOI":"10.1016\/j.neunet.2010.08.010"},{"key":"2064_CR82","doi-asserted-by":"publisher","unstructured":"Fachantidis, A., Di\u00a0Nuovo, A., Cangelosi, A., Vlahavas, I.: Model-based reinforcement learning for humanoids: A study on forming rewards with the iCub platform. In: 2013 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, And Brain (CCMB), pp. 87\u201393. IEEE, Singapore (2013). https:\/\/doi.org\/10.1109\/CCMB.2013.6609170 . http:\/\/ieeexplore.ieee.org\/document\/6609170\/. Accessed 23 Aug 2018","DOI":"10.1109\/CCMB.2013.6609170"},{"key":"2064_CR83","doi-asserted-by":"publisher","unstructured":"Tutsoy, O., Barkana, D.E.: Model free adaptive control of the under-actuated robot manipulator with the chaotic dynamics. ISA Transactions 118 (2021) https:\/\/doi.org\/10.1016\/j.isatra.2021.02.006","DOI":"10.1016\/j.isatra.2021.02.006"},{"key":"2064_CR84","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1037\/0003-066X.40.4.385","volume":"60","author":"E Tulving","year":"1985","unstructured":"Tulving, E.: How many memory systems are there? Am. Psychol. 60, 385\u2013398 (1985)","journal-title":"Am. Psychol."},{"key":"2064_CR85","unstructured":"Chenatti, S.F., Previato, G., Tomazela, R., Kopp, V.G., Begazo, M.F.T., Salaro, L.G., Rohmer, E., Colombini, E.L., Simoes, A.d.S.: Larocs+unesp team description paper for the ieee humanoid racing 2018. In: Proceedings of the IEEE Humanoid Racing 2018 (2018). http:\/\/sistemaolimpo.org\/midias\/uploads\/e6d5d0a492bae57e6aed09c99f816152.pdf"},{"key":"2064_CR86","doi-asserted-by":"crossref","unstructured":"Rohmer, E., Singh, S.P.N., Freese, M.: V-rep: a versatile and scalable robot simulation framework. In: Proc. of The international conference on intelligent robots and systems (IROS) (2013). https:\/\/ieeexplore.ieee.org\/document\/6696520","DOI":"10.1109\/IROS.2013.6696520"},{"key":"2064_CR87","unstructured":"Rohmer, E., Freese, M.: Robot Simulator CoppeliaSim (2019). https:\/\/www.coppeliarobotics.com\/"},{"key":"2064_CR88","doi-asserted-by":"publisher","DOI":"10.1016\/j.dcn.2019.100733","volume":"40","author":"K Nussenbaum","year":"2019","unstructured":"Nussenbaum, K., Hartley, C.A.: Reinforcement learning across development: What insights can we draw from a decade of research? Dev. Cogn. Neurosci. 40, 100733 (2019). https:\/\/doi.org\/10.1016\/j.dcn.2019.100733","journal-title":"Dev. Cogn. Neurosci."}],"container-title":["Journal of Intelligent &amp; Robotic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-024-02064-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10846-024-02064-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-024-02064-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,1]],"date-time":"2024-04-01T02:22:27Z","timestamp":1711938147000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10846-024-02064-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,23]]},"references-count":88,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3]]}},"alternative-id":["2064"],"URL":"https:\/\/doi.org\/10.1007\/s10846-024-02064-9","relation":{},"ISSN":["0921-0296","1573-0409"],"issn-type":[{"value":"0921-0296","type":"print"},{"value":"1573-0409","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,23]]},"assertion":[{"value":"23 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 January 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical standard"}}],"article-number":"38"}}