{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,4,5]],"date-time":"2022-04-05T02:09:27Z","timestamp":1649124567554},"reference-count":35,"publisher":"Hindawi Limited","license":[{"start":{"date-parts":[[2015,1,1]],"date-time":"2015-01-01T00:00:00Z","timestamp":1420070400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Robotics"],"published-print":{"date-parts":[[2015]]},"abstract":"<jats:p>Action selection (AS) is thought to represent the mechanism involved by natural agents when deciding what should be the next move or action. Is there a functional elementary core sustaining this cognitive process? Could we reproduce the mechanism with an artificial agent and more specifically in a neurorobotic paradigm? Unsupervised autonomous robots may require a decision-making skill to evolve in the real world and the bioinspired approach is the avenue explored through this paper. We propose simulating an AS process by using a small spiking neural network (SNN) as the lower neural organisms, in order to control virtual and physical robots. We base our AS process on a simple central pattern generator (CPG), decision neurons, sensory neurons, and motor neurons as the main circuit components. As novelty, this study targets a specific operant conditioning (OC) context which is relevant in an AS process; choices do influence future sensory feedback. Using a simple adaptive scenario, we show the complementarity interaction of both phenomena. We also suggest that this AS kernel could be a fast track model to efficiently design complex SNN which include a growing number of input stimuli and motor outputs. Our results demonstrate that merging AS and OC brings flexibility to the behavior in generic dynamical situations.<\/jats:p>","DOI":"10.1155\/2015\/643869","type":"journal-article","created":{"date-parts":[[2015,10,4]],"date-time":"2015-10-04T17:06:55Z","timestamp":1443978415000},"page":"1-10","source":"Crossref","is-referenced-by-count":2,"title":["Action Selection and Operant Conditioning: A Neurorobotic Implementation"],"prefix":"10.1155","volume":"2015","author":[{"given":"Andr\u00e9","family":"Cyr","sequence":"first","affiliation":[{"name":"D\u00e9partement d\u2019Informatique, Universit\u00e9 du Qu\u00e9bec \u00e0 Montr\u00e9al (UQAM), Succursale Centre-Ville, Case Postale 8888, Montreal, QC, Canada H3C 3P8"}]},{"given":"Fr\u00e9d\u00e9ric","family":"Th\u00e9riault","sequence":"additional","affiliation":[{"name":"D\u00e9partement d\u2019Informatique, Universit\u00e9 du Qu\u00e9bec \u00e0 Montr\u00e9al (UQAM), Succursale Centre-Ville, Case Postale 8888, Montreal, QC, Canada H3C 3P8"}]}],"member":"98","reference":[{"key":"1","year":"2011"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2007.2057"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.29.051605.113038"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1177\/105971230501300205"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2011.0750"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.06.049"},{"key":"7","doi-asserted-by":"publisher","DOI":"10.1016\/s0893-6080(97)00011-7"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2012.00002"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0090821"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1109\/tnn.2003.820440"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2012.05.005"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1186\/1752-0509-4-81"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0027201"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1038\/nn.3741"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1126\/science.3975635"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1007\/bf00319514"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2008.03.014"},{"key":"18","volume-title":"Action selection","volume":"22","year":"2013"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1016\/s0306-4522(98)00319-4"},{"key":"20","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2012.05.007"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1523\/jneurosci.1844-09.2009"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogpsych.2007.12.002"},{"key":"23","doi-asserted-by":"publisher","DOI":"10.1037\/\/0033-295x.108.3.550"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2014.00318"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1126\/science.1069434"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1242\/jeb.02204"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1523\/jneurosci.4723-11.2011"},{"key":"29","volume":"8, article 21","year":"2014","journal-title":"Frontiers in Neurorobotics"},{"key":"30","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.31.060407.125639"},{"key":"31","doi-asserted-by":"publisher","DOI":"10.1177\/1059712312442231"},{"key":"32","doi-asserted-by":"publisher","DOI":"10.3389\/fnsyn.2011.00004"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2009.0270"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003700"},{"key":"35","doi-asserted-by":"publisher","DOI":"10.1016\/j.tins.2009.09.002"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2012.08.030"}],"container-title":["Journal of Robotics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/jr\/2015\/643869.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/jr\/2015\/643869.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/jr\/2015\/643869.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2016,8,18]],"date-time":"2016-08-18T19:12:02Z","timestamp":1471547522000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.hindawi.com\/journals\/jr\/2015\/643869\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015]]},"references-count":35,"alternative-id":["643869","643869"],"URL":"https:\/\/doi.org\/10.1155\/2015\/643869","relation":{},"ISSN":["1687-9600","1687-9619"],"issn-type":[{"value":"1687-9600","type":"print"},{"value":"1687-9619","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015]]}}}