{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T17:23:27Z","timestamp":1754155407543,"version":"3.41.2"},"reference-count":26,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2016,1,18]],"date-time":"2016-01-18T00:00:00Z","timestamp":1453075200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,1,18]]},"abstract":"<jats:sec>\n               <jats:title content-type=\"abstract-heading\">Purpose<\/jats:title>\n               <jats:p> \u2013 This paper aims to present a hybrid control approach that combines learning-based reactive control and affordance-based deliberate control for autonomous mobile robot navigation. Unlike many current navigation approaches which only use learning-based paradigms, the authors focus on how to utilize the machine learning methods for reactive control together with the affordance knowledge that is simultaneously inherent in natural environments to gain advantages from both local and global optimization. <\/jats:p>\n            <\/jats:sec>\n            <jats:sec>\n               <jats:title content-type=\"abstract-heading\">Design\/methodology\/approach<\/jats:title>\n               <jats:p> \u2013 The idea is to decompose the complex and large-scale robot navigation task into multiple sub-tasks and use the hierarchical reinforcement learning (HRL) algorithm, which is well-studied in the learning and control algorithm domains, to decompose the overall task into sub-tasks and learn a grid-topological map of the environment. An affordance-based deliberate controller is used to inspect the affordance knowledge of the obstacles in the environment. The hybrid control architecture is then designed to integrate the learning-based reactive control and affordance-based deliberate control based on the grid-topological and affordance knowledge. <\/jats:p>\n            <\/jats:sec>\n            <jats:sec>\n               <jats:title content-type=\"abstract-heading\">Findings<\/jats:title>\n               <jats:p> \u2013 Experiments with computer simulation and an actual humanoid NAO robot have demonstrated the effectiveness of the proposed hybrid approach for mobile robot navigation. <\/jats:p>\n            <\/jats:sec>\n            <jats:sec>\n               <jats:title content-type=\"abstract-heading\">Originality\/value<\/jats:title>\n               <jats:p> \u2013 The main contributions of this paper are a new robot navigation framework that decomposes a complex navigation task into multiple sub-tasks using the HRL approach, and hybrid control architecture development that integrates learning-based and affordance-based paradigms for autonomous mobile robot navigation.<\/jats:p>\n            <\/jats:sec>","DOI":"10.1108\/ir-05-2015-0084","type":"journal-article","created":{"date-parts":[[2016,1,19]],"date-time":"2016-01-19T09:58:21Z","timestamp":1453197501000},"page":"48-57","source":"Crossref","is-referenced-by-count":4,"title":["Goal-directed affordance prediction at the subtask level"],"prefix":"10.1108","volume":"43","author":[{"given":"Huaqing","family":"Min","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chang'an","family":"Yi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ronghua","family":"Luo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinhui","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2020121822243783800_b1","doi-asserted-by":"crossref","unstructured":"Arkin, R.C.\n                (1989), \u201cMotor-schema-based mobile robot navigation\u201d, \n                  International Journal of Robotics Research\n               , Vol. 8 No. 4, pp. 92-112.","DOI":"10.1177\/027836498900800406"},{"key":"key2020121822243783800_b2","doi-asserted-by":"crossref","unstructured":"Borenstein, J.\n                and \n                  Koren, Y.\n                (1989), \u201cReal-time obstacle avoidance for fast mobile robot\u201d, \n                  IEEE Transactions on Systems, Man and Cybernetics. B\n               , Vol. 19 No. 5, pp. 1179-1187.","DOI":"10.1109\/21.44033"},{"key":"key2020121822243783800_b3","doi-asserted-by":"crossref","unstructured":"Botvinick, M.M.\n               , \n                  Niv, Y.\n                and \n                  Barto, A.C.\n                (2009), \u201cHierarchically organized behavior and its neural foundations: a reinforcement learning perspective\u201d, \n                  Cognition\n               , Vol. 113 No. 3, pp. 262-280.","DOI":"10.1016\/j.cognition.2008.08.011"},{"key":"key2020121822243783800_b4","doi-asserted-by":"crossref","unstructured":"Brooks, R.A.\n                (1986), \u201cA robust layered control system for a mobile robot\u201d, \n                  IEEE Journal of Robotics and Automation\n               , Vol. 2 No. 1, pp. 14-23.","DOI":"10.1109\/JRA.1986.1087032"},{"key":"key2020121822243783800_b6","doi-asserted-by":"crossref","unstructured":"Castellini, C.\n               , \n                  Tommasi, T.\n               , \n                  Noceti, N.\n                and \n                  Caputo, B.\n                (2011), \u201cUsing object affordances to improve object recognition\u201d, \n                  IEEE Transactions on Autonomous Mental Development\n               , Vol. 3 No. 3, pp. 207-215.","DOI":"10.1109\/TAMD.2011.2106782"},{"key":"key2020121822243783800_b7","unstructured":"Chen, C.L.\n                and \n                  Chen, Z.H.\n                (2005), \u201cReinforcement learning for mobile robot: from reaction to deliberation\u201d, \n                  Journal of Systems Engineering and Electronics\n               , Vol. 16 No. 3, pp. 611-617."},{"key":"key2020121822243783800_b8","unstructured":"Cos-Aguilera, I.\n               , \n                  Hayes, G.\n                and \n                  Ca\u00f1amero, L.\n                (2004), \n                  Using a SOFM to Learn Object Affordances\n               , 5th Workshop of Physical Agents, University of Edinburgh."},{"key":"key2020121822243783800_b9","doi-asserted-by":"crossref","unstructured":"Dietterich, T.G.\n                (2000), \u201cHierarchical reinforcement learning with the maxq value function decomposition\u201d, \n                  Journal of Artificial Intelligence Research\n               , Vol. 13 No. 1, pp. 227-303.","DOI":"10.1613\/jair.639"},{"key":"key2020121822243783800_b10","doi-asserted-by":"crossref","unstructured":"Elfes, A.\n                (1987), \u201cSonar based real world mapping and navigation\u201d, \n                  IEEE Journal of Robotics and Automation\n               , Vol. 3 No. 3, pp. 249-265.","DOI":"10.1109\/JRA.1987.1087096"},{"key":"key2020121822243783800_b11","unstructured":"Gibson, J.J.\n                (1977), \u201cThe theory of affordances\u201d, in \n                  Shaw, R.\n                and \n                  Bransford, J.\n                (Eds), \n                  Perceiving, Acting, and Knowing: Toward an Ecological Psychology\n               , Lawrence Erlbaum Associate, Hillsdale, NJ, pp. 67-82."},{"key":"key2020121822243783800_b12","unstructured":"Gomi, T.\n                (1997), \u201cSubsumption robots and the application of intelligent robots to the service industry\u201d, Technical Paper, Applied AI Systems."},{"key":"key2020121822243783800_b13","doi-asserted-by":"crossref","unstructured":"Grave, K.\n                and \n                  Behnke, S.\n                (2014), \u201cBayesian exploration and interactive demonstration in continuous state MAXQ-learning\u201d, IEEE International Conference on Robotics and Automation, Hong Kong, China, pp. 3323-3330.","DOI":"10.1109\/ICRA.2014.6907337"},{"key":"key2020121822243783800_b14","doi-asserted-by":"crossref","unstructured":"Jiang, Y.\n               , \n                  Koppula, H.\n                and \n                  Saxena, A.\n                (2013), \u201cHallucinated humans as the hidden context for labeling 3d scenes\u201d, IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, pp. 2993-3000.","DOI":"10.1109\/CVPR.2013.385"},{"key":"key2020121822243783800_b15","doi-asserted-by":"crossref","unstructured":"Khatib, O.\n                (1985), \u201cReal-time obstacle avoidance for manipulators and mobile robots\u201d, \n                  IEEE International Conference on Robotics and Automation\n               , St. Louis, Missouri, USA, pp. 500-505.","DOI":"10.1109\/ROBOT.1985.1087247"},{"key":"key2020121822243783800_b16","doi-asserted-by":"crossref","unstructured":"Kondo, T.\n                and \n                  Ito, K.\n                (2004), \u201cA reinforcement learning with evolutionary state recruitment strategy for autonomous mobile robots control\u201d, \n                  Robotics and Autonomous Systems\n               , Vol. 46 No. 2, pp. 111-124.","DOI":"10.1016\/j.robot.2003.11.006"},{"key":"key2020121822243783800_b17","doi-asserted-by":"crossref","unstructured":"Montesano, L.\n               , \n                  Lopes, M.\n               , \n                  Bernardino, A.\n                and \n                  Santos, V.J.\n                (2008), \u201cLearning object affordances: from sensory \u2013 motor coordination to imitation\u201d, \n                  IEEE Transactions on Robotics\n               , Vol. 24 No. 1, pp. 15-26.","DOI":"10.1109\/TRO.2007.914848"},{"key":"key2020121822243783800_b18","doi-asserted-by":"crossref","unstructured":"Na, Y.K.\n                and \n                  Oh, S.Y.\n                (2003), \u201cHybrid control for autonomous mobile robot navigation using neural network based behavior modules and environment classification\u201d, \n                  Autonomous Robots\n               , Vol. 15 No. 2, pp. 193-206.","DOI":"10.1023\/A:1025597227189"},{"key":"key2020121822243783800_b19","doi-asserted-by":"crossref","unstructured":"\u015eahin, E.\n               , \n                  \u00c7akmak, M.\n               , \n                  Do\u011far, M.R.\n               , \n                  Ugur, E.\n                and \n                  Ucoluk, G.\n                (2007), \u201cTo afford or not to afford: a new formalization of affordances toward affordance-based robot control\u201d, \n                  Adaptive Behavior\n               , Vol. 15 No. 4, pp. 447-472.","DOI":"10.1177\/1059712307084689"},{"key":"key2020121822243783800_b20","doi-asserted-by":"crossref","unstructured":"Salichs, M.A.\n                and \n                  Moreno, L.\n                (2000), \u201cNavigation of mobile robot: open questions\u201d, \n                  Robotica\n               , Vol. 18 No. 3, pp. 227-234.","DOI":"10.1017\/S0263574799002210"},{"key":"key2020121822243783800_b21","doi-asserted-by":"crossref","unstructured":"Stringer, S.M.\n               , \n                  Rolls, E.T.\n                and \n                  Taylor, P.\n                (2007), \u201cLearning movement sequences with a delayed reward signal in a hierarchical model of motor function\u201d, \n                  Neural Networks\n               , Vol. 20 No. 2, pp. 172-181.","DOI":"10.1016\/j.neunet.2006.01.016"},{"key":"key2020121822243783800_b22","unstructured":"Thrun, S.\n                (2000), \u201cProbabilistic algorithms in robotics\u201d, \n                  AI Magazine\n               , Vol. 21 No. 4, pp. 93-109."},{"key":"key2020121822243783800_b23","doi-asserted-by":"crossref","unstructured":"U\u011fur, E.\n                and \n                  \u00b8Sahin, E.\n                (2010), \u201cTraversability: a case study for learning and perceiving affordances in robots\u201d, \n                  Adaptive Behavior\n               , Vol. 18 Nos 3\/4, pp. 258-284.","DOI":"10.1177\/1059712310370625"},{"key":"key2020121822243783800_b24","doi-asserted-by":"crossref","unstructured":"Ugur, E.\n               , \n                  Oztop, E.\n                and \n                  Sahin, E.\n                (2011), \u201cGoal emulation and planning in perceptual space using learned affordances\u201d, \n                  Robotics and Autonomous Systems\n               , Vol. 59 No. 7, pp. 580-595.","DOI":"10.1016\/j.robot.2011.04.005"},{"key":"key2020121822243783800_b25","doi-asserted-by":"crossref","unstructured":"Wang, C.\n               , \n                  Hindriks, K.V.\n                and \n                  Babuska, R.\n                (2013), \u201cRobot learning and use of affordances in goal-directed tasks\u201d, IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, pp. 2288-2294.","DOI":"10.1109\/IROS.2013.6696676"},{"key":"key2020121822243783800_b26","doi-asserted-by":"crossref","unstructured":"Zhu, A.M.\n               , \n                  Yang, S.X.\n               , \n                  Wang, F.J.\n                and \n                  Mittal, G.S.\n                (2005), \u201cA neuro-fuzzy controller for reactive navigation of a behavior-based mobile robot\u201d, \n                  Lecture Notes in Computer Science\n               , Vol. 3498 No. 5, pp. 259-264.","DOI":"10.1007\/11427469_41"},{"key":"key2020121822243783800_b27","doi-asserted-by":"crossref","unstructured":"Zhu, Y.\n               , \n                  Alireza, F.\n                and \n                  Li, F-F.\n                (2014), \u201cReasoning about object affordances in a knowledge base representation\u201d, European Conference on Computer Vision, Zurich, pp. 408-424.","DOI":"10.1007\/978-3-319-10605-2_27"}],"container-title":["Industrial Robot: An International Journal"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/IR-05-2015-0084","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IR-05-2015-0084\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IR-05-2015-0084\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T21:39:01Z","timestamp":1753393141000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ir\/article\/43\/1\/48-57\/180310"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,1,18]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2016,1,18]]}},"alternative-id":["10.1108\/IR-05-2015-0084"],"URL":"https:\/\/doi.org\/10.1108\/ir-05-2015-0084","relation":{},"ISSN":["0143-991X"],"issn-type":[{"type":"print","value":"0143-991X"}],"subject":[],"published":{"date-parts":[[2016,1,18]]}}}