{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:42:00Z","timestamp":1740123720110,"version":"3.37.3"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,5,31]],"date-time":"2022-05-31T00:00:00Z","timestamp":1653955200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,31]],"date-time":"2022-05-31T00:00:00Z","timestamp":1653955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003176","name":"Ministerio de Educaci\u00f3n, Cultura y Deporte","doi-asserted-by":"publisher","award":["FPU15\/00504"],"award-info":[{"award-number":["FPU15\/00504"]}],"id":[{"id":"10.13039\/501100003176","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["ERC-2016-ADG-741930"],"award-info":[{"award-number":["ERC-2016-ADG-741930"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/V062506\/1"],"award-info":[{"award-number":["EP\/V062506\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011033","name":"Agencia Estatal de Investigaci\u00f3n","doi-asserted-by":"publisher","award":["PID2020-118649RB-l00","PLEC2021-007859"],"award-info":[{"award-number":["PID2020-118649RB-l00","PLEC2021-007859"]}],"id":[{"id":"10.13039\/501100011033","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000287","name":"Royal Academy of Engineering","doi-asserted-by":"crossref","award":["UK IC Postdoctoral Research Fellowship"],"award-info":[{"award-number":["UK IC Postdoctoral Research Fellowship"]}],"id":[{"id":"10.13039\/501100000287","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["User Model User-Adap Inter"],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Task planning in human\u2013robot environments tends to be particularly complex as it involves additional uncertainty introduced by the human user. Several plans, entailing few or various differences, can be obtained to solve the same given task. To choose among them, the usual least-cost plan criteria is not necessarily the best option, because here, human constraints and preferences come into play. Knowing these user preferences is very valuable to select an appropriate plan, but the preference values are usually hard to obtain. In this context, we propose the Space-of-Plans-based Suggestions (SoPS) algorithms that can provide suggestions for some planning predicates, which are used to define the state of the environment in a task planning problem where actions modify the predicates. We denote these predicates as <jats:italic>suggestible predicates<\/jats:italic>, of which user preferences are a particular case. The first algorithm is able to analyze the potential effect of the unknown predicates and provide suggestions to values for these unknown predicates that may produce better plans. The second algorithm is able to suggest changes to already known values that potentially improve the obtained reward. The proposed approach utilizes a Space of Plans Tree structure to represent a subset of the space of plans. The tree is traversed to find the predicates and the values that would most increase the reward, and output them as a suggestion to the user. Our evaluation in three preference-based assistive robotics domains shows how the proposed algorithms can improve task performance by suggesting the most effective predicate values first.<\/jats:p>","DOI":"10.1007\/s11257-022-09327-w","type":"journal-article","created":{"date-parts":[[2022,5,31]],"date-time":"2022-05-31T05:02:20Z","timestamp":1653973340000},"page":"333-357","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Generating predicate suggestions based on the space of plans: an example of planning with preferences"],"prefix":"10.1007","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6718-1198","authenticated-orcid":false,"given":"Gerard","family":"Canal","sequence":"first","affiliation":[]},{"given":"Carme","family":"Torras","sequence":"additional","affiliation":[]},{"given":"Guillem","family":"Aleny\u00e0","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,5,31]]},"reference":[{"key":"9327_CR1","unstructured":"Alami, R., Clodic, A., Montreuil, V., Sisbot, EA., Chatila, R.: Toward Human-Aware Robot Task Planning. In: AAAI spring symposium, pp. 39\u201346 (2006)"},{"key":"9327_CR2","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1007\/s12559-019-09696-2","volume":"12","author":"A Andriella","year":"2020","unstructured":"Andriella, A., Torras, C., Alenya, G.: Cognitive system framework for brain-training exercise based on human\u2013robot interaction. Cognit. Comput. 12, 793\u2013810 (2020)","journal-title":"Cognit. Comput."},{"issue":"4","key":"9327_CR3","first-page":"25","volume":"29","author":"JA Baier","year":"2008","unstructured":"Baier, J.A., McIlraith, S.: Planning with preferences. AI Mag. 29(4), 25\u201336 (2008)","journal-title":"AI Mag."},{"key":"9327_CR4","doi-asserted-by":"publisher","unstructured":"Behnke, G., Leichtmann, B., Bercher, P., H\u00f6ller, D., Nitsch, V., Baumann, M., Biundo, S.: Help me make a dinner! Challenges when assisting humans in action planning. In: Proceedings of the International Conference on Companion Technology, Ulm, vol.\u00a011. https:\/\/doi.org\/10.1109\/ICCT42709.2017.9151907 (2017)","DOI":"10.1109\/ICCT42709.2017.9151907"},{"issue":"6","key":"9327_CR5","doi-asserted-by":"publisher","first-page":"857","DOI":"10.1016\/j.engappai.2006.10.004","volume":"20","author":"A BenHassine","year":"2007","unstructured":"BenHassine, A., Ho, T.B.: An agent-based approach to solve dynamic meeting scheduling problems with preferences. Eng. Appl. Artif. Intell. 20(6), 857\u2013873 (2007). https:\/\/doi.org\/10.1016\/j.engappai.2006.10.004","journal-title":"Eng. Appl. Artif. Intell."},{"key":"9327_CR6","doi-asserted-by":"publisher","first-page":"808","DOI":"10.1016\/j.engappai.2019.08.002","volume":"85","author":"L Bidoux","year":"2019","unstructured":"Bidoux, L., Pignon, J.P., B\u00e9naben, F.: Planning with preferences using Multi-Attribute Utility Theory along with a Choquet Integral. Eng. Appl. Artif. Intell. 85, 808\u2013817 (2019). https:\/\/doi.org\/10.1016\/j.engappai.2019.08.002","journal-title":"Eng. Appl. Artif. Intell."},{"key":"9327_CR7","doi-asserted-by":"publisher","unstructured":"Canal, G., Aleny\u00e0, G., Torras, C.: A taxonomy of preferences for physically assistive robots. In: IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 292\u2013297, https:\/\/doi.org\/10.1109\/ROMAN.2017.8172316 (2017)","DOI":"10.1109\/ROMAN.2017.8172316"},{"key":"9327_CR8","doi-asserted-by":"publisher","unstructured":"Canal, G., Cashmore, M., Krivi\u0107, S., Aleny\u00e0, G., Magazzeni, D., Torras, C.: Probabilistic Planning for Robotics with ROSPlan. In: Towards Autonomous Robotic Systems, Springer, Cham, pp. 236\u2013250. https:\/\/doi.org\/10.1007\/978-3-030-23807-0_20 (2019b)","DOI":"10.1007\/978-3-030-23807-0_20"},{"key":"9327_CR9","doi-asserted-by":"publisher","unstructured":"Canal, G., Pignat, E., Aleny\u00e0, G., Calinon, S., Torras, C.: Joining high-level symbolic planning with low-level motion primitives in adaptive HRI: application to dressing assistance. In: IEEE International Conference on Robotics and Automation (ICRA), pp 3273\u20133278, https:\/\/doi.org\/10.1109\/ICRA.2018.8460606 (2018)","DOI":"10.1109\/ICRA.2018.8460606"},{"issue":"6","key":"9327_CR10","doi-asserted-by":"publisher","first-page":"1343","DOI":"10.1007\/s10514-018-9737-2","volume":"43","author":"G Canal","year":"2019","unstructured":"Canal, G., Aleny\u00e0, G., Torras, C.: Adapting robot task planning to user preferences: an assistive shoe dressing example. Auton. Robots 43(6), 1343\u20131356 (2019). https:\/\/doi.org\/10.1007\/s10514-018-9737-2","journal-title":"Auton. Robots"},{"issue":"4","key":"9327_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3472208","volume":"10","author":"G Canal","year":"2021","unstructured":"Canal, G., Torras, C., Aleny\u00e0, G.: Are preferences useful for better assistance?: A physically assistive robotics user study. ACM Trans. Human\u2013Robot Interact. (THRI) 10(4), 1\u201319 (2021). https:\/\/doi.org\/10.1145\/3472208","journal-title":"ACM Trans. Human\u2013Robot Interact. (THRI)"},{"key":"9327_CR12","doi-asserted-by":"crossref","unstructured":"Chakraborti, T., Sreedharan, S., Kulkarni, A., Kambhampati, S.: Projection-aware task planning and execution for human-in-the-loop operation of robots in a mixed-reality workspace. In: 2018 IEEE\/RSJ International conference on intelligent robots and systems (IROS), IEEE, pp. 4476\u20134482 (2018)","DOI":"10.1109\/IROS.2018.8593830"},{"issue":"7","key":"9327_CR13","doi-asserted-by":"publisher","first-page":"727","DOI":"10.1016\/j.engappai.2003.09.009","volume":"16","author":"A Chun","year":"2003","unstructured":"Chun, A., Wai, H., Wong, R.Y.: Optimizing agent-based meeting scheduling through preference estimation. Eng. Appl. Artif. Intell. 16(7), 727\u2013743 (2003). https:\/\/doi.org\/10.1016\/j.engappai.2003.09.009","journal-title":"Eng. Appl. Artif. Intell."},{"key":"9327_CR14","doi-asserted-by":"crossref","unstructured":"Cirillo, M., Karlsson, L., Saffiotti, A.: Human-aware task planning: an application to mobile robots. ACM Trans. Intell. Syst. Technol. (TIST) 1(2) (2010)","DOI":"10.1145\/1869397.1869404"},{"key":"9327_CR15","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1016\/j.knosys.2018.11.028","volume":"165","author":"M Das","year":"2019","unstructured":"Das, M., Odom, P., Islam, M.R., Doppa, J.R.J., Roth, D., Natarajan, S.: Planning with actively eliciting preferences. Knowl.-Based Syst. 165, 219\u2013227 (2019). https:\/\/doi.org\/10.1016\/j.knosys.2018.11.028","journal-title":"Knowl.-Based Syst."},{"key":"9327_CR16","doi-asserted-by":"publisher","unstructured":"De, Silva L., Lallement, R., Alami, R.: The HATP hierarchical planner: Formalisation and an initial study of its usability and practicality. In: 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 6465\u20136472, https:\/\/doi.org\/10.1109\/IROS.2015.7354301 (2015)","DOI":"10.1109\/IROS.2015.7354301"},{"key":"9327_CR17","doi-asserted-by":"publisher","unstructured":"Domshlak, C., H\u00fcllermeier, E., Kaci, S., Prade, H.: Preferences in AI: an overview. Artif. Intell. 175(7), 1037\u20131052. https:\/\/doi.org\/10.1016\/j.artint.2011.03.004, representing, Processing, and Learning Preferences: Theoretical and Practical Challenges (2011)","DOI":"10.1016\/j.artint.2011.03.004"},{"key":"9327_CR18","unstructured":"Eifler, R., Cashmore, M., Hoffmann, J., Magazzeni, D., Steinmetz, M.: Explaining the Space of Plans through Plan-Property Dependencies. In: ICAPS-19 Workshop on Explainable Planning (2019)"},{"key":"9327_CR19","doi-asserted-by":"publisher","unstructured":"Fiore, M., Clodic, A., Alami, R.: On planning and task achievement modalities for human\u2013robot collaboration. In: Experimental Robotics: The 14th International Symposium on Experimental Robotics, Springer, Cham, pp. 293\u2013306. https:\/\/doi.org\/10.1007\/978-3-319-23778-7_20 (2016)","DOI":"10.1007\/978-3-319-23778-7_20"},{"key":"9327_CR20","unstructured":"Fox, M., Long, D., Magazzeni, D.: Explainable planning. In: IJCAI-17 Workshop on Explainable AI (2017)"},{"key":"9327_CR21","doi-asserted-by":"publisher","unstructured":"Gao, Y., Chang, HJ., Demiris, Y.: User modelling for personalised dressing assistance by humanoid robots. In: 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1840\u20131845. https:\/\/doi.org\/10.1109\/IROS.2015.7353617 (2015)","DOI":"10.1109\/IROS.2015.7353617"},{"key":"9327_CR22","unstructured":"Gerevini, A., Long, D.: Plan constraints and preferences in PDDL3. Tech. rep., Department of Electronics for Automation, University of Brescia (2005)"},{"key":"9327_CR23","doi-asserted-by":"crossref","unstructured":"G\u00f6belbecker, M., Keller, T., Eyerich, P., Brenner, M., Nebel, B.: Coming up with good excuses: what to do when no plan can be found. In: Proceedings of the Twentieth International Conference on International Conference on Automated Planning and Scheduling, AAAI Press, pp. 81\u201388 (2010)","DOI":"10.1609\/icaps.v20i1.13421"},{"key":"9327_CR24","unstructured":"Hoffmann, J., Brafman, R.: Contingent planning via heuristic forward search with implicit belief states. In: Proceedings of the 15th International Conference on Planning and Scheduling (ICAPS), vol. 15, pp. 71\u201388 (2005)"},{"key":"9327_CR25","doi-asserted-by":"publisher","unstructured":"Jiang, S., Arkin, RC.: Mixed-initiative human\u2013robot interaction: definition, taxonomy, and survey. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics, pp. 954\u2013961. https:\/\/doi.org\/10.1109\/SMC.2015.174 (2015)","DOI":"10.1109\/SMC.2015.174"},{"key":"9327_CR26","doi-asserted-by":"crossref","unstructured":"Joppen, T., Wirth, C., F\u00fcrnkranz, J.: Preference-based Monte Carlo tree search. In: KI 2018: Advances in Artificial Intelligence. Springer, pp. 327\u2013340 (2018)","DOI":"10.1007\/978-3-030-00111-7_28"},{"key":"9327_CR27","doi-asserted-by":"crossref","unstructured":"Keller, T., Eyerich, P.: PROST: Probabilistic planning based on UCT. In: Proceedings of the 22nd International Conference on Planning and Scheduling (ICAPS), vol. 22, pp. 119\u2013127 (2012)","DOI":"10.1609\/icaps.v22i1.13518"},{"key":"9327_CR28","doi-asserted-by":"publisher","unstructured":"Kim, J., Woicik, ME., Gombolay, MC., Son, SH., Shah, JA.: Learning to infer final plans in human team planning. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence, IJCAI-18, pp. 4771\u20134779. https:\/\/doi.org\/10.24963\/ijcai.2018\/663 (2018)","DOI":"10.24963\/ijcai.2018\/663"},{"key":"9327_CR29","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1016\/j.artint.2015.02.006","volume":"247","author":"D Mart\u00ednez","year":"2017","unstructured":"Mart\u00ednez, D., Aleny\u00e0, G., Torras, C.: Relational reinforcement learning with guided demonstrations. Artif. Intell. 247, 295\u2013312 (2017)","journal-title":"Artif. Intell."},{"key":"9327_CR30","doi-asserted-by":"crossref","unstructured":"Pinsler, R., Akrour, R., Osa, T., Peters, J., Neumann, G.: Sample and feedback efficient hierarchical reinforcement learning from human preferences. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), IEEE, pp. 596\u2013601 (2018)","DOI":"10.1109\/ICRA.2018.8460907"},{"key":"9327_CR31","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.patrec.2017.06.002","volume":"99","author":"S Rossi","year":"2017","unstructured":"Rossi, S., Ferland, F., Tapus, A.: User profiling and behavioral adaptation for HRI: A survey. Pattern Recognit. Lett. 99, 3\u201312 (2017). https:\/\/doi.org\/10.1016\/j.patrec.2017.06.002","journal-title":"Pattern Recognit. Lett."},{"key":"9327_CR32","first-page":"27","volume":"32","author":"S Sanner","year":"2010","unstructured":"Sanner, S.: Relational dynamic influence diagram language (RDDL): language description, unpublished ms. Aust. Natl. Univ. 32, 27 (2010)","journal-title":"Aust. Natl. Univ."},{"key":"9327_CR33","unstructured":"Shmaryahu, D., Shani, G., Hoffmann, J., Steinmetz, M.: Constructing plan trees for simulated penetration testing. In: The 26th International Conference on Automated Planning and Scheduling, vol.\u00a026 (2016)"},{"key":"9327_CR34","doi-asserted-by":"crossref","unstructured":"Sohrabi, S., Baier, JA., McIlraith, SA.: Preferred explanations: Theory and generation via planning. In: Proceedings of the 25th AAAI Conference on Artificial Intelligence, vol.\u00a025 (2011)","DOI":"10.1609\/aaai.v25i1.7845"},{"issue":"3","key":"9327_CR35","doi-asserted-by":"publisher","first-page":"617","DOI":"10.1007\/s12369-019-00617-9","volume":"12","author":"A Umbrico","year":"2020","unstructured":"Umbrico, A., Cesta, A., Cortellessa, G., Orlandini, A.: A holistic approach to behavior adaptation for socially assistive robots. Int. J. Soc. Robot. 12(3), 617\u2013637 (2020)","journal-title":"Int. J. Soc. Robot."},{"issue":"2","key":"9327_CR36","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1007\/s10458-015-9288-2","volume":"30","author":"S Visser","year":"2016","unstructured":"Visser, S., Thangarajah, J., Harland, J., Dignum, F.: Preference-based reasoning in BDI agent systems. Auton. Agents Multi-Agent Syst. 30(2), 291\u2013330 (2016). https:\/\/doi.org\/10.1007\/s10458-015-9288-2","journal-title":"Auton. Agents Multi-Agent Syst."},{"issue":"1","key":"9327_CR37","first-page":"4945","volume":"18","author":"C Wirth","year":"2017","unstructured":"Wirth, C., Akrour, R., Neumann, G., F\u00fcrnkranz, J.: A survey of preference-based reinforcement learning methods. J. Mach. Learn. Res. 18(1), 4945\u20134990 (2017)","journal-title":"J. Mach. Learn. Res."}],"container-title":["User Modeling and User-Adapted Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11257-022-09327-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11257-022-09327-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11257-022-09327-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,28]],"date-time":"2023-04-28T17:07:14Z","timestamp":1682701634000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11257-022-09327-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,31]]},"references-count":37,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["9327"],"URL":"https:\/\/doi.org\/10.1007\/s11257-022-09327-w","relation":{},"ISSN":["0924-1868","1573-1391"],"issn-type":[{"type":"print","value":"0924-1868"},{"type":"electronic","value":"1573-1391"}],"subject":[],"published":{"date-parts":[[2022,5,31]]},"assertion":[{"value":"12 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 April 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 May 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}