{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:24:43Z","timestamp":1760243083419,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2015,7,13]],"date-time":"2015-07-13T00:00:00Z","timestamp":1436745600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>Learning and planning are powerful AI methods that exhibit complementary strengths. While planning allows goal-directed actions to be computed when a reliable forward model is known, learning allows such models to be obtained autonomously. In this paper we describe how both methods can be combined using an expressive qualitative knowledge representation. We argue that the crucial step in this integration is to employ a representation based on a well-defined semantics. This article proposes the qualitative spatial logic QSL, a representation that combines qualitative abstraction with linear temporal logic, allowing us to represent relevant information about the learning task, possible actions, and their consequences. Doing so, we empower reasoning processes to enhance learning performance beyond the positive effects of learning in abstract state spaces. Proof-of-concept experiments in two simulation environments show that this approach can help to improve learning-based robotics by quicker convergence and leads to more reliable action planning.<\/jats:p>","DOI":"10.3390\/robotics4030253","type":"journal-article","created":{"date-parts":[[2015,7,13]],"date-time":"2015-07-13T10:38:10Z","timestamp":1436783890000},"page":"253-283","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Leveraging Qualitative Reasoning to Learning Manipulation Tasks"],"prefix":"10.3390","volume":"4","author":[{"given":"Diedrich","family":"Wolter","sequence":"first","affiliation":[{"name":"Faculty of Information Systems and Applied Computer Sciences, University of Bamberg, Bamberg, D-96045, Germany"}]},{"given":"Alexandra","family":"Kirsch","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Eberhard Karls Universit\u00e4t T\u00fcbingen, T\u00fcbingen, D-72074, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2015,7,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0004-3702(91)90106-T","article-title":"Qualitative Reasoning About Physical Systems\u2014A Return to Roots","volume":"51","author":"Williams","year":"1991","journal-title":"Artif. Intell."},{"key":"ref_2","first-page":"13","article-title":"Current topics in qualitative reasoning","volume":"24","author":"Bredeweg","year":"2003","journal-title":"AI Mag."},{"key":"ref_3","unstructured":"Davis, E. (1990). Representations of Commonsense Knowledge, Morgan Kaufmann Publishers."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"M\u00f6senlechner, L., and Beetz, M. (2011, January 25\u201330). Parameterizing Actions to have the Appropriate Effects. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), San Francisco, CA, USA.","DOI":"10.1109\/IROS.2011.6048523"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1207\/s15427633scc0402_3","article-title":"The Psychological Validity of Qualitative Spatial Reasoning in One Dimension","volume":"4","author":"Knauff","year":"2004","journal-title":"Spat. Cogn. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"943","DOI":"10.1016\/j.robot.2009.05.001","article-title":"Robot Learning Language\u2014Integrating Programming and Learning for Cognitive Systems","volume":"57","author":"Kirsch","year":"2009","journal-title":"Robot. Auton. Syst. J."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1145\/1656274.1656278","article-title":"The WEKA Data Mining Software: An Update","volume":"11","author":"Hall","year":"2009","journal-title":"SIGKDD Explor."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Echeverria, G., Lassabe, N., Degroote, A., and Lemaignan, S. (2011, January 9\u201313). Modular openrobots simulation engine: MORSE. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980252"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lemaignan, S., Echeverria, G., Karg, M., Mainprice, M., Kirsch, A., and Alami, R. (2012, January 5\u20138). Human-Robot Interaction in the MORSE Simulator. Proceedings of the 2012 7th ACM\/IEEE International Conference on Human-Robot Interaction Conference (Late Breaking Report), Boston, MA, USA.","DOI":"10.1145\/2157689.2157745"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1016\/S1574-6526(07)03013-1","article-title":"Qualitative Spatial Representation and Reasoning. Chapter 13: Foundations of Artificial Intelligence","volume":"Volume 3","author":"Lifschitz","year":"2008","journal-title":"Handbook of Knowledge Representation"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Aiello, M., Pratt-Hartmann, I.E., and van Benthem, J.F. (2007). Handbook of Spatial Logics, Springer.","DOI":"10.1007\/978-1-4020-5587-4"},{"key":"ref_12","unstructured":"Vilain, M.B., and Kautz, H.A. (1986, January 11\u201315). Constraint propagation algorithms for temporal reasoning. Proceedings of the 5th National Conference of the 13 American Association for Artificial Intelligence (AAAI-86), Philadelphia, PA, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1145\/182.358434","article-title":"Maintaining knowledge about temporal intervals","volume":"26","author":"Allen","year":"1983","journal-title":"Commun. ACM"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"885","DOI":"10.1093\/logcom\/12.5.885","article-title":"Tractability Results in the Block Algebra","volume":"12","author":"Balbiani","year":"2002","journal-title":"J. Logic Comput."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Renz, J., and Mitra, D. (2004, January 9\u201313). Qualitative Direction Calculi with Arbitrary Granularity. Proceedings of the 8th Pacific Rim International Conference on Artificial Intelligence (PRICAI-04), Auckland, New Zealand.","DOI":"10.1007\/978-3-540-28633-2_9"},{"key":"ref_16","unstructured":"Rossi, F. (2013, January 3\u20139). StarVars\u2014Effective Reasoning about Relative Directions. Proceedings of the Internatoinal Joint Conference on Artificial Intelligence (IJCAI), Beijing, China."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.jvlc.2006.11.001","article-title":"Qualitative spatial reasoning about relative point position","volume":"19","author":"Moratz","year":"2008","journal-title":"J. Vis. Lang. Comput."},{"key":"ref_18","unstructured":"Zhang, C., Guesgen, H., and Yeap, W. (2004, January 9\u201313). What Is a Qualitative Calculus? A General Framework. Proceedings of the 8th Pacific Rim International Conference on Artificial Intelligence (PRICAI-04), Auckland, New Zealand."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Dylla, F., Mossakowski, T., Schneider, T., and Wolter, D. (2013, January 2\u20136). Algebraic Properties of Qualitative Spatio-temporal Calculi. Proceedings of the 11th International Conference on COSIT, Scarborough, UK.","DOI":"10.1007\/978-3-319-01790-7_28"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kreutzmann, A., and Wolter, D. (2014, January 17\u201322). Qualitative Spatial and Temporal Reasoning with AND\/OR Linear Programming. Proceedings of the 21st European Conference on Artificial Intelligence (ECAI), Prague, Czech.","DOI":"10.3233\/978-1-61499-419-0-495"},{"key":"ref_21","unstructured":"Pnueli, A. (November, January 31). The temporal logic of programs. Proceedings of the 18th Annual Symposium on Foundations of Computer Science (FOCS), Providence, RI, USA."},{"key":"ref_22","unstructured":"Antoniotti, M., and Mishra, B. (1995, January 21\u201327). Discrete event models + temporal logic = supervisory controller: Automatic synthesis of locomotion controllers. Proceedings of the IEEE Conference on Robotics and Automation (ICRA), Nagoya, Japan."},{"key":"ref_23","first-page":"65","article-title":"Correct, Reactive Robot Control from Abstraction and Temporal Logic Specifications","volume":"18","author":"Wongpiromsarn","year":"2011","journal-title":"Spec. Issue IEEE Robot. Autom. Mag. Form. Methods Robot. Autom."},{"key":"ref_24","unstructured":"Kloetzer, M., and Belta, C. (2006, January 23\u201325). LTL planning for groups of robots. Proceedings of the IEEE International Conference on Networking, Sensing and Control (ICNSC), Ft. Lauderdale, FL, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Smith, S.L., T\u016fmov\u00e1, J., Belta, C., and Rus, D. (2010, January 18\u201322). Optimal path planning under temporal logic constraints. Proceeding of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5650896"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1109\/TRO.2009.2035776","article-title":"Automatic deployment of distributed teams of robots from temporal logic motion specifications","volume":"26","author":"Kloetzer","year":"2010","journal-title":"IEEE Trans. Robot."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s11370-012-0122-2","article-title":"Temporal logic for process specification and recognition","volume":"6","author":"Kreutzmann","year":"2013","journal-title":"Intell. Serv. Robot."},{"key":"ref_28","unstructured":"Kr\u00f6ger, F., and Merz, S. (2008). Temporal Logic and State Systems, Springer. Texts in Theoretical Computer Science."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/j.entcs.2009.02.041","article-title":"The tractability of model checking for LTL: The good, the bad, and the ugly fragments","volume":"231","author":"Bauland","year":"2009","journal-title":"Electron. Notes Theor. Comput. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Gebser, M., Grote, T., and Schaub, T. (2010, January 13\u201315). Coala: A Compiler from Action Languages to ASP. Lecture Notes in Computer Science In Proceedings of the 12th European Conference on Logics in Artificial Intelligence (JELIA), Helsinki, Finland.","DOI":"10.1007\/978-3-642-15675-5_32"},{"key":"ref_31","first-page":"271","article-title":"Monte Carlo Model Checking","volume":"Volume 3440","author":"Grosu","year":"2005","journal-title":"Tools and Algorithms for the Construction and Analysis of Systems"},{"key":"ref_32","unstructured":"Witten, I.H., and Frank, E. (2005). Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufmann. [2nd ed.]."},{"key":"ref_33","unstructured":"Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A.Y. (2009, January 17). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan."},{"key":"ref_34","unstructured":"Kirsch, A., Schweitzer, M., and Beetz, M. (2005, January 5\u201310). Making Robot Learning Controllable: A Case Study in Robot Navigation. Proceedings of the ICAPS Workshop on Plan Execution: A Reality Check, Monterey, CA, USA."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1142\/S021821300800400X","article-title":"Learning to Behave in Space: A Qualitative Spatial Representation for Robot Navigation with Reinforcement Learning","volume":"17","author":"Frommberger","year":"2008","journal-title":"Int. J. Artif. Intell. Tools (IJAIT)"},{"key":"ref_36","unstructured":"Kulick, J., Toussaint, M., Lang, T., and Lopes, M. (2013, January 3\u20139). Active Learning for Teaching a Robot Grounded Relational Symbols. Proceedings of the International Joint Conference on Artificial Intelligence, IJCAI, Beijing, China."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Beetz, M., M\u00f6senlechner, L., and Tenorth, M. (2010, January 18\u201322). CRAM\u2014A Cognitive Robot Abstract Machine for Everyday Manipulation in Human Environments. Proceedings of the International Conference on Intelligent Robots and Systems, Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5650146"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/TASE.2013.2244883","article-title":"Representation and Exchange of Knowledge about Actions, Objects, and Environments in the RoboEarth Framework","volume":"10","author":"Tenorth","year":"2013","journal-title":"IEEE Trans. Autom. Sci. Eng. (T-ASE)"},{"key":"ref_39","unstructured":"Tenorth, M., Bartels, G., and Beetz, M. (2014, January 18\u201322). Knowledge-based Specification of Robot Motions. Proceedings of the 21st European Conference on Artificial Intelligence (ECAI 2014), Prague, Czech."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/S0743-1066(96)00121-5","article-title":"Golog: A logic programming language for dynamic domains","volume":"31","author":"Levesque","year":"1997","journal-title":"J. Logic Program."},{"key":"ref_41","unstructured":"Lifschitz, V., van Harmelen, F., and Porter, F. (2007). Handbook of Knowledge Representation, Elsevier."},{"key":"ref_42","unstructured":"Mitchell, T. (2006). The Discipline of Machine Learning, Carnegie Mellon University. Technical Report CMU-ML-06-108."},{"key":"ref_43","unstructured":"Kirsch, A. (2008). Integration of Programming and Learning in a Control Language for Autonomous Robots Performing Everyday Activities. [Ph.D. Thesis, Technische Universit\u00e4t M\u00fcnchen]."},{"key":"ref_44","unstructured":"Thrun, S. (2000, January 24\u201328). Towards programming tools for robots that integrate probabilistic computation and learning. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), San Francisco, CA, USA."},{"key":"ref_45","unstructured":"Thrun, S. (1998). A Framework for Programming Embedded Systems: Initial Design and Results, Carnegie Mellon University, Computer Science Department. Technical Report CMU-CS-98-142."},{"key":"ref_46","unstructured":"Andre, D., and Russell, S. (2001, January 3\u20138). Programmable Reinforcement Learning Agents. Proceedings of the 13th Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_47","unstructured":"Andre, D. (2003). Programmable Reinforcement Learning Agents. [Ph.D. Thesis, University of California]."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/4\/3\/253\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:49:06Z","timestamp":1760215746000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/4\/3\/253"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,13]]},"references-count":47,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2015,9]]}},"alternative-id":["robotics4030253"],"URL":"https:\/\/doi.org\/10.3390\/robotics4030253","relation":{},"ISSN":["2218-6581"],"issn-type":[{"type":"electronic","value":"2218-6581"}],"subject":[],"published":{"date-parts":[[2015,7,13]]}}}