{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T21:10:54Z","timestamp":1792789854690,"version":"4.5.0"},"reference-count":110,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T00:00:00Z","timestamp":1698969600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T00:00:00Z","timestamp":1698969600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Wallenberg AI, Autonomous Systems and Software Program"},{"DOI":"10.13039\/501100004359","name":"Swedish Research Council","doi-asserted-by":"crossref","award":["2017-05102"],"award-info":[{"award-number":["2017-05102"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004063","name":"Knut and Alice Wallenberg Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004063","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton Robot"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Many tasks require robots to manipulate objects while satisfying a complex interplay of spatial and temporal constraints. For instance, a table setting robot first needs to place a mug and then fill it with coffee, while satisfying spatial relations such as forks need to placed left of plates. We propose the spatio-temporal framework SpaTiaL that unifies the specification, monitoring, and planning of object-oriented robotic tasks in a robot-agnostic fashion. SpaTiaL is able to specify diverse spatial relations between objects and temporal task patterns. Our experiments with recorded data, simulations, and real robots demonstrate how SpaTiaL provides real-time monitoring and facilitates online planning. SpaTiaL is open source and easily expandable to new object relations and robotic applications.<\/jats:p>","DOI":"10.1007\/s10514-023-10145-1","type":"journal-article","created":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T05:02:59Z","timestamp":1698987779000},"page":"1439-1462","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["SpaTiaL: monitoring and planning of robotic tasks using spatio-temporal logic specifications"],"prefix":"10.1007","volume":"47","author":[{"given":"Christian","family":"Pek","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Georg Friedrich","family":"Schuppe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Francesco","family":"Esposito","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jana","family":"Tumova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danica","family":"Kragic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,11,3]]},"reference":[{"key":"10145_CR1","unstructured":"Agostini, A., & Lee, D. (2020). Efficient state abstraction using object-centered predicates for manipulation planning. Preprint retrieved from preprint arXiv:2007.08251"},{"key":"10145_CR2","doi-asserted-by":"crossref","unstructured":"Aineto, D., Jim\u00e9nez, S., & Onaindia, E. (2018). Learning STRIPS action models with classical planning. In Proceeding of the international conference on automated planning and scheduling.","DOI":"10.1609\/icaps.v28i1.13870"},{"issue":"11","key":"10145_CR3","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1145\/182.358434","volume":"26","author":"JF Allen","year":"1983","unstructured":"Allen, J. F. (1983). Maintaining knowledge about temporal intervals. Communications of the ACM, 26(11), 832\u2013843.","journal-title":"Communications of the ACM"},{"issue":"1","key":"10145_CR4","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1145\/227595.227602","volume":"43","author":"R Alur","year":"1996","unstructured":"Alur, R., Feder, T., & Henzinger, T. A. (1996). The benefits of relaxing punctuality. Journal of the ACM, 43(1), 116\u2013146.","journal-title":"Journal of the ACM"},{"key":"10145_CR5","unstructured":"Baier, C., & Katoen, J. P. (2008). Principles of model checking. MIT Press."},{"issue":"4","key":"10145_CR6","doi-asserted-by":"publisher","first-page":"3332","DOI":"10.1109\/LRA.2019.2926669","volume":"4","author":"FS Barbosa","year":"2019","unstructured":"Barbosa, F. S., Duberg, D., Jensfelt, P., & Tumova, J. (2019). Guiding autonomous exploration with signal temporal logic. IEEE Robotics and Automation Letters, 4(4), 3332\u20133339.","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"6446","key":"10145_CR7","doi-asserted-by":"publisher","first-page":"eaat8414","DOI":"10.1126\/science.aat8414","volume":"364","author":"A Billard","year":"2019","unstructured":"Billard, A., & Kragic, D. (2019). Trends and challenges in robot manipulation. Science, 364(6446), eaat8414.","journal-title":"Science"},{"key":"10145_CR8","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511804441","volume-title":"Convex optimization","author":"S Boyd","year":"2004","unstructured":"Boyd, S., Boyd, S. P., & Vandenberghe, L. (2004). Convex optimization. Cambridge University Press."},{"issue":"1\u20132","key":"10145_CR9","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/0004-3702(94)90081-7","volume":"69","author":"T Bylander","year":"1994","unstructured":"Bylander, T. (1994). The computational complexity of propositional strips planning. Artificial Intelligence, 69(1\u20132), 165\u2013204.","journal-title":"Artificial Intelligence"},{"key":"10145_CR10","doi-asserted-by":"crossref","unstructured":"Cashmore, M., Fox, M., Long, D., Magazzeni, D., Ridder, B., Carrera, A., Palomeras, N., Hurtos, N., & Carreras,M. (2015). ROSplan: Planning in the robot operating system. In Proceedings of the international conference on automated planning and scheduling.","DOI":"10.1609\/icaps.v25i1.13699"},{"key":"10145_CR11","doi-asserted-by":"crossref","unstructured":"Colledanchise, M., & \u00d6gren, P. (2018). Behavior trees in robotics and AI: An introduction. CRC Press.","DOI":"10.1201\/9780429489105"},{"issue":"1","key":"10145_CR12","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1109\/TASE.2016.2600527","volume":"15","author":"N Correll","year":"2016","unstructured":"Correll, N., Bekris, K. E., Berenson, D., Brock, O., Causo, A., Hauser, K., Okada, K., Rodriguez, A., Romano, J. M., & Wurman, P. R. (2016). Analysis and observations from the first amazon picking challenge. IEEE Transactions on Automation Science and Engineering, 15(1), 172\u2013188.","journal-title":"IEEE Transactions on Automation Science and Engineering"},{"key":"10145_CR13","unstructured":"Coumans, E., & Bai, Y. (2022). PyBullet, a Python module for physics simulation for games, robotics and machine learning. https:\/\/pybullet.org."},{"key":"10145_CR14","first-page":"1","volume":"12","author":"NT Dantam","year":"2016","unstructured":"Dantam, N. T., Kingston, Z. K., Chaudhuri, S., & Kavraki, L. E. (2016). Incremental task and motion planning: A constraint-based approach. In Robotics: Science and systems, 12, 1\u201311.","journal-title":"In Robotics: Science and systems"},{"key":"10145_CR15","unstructured":"De\u00a0Giacomo, G., & Vardi, M. Y. (2013). Linear temporal logic and linear dynamic logic on finite traces. In Proceedings of the ACM international conference on artificial intelligence (pp. 854\u2013860)."},{"key":"10145_CR16","doi-asserted-by":"crossref","unstructured":"Deng, B., Genova, K., Yazdani, S., Bouaziz, S., Hinton, G., & Tagliasacchi, A. (2020). CvxNet: Learnable convex decomposition. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 31\u201344).","DOI":"10.1109\/CVPR42600.2020.00011"},{"key":"10145_CR17","doi-asserted-by":"crossref","unstructured":"Devin, C., Abbeel, P., Darrell, T., & Levine, S. (2018). Deep object-centric representations for generalizable robot learning. In Proceedings of the IEEE international conference on robotics and automation (pp. 7111\u20137118).","DOI":"10.1109\/ICRA.2018.8461196"},{"key":"10145_CR18","doi-asserted-by":"crossref","unstructured":"Diehl, M., Paxton, C., & Ramirez-Amaro, K. (2021). Automated generation of robotic planning domains from observations. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 6732\u20136738).","DOI":"10.1109\/IROS51168.2021.9636781"},{"key":"10145_CR19","doi-asserted-by":"crossref","unstructured":"Donz\u00e9, A., Ferrere, T., Maler, O. (2013). Efficient robust monitoring for STL. In International conference on computer aided verification (pp. 264\u2013279). Springer.","DOI":"10.1007\/978-3-642-39799-8_19"},{"key":"10145_CR20","doi-asserted-by":"crossref","unstructured":"Donz\u00e9, A., & Maler, O. (2010). Robust satisfaction of temporal logic over real-valued signals. In Proceedings of the international conference on formal modeling and analysis of timed systems (pp. 92\u2013106).","DOI":"10.1007\/978-3-642-15297-9_9"},{"key":"10145_CR21","doi-asserted-by":"crossref","unstructured":"Driess, D., Ha, J. S., Tedrake, R., & Toussaint, M. (2021). Learning geometric reasoning and control for long-horizon tasks from visual input. In Proceedings of the IEEE international conference on robotics and automation (pp. 14298\u201314305).","DOI":"10.1109\/ICRA48506.2021.9560934"},{"key":"10145_CR22","unstructured":"Driess, D., Ha, J. S., Toussaint, M., & Tedrake, R. (2022). Learning models as functionals of signed-distance fields for manipulation planning. In Conference on robot learning (pp. 245\u2013255)."},{"key":"10145_CR23","doi-asserted-by":"publisher","DOI":"10.1201\/b14581","volume-title":"Real-time collision detection","author":"C Ericson","year":"2004","unstructured":"Ericson, C. (2004). Real-time collision detection. CRC Press."},{"key":"10145_CR24","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1016\/0004-3702(72)90051-3","volume":"3","author":"RE Fikes","year":"1972","unstructured":"Fikes, R. E., Hart, P. E., & Nilsson, N. J. (1972). Learning and executing generalized robot plans. Artificial intelligence, 3, 251\u2013288.","journal-title":"Artificial intelligence"},{"issue":"5","key":"10145_CR25","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1163\/156855305323383811","volume":"19","author":"B Finkemeyer","year":"2005","unstructured":"Finkemeyer, B., Kr\u00f6ger, T., & Wahl, F. M. (2005). Executing assembly tasks specified by manipulation primitive nets. Advanced Robotics, 19(5), 591\u2013611.","journal-title":"Advanced Robotics"},{"key":"10145_CR26","doi-asserted-by":"crossref","unstructured":"Finucane, C., Jing, G., & Kress-Gazit, H. (2010). LTLMoP: Experimenting with language, temporal logic and robot control. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 1988\u20131993).","DOI":"10.1109\/IROS.2010.5650371"},{"key":"10145_CR27","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1613\/jair.1129","volume":"20","author":"M Fox","year":"2003","unstructured":"Fox, M., & Long, D. (2003). PDDL2.1: An extension to PDDL for expressing temporal planning domains. Journal of Artificial Intelligence Research, 20, 61\u2013124.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"10145_CR28","unstructured":"Fuggitti, F. (2021). LTLf2DFA Github repository. Retrieved July 20, 2021, from https:\/\/github.com\/whitemech\/LTLf2DFA"},{"key":"10145_CR29","unstructured":"Garrett, C. R., Lozano-P\u00e9rez, T., & Kaelbling, L. P. (2017). STRIPS planning in infinite domains (pp. 1\u201311). Preprint retrieved from arXiv:1701.00287"},{"key":"10145_CR30","doi-asserted-by":"crossref","unstructured":"Garrett, C. R., Lozano-P\u00e9rez, T., & Kaelbling, L. P. (2020). PDDLStream: Integrating symbolic planners and blackbox samplers via optimistic adaptive planning. In Proceedings of the international conference on automated planning and scheduling (pp. 440\u2013448).","DOI":"10.1609\/icaps.v30i1.6739"},{"key":"10145_CR31","doi-asserted-by":"crossref","unstructured":"Ghzouli, R., Berger, T., Johnsen, E. B., Dragule, S., & Wasowski, A. (2020). Behavior trees in action: A study of robotics applications. In Proceedings of the ACM SIGPLAN international conference on software language engineering (pp. 196\u2013209).","DOI":"10.1145\/3426425.3426942"},{"key":"10145_CR32","unstructured":"Gillies, S., Bierbaum, A., Lautaportti, K., & Tonnhofer, O. (2007). Shapely: Manipulation and analysis of geometric objects."},{"key":"10145_CR33","doi-asserted-by":"crossref","unstructured":"Guadarrama, S., Riano, L., Golland, D., Go, D., Jia, Y., Klein, D., Abbeel, P., Darrell, T. (2013). Grounding spatial relations for human-robot interaction. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 1640\u20131647).","DOI":"10.1109\/IROS.2013.6696569"},{"key":"10145_CR34","doi-asserted-by":"crossref","unstructured":"Harabor, D., & Grastien, A. (2011). Online graph pruning for pathfinding on grid maps. In Proceedings of the AAAI conference on artificial intelligence, Vol. 25.","DOI":"10.1609\/aaai.v25i1.7994"},{"key":"10145_CR35","doi-asserted-by":"crossref","unstructured":"He, K., Lahijanian, M., Kavraki, L. E., & Vardi, M. Y. (2015). Towards manipulation planning with temporal logic specifications. In Proceedings of the IEEE international conference on robotics and automation (pp. 346\u2013352).","DOI":"10.1109\/ICRA.2015.7139022"},{"issue":"2","key":"10145_CR36","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1109\/LRA.2018.2889191","volume":"4","author":"K He","year":"2018","unstructured":"He, K., Lahijanian, M., Kavraki, L. E., & Vardi, M. Y. (2018). Automated abstraction of manipulation domains for cost-based reactive synthesis. IEEE Robotics and Automation Letters, 4(2), 285\u2013292.","journal-title":"IEEE Robotics and Automation Letters"},{"key":"10145_CR37","doi-asserted-by":"crossref","unstructured":"He, K., Wells, A. M., Kavraki, L. E., & Vardi, M. Y. (2019). Efficient symbolic reactive synthesis for finite-horizon tasks. In Proceedings of the international conference on robotics and automation (pp. 8993\u20138999).","DOI":"10.1109\/ICRA.2019.8794170"},{"key":"10145_CR38","doi-asserted-by":"crossref","unstructured":"Henriksen, J. G., Jensen, J., J\u00f8rgensen, M., Klarlund, N., Paige, R., Rauhe, T., & Sandholm, A. (1995). Mona: Monadic second-order logic in practice. In International workshop on tools and algorithms for the construction and analysis of systems (pp. 89\u2013110). Springer.","DOI":"10.1007\/3-540-60630-0_5"},{"key":"10145_CR39","doi-asserted-by":"publisher","first-page":"104096","DOI":"10.1016\/j.robot.2022.104096","volume":"154","author":"M Iovino","year":"2022","unstructured":"Iovino, M., Scukins, E., Styrud, J., \u00d6gren, P., & Smith, C. (2022). A survey of behavior trees in robotics and AI. Robotics and Autonomous Systems, 154, 104096.","journal-title":"Robotics and Autonomous Systems"},{"key":"10145_CR40","doi-asserted-by":"crossref","unstructured":"Izatt, G., & Tedrake, R. (2020). Generative modeling of environments with scene grammars and variational inference. In Proceedings of the IEEE international conference on robotics and automation (pp. 6891\u20136897).","DOI":"10.1109\/ICRA40945.2020.9196910"},{"issue":"4","key":"10145_CR41","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1017\/S026988891200001X","volume":"27","author":"S Jim\u00e9nez","year":"2012","unstructured":"Jim\u00e9nez, S., De La Rosa, T., Fern\u00e1ndez, S., Fern\u00e1ndez, F., & Borrajo, D. (2012). A review of machine learning for automated planning. The Knowledge Engineering Review, 27(4), 433\u2013467.","journal-title":"The Knowledge Engineering Review"},{"key":"10145_CR42","doi-asserted-by":"crossref","unstructured":"Jund, P., Eitel, A., Abdo, N., & Burgard, W. (2018). Optimization beyond the convolution: Generalizing spatial relations with end-to-end metric learning. In Proceedings of the IEEE international conference on robotics and automation (pp. 4510\u20134516).","DOI":"10.1109\/ICRA.2018.8460220"},{"key":"10145_CR43","doi-asserted-by":"crossref","unstructured":"Kantaros, Y., Malencia, M., Kumar, V., & Pappas, G .J. (2020). Reactive temporal logic planning for multiple robots in unknown environments. In Proceedigns of the IEEE international conference on robotics and automation (pp. 11479\u201311485).","DOI":"10.1109\/ICRA40945.2020.9197570"},{"key":"10145_CR44","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1146\/annurev-control-082619-100135","volume":"3","author":"E Karpas","year":"2020","unstructured":"Karpas, E., & Magazzeni, D. (2020). Automated planning for robotics. Annual Review of Control, Robotics, and Autonomous Systems, 3, 417\u2013439.","journal-title":"Annual Review of Control, Robotics, and Autonomous Systems"},{"issue":"4","key":"10145_CR45","doi-asserted-by":"publisher","first-page":"3991","DOI":"10.1109\/LRA.2018.2859448","volume":"3","author":"R Kartmann","year":"2018","unstructured":"Kartmann, R., Paus, F., Grotz, M., & Asfour, T. (2018). Extraction of physically plausible support relations to predict and validate manipulation action effects. IEEE Robotics and Automation Letters, 3(4), 3991\u20133998.","journal-title":"IEEE Robotics and Automation Letters"},{"key":"10145_CR46","doi-asserted-by":"crossref","unstructured":"Katayama, M., Tokuda, S., Yamakita, M., & Oyama, H. (2020). Fast LTL-based flexible planning for dual-arm manipulation. In Proceeedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 6605\u20136612).","DOI":"10.1109\/IROS45743.2020.9341352"},{"key":"10145_CR47","doi-asserted-by":"crossref","unstructured":"Kent, D., Saldanha, C., & Chernova, S. (2017). A comparison of remote robot teleoperation interfaces for general object manipulation. In Proceedings of the ACM\/IEEE international conference on human-robot interaction (pp. 371\u2013379).","DOI":"10.1145\/2909824.3020249"},{"issue":"4","key":"10145_CR48","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1007\/BF01995674","volume":"2","author":"R Koymans","year":"1990","unstructured":"Koymans, R. (1990). Specifying real-time properties with metric temporal logic. Real-Time Systems, 2(4), 255\u2013299.","journal-title":"Real-Time Systems"},{"issue":"9","key":"10145_CR49","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1145\/3433637","volume":"64","author":"H Kress-Gazit","year":"2021","unstructured":"Kress-Gazit, H., Eder, K., Hoffman, G., Admoni, H., Argall, B., Ehlers, R., Heckman, C., Jansen, N., Knepper, R., K\u0159et\u00ednsk\u1ef3, J., et al. (2021). Formalizing and guaranteeing human-robot interaction. Communications of the ACM, 64(9), 78\u201384.","journal-title":"Communications of the ACM"},{"issue":"12","key":"10145_CR50","doi-asserted-by":"publisher","first-page":"1343","DOI":"10.1163\/156855308X344864","volume":"22","author":"H Kress-Gazit","year":"2008","unstructured":"Kress-Gazit, H., Fainekos, G. E., & Pappas, G. J. (2008). Translating structured English to robot controllers. Advanced Robotics, 22(12), 1343\u20131359.","journal-title":"Advanced Robotics"},{"issue":"6","key":"10145_CR51","doi-asserted-by":"publisher","first-page":"1370","DOI":"10.1109\/TRO.2009.2030225","volume":"25","author":"H Kress-Gazit","year":"2009","unstructured":"Kress-Gazit, H., Fainekos, G. E., & Pappas, G. J. (2009). Temporal-logic-based reactive mission and motion planning. IEEE Transactions on Robotics, 25(6), 1370\u20131381.","journal-title":"IEEE Transactions on Robotics"},{"key":"10145_CR52","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1146\/annurev-control-060117-104838","volume":"1","author":"H Kress-Gazit","year":"2018","unstructured":"Kress-Gazit, H., Lahijanian, M., & Raman, V. (2018). Synthesis for robots: Guarantees and feedback for robot behavior. Annual Review of Control, Robotics, and Autonomous Systems, 1, 211\u2013236.","journal-title":"Annual Review of Control, Robotics, and Autonomous Systems"},{"key":"10145_CR53","first-page":"293","volume-title":"Manipulation primitives-a universal interface between sensor-based motion control and robot programming, Robotic systems for handling and assembly","author":"T Kr\u00f6ger","year":"2010","unstructured":"Kr\u00f6ger, T., Finkemeyer, B., & Wahl, F. M. (2010). Manipulation primitives-a universal interface between sensor-based motion control and robot programming, Robotic systems for handling and assembly (pp. 293\u2013313). Springer."},{"key":"10145_CR54","doi-asserted-by":"crossref","unstructured":"Kshirsagar, A., Kress-Gazit, H., & Hoffman, G. (2019). Specifying and synthesizing human-robot handovers. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 5930\u20135936).","DOI":"10.1109\/IROS40897.2019.8967709"},{"issue":"3","key":"10145_CR55","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1023\/A:1011254632723","volume":"19","author":"O Kupferman","year":"2001","unstructured":"Kupferman, O., & Vardi, M. Y. (2001). Model checking of safety properties. Formal Methods in System Design, 19(3), 291\u2013314.","journal-title":"Formal Methods in System Design"},{"key":"10145_CR56","doi-asserted-by":"crossref","unstructured":"Lacerda, B., Parker, D., & Hawes, N. (2014). Optimal and dynamic planning for Markov decision processes with co-safe LTL specifications. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 1511\u20131516).","DOI":"10.1109\/IROS.2014.6942756"},{"key":"10145_CR57","doi-asserted-by":"crossref","unstructured":"Li, S., Park, D., Sung Y., Shah, J. A., & Roy, N. (2021). Reactive task and motion planning under temporal logic specifications. In Proceedings of the IEEE international conference on robotics and automation (pp. 12618\u201312624).","DOI":"10.1109\/ICRA48506.2021.9561807"},{"key":"10145_CR58","unstructured":"Li, X., Guo, D., Liu, H., & Sun, F. (2022). Embodied semantic scene graph generation. In Conference on robot learning (pp. 1585\u20131594)."},{"key":"10145_CR59","doi-asserted-by":"crossref","unstructured":"Li, X., Vasile, C. I., & Belta, C. (2017). Reinforcement learning with temporal logic rewards. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 3834\u20133839).","DOI":"10.1109\/IROS.2017.8206234"},{"key":"10145_CR60","doi-asserted-by":"crossref","unstructured":"Lindemann, L., & Dimarogonas, D. V. (2017). Robust motion planning employing signal temporal logic. In Proceedings of the American control conference (pp. 2950\u20132955).","DOI":"10.23919\/ACC.2017.7963399"},{"issue":"1","key":"10145_CR61","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1109\/LCSYS.2018.2853182","volume":"3","author":"L Lindemann","year":"2018","unstructured":"Lindemann, L., & Dimarogonas, D. V. (2018). Control barrier functions for signal temporal logic tasks. IEEE Control Systems Letters, 3(1), 96\u2013101.","journal-title":"IEEE Control Systems Letters"},{"key":"10145_CR62","doi-asserted-by":"crossref","unstructured":"Liu, W., Paxton, C., Hermans, T., & Fox, D. (2022). StructFormer: Learning spatial structure for language-guided semantic rearrangement of novel objects. In Proceedings of the international conference on robotics and automation (pp. 6322\u20136329).","DOI":"10.1109\/ICRA46639.2022.9811931"},{"key":"10145_CR63","doi-asserted-by":"crossref","unstructured":"Loula, J., Allen, K., Silver, T., & Tenenbaum, J. (2020). Learning constraint-based planning models from demonstrations. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 5410\u20135416).","DOI":"10.1109\/IROS45743.2020.9341535"},{"key":"10145_CR64","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1007\/978-1-4613-8997-2_20","volume-title":"Spatial planning: A configuration space approach, Autonomous robot vehicles","author":"T Lozano-Perez","year":"1990","unstructured":"Lozano-Perez, T. (1990). Spatial planning: A configuration space approach, Autonomous robot vehicles (pp. 259\u2013271). Springer."},{"key":"10145_CR65","doi-asserted-by":"crossref","unstructured":"Manuelli, L., Gao, W., Florence, P. R., & Tedrake, R. (2019). KPAM: Keypoint affordances for category-level robotic manipulation. In Proceedings of the international symposium on robotics research, Vol.\u00a020 (pp. 132\u2013157). Springer.","DOI":"10.1007\/978-3-030-95459-8_9"},{"key":"10145_CR66","unstructured":"McDermott, D., Ghallab, M., Howe, A., Knoblock, C., Ram, A., Veloso, M., Weld, D., & Wilkins, D. (1998). PDDL-the planning domain definition language. Technical report, Technical Report CVC TR-98-003\/DCS TR-1165, Yale Center for Computational."},{"key":"10145_CR67","doi-asserted-by":"crossref","unstructured":"Menghi, C., Tsigkanos, C., Berger, T., & Pelliccione, P. (2019). PsALM: Specification of dependable robotic missions. In Proceedings of the IEEE\/ACM international conference on software engineering (pp. 99\u2013102).","DOI":"10.1109\/ICSE-Companion.2019.00048"},{"issue":"10","key":"10145_CR68","doi-asserted-by":"publisher","first-page":"2208","DOI":"10.1109\/TSE.2019.2945329","volume":"47","author":"C Menghi","year":"2019","unstructured":"Menghi, C., Tsigkanos, C., Pelliccione, P., Ghezzi, C., & Berger, T. (2019). Specification patterns for robotic missions. IEEE Transactions on Software Engineering, 47(10), 2208\u20132224.","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"2","key":"10145_CR69","doi-asserted-by":"publisher","first-page":"844","DOI":"10.1109\/LRA.2020.2965875","volume":"5","author":"T Migimatsu","year":"2020","unstructured":"Migimatsu, T., & Bohg, J. (2020). Object-centric task and motion planning in dynamic environments. IEEE Robotics and Automation Letters, 5(2), 844\u2013851.","journal-title":"IEEE Robotics and Automation Letters"},{"key":"10145_CR70","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/j.robot.2014.12.014","volume":"71","author":"R Mojtahedzadeh","year":"2015","unstructured":"Mojtahedzadeh, R., Bouguerra, A., Schaffernicht, E., & Lilienthal, A. J. (2015). Support relation analysis and decision making for safe robotic manipulation tasks. Robotics and Autonomous Systems, 71, 99\u2013117.","journal-title":"Robotics and Autonomous Systems"},{"key":"10145_CR71","doi-asserted-by":"crossref","unstructured":"Nicolescu, M., Arnold, N., Blankenburg, J., Feil-Seifer, D., Banisetty, S., Nicolescu, M., Palmer, A., Monteverde, T. (2019). Learning of complex-structured tasks from verbal instruction. In Proceedings of the IEEE-RAS international conference on humanoid robots (pp. 747\u2013754).","DOI":"10.1109\/Humanoids43949.2019.9035032"},{"issue":"4","key":"10145_CR72","doi-asserted-by":"publisher","first-page":"6073","DOI":"10.1109\/LRA.2020.3010747","volume":"5","author":"P \u00d6gren","year":"2020","unstructured":"\u00d6gren, P. (2020). Convergence analysis of hybrid control systems in the form of backward chained behavior trees. IEEE Robotics and Automation Letters, 5(4), 6073\u20136080.","journal-title":"IEEE Robotics and Automation Letters"},{"key":"10145_CR73","unstructured":"Oleynikova, H., Millane, A., Taylor, Z., Galceran, E., Nieto, J., & Siegwart, R. (2016). Signed distance fields: A natural representation for both mapping and planning. In RSS workshop: Geometry and beyond-representations, physics, and scene understanding for robotics."},{"key":"10145_CR74","doi-asserted-by":"crossref","unstructured":"Pan, T., Wells, A. M., Shome, R., & Kavraki, L. E. (2021). A general task and motion planning framework for multiple manipulators. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 3168\u20133174).","DOI":"10.1109\/IROS51168.2021.9636119"},{"issue":"2","key":"10145_CR75","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1007\/s10846-015-0330-z","volume":"83","author":"S Panda","year":"2016","unstructured":"Panda, S., Hafez, A. A., & Jawahar, C. (2016). Single and multiple view support order prediction in clutter for manipulation. Journal of Intelligent & Robotic Systems, 83(2), 179\u2013203.","journal-title":"Journal of Intelligent & Robotic Systems"},{"key":"10145_CR76","doi-asserted-by":"crossref","unstructured":"Paus, F., Huang, T., & Asfour, T. (2020). Predicting pushing action effects on spatial object relations by learning internal prediction models. In Proceedings of the IEEE international conference on robotics and automation (pp. 10584\u201310590).","DOI":"10.1109\/ICRA40945.2020.9197295"},{"key":"10145_CR77","unstructured":"Paxton, C., Xie, C., Hermans, T., & Fox, D. (2022). Predicting stable configurations for semantic placement of novel objects. In Conference on robot learning (pp. 806\u2013815)."},{"key":"10145_CR78","unstructured":"Pednault, E. P. (1989). ADL: Exploring the middle ground between STRIPS and the situation calculus. In Proceedings of the international conference on principles of knowledge representaion and reasoning (pp. 324\u2013332)."},{"key":"10145_CR79","doi-asserted-by":"crossref","unstructured":"Pek, C., Muxfeldt, A., & Kubus, D. (2016). Simplifying synchronization in cooperative robot tasks-an enhancement of the manipulation primitive paradigm. In Proceedings of the IEEE international conference on emerging technologies and factory automation (pp. 1\u20138).","DOI":"10.1109\/ETFA.2016.7733552"},{"issue":"1","key":"10145_CR80","doi-asserted-by":"publisher","first-page":"151","DOI":"10.3233\/AIC-150682","volume":"29","author":"E Plaku","year":"2016","unstructured":"Plaku, E., & Karaman, S. (2016). Motion planning with temporal-logic specifications: Progress and challenges. AI Communications, 29(1), 151\u2013162.","journal-title":"AI Communications"},{"key":"10145_CR81","doi-asserted-by":"crossref","unstructured":"Pnueli, A. (1977). The temporal logic of programs. In Proceedings of the annual symposium on foundations of computer science (pp. 46\u201357).","DOI":"10.1109\/SFCS.1977.32"},{"key":"10145_CR82","doi-asserted-by":"crossref","unstructured":"Raman, V., Donz\u00e9, A., Maasoumy, M., Murray, R. M., Sangiovanni-Vincentelli, A., & Seshia, S. A. (2014). Model predictive control with signal temporal logic specifications. In Proceedings of the IEEE conference on decision and control (pp. 81\u201387).","DOI":"10.1109\/CDC.2014.7039363"},{"key":"10145_CR83","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.artint.2015.08.009","volume":"247","author":"K Ramirez-Amaro","year":"2017","unstructured":"Ramirez-Amaro, K., Beetz, M., & Cheng, G. (2017). Transferring skills to humanoid robots by extracting semantic representations from observations of human activities. Artificial Intelligence, 247, 95\u2013118.","journal-title":"Artificial Intelligence"},{"key":"10145_CR84","doi-asserted-by":"crossref","unstructured":"Ramirez-Amaro, K., Kim, E. S., Kim, J., Zhang, B. T., Beetz, M., & Cheng, G. (2013). Enhancing human action recognition through spatio-temporal feature learning and semantic rules. In Proceedings of the IEEE-RAS international conference on humanoid robots (pp. 456\u2013461).","DOI":"10.1109\/HUMANOIDS.2013.7030014"},{"key":"10145_CR85","doi-asserted-by":"crossref","unstructured":"Robicquet, A., Sadeghian, A., Alahi, A., & Savarese, S. (2016). Learning social etiquette: Human trajectory understanding in crowded scenes. In Proceedings of the European conference on computer vision (pp. 549\u2013565). Springer.","DOI":"10.1007\/978-3-319-46484-8_33"},{"issue":"11","key":"10145_CR86","doi-asserted-by":"publisher","first-page":"1328","DOI":"10.1177\/0278364911408155","volume":"30","author":"B Rosman","year":"2011","unstructured":"Rosman, B., & Ramamoorthy, S. (2011). Learning spatial relationships between objects. The International Journal of Robotics Research, 30(11), 1328\u20131342.","journal-title":"The International Journal of Robotics Research"},{"key":"10145_CR87","doi-asserted-by":"crossref","unstructured":"Schillinger, P., B\u00fcrger, M., & Dimarogonas, D. V. (2018). Decomposition of finite LTL specifications for efficient multi-agent planning. In Distributed autonomous robotic systems (pp. 253\u2013267).","DOI":"10.1007\/978-3-319-73008-0_18"},{"issue":"9","key":"10145_CR88","doi-asserted-by":"publisher","first-page":"1251","DOI":"10.1177\/0278364914528132","volume":"33","author":"J Schulman","year":"2014","unstructured":"Schulman, J., Duan, Y., Ho, J., Lee, A., Awwal, I., Bradlow, H., Pan, J., Patil, S., Goldberg, K., & Abbeel, P. (2014). Motion planning with sequential convex optimization and convex collision checking. The International Journal of Robotics Research, 33(9), 1251\u20131270.","journal-title":"The International Journal of Robotics Research"},{"key":"10145_CR89","unstructured":"Sharma, M., Liang, J., Zhao, J., LaGrassa, A., & Kroemer, O. (2020). Learning to compose hierarchical object-centric controllers for robotic manipulation. In Proceedings of the conference on robot learning, Vol. 155 (pp. 822\u2013844)."},{"key":"10145_CR90","unstructured":"Spawn-Lee, S. A., Lark, T. J., Gibbs, H. K., Houghton, R. A., Kucharik, C. J., Malins, C., Pelton, R. E., Robertson, G. P. (2021). Lark Github repository. Retrieved July 20, 2021, from https:\/\/github.com\/lark-parser\/lark"},{"key":"10145_CR91","unstructured":"Shridhar, M., Manuelli, L., & Fox, D. (2022). CLIPort: What and where pathways for robotic manipulation. In Conference on robot learning (pp. 894\u2013906)."},{"key":"10145_CR92","doi-asserted-by":"crossref","unstructured":"Silver, T., Chitnis, R., Tenenbaum, J. B., Kaelbling, L. P., & Lozano-P\u00e9rez, T. (2021). Learning symbolic operators for task and motion planning. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 3182\u20133189).","DOI":"10.1109\/IROS51168.2021.9635941"},{"issue":"2","key":"10145_CR93","first-page":"154","volume":"34","author":"M Skubic","year":"2004","unstructured":"Skubic, M., Perzanowski, D., Blisard, S., Schultz, A., Adams, W., Bugajska, M., & Brock, D. (2004). IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). Spatial language for human-robot dialogs, 34(2), 154\u2013167.","journal-title":"Spatial language for human-robot dialogs"},{"key":"10145_CR94","doi-asserted-by":"crossref","unstructured":"Sobti, S., Shome, R., Chaudhuri, S., & Kavraki, L. E. (2021). A sampling-based motion planning framework for complex motor actions. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 6928\u20136934).","DOI":"10.1109\/IROS51168.2021.9636395"},{"key":"10145_CR95","doi-asserted-by":"crossref","unstructured":"Sprague, C. I., \u00d6zkahraman,\u00d6., Munafo, A., Marlow, R., Phillips, A., & \u00d6gren, P. (2018). Improving the modularity of AUV control systems using behaviour trees. In Proceedings of the IEEE\/OES autonomous underwater vehicle workshop (pp. 1\u20136).","DOI":"10.1109\/AUV.2018.8729810"},{"key":"10145_CR96","unstructured":"Toussaint, M. (2015). Logic-geometric programming: An optimization-based approach to combined task and motion planning. In Proceedings of the international joint conference on artificial intelligence."},{"key":"10145_CR97","doi-asserted-by":"crossref","unstructured":"Toussaint, M. A., Allen, K. R., Smith, K. A., & Tenenbaum, J. B. (2018). Differentiable physics and stable modes for tool-use and manipulation planning. In Robotics: Science and systems foundation.","DOI":"10.15607\/RSS.2018.XIV.044"},{"key":"10145_CR98","doi-asserted-by":"crossref","unstructured":"Tumova, J., Hall, G. C., Karaman, S., Frazzoli, E., & Rus, D. (2013). Least-violating control strategy synthesis with safety rules. In Proceedings of the international conference on hybrid systems: computation and control (pp. 1\u201310).","DOI":"10.1145\/2461328.2461330"},{"key":"10145_CR99","doi-asserted-by":"crossref","first-page":"242","DOI":"10.3389\/frobt.2021.646002","volume":"8","author":"S van Waveren","year":"2021","unstructured":"van Waveren, S., Carter, E. J., \u00d6rnberg, O., & Leite, I. (2021). Exploring non-expert robot programming through crowdsourcing. Frontiers in Robotics and AI, 8, 242.","journal-title":"Frontiers in Robotics and AI"},{"key":"10145_CR100","doi-asserted-by":"crossref","unstructured":"van Waveren, S., Pek, C., Tumova, J., & Leite, I. (2022). Correct me if I\u2019m wrong: Using non-experts to repair reinforcement learning policies. In Proceedings of the ACM\/IEEE international conference on human-robot interaction (pp. 1\u20139).","DOI":"10.1109\/HRI53351.2022.9889604"},{"key":"10145_CR101","doi-asserted-by":"crossref","unstructured":"Vasile, C. I., Tumova, J., Karaman, S., Belta, C., & Rus, D. (2017). Minimum-violation scLTL motion planning for mobility-on-demand. In Proceedings of the IEEE international conference on robotics and automation (pp. 1481\u20131488).","DOI":"10.1109\/ICRA.2017.7989177"},{"key":"10145_CR102","doi-asserted-by":"crossref","unstructured":"Vasilopoulos, V., Kantaros, Y., Pappas, G. J., & Koditschek, D. E. (2021). Reactive planning for mobile manipulation tasks in unexplored semantic environments. In Proceedings of the IEEE international conference on robotics and automation (pp. 6385\u20136392).","DOI":"10.1109\/ICRA48506.2021.9561958"},{"key":"10145_CR103","doi-asserted-by":"crossref","unstructured":"Wang, J., & Olson, E. (2016). Apriltag 2: Efficient and robust fiducial detection. In Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (pp. 4193\u20134198).","DOI":"10.1109\/IROS.2016.7759617"},{"key":"10145_CR104","doi-asserted-by":"crossref","unstructured":"Wells, A. M., Dantam, N. T., Shrivastava, A., & Kavraki, L. E. (2019). Learning feasibility for task and motion planning in tabletop environments. IEEE Robotics and Automation Letters, 4(2), 1255\u20131262.","DOI":"10.1109\/LRA.2019.2894861"},{"key":"10145_CR105","doi-asserted-by":"crossref","unstructured":"Wells, A. M., Lahijanian, M., Kavraki, L. E., & Vardi, M. Y. (2020). LTLf synthesis on probabilistic systems. In Proceedings of the international symposium on games, automata, logics, and formal verification, Vol. 326 (pp. 166\u2013181).","DOI":"10.4204\/EPTCS.326.11"},{"key":"10145_CR106","doi-asserted-by":"crossref","unstructured":"Wells, M., Kingston, Z., Lahijanian, M., Kavraki, L. E., & Vardi, M. Y. (2021). Finite-horizon synthesis for probabilistic manipulation domains. In Proceedings of the IEEE international conference on robotics and automation (pp. 6336\u20136342).","DOI":"10.1109\/ICRA48506.2021.9561297"},{"key":"10145_CR107","unstructured":"Yuan, W., Paxton, C., Desingh, K., & Fox, D. (2022). SORNet: Spatial object-centric representations for sequential manipulation. In Conference on Robot Learning (pp. 148\u2013157)."},{"key":"10145_CR108","doi-asserted-by":"crossref","unstructured":"Zhang, H., Lu, Y., Yu, C., Hsu, D., La, X., & Zheng, N. (2021). Invigorate: Interactive visual grounding and grasping in clutter, pp. 1\u201311. Preprint retrieved from arXiv:2108.11092","DOI":"10.15607\/RSS.2021.XVII.020"},{"key":"10145_CR109","doi-asserted-by":"publisher","first-page":"128817","DOI":"10.1109\/ACCESS.2021.3112879","volume":"9","author":"Z Zhao","year":"2021","unstructured":"Zhao, Z., Zhou, Z., Park, M., & Zhao, Y. (2021). SyDeBO: Symbolic-decision-embedded bilevel optimization for long-horizon manipulation in dynamic environments. IEEE Access, 9, 128817\u2013128826.","journal-title":"IEEE Access"},{"issue":"9\u201310","key":"10145_CR110","doi-asserted-by":"publisher","first-page":"1164","DOI":"10.1177\/0278364913488805","volume":"32","author":"M Zucker","year":"2013","unstructured":"Zucker, M., Ratliff, N., Dragan, A. D., Pivtoraiko, M., Klingensmith, M., Dellin, C. M., Bagnell, J. A., & Srinivasa, S. S. (2013). CHOMP: Covariant hamiltonian optimization for motion planning. The International Journal of Robotics Research, 32(9\u201310), 1164\u20131193.","journal-title":"The International Journal of Robotics Research"}],"container-title":["Autonomous Robots"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10514-023-10145-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10514-023-10145-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10514-023-10145-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,28]],"date-time":"2023-11-28T13:16:31Z","timestamp":1701177391000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10514-023-10145-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,3]]},"references-count":110,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["10145"],"URL":"https:\/\/doi.org\/10.1007\/s10514-023-10145-1","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2430844\/v1","asserted-by":"object"}]},"ISSN":["0929-5593","1573-7527"],"issn-type":[{"value":"0929-5593","type":"print"},{"value":"1573-7527","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,3]]},"assertion":[{"value":"31 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 November 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Danica Kragic is an Editorial Board Member of Springer Autonomous Robots. The experiments in this article have been conducted in compliance with ethical standards.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}}]}}