{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T09:41:58Z","timestamp":1773999718167,"version":"3.50.1"},"reference-count":121,"publisher":"Annual Reviews","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Annu. Rev. Control Robot. Auton. Syst."],"published-print":{"date-parts":[[2021,5,3]]},"abstract":"<jats:p>Biomimetic robots that replace living social interaction partners can help elucidate the underlying interaction rules in animal groups. Our review focuses on the use of interactive robots that respond dynamically to animal behavior as part of a closed control loop. We discuss the most influential works to date and how they have contributed to our understanding of animal sociality. Technological advances permit the use of robots that can adapt to the situations they face and the conspecifics they encounter, or robots that learn to optimize their social performance from a set of experiences. We discuss how adaptation and learning may provide novel insights into group sociobiology and describe the technical challenges associatedwith these types of interactive robots. This interdisciplinary field provides a rich set of problems to be tackled by roboticists, machine learning engineers, and control theorists. By cultivating smarter robots, we can usher in an era of more nuanced exploration of animal behavior.<\/jats:p>","DOI":"10.1146\/annurev-control-061920-103228","type":"journal-article","created":{"date-parts":[[2020,12,3]],"date-time":"2020-12-03T00:49:05Z","timestamp":1606956545000},"page":"487-507","source":"Crossref","is-referenced-by-count":35,"title":["Animal-in-the-Loop: Using Interactive Robotic Conspecifics to Study Social Behavior in Animal Groups"],"prefix":"10.1146","volume":"4","author":[{"given":"Tim","family":"Landgraf","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, Freie Universit\u00e4t Berlin, 14195 Berlin, Germany;"}]},{"given":"Gregor H.W.","family":"Gebhardt","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Freie Universit\u00e4t Berlin, 14195 Berlin, Germany;"},{"name":"Computational Systems Neuroscience, Institute of Zoology, University of Cologne, 50674 Cologne, Germany"}]},{"given":"David","family":"Bierbach","sequence":"additional","affiliation":[{"name":"Department of Biology and Ecology of Fishes, Leibniz-Institute of Freshwater Ecology and Inland Fisheries, 12587 Berlin, Germany"},{"name":"Faculty of Life Sciences, Albrecht Daniel Thaer-Institute of Agricultural and Horticultural Sciences, Humboldt-Universit\u00e4t zu Berlin, 10099 Berlin, Germany"}]},{"given":"Pawel","family":"Romanczuk","sequence":"additional","affiliation":[{"name":"Institute for Theoretical Biology, Department of Biology, Humboldt-Universit\u00e4t zu Berlin, 10115 Berlin, Germany"}]},{"given":"Lea","family":"Musiolek","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Humboldt-Universit\u00e4t zu Berlin, 10099 Berlin, Germany"}]},{"given":"Verena V.","family":"Hafner","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Humboldt-Universit\u00e4t zu Berlin, 10099 Berlin, Germany"}]},{"given":"Jens","family":"Krause","sequence":"additional","affiliation":[{"name":"Department of Biology and Ecology of Fishes, Leibniz-Institute of Freshwater Ecology and Inland Fisheries, 12587 Berlin, Germany"},{"name":"Faculty of Life Sciences, Albrecht Daniel Thaer-Institute of Agricultural and Horticultural Sciences, Humboldt-Universit\u00e4t zu Berlin, 10099 Berlin, Germany"}]}],"member":"22","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1006\/anbe.2000.1514"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tree.2011.03.015"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1007\/s00422-018-0787-5"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1007\/s11229-020-02533-2"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1098\/rsbl.2020.0436"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1093\/cz\/zow104"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2016.0414"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1038\/nmeth.4399"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1126\/science.1144259"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1098\/rsos.181026"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2010.5650930"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1109\/ROBIO.2014.7090455"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2012.0540"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-95972-6_9"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2019.00038"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3190\/ab8706"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38703-6_1"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-09435-9_16"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3190\/11\/1\/015001"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1801283115"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2011.2165449"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3190\/10\/5\/056011"},{"key":"B23","unstructured":"Gribovskiy A, Mondada F, Deneubourg JL, Cazenille L, Bredeche N, Halloy J. 2015. Automated analysis of behavioural variability and filial imprinting of chicks (G. gallus), using autonomous robots. arXiv:1509.01957 [q-bio.QM]"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2018.02.003"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3190\/11\/1\/016007"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1201\/b14908-19"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2010.5649542"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-19083-2"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1109\/ROBIO.2014.7090421"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1006\/jtbi.2002.3065"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0220559"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aau7897"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1007\/s11721-017-0153-6"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1007\/s10682-009-9336-y"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1016\/j.anbehav.2012.12.031"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1016\/j.nlm.2008.09.012"},{"key":"B37","volume-title":"Habituation, Vol. 1: Behavioral Studies","author":"Peeke HVS","year":"2012"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1016\/j.anbehav.2016.05.012"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1111\/j.1095-8649.1993.tb00340.x"},{"key":"B40","doi-asserted-by":"crossref","unstructured":"Lukas J, Kalinkat G, Miesen FW, Landgraf T, Krause J, Bierbach D. 2020. Consistent behavioral syndromes across seasons in an invasive freshwater fish. bioRxiv 2020.03.03.974998.https:\/\/doi.org\/10.1101\/2020.03.03.974998","DOI":"10.1101\/2020.03.03.974998"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1038\/44314"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1007\/s100710100105"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1098\/rsbl.2010.0982"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1016\/j.anbehav.2018.12.013"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.8974"},{"key":"B46","unstructured":"Landgraf T, Moenck HJ, Gebhardt GHW, Weimar N, Hocke M, et al. 2020. Socially competent robots: adaptation improves leadership performance in groups of live fish. arXiv:2009.06633 [cs.RO]"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1521\/soco.2008.26.2.210"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0002597"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1037\/a0020240"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-012-0174-7"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-23807-0_27"},{"key":"B52","author":"Schneider S","year":"2020","journal-title":"Int. J. Soc. Robot."},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2018.2825641"},{"key":"B54","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton RS","year":"2018"},{"key":"B55","volume-title":"Evolutionsstrategie, Optimierung technischer Systeme nach Prinzipien der biologischen Evolution","author":"Rechenberg I.","year":"1973"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.1162\/106365601750190398"},{"key":"B57","first-page":"944","volume-title":"Proceedings of the 20th International Joint Conference on Artificial Intelligence","author":"Lizotte D","year":"2007"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15939-8_30"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45622-8_16"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(99)00052-1"},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.1007\/11008941_60"},{"key":"B62","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2010.2065430"},{"key":"B63","doi-asserted-by":"publisher","DOI":"10.1016\/j.tree.2014.05.004"},{"key":"B64","volume-title":"The Study of Instinct","author":"Tinbergen N.","year":"1951"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-018-0295-5"},{"key":"B66","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-018-0234-5"},{"key":"B67","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-018-0209-y"},{"key":"B68","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.47994"},{"key":"B69","doi-asserted-by":"publisher","DOI":"10.1038\/nmeth.1310"},{"key":"B70","doi-asserted-by":"publisher","DOI":"10.1038\/nmeth.1328"},{"key":"B71","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms2908"},{"key":"B72","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2014.0672"},{"key":"B73","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-019-0533-x"},{"key":"B74","doi-asserted-by":"publisher","DOI":"10.1515\/9781400837762"},{"key":"B75","volume-title":"Animal Social Networks","author":"Krause J","year":"2015"},{"key":"B76","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1001763107"},{"key":"B77","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1107583108"},{"key":"B78","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1109355108"},{"key":"B79","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.2012.2564"},{"key":"B80","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2017.08.004"},{"key":"B81","doi-asserted-by":"publisher","DOI":"10.1016\/j.tree.2019.11.001"},{"key":"B82","doi-asserted-by":"publisher","DOI":"10.1038\/nature08891"},{"key":"B83","volume-title":"The Mathematical Theory of Information","author":"Shannon C","year":"1998"},{"key":"B84","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.85.461"},{"key":"B85","doi-asserted-by":"publisher","DOI":"10.1109\/TMBMC.2016.2632099"},{"key":"B86","doi-asserted-by":"publisher","DOI":"10.1016\/j.physd.2013.07.001"},{"key":"B87","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2019.0563"},{"key":"B88","doi-asserted-by":"publisher","DOI":"10.1016\/j.arcontrol.2014.09.002"},{"key":"B89","unstructured":"Eyjolfsdottir E, Branson K, Yue Y, Perona P. 2016. Learning recurrent representations for hierarchical behavior modeling. arXiv:1611.00094 [cs.AI]"},{"key":"B90","doi-asserted-by":"publisher","DOI":"10.1109\/COASE.2016.7743453"},{"key":"B91","doi-asserted-by":"crossref","unstructured":"Mguni D, Jennings J, de Cote EM. 2018. Decentralised learning in systems with many, many strategic agents. arXiv:1803.05028 [cs.MA]","DOI":"10.1609\/aaai.v32i1.11586"},{"key":"B92","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8463215"},{"key":"B93","first-page":"3391","volume-title":"Advances in Neural Information Processing Systems 30","author":"Zaheer M","year":"2017"},{"key":"B94","unstructured":"H\u00fcttenrauch M, \u0160o\u017ei\u0107 A, Neumann G. 2019. Deep reinforcement learning for swarm systems. arXiv:1807.06613 [cs.MA]"},{"key":"B95","volume-title":"Using mean embeddings for state estimation and reinforcement learning","author":"Gebhardt GHW.","year":"2019"},{"key":"B96","volume-title":"A (revised) survey of approximate methods for solving partially observable Markov decision processes","author":"Aberdeen D.","year":"2003"},{"key":"B97","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74690-4_71"},{"key":"B98","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2014.09.003"},{"key":"B99","doi-asserted-by":"crossref","unstructured":"Tobin J, Fong R, Ray A, Schneider J, Zaremba W, Abbeel P. 2017. Domain randomization for transferring deep neural networks from simulation to the real world. arXiv:1703.06907 [cs.RO]","DOI":"10.1109\/IROS.2017.8202133"},{"key":"B100","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2016.7759592"},{"key":"B101","first-page":"1620","volume-title":"Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence","author":"Isele D","year":"2016"},{"key":"B102","first-page":"1126","volume-title":"Proceedings of the 34th International Conference on Machine Learning","author":"Finn C","year":"2017"},{"key":"B103","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA.2018.00018"},{"key":"B104","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-185X.2007.00010.x"},{"key":"B105","doi-asserted-by":"publisher","DOI":"10.1126\/science.1235294"},{"key":"B106","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms15361"},{"key":"B107","first-page":"465","volume-title":"Proceedings of the 28th International Conference on Machine Learning","author":"Deisenroth M","year":"2011"},{"key":"B108","volume-title":"Improving PILCO with Bayesian neural network dynamics models","author":"Gal Y","year":"2016"},{"key":"B109","unstructured":"Ha D, Schmidhuber J. 2018. World models. arXiv:1803.10122 [cs.LG]"},{"key":"B110","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2006.890271"},{"key":"B111","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.70"},{"key":"B112","doi-asserted-by":"publisher","DOI":"10.1080\/09540090600768658"},{"key":"B113","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-75488-6_3"},{"key":"B114","doi-asserted-by":"publisher","DOI":"10.1109\/TAMD.2010.2056368"},{"key":"B115","doi-asserted-by":"publisher","DOI":"10.1038\/nature03236"},{"key":"B116","doi-asserted-by":"publisher","DOI":"10.1086\/681988"},{"key":"B117","doi-asserted-by":"publisher","DOI":"10.1002\/jeab.193"},{"key":"B118","doi-asserted-by":"publisher","DOI":"10.1016\/j.tree.2010.01.002"},{"key":"B119","unstructured":"Bieker K, Peitz S, Brunton SL, Kutz JN, Dellnitz M. 2019. Deep model predictive control with online learning for complex physical systems. arXiv:1905.10094 [cs.LG]"},{"key":"B120","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.10.084"},{"key":"B121","first-page":"42341","volume":"97","author":"Tessadori J","year":"2015","journal-title":"J. Vis. Exp."}],"container-title":["Annual Review of Control, Robotics, and Autonomous Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.annualreviews.org\/doi\/pdf\/10.1146\/annurev-control-061920-103228","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,2]],"date-time":"2022-12-02T02:23:08Z","timestamp":1669947788000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.annualreviews.org\/doi\/10.1146\/annurev-control-061920-103228"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,3]]},"references-count":121,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,5,3]]}},"alternative-id":["10.1146\/annurev-control-061920-103228"],"URL":"https:\/\/doi.org\/10.1146\/annurev-control-061920-103228","relation":{},"ISSN":["2573-5144","2573-5144"],"issn-type":[{"value":"2573-5144","type":"print"},{"value":"2573-5144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,3]]}}}