{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T07:49:45Z","timestamp":1770709785836,"version":"3.49.0"},"reference-count":58,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T00:00:00Z","timestamp":1716249600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>We recently developed a biomimetic robotic eye with six independent tendons, each controlled by their own rotatory motor, and with insertions on the eye ball that faithfully mimic the biomechanics of the human eye. We constructed an accurate physical computational model of this system, and learned to control its nonlinear dynamics by optimising a cost that penalised saccade inaccuracy, movement duration, and total energy expenditure of the motors. To speed up the calculations, the physical simulator was approximated by a recurrent neural network (NARX). We showed that the system can produce realistic eye movements that closely resemble human saccades in all directions: their nonlinear main-sequence dynamics (amplitude-peak eye velocity and duration relationships), cross-coupling of the horizontal and vertical movement components leading to approximately straight saccade trajectories, and the 3D kinematics that restrict 3D eye orientations to a plane (Listing\u2019s law). Interestingly, the control algorithm had organised the motors into appropriate agonist-antagonist muscle pairs, and the motor signals for the eye resembled the well-known pulse-step characteristics that have been reported for monkey motoneuronal activity. We here fully analyse the eye-movement properties produced by the computational model across the entire oculomotor range and the underlying control signals. We argue that our system may shed new light on the neural control signals and their couplings within the final neural pathways of the primate oculomotor system, and that an optimal control principle may account for a wide variety of oculomotor behaviours. The generated data are publicly available at <jats:ext-link>https:\/\/data.ru.nl\/collections\/di\/dcn\/DSC_626870_0003_600<\/jats:ext-link>.<\/jats:p>","DOI":"10.3389\/frobt.2024.1393637","type":"journal-article","created":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T12:32:00Z","timestamp":1716294720000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Realistic 3D human saccades generated by a 6-DOF biomimetic robotic eye under optimal control"],"prefix":"10.3389","volume":"11","author":[{"given":"A. John","family":"Van Opstal","sequence":"first","affiliation":[]},{"given":"Reza","family":"Javanmard Alitappeh","sequence":"additional","affiliation":[]},{"given":"Akhil","family":"John","sequence":"additional","affiliation":[]},{"given":"Alexandre","family":"Bernardino","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2024,5,21]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/0025-5564(75)90075-9","article-title":"The main sequence, a tool for studying human eye movements","volume":"24","author":"Bahill","year":"1975","journal-title":"Math. Biosci."},{"key":"B2","first-page":"94","article-title":"Design of the robot-cub (icub) head","author":"Beira","year":"2006"},{"key":"B3","first-page":"62","article-title":"Mac-eye: a tendon driven fully embedded robot eye","author":"Biamino","year":"2005"},{"key":"B4","volume-title":"Feedback control on a model of a 3d biomimetic robotic eye","author":"Cardoso","year":"2019"},{"key":"B5","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1097\/01.wco.0000198100.87670.37","article-title":"Current concepts of mechanical and neural factors in ocular motility","volume":"19","author":"Demer","year":"2006","journal-title":"Curr. Opin. Neurology"},{"key":"B6","volume-title":"Modeling, simulation, analytic linearization and optimal control of a 6 tendon-driven biomimetic eye: a tool for studying human oculomotor control","author":"Dias","year":"2021"},{"key":"B7","volume-title":"The 11th yearly report of The Netherlands hospital for necessitous eye patients (in Dutch), vol. 11","author":"Donders","year":"1870"},{"key":"B8","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1152\/jn.1970.33.3.382","article-title":"Firing patterns of abducens neurons of alert monkeys in relationship to horizontal eye movement","volume":"33","author":"Fuchs","year":"1970","journal-title":"J. Neurophysiology"},{"key":"B9","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1007\/bf00236431","article-title":"The activity of single trochlear nerve fibers during eye movements in the alert monkey","volume":"13","author":"Fuchs","year":"1971","journal-title":"Exp. Brain Res."},{"key":"B10","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/s00422-006-0064-x","article-title":"The main sequence of saccades optimizes speed-accuracy trade-off","volume":"95","author":"Harris","year":"2006","journal-title":"Biol. Cybern."},{"key":"B11","doi-asserted-by":"publisher","first-page":"1727","DOI":"10.1016\/0042-6989(94)00257-M","article-title":"Mathematics of three-dimensional eye rotations","volume":"35","author":"Haslwanter","year":"1995","journal-title":"Vis. Res."},{"key":"B12","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1007\/bf00204696","article-title":"Considerations on listing\u2019s law and the primary position by means of a matrix description of eye position control","volume":"60","author":"Haustein","year":"1989","journal-title":"Biol. Cybern."},{"key":"B13","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1007\/bf02278012","article-title":"On listing\u2019s law","volume":"132","author":"Hepp","year":"1990","journal-title":"Commun. Math. Phys."},{"key":"B14","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1016\/0042-6989(85)90151-8","article-title":"Iso-frequency curves of oculomotor neurons in the rhesus monkey","volume":"25","author":"Hepp","year":"1985","journal-title":"Vis. Res."},{"key":"B15","first-page":"105","article-title":"The neurobiology of saccadic eye movements","volume-title":"Brainstem regions related to saccade generation","author":"Hepp","year":"1989"},{"key":"B16","doi-asserted-by":"publisher","first-page":"1647","DOI":"10.1016\/0042-6989(92)90157-e","article-title":"Calibration of three-dimensional eye position using search coil signals in the rhesus monkey","volume":"32","author":"Hess","year":"1992","journal-title":"Vis. Res."},{"key":"B17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/tcds.2024.3376072","article-title":"Emergence of human oculomotor behavior in a cable-driven biomimetic robotic eye using optimal control","author":"Javanmard Alitappeh","year":"2023","journal-title":"IEEE Trans. Cognitive Dev. Syst."},{"key":"B18","doi-asserted-by":"publisher","first-page":"10089755","DOI":"10.1371\/journal.pcbi.1008975","article-title":"Modelling 3d saccade generation by feedforward optimal control","volume":"17","author":"John","year":"2021","journal-title":"PLOS Comput. Biol."},{"key":"B19","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1109\/ICARA56516.2023.10126021","article-title":"A cable-driven robotic eye for understanding eye-movement control","volume":"2023","author":"John","year":"2023","journal-title":"IEEE Xplore, ICARA-"},{"key":"B20","doi-asserted-by":"publisher","first-page":"2732","DOI":"10.1523\/jneurosci.3610-05.2006","article-title":"Three-dimensional kinematics at the level of the oculomotor plant","volume":"26","author":"Klier","year":"2006","journal-title":"J. Neurosci."},{"key":"B21","doi-asserted-by":"publisher","first-page":"13237","DOI":"10.1523\/jneurosci.2595-12.2012","article-title":"Reaching the limit of the oculomotor plant: 3d kinematics after abducens nerve stimulation during the torsional vestibulo-ocular reflex","volume":"32","author":"Klier","year":"2012","journal-title":"J. Neurosci."},{"key":"B22","doi-asserted-by":"publisher","first-page":"4527","DOI":"10.1167\/iovs.07-0496","article-title":"Sideslip of the medial rectus muscle during vertical eye rotation","volume":"48","author":"Lee","year":"2007","journal-title":"Investigative Ophthalmol. Vis. Sci."},{"key":"B23","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1007\/s10514-007-9078-z","article-title":"Bioinspired velocity control of fast gaze shifts on a robotic anthropomorphic head","volume":"25","author":"Maini","year":"2008","journal-title":"Aut. Robots"},{"key":"B24","doi-asserted-by":"publisher","first-page":"1125","DOI":"10.1016\/j.neunet.2010.08.010","article-title":"The icub humanoid robot: an open-systems platform for research in cognitive development","volume":"23","author":"Metta","year":"2010","journal-title":"Neural Netw."},{"key":"B25","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1016\/0010-4809(84)90012-0","article-title":"A model of the mechanics of binocular alignment","volume":"17","author":"Miller","year":"1984","journal-title":"Comp. Biomed. Res."},{"key":"B26","doi-asserted-by":"publisher","first-page":"1877","DOI":"10.1152\/jn.2001.86.4.1877","article-title":"Neural and mechanical factors in eye control","volume":"86","author":"Misslich","year":"2001","journal-title":"J. Neurophysiology"},{"key":"B27","first-page":"59","article-title":"Eye motion generation in a mobile service robot silbot ii","volume-title":"2010 IEEE workshop on advanced robotics and its social impacts","author":"Oh","year":"2010"},{"key":"B28","first-page":"1472","article-title":"An active vision system for mobile robots","author":"Peng","year":"2000"},{"key":"B29","doi-asserted-by":"publisher","first-page":"3197","DOI":"10.1152\/jn.1998.79.6.3197","article-title":"Commutative saccadic generator is sufficient to control a 3-d ocular plant with pulleys","volume":"79","author":"Quaia","year":"1998","journal-title":"J. Neurophysiology"},{"key":"B30","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1111\/j.1749-6632.2011.06111.x","article-title":"The nonlinearity of passive extraocular muscles","volume":"1233","author":"Quaia","year":"2011","journal-title":"Ann. N. Y. Acad. Sci."},{"key":"B31","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1113\/jphysiol.1964.sp007485","article-title":"The mechanics of human saccadic eye movement","volume":"174","author":"Robinson","year":"1964","journal-title":"J. Physiology"},{"key":"B32","first-page":"801","article-title":"A quantitative analysis of extraocular muscle cooperation and squint","volume":"14","author":"Robinson","year":"1975","journal-title":"Investig. Ophthalmol."},{"key":"B33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/bs.pbr.2021.10.001","article-title":"Modeling the oculomotor control system","volume":"267","author":"Robinson","year":"2022","journal-title":"Prog. Brain Res."},{"key":"B34","first-page":"7","article-title":"The behavior of eye movement motoneurons in the alert monkey","volume":"82","author":"Robinson","year":"1972","journal-title":"Bibl. Ophthalmol."},{"key":"B35","doi-asserted-by":"publisher","first-page":"e1002253","DOI":"10.1371\/journal.pcbi.1002253","article-title":"Learning the optimal control of coordinated eye and head movements","volume":"7","author":"Saeb","year":"2011","journal-title":"PLoS Comput. Biol."},{"key":"B36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1152\/jn.1994.71.5.1-a","article-title":"Modeling three-dimensional velocity-to-position transformation in oculomotor control","volume":"71","author":"Schnabolk","year":"1994","journal-title":"J. Neurophysiology"},{"key":"B37","first-page":"764","article-title":"An affordable, 3d-printable camera eye with two active degrees of freedom for an anthropomorphic robot","author":"Schulz","year":"2012"},{"key":"B38","doi-asserted-by":"publisher","first-page":"10507","DOI":"10.1523\/jneurosci.1343-10.2010","article-title":"Temporal discounting of reward and the cost of time in motor control","volume":"30","author":"Shadmehr","year":"2010","journal-title":"J. Neurosci."},{"key":"B39","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9780262016964.001.0001","volume-title":"Biological learning and control: how the brain builds representations, predicts events, and makes decisions","author":"Shadmehr","year":"2012"},{"key":"B40","volume-title":"The integrative action of the nervous system","author":"Sherrington","year":"1906"},{"key":"B41","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1007\/bf00228124","article-title":"An analysis of curvature in fast and slow human saccades","volume":"81","author":"Smit","year":"1990","journal-title":"Exp. Brain Res."},{"key":"B42","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1007\/bf00228123","article-title":"Component stretching in fast and slow oblique saccades in the human","volume":"81","author":"Smit","year":"1990","journal-title":"Exp. Brain Res."},{"key":"B43","volume-title":"Clinical anatomy of the eye","author":"Snell","year":"2013"},{"key":"B44","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1007\/s002210050728","article-title":"Three-dimensional extra-ocular motoneuron innervation in the rhesus monkey. i: muscle rotation axes and the on-directions during fixation","volume":"126","author":"Suzuki","year":"1999","journal-title":"Exp. Brain Res."},{"key":"B45","doi-asserted-by":"publisher","first-page":"3875","DOI":"10.1152\/jn.00751.2005","article-title":"An optimization principle for determining movement duration","volume":"95","author":"Tanaka","year":"2007","journal-title":"J. Neurophysiology"},{"key":"B46","doi-asserted-by":"publisher","first-page":"066003","DOI":"10.1088\/1748-3190\/aa839f","article-title":"Learning dynamic models for open loop predictive control of soft robotic manipulators","volume":"12","author":"Thuruthel","year":"2017","journal-title":"Bioinspiration Biomimetics"},{"key":"B47","doi-asserted-by":"publisher","first-page":"1363","DOI":"10.1126\/science.281.5381.1363","article-title":"Optimizing gaze control in three dimensions","volume":"281","author":"Tweed","year":"1998","journal-title":"Science"},{"key":"B48","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1038\/20441","article-title":"Non-commutativity in the brain","volume":"399","author":"Tweed","year":"1999","journal-title":"Nature"},{"key":"B49","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1152\/jn.1987.58.4.832","article-title":"Implications of rotational kinematics for the oculomotor system in three dimensions","volume":"58","author":"Tweed","year":"1987","journal-title":"J. Neurophysiology"},{"key":"B50","doi-asserted-by":"publisher","first-page":"e2070","DOI":"10.1371\/journal.pone.0002070","article-title":"Saccadic eye movements minimize the consequences of motor noise","volume":"3","author":"Van Beers","year":"2008","journal-title":"PLoS One"},{"key":"B51","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1007\/bf00236538","article-title":"Experimental test of two models for the generation of oblique saccades","volume":"57","author":"Van Gisbergen","year":"1985","journal-title":"Exp. Brain Res."},{"key":"B52","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1007\/978-0-387-21703-1_2","article-title":"The gaze control system","volume-title":"Models of neural networks IV","author":"Van Opstal","year":"2002"},{"key":"B53","doi-asserted-by":"publisher","first-page":"927","DOI":"10.1038\/s42003-023-05305-z","article-title":"Neural encoding of instantaneous kinematics of eye-head gaze shifts in monkey superior colliculus","volume":"6","author":"Van Opstal","year":"2023","journal-title":"Commun. Biol."},{"key":"B54","doi-asserted-by":"publisher","first-page":"1313","DOI":"10.1126\/science.1925545","article-title":"Two-rather than three-dimensional representation of saccades in monkey superior colliculus","volume":"252","author":"Van Opstal","year":"1991","journal-title":"Science"},{"key":"B55","doi-asserted-by":"publisher","first-page":"7284","DOI":"10.1523\/jneurosci.16-22-07284.1996","article-title":"Role of monkey nucleus reticularis tegmenti pontis in the stabilization of listing\u2019s plane","volume":"16","author":"Van Opstal","year":"1996","journal-title":"J. Neurosci."},{"key":"B56","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1016\/0042-6989(87)90071-x","article-title":"Skewness of saccadic velocity profiles: a unifying parameter for normal and slow saccades","volume":"27","author":"Van Opstal","year":"1987","journal-title":"Vis. Res."},{"key":"B57","doi-asserted-by":"publisher","first-page":"102679","DOI":"10.1016\/j.bspc.2021.102679","article-title":"A stochastic optimal control model with internal feedback and velocity tracking for saccadic eye movements","volume":"68","author":"Varsha","year":"2021","journal-title":"Biomed. Signal Process. Control"},{"key":"B58","doi-asserted-by":"publisher","first-page":"548","DOI":"10.1109\/TCDS.2018.2877128","article-title":"Optimal control of eye movements during visual search","volume":"11","author":"Vasilyev","year":"2019","journal-title":"IEEE Trans. Cognitive Dev. Syst."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1393637\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T12:32:12Z","timestamp":1716294732000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1393637\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,21]]},"references-count":58,"alternative-id":["10.3389\/frobt.2024.1393637"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2024.1393637","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,21]]},"article-number":"1393637"}}