{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T14:01:43Z","timestamp":1766066503719,"version":"3.37.3"},"reference-count":40,"publisher":"Cambridge University Press (CUP)","issue":"4","license":[{"start":{"date-parts":[[2015,11,17]],"date-time":"2015-11-17T00:00:00Z","timestamp":1447718400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotica"],"published-print":{"date-parts":[[2017,4]]},"abstract":"<jats:title>SUMMARY<\/jats:title><jats:p>Legged robots have the potential to navigate in more challenging terrains than wheeled robots. Unfortunately, their control is more demanding, because they have to deal with the common tasks of mapping and path planning as well as more specific issues of legged locomotion, like balancing and foothold planning. In this paper, we present the integration and the development of a stabilized vision system on the fully torque-controlled hydraulically actuated quadruped robot (HyQ). The active head added onto the robot is composed of a fast pan and tilt unit (PTU) and a high-resolution wide angle stereo camera. The PTU enables camera gaze shifting to a specific area in the environment (both to extend and refine the map) or to track an object while navigating. Moreover, as the quadruped locomotion induces strong regular vibrations, impacts or slippages on rough terrain, we took advantage of the PTU to mechanically compensate for the robot's motions. In this paper, we demonstrate the influence of legged locomotion on the quality of the visual data stream by providing a detailed study of HyQ's motions, which are compared against a rough terrain wheeled robot of the same size. Our proposed Inertial Measurement Unit (IMU)-based controller allows us to decouple the camera from the robot motions. We show through experiments that, by stabilizing the image feedback, we can improve the onboard vision-based processes of tracking and mapping. In particular, during the outdoor tests on the quadruped robot, the use of our camera stabilization system improved the accuracy on the 3D maps by 25%, with a decrease of 50% of mapping failures.<\/jats:p>","DOI":"10.1017\/s0263574715000909","type":"journal-article","created":{"date-parts":[[2015,11,17]],"date-time":"2015-11-17T05:52:58Z","timestamp":1447739578000},"page":"942-960","source":"Crossref","is-referenced-by-count":6,"title":["Active camera stabilization to enhance the vision of agile legged robots"],"prefix":"10.1017","volume":"35","author":[{"given":"St\u00e9phane","family":"Bazeille","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9475-1945","authenticated-orcid":false,"given":"Jesus","family":"Ortiz","sequence":"additional","affiliation":[]},{"given":"Francesco","family":"Rovida","sequence":"additional","affiliation":[]},{"given":"Marco","family":"Camurri","sequence":"additional","affiliation":[]},{"given":"Anis","family":"Meguenani","sequence":"additional","affiliation":[]},{"given":"Darwin G.","family":"Caldwell","sequence":"additional","affiliation":[]},{"given":"Claudio","family":"Semini","sequence":"additional","affiliation":[]}],"member":"56","published-online":{"date-parts":[[2015,11,17]]},"reference":[{"key":"S0263574715000909_ref16","unstructured":"R. Karazume and S. Hirose , \u201cDevelopment of Image Stabilization System for Remote Operation of Walking Robots,\u201d Proceedings IEEE International Conference on Robotics and Automation (2000) pp. 1856\u20131861."},{"key":"S0263574715000909_ref30","doi-asserted-by":"publisher","DOI":"10.1016\/S0925-2312(01)00645-2"},{"key":"S0263574715000909_ref10","doi-asserted-by":"publisher","DOI":"10.1177\/0278364911435161"},{"key":"S0263574715000909_ref28","doi-asserted-by":"crossref","unstructured":"S. Gay , A. Ijspeert and J. Santos-Victor , \u201cPredictive Gaze Stabilization During Periodic Locomotion Based on Adaptive Frequency Oscillators,\u201d IEEE International Conference on Robotics and Automation (ICRA), (May 2012) pp. 271\u2013278.","DOI":"10.1109\/ICRA.2012.6225001"},{"key":"S0263574715000909_ref17","first-page":"540","volume-title":"Lecture Notes in Computer Science","author":"Marcinkiewicz","year":"2007"},{"key":"S0263574715000909_ref20","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-009-0038-y"},{"key":"S0263574715000909_ref38","unstructured":"G. Bradski , \u201cComputer video face tracking for use in a perceptual user interface,\u201d Intel Technol. J. (1998)."},{"key":"S0263574715000909_ref9","doi-asserted-by":"crossref","unstructured":"P. Filitchkin and K. Byl , \u201cFeature-Based Terrain Classification for Littledog,\u201d IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) (2012) pp. 1387\u20131392.","DOI":"10.1109\/IROS.2012.6386042"},{"key":"S0263574715000909_ref33","doi-asserted-by":"publisher","DOI":"10.1007\/11559573_18"},{"key":"S0263574715000909_ref7","doi-asserted-by":"crossref","unstructured":"A. Winkler , I. Havoutis , S. Bazeille , J. Ortiz , M. Focchi , R. Dillmann , D. G. Caldwell and C. Semini , \u201cPath Planning with Force-Based Foothold Adaptation and Virtual Model Control for Torque Controlled Quadruped Robots,\u201d IEEE ICRA (2014) pp. 6476\u20136482.","DOI":"10.1109\/ICRA.2014.6907815"},{"key":"S0263574715000909_ref15","unstructured":"P. Rawat and J. Singhai , \u201cReview of Motion Estimation and Video stabilization Techniques for Hand Held Mobile Video,\u201d International Journal of Signal and Image Processing (SIPIJ) (2011)."},{"key":"S0263574715000909_ref13","doi-asserted-by":"crossref","unstructured":"M. Bajracharya , J. Ma , M. Malchano , A. Perkins , A. Rizzi and L. Matthies , \u201cHigh Fidelity Day\/Night Stereo Mapping with Vegetation and Negative Obstacle Detection for Vision-in-the-Loop Walking,\u201d IEEE\/RSJ IROS (2013) pp. 3663\u20133670.","DOI":"10.1109\/IROS.2013.6696879"},{"key":"S0263574715000909_ref29","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(00)00084-8"},{"key":"S0263574715000909_ref25","doi-asserted-by":"crossref","unstructured":"G. Xiang , \u201cReal-Time Follow-Up Tracking Fast Moving Object with an Active Camera,\u201d Proceedings of the International Congress on Image and Signal Processing (CISP) (2009) pp. 1\u20134.","DOI":"10.1109\/CISP.2009.5303457"},{"key":"S0263574715000909_ref8","doi-asserted-by":"crossref","unstructured":"J. Z. Kolter , K. Youngjun and A. Y. Ng , \u201cStereo Vision and Terrain Modeling for Quadruped Robots,\u201d IEEE International Conference on Robotics and Automation (2009) pp. 1557\u20131564.","DOI":"10.1109\/ROBOT.2009.5152795"},{"key":"S0263574715000909_ref1","first-page":"831","article-title":"Design of HyQ - a hydraulically and electrically actuated quadruped robot","volume":"225","author":"Semini","year":"2011","journal-title":"J. Syst.Control Eng."},{"key":"S0263574715000909_ref40","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-47967-8_35"},{"key":"S0263574715000909_ref34","unstructured":"B. D. Lucas and T. Kanade , \u201cAn iterative image registration technique with an application to stereo vision,\u201d vol. 2, 1981, pp. 674\u2013679."},{"key":"S0263574715000909_ref12","doi-asserted-by":"crossref","unstructured":"D. Wooden , M. Malchano , K. Blankespoor , A. Howardy , A. A. Rizzi and M. Raibert , \u201cAutonomous Navigation for Bigdog,\u201d IEEE International Conference on Robotics and Automation (ICRA) IEEE (2010) pp. 4736\u20134741.","DOI":"10.1109\/ROBOT.2010.5509226"},{"key":"S0263574715000909_ref26","unstructured":"M. Akhloufi , \u201cReal-Time Target Tracking using a Pan and Tilt Platform,\u201d Proceedings of the International Conference on Machine Vision, Image Processing, and Pattern Analysis (MVIPPA) (2009) pp. 437\u2013441."},{"key":"S0263574715000909_ref37","doi-asserted-by":"crossref","unstructured":"J. Ortiz , C. Tapia , L. Rossi , J. Fontaine and M. Maza , \u201cDescription and Tests of a Multisensorial Driving Interface for Vehicle Teleoperation,\u201d Proceedings of the 11th International IEEE Conference on Intelligent Transportation Systems, ITSC, IEEE (2008) pp. 616\u2013621.","DOI":"10.1109\/ITSC.2008.4732678"},{"key":"S0263574715000909_ref39","doi-asserted-by":"crossref","unstructured":"F. Endres , J. Hess , N. Engelhard , J. Sturm , D. Cremers and W. Burgard , \u201cAn Evaluation of the rgb-d Slam System,\u201d IEEE International Conference on Robotics and Automation (2012) pp. 1691\u20131696.","DOI":"10.1109\/ICRA.2012.6225199"},{"key":"S0263574715000909_ref36","unstructured":"\u201cARTOR (Autonomous Rough Terrain Outdoor Robot),\u201d [Online]. Available: http:\/\/www.artor.ethz.ch\/"},{"key":"S0263574715000909_ref27","unstructured":"K. Huebner , K. Welke , M. Przybylski , N. Vahrenkamp , T. Asfour , D. Kragic and R. Dillmann , \u201cGrasping Known Objects with Humanoid Robots: A Box-based Approach,\u201d Proceedings of the International Conference on Advanced Robotics (2009) pp. 1\u20136."},{"key":"S0263574715000909_ref21","doi-asserted-by":"publisher","DOI":"10.1080\/15599610802081753"},{"key":"S0263574715000909_ref19","doi-asserted-by":"crossref","unstructured":"J. Giesbrecht , P. Goldsmith and J. Pieper , \u201cControl Strategies for Visual Tracking from a Moving Platform,\u201d Proceedings of Canadian Conference on Electrical and Computer Engineering (CCECE) (2010) pp. 1\u20137.","DOI":"10.1109\/CCECE.2010.5575246"},{"key":"S0263574715000909_ref14","doi-asserted-by":"crossref","unstructured":"X. Shao , Y. Yang and W. Wang , \u201cObstacle Crossing with Stereo Vision for a Quadruped Robot,\u201d International Conference on Mechatronics and Automation (ICMA), (2012) pp. 1738\u20131743.","DOI":"10.1109\/ICMA.2012.6284399"},{"key":"S0263574715000909_ref22","unstructured":"T.-K. Kang , H. Zhang and G.-T. Park , \u201cStereo-Vision Based Motion Estimation of a Humanoid Robot for the Ego-Motion Compensation by Type-2 Fuzzy Sets,\u201d Proceedings of the IEEE International Symposium on Industrial Electronics (ISIE) (2009) pp. 1785\u20131790."},{"key":"S0263574715000909_ref32","unstructured":"\u201cFLIR.\u201d [Online]. Available: http:\/\/www.flir.com\/mcs\/view\/?id=53679"},{"key":"S0263574715000909_ref3","doi-asserted-by":"crossref","unstructured":"I. Havoutis , C. Semini , J. Buchli and D. G. Caldwell , \u201cQuadrupedal Trotting with Active Compliance,\u201d IEEE International Conference on Mechatronics (ICM) (2013) pp. 2554\u20132561.","DOI":"10.1109\/ICMECH.2013.6519112"},{"key":"S0263574715000909_ref2","doi-asserted-by":"crossref","unstructured":"V. Barasuol , J. Buchli , C. Semini , M. Frigerio , E. R. De Pieri and D. G. Caldwell , \u201cA Reactive Controller Framework for Quadrupedal Locomotion on Challenging Terrain,\u201d IEEE International Conference on Robotics and Automation (ICRA) (2013) pp. 2554\u20132561.","DOI":"10.1109\/ICRA.2013.6630926"},{"key":"S0263574715000909_ref35","unstructured":"J. Shi and C. Tomasi , \u201cGood Features to Track,\u201d International Conference on Computer Vision and Pattern Recognition (1994) pp. 593\u2013600."},{"key":"S0263574715000909_ref23","unstructured":"A. Ude and E. Oztop , \u201cActive 3-d Vision on a Humanoid Head,\u201d Proceedings of the IEEE International Conference on Advanced Robotics (ICAR) (2009)."},{"key":"S0263574715000909_ref18","doi-asserted-by":"crossref","unstructured":"M. Marcinkiewicz , R. Kaushik , I. Labutov , S. Parsons and T. Raphan , \u201cLearning to Stabilize the Head of a Walking Quadrupedal Robot using a Bioinspired Artificial Vestibular System,\u201d Proceedings of the IEEE International Conference on Robotics and Automation (2008).","DOI":"10.1109\/ROBOT.2009.5152685"},{"key":"S0263574715000909_ref5","doi-asserted-by":"crossref","unstructured":"S. Bazeille , V. Barasuol , M. Focchi , I. Havoutis , M. Frigerio , J. Buchli , C. Semini and D. G. Caldwell , \u201cVision Enhanced Reactive Locomotion Control for Trotting on Rough Terrain,\u201d IEEE International Conference on Technologies for Practical Robot Applications (TePRA) (2013) pp. 1\u20136.","DOI":"10.1109\/TePRA.2013.6556366"},{"key":"S0263574715000909_ref31","unstructured":"\u201cOcular Robotics.\u201d [Online]. Available: http:\/\/www.ocularrobotics.com\/products\/camera-pointing-devices\/rev25-st\/"},{"key":"S0263574715000909_ref11","doi-asserted-by":"crossref","unstructured":"J. Ma , S. Susca , M. Bajracharya , L. Matthies , M. Malchano and D. Wooden , \u201cRobust Multi-Sensor, Day\/Night 6-dof Pose estimation for a Dynamic Legged Vehicle in gps-Denied Environments,\u201d IEEE International Conference on Robotics and Automation (ICRA) (2012) pp. 619\u2013626.","DOI":"10.1109\/ICRA.2012.6225132"},{"key":"S0263574715000909_ref4","doi-asserted-by":"crossref","unstructured":"M. Focchi , V. Barasuol , I. Havoutis , J. Buchli , C. Semini and D. G. Caldwell , \u201cLocal Reflex Generation for Obstacle Negotiation in Quadrupedal Locomotion,\u201d International Conference on Climbing and Walking Robots (CLAWAR) (2013) pp. 610\u2013616.","DOI":"10.1142\/9789814525534_0056"},{"key":"S0263574715000909_ref6","doi-asserted-by":"crossref","unstructured":"I. Havoutis , J. Ortiz , S. Bazeille , V. Barasuol , C. Semini and D. G. Caldwell , \u201cOnboard Perception-Based Trotting and Crawling with the Hydraulic Quadruped Robot (hyq),\u201d IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) (2013) pp. 6052\u20136057.","DOI":"10.1109\/IROS.2013.6697235"},{"key":"S0263574715000909_ref24","doi-asserted-by":"crossref","unstructured":"B. Bauml , O. Birbach , T. Wimbock , U. Frese , A. Dietrich and G. Hirzinger , \u201cCatching Flying Balls with a Mobile Humanoid: System Overview and Design Considerations,\u201d International Conference on Humanoid Robots (2011) pp. 513\u2013520.","DOI":"10.1109\/Humanoids.2011.6100837"}],"container-title":["Robotica"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0263574715000909","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,9,1]],"date-time":"2019-09-01T12:17:30Z","timestamp":1567340250000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0263574715000909\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,11,17]]},"references-count":40,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,4]]}},"alternative-id":["S0263574715000909"],"URL":"https:\/\/doi.org\/10.1017\/s0263574715000909","relation":{},"ISSN":["0263-5747","1469-8668"],"issn-type":[{"type":"print","value":"0263-5747"},{"type":"electronic","value":"1469-8668"}],"subject":[],"published":{"date-parts":[[2015,11,17]]}}}