{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T13:57:22Z","timestamp":1761487042478,"version":"3.38.0"},"reference-count":47,"publisher":"SAGE Publications","issue":"9","license":[{"start":{"date-parts":[[2003,9,1]],"date-time":"2003-09-01T00:00:00Z","timestamp":1062374400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2003,9]]},"abstract":"<jats:p> In this paper we present a new methodology to achieve vision-based control using a mobile manipulator to reach a required three-dimensional target position and orientation. Examples of mobile manipulators include standard forklifts and backhoes, which have a fixed manipulator mounted on a mobile platform. The overall objective of this methodology is to apply the nonholonomic degrees of freedom represented by two independently driven wheels together with the holonomic dexterity of the on-board arm in order to bring about a desired positioning objective for the arm. Mobile Camera-Space Manipulation and an extended Kalman filter are implemented to use a minimum number of holonomic and nonholonomic degrees of freedom as required for the end member of the on-board arm to achieve a target position and orientation. We present this vision-based method to control mobile manipulators as an alternative to methods such as visual servoing and calibration (i.e., stereo approaches). This new approach only requires a minimum number of holonomic degrees of freedom to achieve the required three-dimensional positioning by taking full advantage of the nonholonomic degrees of freedom. Experimentally, the method shows itself to be robust to errors in the nominal kinematics and the optics models, as demonstrated by the experimental tests. <\/jats:p>","DOI":"10.1177\/02783649030229001","type":"journal-article","created":{"date-parts":[[2003,9,25]],"date-time":"2003-09-25T20:10:51Z","timestamp":1064520651000},"page":"677-698","source":"Crossref","is-referenced-by-count":20,"title":["Vision-Based Control of a Mobile Base and On-Board Arm"],"prefix":"10.1177","volume":"22","author":[{"given":"Antonio","family":"C\u00e1rdenas","sequence":"first","affiliation":[{"name":"Department of Aerospace and Mechanical Engineering (AME) University of                        Notre Dame (ND) Notre Dame, IN 46556, USA"}]},{"given":"Bill","family":"Goodwine","sequence":"additional","affiliation":[{"name":"Department of Aerospace and Mechanical Engineering (AME) University of                        Notre Dame (ND) Notre Dame, IN 46556, USA"}]},{"given":"Steven","family":"Skaar","sequence":"additional","affiliation":[{"name":"Department of Aerospace and Mechanical Engineering (AME) University of                        Notre Dame (ND) Notre Dame, IN 46556, USA"}]},{"given":"Mike","family":"Seelinger","sequence":"additional","affiliation":[{"name":"Yoder Software, Inc. 715 W. Michigan Ave. Urbana, IL 61801, USA"}]}],"member":"179","published-online":{"date-parts":[[2003,9,1]]},"reference":[{"key":"atypb1","unstructured":"Allen, P. K., Timcenko, A., Yoshimi, B., and Michelman, P. 1992. Real-time visual servoing . In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1850-1856 ."},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(00)00117-2"},{"key":"atypb3","unstructured":"Baumgartner, E. T. 1992. An autonomous vision-based mobile robot. Ph.D. thesis, University of Notre Dame, Notre Dame, IN."},{"key":"atypb4","unstructured":"Baumgartner, E. T. September 2000. In-situ exploration of mars using rover systems . In Proceedings of the AIAA Space 2000 Conference. AIAA paper 2000-5062, Long Beach, CA."},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1109\/9.280748"},{"key":"atypb6","doi-asserted-by":"crossref","unstructured":"Cameron, J. M., MacKenzie, D. C., Ward, K. R., Arkin, R. C., and Book, W. J. 1993. Reactive control for mobile manipulation . In Proceedings of the IEEE International Conference on Robotics and Automation, Atlanta, USA, Vol. 3, pp. 228-235 .","DOI":"10.1109\/ROBOT.1993.292181"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1109\/70.88151"},{"key":"atypb8","unstructured":"Castellanos, J., Mart\u00ednez, J., Neira, J., and Tard\u00f3s, J. 1997. Testbed for mobile robot navigation: The cps experiment. Technical report, Departamento de Inform\u00e1tica e Ingenier\u00eda de Sistemas, Universidad de Zaragoza, Spain. Technical Report RR-97-11."},{"key":"atypb9","doi-asserted-by":"crossref","unstructured":"Denavit, J., and Hartenberg, R. S. 1955. A kinematic notation for lower-pair mechanisms based on matrices . Journal of Applied Mechanics 22: 215-221 .","DOI":"10.1115\/1.4011045"},{"key":"atypb10","unstructured":"Dubowsky, S., and Tanner, A. B. 1987. A study of the dynamics and control of mobile manipulators subjected to vehicle disturbances . In R. C. Bolles, and B. Roth, eds., Proceedings of the 4th Symposium of Robotics Research. MIT Press, Cambridge, MA, pp. 111-117 ."},{"key":"atypb11","unstructured":"Gelb, A. 1974. Applied Optimal Estimation. MIT Press, Cambridge, MA ."},{"key":"atypb12","unstructured":"Gonzalez-Galvan, E. J. 1995. Application of Servoable Cameras in Three-Dimensional Camera-Space Manipulation. Ph.D. thesis, University of Notre Dame, Notre Dame, IN."},{"key":"atypb13","doi-asserted-by":"crossref","unstructured":"Gonzalez-Galvan, E. J., and Skaar, S. B. 1996. Efficient camera-space manipulation using moments . In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3407-3412 .","DOI":"10.1109\/ROBOT.1996.509231"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1177\/027836499701600208"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1016\/S0736-5845(01)00037-0"},{"key":"atypb16","doi-asserted-by":"crossref","unstructured":"Hashimoto, K. 1993. Visual Servoing. World Scientific, Singapore .","DOI":"10.1142\/1995"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1109\/70.704214"},{"key":"atypb18","unstructured":"Horn, B. 1986. Robot Vision. MIT Press, Cambridge, MA ."},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1109\/70.538972"},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.1997.554212"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(98)00067-0"},{"key":"atypb22","unstructured":"Lewis, F. L. 1986. Optimal Estimation With An Introduction To Stochastic Control Theory. Wiley, New York ."},{"key":"atypb23","unstructured":"Ma, Q. 2000. Supervisory control of a Mobile Robot Using Point-and-Click Mobile Camera-Space Manipulation. Master's thesis, University of Notre Dame, Notre Dame, IN."},{"key":"atypb24","unstructured":"Ma, Q., Cardenas, A., Goodwine, B., and Skaar, S. B. 2000. Supervisory control of a mobile robot using point-and-click mobile camera-space manipulation . In B. S\u00e1nchez, R. H. II, M. Soriano, and P. Tiako, eds., Proceedings of the World Multiconference on Systemics, cybernetics and Informatics, Vol. IX, pp. 38-43 ."},{"key":"atypb25","doi-asserted-by":"crossref","unstructured":"MacKenzie, D., and Arkin, R. 1996. Behavior-based mobile manipulations for drum sampling . In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 2389-2395 .","DOI":"10.1109\/ROBOT.1996.506521"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1126\/science.280.5362.454"},{"key":"atypb27","doi-asserted-by":"crossref","unstructured":"Monta, M., Kondo, N., and Shibano, Y. May 1995. Agricultural robot in grape production system . In Proceedings of the IEEE International Conference on Robotics and Automation, Nagoya, Japan, pp. 2504-2509 .","DOI":"10.1109\/ROBOT.1995.525635"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4563(199611)13:11<709::AID-ROB3>3.0.CO;2-Z"},{"key":"atypb29","unstructured":"Pavlov, V. A., and Timofeyev, A. V. 1976. Construction and stabilization of programmed movements of a mobile robot-manipulator . Engineering Cybernetics 14(6): 70-79 ."},{"key":"atypb30","doi-asserted-by":"crossref","unstructured":"Petersson, L., Austin, D., and Kragic, D. 2000. High-level control of a mobile manipulator for door opening . In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vol. 3, pp. 2333-2338 .","DOI":"10.1109\/IROS.2000.895316"},{"key":"atypb31","doi-asserted-by":"crossref","unstructured":"Petersson, L., Jensfelt, P., Tell, D., Strandberg, M., Kragic, D., and Christensen, H. I. May 2002. Systems integration for real-world manipulation tasks . In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 2500-2505 .","DOI":"10.1109\/ROBOT.2002.1013607"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4563(199611)13:11<723::AID-ROB4>3.0.CO;2-X"},{"key":"atypb33","doi-asserted-by":"crossref","unstructured":"Pissard-Gibollet, R., and Rives, P. May 1995. Applying visual servoing techniques to control a mobile hand-eye system . In Proceedings of the IEEE International Conference on Robotics and Automation, Nagoya, Japan, pp. 166-171 .","DOI":"10.1109\/ROBOT.1995.525280"},{"key":"atypb34","doi-asserted-by":"crossref","unstructured":"Puget, P., and Skordas, T. 1990. An optimal solution for mobile camera calibration . In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Vol. 1, pp. 34-39 .","DOI":"10.1109\/ROBOT.1990.125942"},{"key":"atypb35","unstructured":"Robinson, M. 2001. A structured lighting approach to image analysis for robotic applications using camera-space manipulation. Ph.D. thesis, University of Notre Dame, Notre Dame, IN."},{"key":"atypb36","unstructured":"Seelinger, M. J. 1999. Point-and-click Camera-space manipulation, mobile camera-space manipulation, and some fundamental issues regarding the control of robots using vision. Ph.D. thesis, University of Notre Dame, Notre Dame, IN."},{"key":"atypb37","doi-asserted-by":"crossref","unstructured":"Seelinger, M., Skaar, S. B., and Robinson, M. 1998. An alternative approach for image-plane control of robots . In D. J. Kriegman, G. D. Hager, A. S. Morse, eds., Lecture Notes in Control and Information Sciences. Springer, London, pp. 41-65 .","DOI":"10.1007\/BFb0109662"},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1109\/TRA.2002.805647"},{"key":"atypb39","doi-asserted-by":"crossref","unstructured":"Seraji, H. May 1995. Configuration control of rover-mounted manipulators . In Proceedings of the IEEE International Conference on Robotics and Automation, Nagoya, Japan, pp. 2261-2266 .","DOI":"10.1109\/ROBOT.1995.525598"},{"key":"atypb40","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)0893-1321(1997)10:4(179)"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1177\/027836498700600402"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1177\/027836499000900402"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008914201877"},{"key":"atypb44","unstructured":"Swain, R., and Devy, M. May 1999. Motion control using visual servoing and potential fields for a rover-mounted manipulator . In Proceedings of the IEEE International Conference on Robotics and Automation, Detroit, USA, pp. 2249-2254 ."},{"key":"atypb45","unstructured":"Tan, J., and Xi, N. 2001. Integrated sensing and control of mobile manipulators . In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Hawaii, USA."},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.1109\/70.538986"},{"key":"atypb47","unstructured":"Zhuang, H., and Roth, Z. S. 1996. Camera-Aided Robot Calibration. CRC Press, Boca Raton, FL ."}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649030229001","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649030229001","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,3]],"date-time":"2025-03-03T16:32:44Z","timestamp":1741019564000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/02783649030229001"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2003,9]]},"references-count":47,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2003,9]]}},"alternative-id":["10.1177\/02783649030229001"],"URL":"https:\/\/doi.org\/10.1177\/02783649030229001","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"type":"print","value":"0278-3649"},{"type":"electronic","value":"1741-3176"}],"subject":[],"published":{"date-parts":[[2003,9]]}}}