{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T04:02:37Z","timestamp":1777521757742,"version":"3.51.4"},"reference-count":46,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2003,6,1]],"date-time":"2003-06-01T00:00:00Z","timestamp":1054425600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Adaptive Behavior"],"published-print":{"date-parts":[[2003,6]]},"abstract":"<jats:p>Vision and manipulation are inextricably intertwined in the primate brain. Tantalizing results from neuroscience are shedding light on the mixed motor and sensory representations used by the brain during reaching, grasping, and object recognition. We now know a great deal about what happens in the brain during these activities, but not necessarily why. Is the integration we see functionally important, or just a reflection of evolution's lack of enthusiasm for sharp modularity? We wish to instantiate these results in robotic form to probe the technical advantages and to find any lacunae in existing models. We believe it would be missing the point to investigate this on a platform where dextrous manipulation and sophisticated machine vision are already implemented in their mature form, and instead follow a developmental approach from simpler primitives. We begin with a precursor to manipulation, simple poking and prodding, and show how it facilitates object segmentation, a long-standing problem in machine vision. The robot can familiarize itself with the objects in its environment by acting upon them. It can then recognize other actors (such as humans) in the environment through their effect on the objects it has learned about. We argue that following causal chains of events out from the robot's body into the environment allows for a very natural developmental progression of visual competence, and we relate this idea to results in neuroscience.<\/jats:p>","DOI":"10.1177\/10597123030112004","type":"journal-article","created":{"date-parts":[[2003,10,2]],"date-time":"2003-10-02T16:35:05Z","timestamp":1065112505000},"page":"109-128","source":"Crossref","is-referenced-by-count":103,"title":["Better Vision through Manipulation"],"prefix":"10.1177","volume":"11","author":[{"given":"Giorgio","family":"Metta","sequence":"first","affiliation":[{"name":"LIRA-Lab, DIST, University of Genoa,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Fitzpatrick","sequence":"additional","affiliation":[{"name":"Computer Science and Artificial Intelligence Laboratory, Massachusetts                        Institute of Technology,"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2003,6,1]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1109\/5254.867909"},{"key":"atypb2","unstructured":"Adolph, K. E., Eppler, M. A. & Gibson, E. J. (1993). Development of perception of affordances . Advances in Infancy Research, 8, 51-98 ."},{"key":"atypb3","doi-asserted-by":"crossref","unstructured":"Arbib, M. A. (1981). Perceptual structures and distributed motor control. In V. B. Brooks, (Ed.), Handbook of physiology, Sect. 2: The nervous system, Vol. II, Motor control Part 1 (pp. 1449-1480). American Physiological Society .","DOI":"10.1002\/cphy.cp010233"},{"key":"atypb4","doi-asserted-by":"crossref","unstructured":"Bekkering, H. & Wohlschl\u00e4ger, A. (2000). Imitation in children is goal-directed . Quarterly Journal of Experimental Psychology, 53A(1), 153-164 .","DOI":"10.1080\/713755872"},{"key":"atypb5","unstructured":"Berkeley, G. (1972). A new theory of vision and other writings. London: Dent . (Original work published 1734)"},{"key":"atypb6","unstructured":"Birchfield, S. (1999).\n                      Depth and motion discontinuities\n                      . Unpublished doctoral dissertation, Dept. of Electrical Engineering, Stanford University."},{"key":"atypb7","doi-asserted-by":"crossref","unstructured":"Brooks, R. A., Breazeal, C., Marjanovi\u0107, M., Scassellati, B. & Williamson, M. (1999). The Cog project: Building a humanoid robot. In C. Nehaniv, (Ed.), Computation for metaphors, analogy, and agents (pp. 52-87). Lecture Notes in Artificial Intelligence 1562, New York: Springer .","DOI":"10.1007\/3-540-48834-0_5"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1162\/jocn.1993.5.4.408"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1038\/415429a"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8760(99)00051-3"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00047-1"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1007\/s002210050713"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1996.76.1.141"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/119.2.593"},{"key":"atypb15","unstructured":"Gibson, J. J. (1977). The theory of affordances. In R. Shaw & J. Bransford (Eds.), Perceiving, acting and knowing: Toward an ecological psychology (pp. 67-82). Hillsdale, NJ: Erlbaum ."},{"key":"atypb16","unstructured":"Ginsburg, H. & Opper, S. (1978). Piaget's theory of intellectual development (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall ."},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1126\/science.277.5323.239"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1997.77.5.2268"},{"key":"atypb19","unstructured":"Harnad, S. (2002). Computationalism: New directions. Cambridge, MA: MIT Press ."},{"key":"atypb20","doi-asserted-by":"crossref","unstructured":"Hendriks-Jansen, H. (1996). Catching ourselves in the act. Cambridge, MA: MIT Press .","DOI":"10.7551\/mitpress\/1748.001.0001"},{"key":"atypb21","unstructured":"Jeannerod, M. (1997). The cognitive neuroscience of action. Cambridge MA: Blackwell ."},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1016\/0166-2236(95)93921-J"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(00)00055-9"},{"key":"atypb24","unstructured":"Manzotti, R. & Tagliasco, V. (2001). Coscienza e realt\u00e0: Una teoria della coscienza per costruttori di menti e cervelli. Bologna: Mulino ."},{"key":"atypb25","doi-asserted-by":"crossref","unstructured":"Marjanovi\u0107, M. J., Scassellati, B. & Williamson, M. M. (1996). Self-taught visually-guided pointing for a humanoid robot. In P. Maes, M. J. Mataric, J.A. Meyer, J. Pollack, & S. W. Wilson (Eds.), From animals to animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior (pp. 35-44). Cambridge, MA: MIT Press\/Bradford Books .","DOI":"10.7551\/mitpress\/3118.003.0007"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1126\/science.198.4312.75"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(99)00070-2"},{"key":"atypb28","unstructured":"Milner, A. D. & Goodale, M. A. (1995). The visual brain in action. Oxford: Oxford University Press ."},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1007\/BF00198756"},{"key":"atypb30","unstructured":"Perrett, D. I., Mistlin, A. J., Harries, M. H. & Chitty, A. J. (1990). Understanding the visual appearance and consequence of hand action. In M. A. Goodale (Ed.), Vision and action: The control of grasping (pp. 163-180). Norwood, NJ: Ablex ."},{"key":"atypb31","unstructured":"Piaget, J. (1963). The origin of intelligence in children. New York: Norton ."},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1016\/S0010-0277(01)00162-7"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-2236(98)01260-0"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1016\/S0959-4388(97)80037-2"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-2236(97)01067-9"},{"key":"atypb36","doi-asserted-by":"crossref","unstructured":"Scheier, C. & Lambrinos, D. (1996). Categorization in a real-world agent using haptic exploration and active perception . In P. Maes, M. J. Mataric, J.A. Meyer, J. Pollack, & S. W. Wilson (Eds.), From animals to animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior (pp. 65-74 ). Cambridge, MA: MIT Press\/Bradford Books.","DOI":"10.7551\/mitpress\/3118.003.0010"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008120406972"},{"key":"atypb38","doi-asserted-by":"crossref","unstructured":"Spelke, E. (2000). Core knowledge . American Psychologist, 55(11), 145-160 .","DOI":"10.1037\/\/0003-066X.55.11.1233"},{"key":"atypb39","doi-asserted-by":"crossref","unstructured":"Sperber, D., Premack, D. & Premack, A. J. (1995). Causal cognition: A multisiciplinary debate. New York: Oxford University Press .","DOI":"10.1093\/acprof:oso\/9780198524021.001.0001"},{"key":"atypb40","unstructured":"Ungerleider, L. G. & Mishkin, M. (1982). Two cortical visual systems. In D. J. Ingle, M. A. Goodale, & R. J. W. Mansfield (Eds.), Analysis of visual behavior (pp. 549-586). Cambridge, MA: MIT Press ."},{"key":"atypb41","unstructured":"Weng, J. (2002). A theory for mentally developing robots . In Proceedings of the 2nd International Conference on Development and Learning (pp. 131-140 ). IEEE Computer Society Press."},{"key":"atypb42","doi-asserted-by":"crossref","unstructured":"Weng, J., McClelland, J., Pentland, A., Sporns, O., Stockman, I., Sur, M. & Thelen, E. (2000). Autonomous mental development by robots and animals . Science, 291(5504), 599-600 .","DOI":"10.1126\/science.291.5504.599"},{"key":"atypb43","unstructured":"Williamson, M. (1995).\n                      Series elastic actuators\n                      . Unpublished master's thesis, Massachusetts Institute of Technology, Cambridge, MA."},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00048-3"},{"key":"atypb45","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-001-0993-5"},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.1016\/S0010-0277(98)00058-4"}],"container-title":["Adaptive Behavior"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10597123030112004","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10597123030112004","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T16:15:20Z","timestamp":1777392920000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10597123030112004"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2003,6]]},"references-count":46,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2003,6]]}},"alternative-id":["10.1177\/10597123030112004"],"URL":"https:\/\/doi.org\/10.1177\/10597123030112004","relation":{},"ISSN":["1059-7123","1741-2633"],"issn-type":[{"value":"1059-7123","type":"print"},{"value":"1741-2633","type":"electronic"}],"subject":[],"published":{"date-parts":[[2003,6]]}}}