{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T03:30:52Z","timestamp":1773545452798,"version":"3.50.1"},"reference-count":49,"publisher":"SAGE Publications","issue":"2-3","license":[{"start":{"date-parts":[[2009,11,13]],"date-time":"2009-11-13T00:00:00Z","timestamp":1258070400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2010,2]]},"abstract":"<jats:p> We present a complete vision-guided robot system for model-based three-dimensional (3D) pose estimation and picking of singulated 3D objects. Our system employs a novel vision sensor consisting of a video camera surrounded by eight flashes (light emitting diodes). By capturing images under different flashes and observing the shadows, depth edges or silhouettes in the scene are obtained. The silhouettes are segmented into different objects and each silhouette is matched across a database of object silhouettes in different poses to find the coarse 3D pose. The database is pre-computed using a computer-aided design (CAD) model of the object. The pose is refined using a fully projective formulation of Lowe\u2019s model-based pose estimation algorithm. The estimated pose is transferred to a robot coordinate system utilizing the hand\u2014eye and camera calibration parameters, which allows the robot to pick the object. Our system outperforms conventional systems using two-dimensional sensors with intensity-based features as well as 3D sensors. We handle complex ambient illumination conditions, challenging specular backgrounds, diffuse as well as specular objects, and texture-less objects, on which traditional systems usually fail. Our vision sensor is capable of computing depth edges in real time and is low cost. Our approach is simple and fast for practical implementation. We present real experimental results using our custom designed sensor mounted on a robot arm to demonstrate the effectiveness of our technique. <\/jats:p>","DOI":"10.1177\/0278364909353955","type":"journal-article","created":{"date-parts":[[2009,11,14]],"date-time":"2009-11-14T01:35:00Z","timestamp":1258162500000},"page":"155-173","source":"Crossref","is-referenced-by-count":39,"title":["Vision-guided Robot System for Picking Objects by Casting Shadows"],"prefix":"10.1177","volume":"29","author":[{"given":"Amit","family":"Agrawal","sequence":"first","affiliation":[{"name":"Mitsubishi Electric Research Labs, Cambridge, MA 02139, USA"}]},{"family":"Yu Sun","sequence":"additional","affiliation":[{"name":"University of South Florida, Tampa, FL 33620, USA"}]},{"given":"John","family":"Barnwell","sequence":"additional","affiliation":[{"name":"Mitsubishi Electric Research Labs, Cambridge, MA 02139, USA"}]},{"given":"Ramesh","family":"Raskar","sequence":"additional","affiliation":[{"name":"MIT Media Lab, Cambridge, MA 02139, USA"}]}],"member":"179","published-online":{"date-parts":[[2009,11,13]]},"reference":[{"key":"atypb1","first-page":"882","volume":"2","author":"Agarwal, A.","year":"2004","journal-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1109\/70.238279"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.1997.0632"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1109\/TRA.2002.1019475"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1109\/34.67633"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1145\/4078.4081"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1017\/S0305004100029066"},{"key":"atypb8","volume-title":"Proceedings of the 9th International Conference on Pattern Recognition","author":"Brady, J."},{"key":"atypb9","volume-title":"Computer vision","author":"Brady, J.M.","year":"1981"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1986.4767851"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0109663"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1145\/6462.6464"},{"key":"atypb13","first-page":"150","author":"Christoudias, C.","year":"2002","journal-title":"Proceedings of the International Conference on Pattern Recognition"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1109\/34.1000236"},{"key":"atypb15","volume-title":"Third International Symposium on 3D Data Processing","author":"Crispell, D."},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1007\/BF01450852"},{"issue":"1","key":"atypb17","first-page":"2","volume":"40","author":"Fabbri, R.","year":"2007","journal-title":"ACM Computing Surveys"},{"key":"atypb18","first-page":"412","volume":"1","author":"Feris, R.","year":"2005","journal-title":"Proceedings of the International Conference on Computer Vision"},{"key":"atypb19","volume-title":"Proceedings of SIBGRAPI","author":"Feris, R."},{"key":"atypb20","volume-title":"IEEE Workshop on Real-Time Vision for Human-Computer Interaction","author":"Feris, R."},{"key":"atypb21","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition","author":"Gavrila, D."},{"key":"atypb22","volume-title":"IEEE International Conference on Robotics and Automation","author":"Goemans, O."},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.253"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1109\/34.506791"},{"key":"atypb25","volume-title":"Robot Vision","author":"Horn, B.","year":"1986"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican0884-100"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1109\/70.538972"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.4324\/9781410608918"},{"key":"atypb29","volume-title":"Asian Conference on Computer Vision","author":"Koh, T."},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1109\/87.736761"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(87)90070-1"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1109\/34.134043"},{"key":"atypb33","volume-title":"Proceedings of the Royal Society","author":"Marr, D."},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1109\/34.546256"},{"key":"atypb35","volume-title":"Proceedings of the Fifth International Joint Conference on Artificial Intelligence","author":"Perkins, W."},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1109\/TRA.2003.820923"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1068\/p140449"},{"key":"atypb38","volume-title":"Proceedings of the Conference on the 1999 Symposium on Interactive 3D Graphics","author":"Raskar, R."},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015779"},{"key":"atypb40","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition","author":"Scharstein, D."},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1109\/34.868688"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1109\/70.88014"},{"key":"atypb43","volume-title":"Level Sets-WSCG International Conference on Computer Graphics","author":"Sminchisescu, C."},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1109\/34.3913"},{"key":"atypb45","volume-title":"Proceedings of the 4th IJCAI","author":"Tuji, S."},{"key":"atypb46","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation","author":"Turney, T."},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1109\/83.709661"},{"key":"atypb48","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015759"},{"key":"atypb49","volume-title":"Camera-aided Robot Calibration","author":"Zhuang, H.","year":"1996"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364909353955","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364909353955","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,28]],"date-time":"2025-01-28T12:51:07Z","timestamp":1738068667000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0278364909353955"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,11,13]]},"references-count":49,"journal-issue":{"issue":"2-3","published-print":{"date-parts":[[2010,2]]}},"alternative-id":["10.1177\/0278364909353955"],"URL":"https:\/\/doi.org\/10.1177\/0278364909353955","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,11,13]]}}}