{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T06:29:58Z","timestamp":1782282598013,"version":"3.54.5"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2004,8,1]],"date-time":"2004-08-01T00:00:00Z","timestamp":1091318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2004,8]]},"abstract":"<jats:p>The combination of the cornea of an eye and a camera viewing the eye form a catadioptric (mirror + lens) imaging system with a very wide field of view. We present a detailed analysis of the characteristics of this corneal imaging system. Anatomical studies have shown that the shape of a normal cornea (without major defects) can be approximated with an ellipsoid of fixed eccentricity and size. Using this shape model, we can determine the geometric parameters of the corneal imaging system from the image. Then, an environment map of the scene with a large field of view can be computed from the image. The environment map represents the illumination of the scene with respect to the eye. This use of an eye as a natural light probe is advantageous in many relighting scenarios. For instance, it enables us to insert virtual objects into an image such that they appear consistent with the illumination of the scene. The eye is a particularly useful probe when relighting faces. It allows us to reconstruct the geometry of a face by simply waving a light source in front of the face. Finally, in the case of an already captured image, eyes could be the only direct means for obtaining illumination information. We show how illumination computed from eyes can be used to replace a face in an image with another one. We believe that the eye not only serves as a useful tool for relighting but also makes relighting possible in situations where current approaches are hard to use.<\/jats:p>","DOI":"10.1145\/1015706.1015783","type":"journal-article","created":{"date-parts":[[2004,10,7]],"date-time":"2004-10-07T17:38:56Z","timestamp":1097170736000},"page":"704-711","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":92,"title":["Eyes for relighting"],"prefix":"10.1145","volume":"23","author":[{"given":"Ko","family":"Nishino","sequence":"first","affiliation":[{"name":"Columbia University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shree K.","family":"Nayar","sequence":"additional","affiliation":[{"name":"Columbia University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2004,8]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1201775.882314"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008128724364"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1088\/0959-5309\/55\/5\/302"},{"key":"e_1_2_2_4_1","first-page":"1","article-title":"Introducing Vision-Realistic Rendering","volume":"2002","author":"BARSKY B.","year":"2002","unstructured":"BARSKY, B., BARGTEIL, A., GARCIA, D., AND KLEIN, S. 2002. Introducing Vision-Realistic Rendering. In Proc. of EGWR 2002, 1--7.","journal-title":"Proc. of EGWR"},{"key":"e_1_2_2_5_1","volume-title":"Computational Geometry: Lectures at Morningside Center of Mathematics","author":"BARSKY B.","unstructured":"BARSKY, B. 2003. Geometry for Analysis of Corneal Shape. In Computational Geometry: Lectures at Morningside Center of Mathematics. Amer Mathematical Society, 33--56."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383270"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/800049.801811"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.63.000299"},{"key":"e_1_2_2_10_1","volume-title":"Microwave and Optical Ray Geometry","author":"CORNBLEET S.","unstructured":"CORNBLEET, S. 1984. Microwave and Optical Ray Geometry. John Wiley and Sons."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.244676"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258884"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344855"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280864"},{"key":"e_1_2_2_15_1","unstructured":"FLOM L. AND SAFIR A. 1987. Iris Recognition System. US patent 4 641 349."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.3909"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/882404.882438"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237272"},{"key":"e_1_2_2_19_1","first-page":"1527","article-title":"Human-computer Interaction using Eye-gaze Input","volume":"19","author":"HUTCHINSON T.","year":"1989","unstructured":"HUTCHINSON, T., WHITE, K., REICHERT, K., AND FREY, L. 1989. Human-computer Interaction using Eye-gaze Input. IEEE TSMC 19 (Nov.\/Dec.), 1527--1533.","journal-title":"IEEE TSMC"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/97243.97246"},{"key":"e_1_2_2_21_1","volume-title":"2003. Adler's Physiology of the Eye: Clinical Application","author":"KAUFMAN P.","unstructured":"KAUFMAN, P., AND ALM, A., Eds. 2003. Adler's Physiology of the Eye: Clinical Application, 10th ed. Mosby.","edition":"10"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2003.1242384"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/647653.732303"},{"key":"e_1_2_2_24_1","volume-title":"Sampling and Reconstruction. In Proc. of IEEE CVPR","volume":"1","author":"LIN Z.","year":"2001","unstructured":"LIN, Z., WONG, T.-T., AND SHUM, H.-Y. 2001. Relighting with the Reflected Irradiance Field: Representation, Sampling and Reconstruction. In Proc. of IEEE CVPR 2001, vol. 1, 561--567."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2001.937652"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.2352\/CIC.1997.5.1.art00052"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/566570.566599"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.1999.786966"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.576849"},{"key":"e_1_2_2_30_1","first-page":"1472","article-title":"High Dynamic Range Imaging: Spatially Varying Pixel Exposures","volume":"00","author":"NAYAR S.","year":"2000","unstructured":"NAYAR, S., AND MITSUNAGA, T. 2000. High Dynamic Range Imaging: Spatially Varying Pixel Exposures. In Proc. of IEEE CVPR 00, 1472--1479.","journal-title":"Proc. of IEEE CVPR"},{"key":"e_1_2_2_31_1","volume-title":"Dept. of Computer Science","author":"NISHINO K.","unstructured":"NISHINO, K., AND NAYAR, S. 2004. Corneal imaging system: Environment from eyes. Tech. rep., Dept. of Computer Science, Columbia University. In preparation."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383271"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/192161.192200"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258885"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2003.1182093"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/839277.840121"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258861"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1023035826052"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.57.001105"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.2352\/CIC.2003.11.1.art00014"},{"key":"e_1_2_2_41_1","volume-title":"Physiologic Optics","author":"VON HELMHOLTZ H.","unstructured":"VON HELMHOLTZ, H. 1909. Physiologic Optics, third ed., vol. 1 and 2. Voss, Hamburg, Germany."},{"key":"e_1_2_2_42_1","volume-title":"Proc. of SPIE","volume":"155","author":"WOODHAM R.","year":"1978","unstructured":"WOODHAM, R. 1978. Photometric Stereo: A Reflectance Map Technique for Determining Surface Orientation from a Single View. In Proc. of SPIE, vol. 155, 136--143."},{"key":"e_1_2_2_43_1","first-page":"160","article-title":"Real-time Generation of Environmental Map and Obstacle Avoidance using Omnidirectional Image Sensor with Conic Mirror","volume":"91","author":"YAGI Y.","year":"1991","unstructured":"YAGI, Y., AND YACHIDA, M. 1991. Real-time Generation of Environmental Map and Obstacle Avoidance using Omnidirectional Image Sensor with Conic Mirror. In Proc. of IEEE CVPR 91, 160--165.","journal-title":"Proc. of IEEE CVPR"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311559"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1015706.1015783","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1015706.1015783","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:26:24Z","timestamp":1750281984000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1015706.1015783"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,8]]},"references-count":44,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2004,8]]}},"alternative-id":["10.1145\/1015706.1015783"],"URL":"https:\/\/doi.org\/10.1145\/1015706.1015783","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2004,8]]},"assertion":[{"value":"2004-08-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}