{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,22]],"date-time":"2025-03-22T11:10:12Z","timestamp":1742641812812,"version":"3.37.3"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T00:00:00Z","timestamp":1584057600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T00:00:00Z","timestamp":1584057600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["JP19H01123","JP17F17350"],"award-info":[{"award-number":["JP19H01123","JP17F17350"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Vis"],"published-print":{"date-parts":[[2020,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We present a method for geometric point light source calibration. Unlike prior works that use Lambertian spheres, mirror spheres, or mirror planes, we use a calibration target consisting of a plane and small shadow casters at unknown positions above the plane. We show that shadow observations from a moving calibration target under a fixed light follow the principles of pinhole camera geometry and epipolar geometry, allowing joint recovery of the light position and 3D shadow caster positions, equivalent to how conventional structure from motion jointly recovers camera parameters and 3D feature positions from observed 2D features. Moreover, we devised a unified light model that works with nearby point lights as well as distant light in one common framework. Our evaluation shows that our method yields light estimates that are stable and more accurate than existing techniques while having a much simpler setup and requiring less manual labor.<\/jats:p>","DOI":"10.1007\/s11263-020-01312-3","type":"journal-article","created":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T17:02:52Z","timestamp":1584118972000},"page":"1889-1912","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Light Structure from Pin Motion: Geometric Point Light Source Calibration"],"prefix":"10.1007","volume":"128","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2891-5993","authenticated-orcid":false,"given":"Hiroaki","family":"Santo","sequence":"first","affiliation":[]},{"given":"Michael","family":"Waechter","sequence":"additional","affiliation":[]},{"given":"Wen-Yan","family":"Lin","sequence":"additional","affiliation":[]},{"given":"Yusuke","family":"Sugano","sequence":"additional","affiliation":[]},{"given":"Yasuyuki","family":"Matsushita","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,3,13]]},"reference":[{"key":"1312_CR1","unstructured":"Ackermann, J., Fuhrmann, S., & Goesele, M. (2013). Geometric point light source calibration. In Proceedings of vision, modeling, and visualization (pp. 161\u2013168)."},{"key":"1312_CR2","doi-asserted-by":"crossref","unstructured":"Alldrin, N. G., Mallick, S. P., & Kriegman, D. J. (2007). Resolving the generalized bas-relief ambiguity by entropy minimization. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1\u20137).","DOI":"10.1109\/CVPR.2007.383208"},{"key":"1312_CR3","unstructured":"Aoto, T., Taketomi, T., Sato, T., Mukaigawa, Y., & Yokoya, N. (2012). Position estimation of near point light sources using a clear hollow sphere. In Proceedings of the international conference on pattern recognition (ICPR) (pp. 3721\u20133724)."},{"issue":"2","key":"1312_CR4","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1023\/A:1008124523456","volume":"35","author":"JY Bouguet","year":"1999","unstructured":"Bouguet, J. Y., & Perona, P. (1999). 3D photography using shadows in dual-space geometry. International Journal of Computer Vision (IJCV), 35(2), 129\u2013149.","journal-title":"International Journal of Computer Vision (IJCV)"},{"key":"1312_CR5","first-page":"120","volume":"25","author":"G Bradski","year":"2000","unstructured":"Bradski, G. (2000). The OpenCV Library. Dr. Dobb\u2019s Journal of Software Tools, 25, 120\u2013125.","journal-title":"Dr. Dobb\u2019s Journal of Software Tools"},{"issue":"13","key":"1312_CR6","doi-asserted-by":"publisher","first-page":"168","DOI":"10.5897\/IJPS2015.4274","volume":"11","author":"A Bunteong","year":"2016","unstructured":"Bunteong, A., & Chotikakamthorn, N. (2016). Light source estimation using feature points from specular highlights and cast shadows. International Journal of Physical Sciences, 11(13), 168\u2013177.","journal-title":"International Journal of Physical Sciences"},{"key":"1312_CR7","unstructured":"Cao, X., & Shah, M. (2005). Camera calibration and light source estimation from images with shadows. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 918\u2013923)."},{"key":"1312_CR8","doi-asserted-by":"crossref","unstructured":"Chen, G., Han, K., Shi, B., Matsushita, Y., & Wong, K. Y. K. (2019). Self-calibrating deep photometric stereo networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 8739\u20138747).","DOI":"10.1109\/CVPR.2019.00894"},{"key":"1312_CR9","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1109\/TPAMI.2018.2873295","volume":"42","author":"D Cho","year":"2018","unstructured":"Cho, D., Matsushita, Y., Tai, Y. W., & Kweon, I. S. (2018). Semi-calibrated photometric stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 42, 232\u2013245.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)"},{"key":"1312_CR10","doi-asserted-by":"crossref","unstructured":"Collins, T., & Bartoli, A. (2012). 3D reconstruction in laparoscopy with close-range photometric stereo. In International conference on medical image computing and computer-assisted intervention (pp. 634\u2013642).","DOI":"10.1007\/978-3-642-33418-4_78"},{"issue":"6","key":"1312_CR11","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1145\/358669.358692","volume":"24","author":"MA Fischler","year":"1981","unstructured":"Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6), 381\u2013395.","journal-title":"Communications of the ACM"},{"key":"1312_CR12","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1145\/3130800.3130891","volume":"36","author":"MA Gardner","year":"2017","unstructured":"Gardner, M. A., Sunkavalli, K., Yumer, E., Shen, X., Gambaretto, E., Gagn\u00e9, C., et al. (2017). Learning to predict indoor illumination from a single image. ACM Transactions on Graphics (TOG), 36, 176.","journal-title":"ACM Transactions on Graphics (TOG)"},{"issue":"6","key":"1312_CR13","doi-asserted-by":"publisher","first-page":"2280","DOI":"10.1016\/j.patcog.2014.01.005","volume":"47","author":"S Garrido-Jurado","year":"2014","unstructured":"Garrido-Jurado, S., Mu\u00f1oz-Salinas, R., Madrid-Cuevas, F. J., & Mar\u00edn-Jim\u00e9nez, M. J. (2014). Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition, 47(6), 2280\u20132292.","journal-title":"Pattern Recognition"},{"issue":"6","key":"1312_CR14","doi-asserted-by":"publisher","first-page":"1060","DOI":"10.1109\/TPAMI.2009.102","volume":"32","author":"DB Goldman","year":"2010","unstructured":"Goldman, D. B., Curless, B., Hertzmann, A., & Seitz, S. M. (2010). Shape and spatially-varying BRDFs from photometric stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 32(6), 1060\u20131071.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)"},{"issue":"4","key":"1312_CR15","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1109\/TPAMI.2005.82","volume":"27","author":"K Hara","year":"2005","unstructured":"Hara, K., Nishino, K., & Ikeuchi, K. (2005). Light source position and reflectance estimation from a single view without the distant illumination assumption. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 27(4), 493\u2013505.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)"},{"issue":"6","key":"1312_CR16","doi-asserted-by":"publisher","first-page":"580","DOI":"10.1109\/34.601246","volume":"19","author":"RI Hartley","year":"1997","unstructured":"Hartley, R. I. (1997). In defense of the eight-point algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 19(6), 580\u2013593.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)"},{"issue":"2","key":"1312_CR17","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1006\/cviu.1997.0547","volume":"68","author":"RI Hartley","year":"1997","unstructured":"Hartley, R. I., & Sturm, P. (1997). Triangulation. Computer Vision and Image Understanding Journal (CVIU), 68(2), 146\u2013157.","journal-title":"Computer Vision and Image Understanding Journal (CVIU)"},{"key":"1312_CR18","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511811685","volume-title":"Multiple view geometry in computer vision","author":"RI Hartley","year":"2004","unstructured":"Hartley, R. I., & Zisserman, A. (2004). Multiple view geometry in computer vision (2nd ed.). Cambridge: Cambridge University Press.","edition":"2"},{"key":"1312_CR19","unstructured":"Horn, B. K. (1970). Shape from shading: A method for obtaining the shape of a smooth opaque object from one view. Technical report AITR-232, MIT"},{"key":"1312_CR20","unstructured":"Hu, B., Brown, C. M., & Nelson, R. C. (2004). The geometry of point light source from shadows. Technical report UR CSD\u00a0\/ TR810, University of Rochester"},{"key":"1312_CR21","doi-asserted-by":"crossref","unstructured":"Logothetis, F., Mecca, R., & Cipolla, R. (2017). Semi-calibrated near field photometric stereo. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 941\u2013950).","DOI":"10.1109\/CVPR.2017.481"},{"issue":"4","key":"1312_CR22","doi-asserted-by":"publisher","first-page":"4024","DOI":"10.1364\/OE.27.004024","volume":"27","author":"L Ma","year":"2019","unstructured":"Ma, L., Liu, J., Pei, X., Hu, Y., & Sun, F. (2019). Calibration of position and orientation for point light source synchronously with single image in photometric stereo. Optics Express, 27(4), 4024\u20134033.","journal-title":"Optics Express"},{"issue":"2","key":"1312_CR23","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1364\/JOSAA.7.000279","volume":"7","author":"S Negahdaripour","year":"1990","unstructured":"Negahdaripour, S. (1990). Closed-form relationship between the two interpretations of a moving plane. Journal of the Optical Society of America, 7(2), 279\u2013285.","journal-title":"Journal of the Optical Society of America"},{"key":"1312_CR24","volume-title":"Numerical optimization","author":"J Nocedal","year":"2006","unstructured":"Nocedal, J., & Wright, S. J. (2006). Numerical optimization. Berlin: Springer."},{"key":"1312_CR25","doi-asserted-by":"crossref","unstructured":"Park, J., Sinha, S. N., Matsushita, Y., Tai, Y., & Kweon, I. (2014). Calibrating a non-isotropic near point light source using a plane. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2267\u20132274).","DOI":"10.1109\/CVPR.2014.290"},{"issue":"4","key":"1312_CR26","doi-asserted-by":"publisher","first-page":"788","DOI":"10.1109\/TPAMI.2016.2558150","volume":"39","author":"V P\u0103tr\u0103ucean","year":"2016","unstructured":"P\u0103tr\u0103ucean, V., Gurdjos, P., & von Gioi, R. G. (2016). Joint a contrario ellipse and line detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 39(4), 788\u2013802.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)"},{"key":"1312_CR27","unstructured":"Petersen, K. B., & Pedersen, M. S. (2012). The Matrix Cookbook. Retrieved April 19, 2019, from http:\/\/www2.imm.dtu.dk\/pubdb\/p.php?3274."},{"issue":"9","key":"1312_CR28","doi-asserted-by":"publisher","first-page":"1022","DOI":"10.1109\/34.955114","volume":"23","author":"MW Powell","year":"2001","unstructured":"Powell, M. W., Sarkar, S., & Goldgof, D. (2001). A simple strategy for calibrating the geometry of light sources. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 23(9), 1022\u20131027.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)"},{"issue":"3","key":"1312_CR29","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1007\/s10851-017-0761-1","volume":"60","author":"Y Qu\u00e9au","year":"2018","unstructured":"Qu\u00e9au, Y., Durix, B., Wu, T., Cremers, D., Lauze, F., & Durou, J. D. (2018). Led-based photometric stereo: Modeling, calibration and numerical solution. Journal of Mathematical Imaging and Vision, 60(3), 313\u2013340.","journal-title":"Journal of Mathematical Imaging and Vision"},{"key":"1312_CR30","doi-asserted-by":"crossref","unstructured":"Qu\u00e9au, Y., Wu, T., Lauze, F., Durou, J. D., & Cremers, D. (2017) A non-convex variational approach to photometric stereo under inaccurate lighting. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR).","DOI":"10.1109\/CVPR.2017.45"},{"key":"1312_CR31","unstructured":"Sato, I., Sato, Y., & Ikeuchi, K. (2001) Stability issues in recovering illumination distribution from brightness in shadows. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. II-400\u2013II-407)."},{"issue":"3","key":"1312_CR32","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1109\/TPAMI.2003.1182093","volume":"25","author":"I Sato","year":"2003","unstructured":"Sato, I., Sato, Y., & Ikeuchi, K. (2003). Illumination from shadows. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 25(3), 290\u2013300.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)"},{"issue":"10","key":"1312_CR33","doi-asserted-by":"publisher","first-page":"1536","DOI":"10.1016\/j.cviu.2013.06.004","volume":"117","author":"D Schnieders","year":"2013","unstructured":"Schnieders, D., & Wong, K. Y. K. (2013). Camera and light calibration from reflections on a sphere. Computer Vision and Image Understanding Journal (CVIU), 117(10), 1536\u20131547.","journal-title":"Computer Vision and Image Understanding Journal (CVIU)"},{"key":"1312_CR34","unstructured":"Schnieders, D., Wong, K. Y. K., & Dai, Z. (2009). Polygonal light source estimation. In Proceedings of the Asian conference on computer vision (ACCV) (pp. 96\u2013107)."},{"issue":"1","key":"1312_CR35","doi-asserted-by":"publisher","first-page":"013002-1","DOI":"10.1117\/1.3533326","volume":"20","author":"HL Shen","year":"2011","unstructured":"Shen, H. L., & Cheng, Y. (2011). Calibrating light sources by using a planar mirror. Journal of Electronic Imaging, 20(1), 013002-1\u2013013002-6.","journal-title":"Journal of Electronic Imaging"},{"key":"1312_CR36","doi-asserted-by":"crossref","unstructured":"Shi, B., Matsushita, Y., Wei, Y., Xu, C., & Tan, P. (2010) Self-calibrating photometric stereo. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1118\u20131125).","DOI":"10.1109\/CVPR.2010.5540091"},{"key":"1312_CR37","unstructured":"Silver, W. M. (1980) Determining shape and reflectance using multiple images. Master\u2019s thesis, Massachusetts Institute of Technology"},{"key":"1312_CR38","doi-asserted-by":"crossref","unstructured":"Snavely, N., Seitz, S. M., & Szeliski, R. (2006) Photo tourism: Exploring photo collections in 3D. In Proceedings of SIGGRAPH (pp. 835\u2013846).","DOI":"10.1145\/1141911.1141964"},{"key":"1312_CR39","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1016\/j.optlaseng.2018.08.014","volume":"111","author":"Z Song","year":"2018","unstructured":"Song, Z., Nie, Y., & Song, Z. (2018). Photometric stereo with quasi-point light source. Optics and Lasers in Engineering, 111, 172\u2013182.","journal-title":"Optics and Lasers in Engineering"},{"key":"1312_CR40","volume-title":"Computer vision: Algorithms and applications","author":"R Szeliski","year":"2010","unstructured":"Szeliski, R. (2010). Computer vision: Algorithms and applications. Berlin: Springer."},{"issue":"9","key":"1312_CR41","doi-asserted-by":"publisher","first-page":"966","DOI":"10.1016\/j.cviu.2009.03.017","volume":"113","author":"T Takai","year":"2009","unstructured":"Takai, T., Maki, A., Niinuma, K., & Matsuyama, T. (2009). Difference sphere: An approach to near light source estimation. Computer Vision and Image Understanding Journal (CVIU), 113(9), 966\u2013978.","journal-title":"Computer Vision and Image Understanding Journal (CVIU)"},{"key":"1312_CR42","unstructured":"Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000). Bundle adjustment\u2014A modern synthesis. In ICCV Workshop on vision algorithms: Theory and practice (pp. 298\u2013372)."},{"key":"1312_CR43","doi-asserted-by":"crossref","unstructured":"Wang, Y., & Samaras, D. (2002). Estimation of multiple directional light sources for synthesis of mixed reality images. In Proceedings of the Pacific conference on computer graphics and applications (pp. 38\u201347).","DOI":"10.1109\/PCCGA.2002.1167837"},{"key":"1312_CR44","doi-asserted-by":"crossref","unstructured":"Weber, M., & Cipolla, R. (2001). A practical method for estimation of point light-sources. In Proceedings of the British machine vision conference (BMVC) (vol.\u00a02, pp. 471\u2013480).","DOI":"10.5244\/C.15.49"},{"issue":"1","key":"1312_CR45","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/S0167-8655(02)00208-8","volume":"24","author":"J Wei","year":"2003","unstructured":"Wei, J. (2003). Robust recovery of multiple light source based on local light source constant constraint. Pattern Recognition Letters, 24(1), 159\u2013172.","journal-title":"Pattern Recognition Letters"},{"key":"1312_CR46","doi-asserted-by":"crossref","unstructured":"Wong, K. Y. K., Schnieders, D., & Li, S. (2008). Recovering light directions and camera poses from a single sphere. In Proceedings of the European conference on computer vision (ECCV) (pp. 631\u2013642).","DOI":"10.1007\/978-3-540-88682-2_48"},{"issue":"1","key":"1312_CR47","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1117\/12.7972479","volume":"19","author":"RJ Woodham","year":"1980","unstructured":"Woodham, R. J. (1980). Photometric method for determining surface orientation from multiple images. Optical Engineering, 19(1), 139\u2013144.","journal-title":"Optical Engineering"},{"issue":"8","key":"1312_CR48","doi-asserted-by":"publisher","first-page":"915","DOI":"10.1109\/34.946995","volume":"23","author":"Y Zhang","year":"2001","unstructured":"Zhang, Y., & Yang, Y. H. (2001). Multiple illuminant direction detection with application to image synthesis. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 23(8), 915\u2013920.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)"},{"key":"1312_CR49","doi-asserted-by":"crossref","unstructured":"Zhou, W., & Kambhamettu, C. (2002) Estimation of illuminant direction and intensity of multiple light sources. In: Proceedings of the European conference on computer vision (ECCV) (pp. 206\u2013220).","DOI":"10.1007\/3-540-47979-1_14"}],"container-title":["International Journal of Computer Vision"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-020-01312-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11263-020-01312-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-020-01312-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,13]],"date-time":"2021-03-13T01:01:01Z","timestamp":1615597261000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11263-020-01312-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,13]]},"references-count":49,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2020,7]]}},"alternative-id":["1312"],"URL":"https:\/\/doi.org\/10.1007\/s11263-020-01312-3","relation":{},"ISSN":["0920-5691","1573-1405"],"issn-type":[{"type":"print","value":"0920-5691"},{"type":"electronic","value":"1573-1405"}],"subject":[],"published":{"date-parts":[[2020,3,13]]},"assertion":[{"value":"19 April 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 February 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 March 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}