{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T09:09:52Z","timestamp":1760346592728,"version":"3.41.0"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2017,7,20]],"date-time":"2017-07-20T00:00:00Z","timestamp":1500508800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["HU 2273\/2-1"],"award-info":[{"award-number":["HU 2273\/2-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2017,8,31]]},"abstract":"<jats:p>Light fields are a powerful concept in computational imaging and a mainstay in image-based rendering; however, so far their acquisition required either carefully designed and calibrated optical systems (micro-lens arrays), or multi-camera\/multi-shot settings. Here, we show that fully calibrated light field data can be obtained from a single ordinary photograph taken through a partially wetted window. Each drop of water produces a distorted view on the scene, and the challenge of recovering the unknown mapping from pixel coordinates to refracted rays in space is a severely underconstrained problem. The key idea behind our solution is to combine ray tracing and low-level image analysis techniques (extraction of 2D drop contours and locations of scene features seen through drops) with state-of-the-art drop shape simulation and an iterative refinement scheme to enforce photo-consistency across features that are seen in multiple views. This novel approach not only recovers a dense pixel-to-ray mapping, but also the refractive geometry through which the scene is observed, to high accuracy. We therefore anticipate that our inherently self-calibrating scheme might also find applications in other fields, for instance in materials science where the wetting properties of liquids on surfaces are investigated.<\/jats:p>","DOI":"10.1145\/3072959.3073589","type":"journal-article","created":{"date-parts":[[2017,7,21]],"date-time":"2017-07-21T12:24:07Z","timestamp":1500639847000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["4D imaging through spray-on optics"],"prefix":"10.1145","volume":"36","author":[{"given":"Julian","family":"Iseringhausen","sequence":"first","affiliation":[{"name":"University of Bonn"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bastian","family":"Goldl\u00fccke","sequence":"additional","affiliation":[{"name":"University of Konstanz"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nina","family":"Pesheva","sequence":"additional","affiliation":[{"name":"Bulgarian Academy of Sciences"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stanimir","family":"Iliev","sequence":"additional","affiliation":[{"name":"Bulgarian Academy of Sciences"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander","family":"Wender","sequence":"additional","affiliation":[{"name":"University of Stuttgart"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Fuchs","sequence":"additional","affiliation":[{"name":"Stuttgart Media University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias B.","family":"Hullin","sequence":"additional","affiliation":[{"name":"University of Bonn"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,7,20]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Adamson A. and A. Gast. 1997. Physical Chemistry of Surfaces. Wiley.  Adamson A. and A. Gast. 1997. Physical Chemistry of Surfaces. Wiley."},{"key":"e_1_2_2_2_1","unstructured":"Adelson E. H. and J. R. Bergen. 1991. The plenoptic function and the elements of early vision. Computational models of visual processing 1 2 (1991).  Adelson E. H. and J. R. Bergen. 1991. The plenoptic function and the elements of early vision. Computational models of visual processing 1 2 (1991)."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2016.7492880"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778813"},{"key":"e_1_2_2_5_1","unstructured":"Bouguet J.-Y. 2004. Camera calibration toolbox for MATLAB. (2004).  Bouguet J.-Y. 2004. Camera calibration toolbox for MATLAB. (2004)."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/10586458.1992.10504253"},{"key":"e_1_2_2_7_1","unstructured":"Brakke K. A. 2013. Surface Evolver 2.70. (2013). http:\/\/facstaff.susqu.edu\/brakke\/evolver\/evolver.html.  Brakke K. A. 2013. Surface Evolver 2.70. (2013). http:\/\/facstaff.susqu.edu\/brakke\/evolver\/evolver.html."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344932"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.11.002370"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.461"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03009.x"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-21656-0"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.84"},{"key":"e_1_2_2_14_1","volume-title":"Technical Report MIT-CSAIL-TR-2006--058.","author":"Fergus R.","year":"2006","unstructured":"Fergus , R. , A. Torralba , and W. T. Freeman . 2006 . Random lens imaging. Technical Report MIT-CSAIL-TR-2006--058. Fergus, R., A. Torralba, and W. T. Freeman. 2006. Random lens imaging. Technical Report MIT-CSAIL-TR-2006--058."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12201"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.2312\/EGWR\/EGSR06\/263-272"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1137\/110823766"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237200"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5540073"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1201775.882341"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511811685"},{"key":"e_1_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Hickson P. E. F. Borra R. Cabanac S. C. Chapman V. De Lapparent M. Mulrooney and G. A. Walker. 1998. Large Zenith Telescope project: a 6-m mercury-mirror telescope. In Astronomical Telescopes & Instrumentation. International Society for Optics and Photonics 226--232.  Hickson P. E. F. Borra R. Cabanac S. C. Chapman V. De Lapparent M. Mulrooney and G. A. Walker. 1998. Large Zenith Telescope project: a 6-m mercury-mirror telescope. In Astronomical Telescopes & Instrumentation. International Society for Optics and Photonics 226--232.","DOI":"10.1117\/12.319286"},{"volume-title":"Asian Conference on Computer Vision. Springer.","author":"Honauer K.","key":"e_1_2_2_23_1","unstructured":"Honauer , K. , O. Johannsen , D. Kondermann , and B. Goldluecke . 2016. A dataset and evaluation methodology for depth estimation on 4D light fields . In Asian Conference on Computer Vision. Springer. Honauer, K., O. Johannsen, D. Kondermann, and B. Goldluecke. 2016. A dataset and evaluation methodology for depth estimation on 4D light fields. In Asian Conference on Computer Vision. Springer."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1399504.1360686"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2048259.2048260"},{"volume-title":"EUROGRAPHICS 2008 STAR.","author":"Ihrke I.","key":"e_1_2_2_26_1","unstructured":"Ihrke , I. , K. Kutulakos , H. Lensch , M. Magnor , and W. Heidrich . 2008. State of the art in transparent and specular object reconstruction . In EUROGRAPHICS 2008 STAR. Ihrke, I., K. Kutulakos, H. Lensch, M. Magnor, and W. Heidrich. 2008. State of the art in transparent and specular object reconstruction. In EUROGRAPHICS 2008 STAR."},{"volume-title":"EUROGRAPHICS 2011 STAR.","author":"Ihrke I.","key":"e_1_2_2_27_1","unstructured":"Ihrke , I. , G. Wetzstein , D. Lanman , and W. Heidrich . 2011. State of the art in computational plenoptic imaging . In EUROGRAPHICS 2011 STAR. Ihrke, I., G. Wetzstein, D. Lanman, and W. Heidrich. 2011. State of the art in computational plenoptic imaging. In EUROGRAPHICS 2011 STAR."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/0045-7825(95)00831-K"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1006\/jcis.1997.5110"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1021\/la035044a"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcis.2006.05.067"},{"key":"e_1_2_2_32_1","unstructured":"Jakob W. 2010. Mitsuba renderer. (2010). http:\/\/www.mitsuba-renderer.org.  Jakob W. 2010. Mitsuba renderer. (2010). http:\/\/www.mitsuba-renderer.org."},{"key":"e_1_2_2_33_1","volume-title":"ACM Trans. Graph. (Proc. SIGGRAPH 2013)","author":"Kim C.","year":"2013","unstructured":"Kim , C. , H. Zimmer , Y. Pritch , A. Sorkine-Hornung , and M. Gross . 2013. Scene Reconstruction from High Spatio-Angular Resolution Light Fields . ACM Trans. Graph. (Proc. SIGGRAPH 2013) 32, 4 ( 2013 ), 73:1--73:12. Kim, C., H. Zimmer, Y. Pritch, A. Sorkine-Hornung, and M. Gross. 2013. Scene Reconstruction from High Spatio-Angular Resolution Light Fields. ACM Trans. Graph. (Proc. SIGGRAPH 2013) 32, 4 (2013), 73:1--73:12."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1063\/1.1779954"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0049-9"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237199"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1141976"},{"key":"e_1_2_2_38_1","first-page":"446","article-title":"La photographie int\u00e9grale","volume":"146","author":"Lippmann G.","year":"1908","unstructured":"Lippmann , G. 1908 . La photographie int\u00e9grale . CR Acad. Sci. 146 (1908), 446 -- 451 . Lippmann, G. 1908. La photographie int\u00e9grale. CR Acad. Sci. 146 (1908), 446--451.","journal-title":"CR Acad. Sci."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.1999.790410"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461937"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-19315-6__26"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073256"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1078\/0030-4026-00186"},{"key":"e_1_2_2_44_1","doi-asserted-by":"crossref","unstructured":"Pock T. D. Cremers H. Bischof and A. Chambolle. 2010. Global Solutions of Variational Models with Convex Regularization. SIAM Journal on Imaging Sciences (2010).  Pock T. D. Cremers H. Bischof and A. Chambolle. 2010. Global Solutions of Variational Models with Convex Regularization. SIAM Journal on Imaging Sciences (2010).","DOI":"10.1137\/090757617"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360655"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15567-3_27"},{"key":"e_1_2_2_47_1","doi-asserted-by":"crossref","unstructured":"Taguchi Y. A. Agrawal A. Veeraraghavan S. Ramalingam and R. Raskar. 2010. Axial-Cones: Modeling Spherical Catadioptric Cameras for Wide-Angle Light Field Rendering. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2010) 29 6 (Dec 2010) 172:1--172:8.  Taguchi Y. A. Agrawal A. Veeraraghavan S. Ramalingam and R. Raskar. 2010. Axial-Cones: Modeling Spherical Catadioptric Cameras for Wide-Angle Light Field Rendering. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2010) 29 6 (Dec 2010) 172:1--172:8.","DOI":"10.1145\/1882261.1866194"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.89"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2004.11.002"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-014-0697-5"},{"key":"e_1_2_2_51_1","unstructured":"Vaish V. and others. 2008. The (New) Stanford Light Field Archive. (2008). http:\/\/lightfield.stanford.edu\/lfs.html.  Vaish V. and others. 2008. The (New) Stanford Light Field Archive. (2008). http:\/\/lightfield.stanford.edu\/lfs.html."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276463"},{"key":"e_1_2_2_53_1","doi-asserted-by":"crossref","unstructured":"Wang T.-C. A. Efros and R. Ramamoorthi. 2016. Depth estimation with occlusion modeling using light-field cameras. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) (2016).  Wang T.-C. A. Efros and R. Ramamoorthi. 2016. Depth estimation with occlusion modeling using light-field cameras. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) (2016).","DOI":"10.1109\/TPAMI.2016.2515615"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.147"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766885"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.311"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.2312\/vmv.20151271"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-012-0585-9"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073259"},{"key":"e_1_2_2_60_1","unstructured":"You S. R. T. Tan R. Kawakami Y. Mukaigawa and K. Ikeuchi. 2016. Waterdrop Stereo. CoRR (2016). arXiv:1604.00730v1  You S. R. T. Tan R. Kawakami Y. Mukaigawa and K. Ikeuchi. 2016. Waterdrop Stereo. CoRR (2016). arXiv:1604.00730v1"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3072959.3073589","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3072959.3073589","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:37:22Z","timestamp":1750217842000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3072959.3073589"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,7,20]]},"references-count":60,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,8,31]]}},"alternative-id":["10.1145\/3072959.3073589"],"URL":"https:\/\/doi.org\/10.1145\/3072959.3073589","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2017,7,20]]},"assertion":[{"value":"2017-07-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}