{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:36:35Z","timestamp":1760240195055,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2019,4,2]],"date-time":"2019-04-02T00:00:00Z","timestamp":1554163200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["642841"],"award-info":[{"award-number":["642841"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Shadow-retargeting maps depict the appearance of real shadows to virtual shadows given corresponding deformation of scene geometry, such that appearance is seamlessly maintained. By performing virtual shadow reconstruction from unoccluded real-shadow samples observed in the camera frame, this method efficiently recovers deformed shadow appearance. In this manuscript, we introduce a light-estimation approach that enables light-source detection using flat Fresnel lenses that allow this method to work without a set of pre-established conditions. We extend the adeptness of this approach by handling scenarios with multiple receiver surfaces and a non-grounded occluder with high accuracy. Results are presented on a range of objects, deformations, and illumination conditions in real-time Augmented Reality (AR) on a mobile device. We demonstrate the practical application of the method in generating otherwise laborious in-betweening frames for 3D printed stop-motion animation.<\/jats:p>","DOI":"10.3390\/computers8020029","type":"journal-article","created":{"date-parts":[[2019,4,3]],"date-time":"2019-04-03T03:39:28Z","timestamp":1554262768000},"page":"29","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Enhanced Shadow Retargeting with Light-Source Estimation Using Flat Fresnel Lenses"],"prefix":"10.3390","volume":"8","author":[{"given":"Llogari","family":"Casas Cambra","sequence":"first","affiliation":[{"name":"School of Computing, Edinburgh Napier University, Edinburgh EH10 5DT, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias","family":"Fauconneau","sequence":"additional","affiliation":[{"name":"School of Computing, Edinburgh Napier University, Edinburgh EH10 5DT, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maggie","family":"Kosek","sequence":"additional","affiliation":[{"name":"Centre for Vision, Speech and Signal Processing, University of Surrey, Guildford GU2 7XH, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kieran","family":"Mclister","sequence":"additional","affiliation":[{"name":"Edinburgh College of Art, University of Edinburgh, Edinburgh EH3 9DF, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2420-7447","authenticated-orcid":false,"given":"Kenny","family":"Mitchell","sequence":"additional","affiliation":[{"name":"School of Computing, Edinburgh Napier University, Edinburgh EH10 5DT, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,2]]},"reference":[{"key":"ref_1","unstructured":"Casas, L., Fauconneau, M., Kosek, M., Mclister, K., and Mitchell, K. (2018). Image Based Proximate Shadow Retargeting. Computer Graphics and Visual Computing (CGVC), The Eurographics Association."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Setlur, V., Takagi, S., Raskar, R., Gleicher, M., and Gooch, B. (2005, January 8\u201310). Automatic image retargeting. Proceedings of the ACM International Conference on Mobile and Ubiquitous Multimedia, Christchurch, New Zealand.","DOI":"10.1145\/1149488.1149499"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1915","DOI":"10.1109\/TPAMI.2011.272","article-title":"Context-Aware Saliency Detection","volume":"34","author":"Goferman","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1109\/TVCG.2006.78","article-title":"Real-time markerless tracking for augmented reality: The virtual visual servoing framework","volume":"12","author":"Comport","year":"2006","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_5","unstructured":"(2018, April 01). Vuforia Object Recognition. Available online: https:\/\/developer.vuforia.com\/."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Le\u00e3o, C.W.M., Lima, J.P., Teichrieb, V., Albuquerque, E.S., and Keiner, J. (2011, January 19\u201323). Altered reality: Augmenting and diminishing reality in real time. Proceedings of the IEEE Virtual Reality, Singapore.","DOI":"10.1109\/VR.2011.5759477"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Nowrouzezahrai, D., Geiger, S., Mitchell, K., Sumner, R., Jarosz, W., and Gross, M. (2011, January 26\u201329). Light Factorization for Mixed-Frequency Shadows in Augmented Reality. Proceedings of the 10th IEEE International Symposium on Mixed and Augmented Reality, ISMAR, Basel, Switzerland.","DOI":"10.1109\/ISMAR.2011.6092384"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Takeuchi, Y., and Perlin, K. (2012, January 5\u201310). ClayVision: The (elastic) image of the city. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, TX, USA.","DOI":"10.1145\/2207676.2208404"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1201","DOI":"10.1109\/TVCG.2015.2459871","article-title":"Live Texturing of Augmented Reality Characters from Colored Drawings","volume":"21","author":"Magnenat","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Casas, L., Kosek, M., and Mitchell, K. (2017, January 18\u201319). Props Alive: A Framework for Augmented Reality Stop Motion Animation. Proceedings of the 2017 IEEE 10th Workshop on Software Engineering and Architectures for Realtime Interactive Systems, Los Angeles, CA, USA.","DOI":"10.1109\/SEARIS41720.2017.9183487"},{"key":"ref_11","unstructured":"Mann, S. (2001). Fundamental issues in mediated reality, WearComp, and camera-based augmented reality. Fundamentals of Wearable Computers and Augmented Reality, Lawrence Erlbaum Associates."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. (2000, January 23\u201328). Image inpainting. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA.","DOI":"10.1145\/344779.344972"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1109\/TIP.2003.815261","article-title":"Simultaneous Structure and Texture Image Inpainting","volume":"12","author":"Bertalmio","year":"2003","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Herling, J., and Broll, W. (2012, January 5\u20138). PixMix: A real-time approach to high-quality Diminished Reality. Proceedings of the 11th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Atlanta, GA, USA.","DOI":"10.1109\/ISMAR.2012.6402551"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4623","DOI":"10.1109\/TIP.2015.2465159","article-title":"Shadow Remover: Image Shadow Removal Based on Illumination Recovering Optimization","volume":"24","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jarusirisawad, S., and Saito, H. (2007, January 25\u201328). Diminished reality via multiple hand-held cameras. Proceedings of the 2007 1st ACM\/IEEE International Conference on Distributed Smart Cameras, ICDSC, Vienna, Austria.","DOI":"10.1109\/ICDSC.2007.4357531"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kawai, N., Sato, T., and Yokoya, N. (2013, January 1\u20134). Diminished reality considering background structures. Proceedings of the 2013 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013, Adelaide, SA, Australia.","DOI":"10.1109\/ISMAR.2013.6671794"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mori, S. (2017, January 18\u201322). Diminished Hand: A Diminished Reality-Based Work Area Visualization. Proceedings of the 2017 IEEE Virtual Reality, Los Angeles, CA, USA.","DOI":"10.1109\/VR.2017.7892370"},{"key":"ref_19","unstructured":"Knecht, M., D\u00fcnser, A., Traxler, C., Wimmer, M., and Grasset, R. (2011, January 19). A Framework For Perceptual Studies in Photorealistic Augmented Reality. Proceedings of the 3rd IEEE VR 2011 Workshop on Perceptual Illusions in Virtual Environments, Singapore."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Calian, D., Mitchell, K., Nowrouzezahrai, D., and Kautz, J. (2013). The Shading Probe: Fast Appearance Acquisition for Mobile AR. SIGGRAPH Asia 2013 Technical Briefs, ACM.","DOI":"10.1145\/2542355.2542380"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1007\/s00371-007-0127-6","article-title":"Spatially varying image based lighting by light probe sequences: Capture, processing and rendering","volume":"23","author":"Unger","year":"2007","journal-title":"Vis. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ramamoorthi, R., and Hanrahan, P. (2001, January 12\u201317). An efficient representation for irradiance environment maps. Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2001, Los Angeles, CA, USA.","DOI":"10.1145\/383259.383317"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Jung, Y., Franke, T., D\u00e4hne, P., and Behr, J. (2007, January 15\u201318). Enhancing X3D for advanced MR appliances. Proceedings of the Twelfth International Conference on 3D Web Technology\u2014Web3D \u201907, Perugia, Italy.","DOI":"10.1145\/1229390.1229394"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Franke, T., and Jung, Y. (2008, January 9\u201310). Precomputed radiance transfer for X3D based mixed reality applications. Proceedings of the 13th international symposium on 3D web technology\u2014Web3D \u201908, Los Angeles, CA, USA.","DOI":"10.1145\/1394209.1394213"},{"key":"ref_25","unstructured":"Grosch, T. (2005). Differential Photon Mapping-Consistent Augmentation of Photographs with Correction of all Light Paths. Eurographics (Short Presentations), Available online: http:\/\/www.rendering.ovgu.de\/rendering_media\/downloads\/publications\/DifferentialPhotonMapEG05-p-45.pdf."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Grosch, T., Eble, T., and Mueller, S. (2007, January 5\u20137). Consistent interactive augmentation of live camera images with correct near-field illumination. Proceedings of the 2007 ACM Symp. Virtual Real. Softw. Technol.\u2014VRST \u201907, Newport Beach, CA, USA.","DOI":"10.1145\/1315184.1315207"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Knecht, M., and Mattausch, O. (2010, January 13\u201316). Differential Instant Radiosity for Mixed Reality. Proceedings of the 9th IEEE International Symposium on Mixed and Augmented Reality 2010, ISMAR 2010, Seoul, Korea.","DOI":"10.1109\/ISMAR.2010.5643556"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s11263-006-8815-7","article-title":"Photometric Stereo with General, Unknown Lighting","volume":"72","author":"Basri","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Knorr, S.B., and Kurz, D. (2014, January 10\u201312). Real-time illumination estimation from faces for coherent rendering. Proceedings of the ISMAR 2014\u2014IEEE International Symposium on Mixed and Augmented Reality, Munich, Germany.","DOI":"10.1109\/ISMAR.2014.6948416"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e1686","DOI":"10.1002\/cav.1686","article-title":"Interactive light source position estimation for augmented reality with an RGB-D camera","volume":"28","author":"Boom","year":"2017","journal-title":"Comput. Anim. Virtual Worlds"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Mandl, D., Yi, K.M., Mohr, P., Roth, P.M., Fua, P., Lepetit, V., Schmalstieg, D., and Kalkofen, D. (2017, January 9\u201313). Learning Lightprobes for Mixed Reality Illumination. Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Nantes, France.","DOI":"10.1109\/ISMAR.2017.25"},{"key":"ref_32","unstructured":"Sato, I., Sato, Y., and Ikeuchi, K. (1999, January 23\u201325). Illumination distribution from shadows. Proceedings of the Computer Vision and Pattern Recognition (CVPR), Fort Collins, CO, USA."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Haller, M., Drab, S., and Hartmann, W. (2003, January 1\u20133). A real-time shadow approach for an augmented reality application using shadow volumes. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, Osaka, Japan.","DOI":"10.1145\/1008653.1008665"},{"key":"ref_34","unstructured":"Jacobs, K., Nahmias, J.D., Angus, C., Reche, A., Loscos, C., and Steed, A. (2005, January 9\u201311). Automatic generation of consistent shadows for augmented reality. Proceedings of the ACM International Conference Proceeding Series, Victoria, BC, Canada."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Castro, T.K.D., Figueiredo, L.H.D., and Velho, L. (2012, January 28\u201331). Realistic shadows for mobile augmented reality. Proceedings of the 14th Symposium on Virtual and Augmented Reality, SVR 2012, Rio Janiero, Brazil.","DOI":"10.1109\/SVR.2012.9"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Debevec, P. (1998, January 11\u201315). Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-based Graphics with Global Illumination and High Dynamic Range Photography. Proceedings of the ACM SIGGRAPH \u201998 Proceeding, Los Angeles, CA, USA.","DOI":"10.1145\/280814.280864"},{"key":"ref_37","first-page":"82","article-title":"Me and My (Fake) Shadow","volume":"8","author":"Blinn","year":"1988","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1145\/15886.15902","article-title":"The Rendering Equation","volume":"20","author":"Kajiya","year":"1986","journal-title":"SIGGRAPH Comput. Graph."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Fernando, R. (2005). Percentage-closer Soft Shadows. ACM SIGGRAPH Sketches on SIGGRAPH, Available online: http:\/\/download.nvidia.com\/developer\/presentations\/2005\/SIGGRAPH\/Percentage_Closer_Soft_Shadows.pdf.","DOI":"10.1145\/1187112.1187153"},{"key":"ref_40","unstructured":"ARKit (2018, April 01). Apple ARKit. Available online: https:\/\/developer.apple.com\/arkit\/."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A Versatile and Accurate Monocular SLAM System","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_42","first-page":"1","article-title":"Image-based Bidirectional Scene Reprojection","volume":"30","author":"Yang","year":"2011","journal-title":"ACM Trans. Graph."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/8\/2\/29\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:42:24Z","timestamp":1760186544000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/8\/2\/29"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,2]]},"references-count":42,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,6]]}},"alternative-id":["computers8020029"],"URL":"https:\/\/doi.org\/10.3390\/computers8020029","relation":{},"ISSN":["2073-431X"],"issn-type":[{"type":"electronic","value":"2073-431X"}],"subject":[],"published":{"date-parts":[[2019,4,2]]}}}