{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T02:24:52Z","timestamp":1783995892502,"version":"3.55.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,7,16]],"date-time":"2021-07-16T00:00:00Z","timestamp":1626393600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Indonesian-Austrian Scholarship Program"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Comput. Cult. Herit."],"published-print":{"date-parts":[[2021,12,31]]},"abstract":"<jats:p>This article investigates the limitations of single image depth prediction (SIDP) under different lighting conditions. Besides that, it also offers a new approach to obtain the ideal condition for SIDP. To satisfy the data requirement, we exploit a photometric stereo dataset consisting of several images of an object under different light properties. In this work, we used a dataset of ancient Roman coins captured under 54 different lighting conditions to illustrate how the approach is affected by them. This dataset emulates many lighting variances with a different state of shading and reflectance common in the natural environment. The ground truth depth data in the dataset was obtained using the stereo photometric method and used as training data. We investigated the capabilities of three different state-of-the-art methods to reconstruct ancient Roman coins with different lighting scenarios. The first investigation compares the performance of a given network using previously trained data to check cross-domains performance. Second, the model is fine-tuned from pre-trained data and trained using 70% of the ancient Roman coin dataset. Both models are tested on the remaining 30% of the data. As evaluation metrics, root mean square error and visual inspection are used. As a result, the methods show different characteristic results based on the lighting condition of the test data. Overall, they perform better at 51\u00b0 and 71\u00b0 angles of light, so-called ideal condition afterward. However, they perform worse at 13\u00b0 and 32\u00b0 because of the high density of shadows. They also cannot reach the best performance at 82\u00b0 caused by the reflection that appears on the image. Based on these findings, we propose a new approach to reduce the shadows and reflections on the image using intrinsic image decomposition to achieve a synthetic ideal condition. Based on the results of synthetic images, this approach can enhance the performance of SIDP. For some state-of-the-art methods, it also achieves better results than previous original RGB images.<\/jats:p>","DOI":"10.1145\/3465742","type":"journal-article","created":{"date-parts":[[2021,7,16]],"date-time":"2021-07-16T10:06:48Z","timestamp":1626430008000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Investigation of Single Image Depth Prediction Under Different Lighting Conditions"],"prefix":"10.1145","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7512-2043","authenticated-orcid":false,"given":"Aufaclav Zatu Kusuma","family":"Frisky","sequence":"first","affiliation":[{"name":"Computer Vision Lab, Institute of Visual Computing and Human-Centered Technology, TU Wien, Austria and Electronics and Instrumentation Lab, Department of Computer Science and Electronics, Universitas Gadjah Mada, Yogyakarta, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Agus","family":"Harjoko","sequence":"additional","affiliation":[{"name":"Electronics and Instrumentation Lab, Department of Computer Science and Electronics, Universitas Gadjah Mada, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0063-9571","authenticated-orcid":false,"given":"Lukman","family":"Awaludin","sequence":"additional","affiliation":[{"name":"Electronics and Instrumentation Lab, Department of Computer Science and Electronics, Universitas Gadjah Mada, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Zambanini","sequence":"additional","affiliation":[{"name":"Computer Vision Lab, Institute of Visual Computing and Human-Centered Technology, TU Wien, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Sablatnig","sequence":"additional","affiliation":[{"name":"Computer Vision Lab, Institute of Visual Computing and Human-Centered Technology, TU Wien, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,7,16]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 2nd International Conference on Image, Vision, and Computing (ICIVC\u201917)","author":"Fan Baijiang","year":"2017"},{"key":"e_1_2_1_2_1","volume-title":"CathNets: Detection and single-view depth prediction of catheter electrodes","author":"Baur Christoph"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage. https:\/\/doi.org\/10","author":"Brenner Simon","year":"2018"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2017.2740321"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2699184"},{"key":"e_1_2_1_6_1","volume-title":"Advances in Neural Information Processing Systems 27. Curran Associates","author":"Eigen David"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.264"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5220\/0008964907920799"},{"key":"e_1_2_1_9_1","series-title":"Lecture Notes in Computer Science","volume-title":"Pattern Recognition. ICPR International Workshops and Challenges","author":"Frisky Aufaclav","year":"2079"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00214"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364913491297"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. 3354\u20133361","author":"Geiger A."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the IEEE 11th International Conference on Computer Vision. 1\u20138.","author":"Goesele M."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.102"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.11591\/ijece.v9i4.pp2394-2402"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2832296"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01267-0_4"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_9"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of ECCV Workshops. 1\u201317","author":"Koch Tobias","year":"2018"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.401"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 2016 4th International Conference on 3D Vision (3DV\u201916)","author":"Laina I."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00996"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13578"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2505283"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.338"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915)","author":"Menze M."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33715-4_54"},{"key":"e_1_2_1_29_1","first-page":"443","article-title":"A robust hybrid of lasso and ridge regression","volume":"1","author":"Owen Art B.","year":"2007","journal-title":"Contemporary Mathematics"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201914)","author":"Oxholm G."},{"key":"e_1_2_1_31_1","volume-title":"Methods and Applications for Modeling and Simulation of Complex Systems","author":"Pan Jiao"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage. 207\u2013210","author":"Pan Jiao","year":"2018"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915)","author":"Wang Peng"},{"key":"e_1_2_1_34_1","article-title":"Solving uncalibrated photometric stereo using total variation","author":"Queau Yvain","year":"2014","journal-title":"Journal of Mathematical Imaging and Vision 52"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00266"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.132"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2015.39"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops\u201911)","author":"Silberman N."},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV\u201905)","volume":"1","author":"Vogiatzis G."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906)","volume":"2","author":"White R.","year":"1809"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2839602"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 3684\u20133692","author":"Yang M."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV\u201919)","author":"Yin W."},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917)","author":"Zhang Y."}],"container-title":["Journal on Computing and Cultural Heritage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3465742","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3465742","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:18Z","timestamp":1750191498000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3465742"}},"subtitle":["A Case Study of Ancient Roman Coins"],"short-title":[],"issued":{"date-parts":[[2021,7,16]]},"references-count":45,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,12,31]]}},"alternative-id":["10.1145\/3465742"],"URL":"https:\/\/doi.org\/10.1145\/3465742","relation":{},"ISSN":["1556-4673","1556-4711"],"issn-type":[{"value":"1556-4673","type":"print"},{"value":"1556-4711","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,16]]},"assertion":[{"value":"2020-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}