{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T18:18:48Z","timestamp":1761157128844,"version":"3.37.3"},"reference-count":33,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2021,6,15]],"date-time":"2021-06-15T00:00:00Z","timestamp":1623715200000},"content-version":"vor","delay-in-days":1,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100014188","name":"MSIT","doi-asserted-by":"publisher","award":["2020R1A2B5B03002005"],"award-info":[{"award-number":["2020R1A2B5B03002005"]}],"id":[{"id":"10.13039\/501100014188","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,6,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>This paper introduces a novel deep-learning-based photometric stereo method that uses superresolution (SR) images: SR photometric stereo. Recent deep-learning-based SR algorithms have yielded great results in terms of enlarging images without mosaic effects. Supposing that the SR algorithms successfully enhance the feature and colour information of original images, implementing SR images using the photometric stereo method facilitates the use of considerably more information on the object than existing photometric stereo methods. We built a novel deep-learning-based network for the photometric stereo technique to optimize the input\u2013output of SR image inputs and normal map outputs. We tested our network using the most widely used benchmark dataset and obtained better results than existing photometric stereo methods.<\/jats:p>","DOI":"10.1093\/jcde\/qwab025","type":"journal-article","created":{"date-parts":[[2021,4,13]],"date-time":"2021-04-13T21:44:21Z","timestamp":1618350261000},"page":"995-1012","source":"Crossref","is-referenced-by-count":7,"title":["SRPS\u2013deep-learning-based photometric stereo using superresolution images"],"prefix":"10.1093","volume":"8","author":[{"given":"Euijeong","family":"Song","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Korea University, Seoul 02841, Korea"}]},{"given":"Seokjung","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Korea University, Seoul 02841, Korea"}]},{"given":"Seok","family":"Chung","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Korea University, Seoul 02841, Korea"},{"name":"KU-KIST Graduate School of Converging Science and Technology, Seoul 02841, Korea"}]},{"given":"Minho","family":"Chang","sequence":"additional","affiliation":[{"name":"Medit Corp., Seoul 02855, Korea"}]}],"member":"286","published-online":{"date-parts":[[2021,6,14]]},"reference":[{"key":"2021073111501675300_bib1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/CVPR.2008.4587656","article-title":"Photometric stereo with non-parametric and spatially-varying reflectance","volume-title":"2008 IEEE Conference on Computer Vision and Pattern Recognition","author":"Alldrin","year":"2008"},{"key":"2021073111501675300_bib2","first-page":"3","article-title":"PS-FCN: A flexible learning framework for photometric stereo","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV)","author":"Chen","year":"2018"},{"key":"2021073111501675300_bib4","doi-asserted-by":"crossref","DOI":"10.1109\/TPAMI.2020.3005397","article-title":"Deep photometric stereo for non-Lambertian surfaces","author":"Chen","year":"2020","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2021073111501675300_bib3","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1109\/TPAMI.2019.2927909","article-title":"A microfacet-based model for photometric stereo with general isotropic reflectance","volume":"43","author":"Chen","year":"2019","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2021073111501675300_bib6","first-page":"184","article-title":"Learning a deep convolutional network for image super-resolution","volume-title":"European Conference on Computer Vision","author":"Dong","year":"2014"},{"key":"2021073111501675300_bib7","first-page":"183","article-title":"Relighting human locomotion with flowed reflectance fields","volume-title":"Proceedings of the Eurographics Conference on Rendering Techniques","author":"Einarsson","year":"2006"},{"key":"2021073111501675300_bib8","doi-asserted-by":"crossref","first-page":"3079","DOI":"10.1364\/JOSAA.11.003079","article-title":"Photometric stereo under a light source with arbitrary motion","volume":"11","author":"Hayakawa","year":"1994","journal-title":"Journal of the Optical Society of America A"},{"key":"2021073111501675300_bib9","first-page":"770","article-title":"Deep residual learning for image recognition","volume-title":"Proceedings of the IEEE conference on Computer Vision and Pattern Recognition","author":"He","year":"2016"},{"key":"2021073111501675300_bib11","first-page":"3","article-title":"CNN-PS: CNN-based photometric stereo for general non-convex surfaces","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV)","author":"Ikehata","year":"2018"},{"key":"2021073111501675300_bib10","first-page":"2179","article-title":"Photometric stereo using constrained bivariate regression for general isotropic surfaces","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Ikehata","year":"2014"},{"key":"2021073111501675300_bib12","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1109\/PBMCV.1995.514676","article-title":"Principal components analysis and neural network implementation of photometric stereo","volume-title":"Proceedings of the Workshop on Physics-Based Modeling in Computer Vision","author":"Iwahori","year":"1995"},{"key":"2021073111501675300_bib13","doi-asserted-by":"crossref","first-page":"107475","DOI":"10.1016\/j.patcog.2020.107475","article-title":"Hierarchical dense recursive network for image super-resolution","volume":"107","author":"Jiang","year":"2020","journal-title":"Pattern Recognition"},{"key":"2021073111501675300_bib14","first-page":"2260","article-title":"Light field spatial super-resolution via deep combinatorial geometry embedding and structural consistency regularization","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Jin","year":"2020"},{"volume-title":"Deep learning for humans","year":"2015","author":"Keras","key":"2021073111501675300_bib5"},{"key":"2021073111501675300_bib15","first-page":"1646","article-title":"Accurate image super-resolution using very deep convolutional networks","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Kim","year":"2016"},{"volume-title":"Adam: A method for stochastic optimization","year":"2014","author":"Kingma","key":"2021073111501675300_bib16"},{"key":"2021073111501675300_bib17","first-page":"7568","article-title":"Learning to minify photometric stereo","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Li","year":"2019"},{"key":"2021073111501675300_bib18","first-page":"136","article-title":"Enhanced deep residual networks for single image super-resolution","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops","author":"Lim","year":"2017"},{"key":"2021073111501675300_bib19","first-page":"177","article-title":"Superresolution blind reconstruction of low-resolution images using wavelets based fusion","volume":"40","author":"","year":"2008","journal-title":"World Academy of Science, Engineering and Technology"},{"key":"2021073111501675300_bib20","doi-asserted-by":"crossref","first-page":"23","DOI":"10.9790\/2834-0552333","article-title":"Survey on single image super resolution techniques","volume":"5","author":"Makwana","year":"2013","journal-title":"IOSR Journal of Electronics and Communication Engineering (IOSR-JECE)"},{"key":"2021073111501675300_bib21","first-page":"5690","article-title":"Image super-resolution with cross-scale non-local attention and exhaustive self-exemplars mining","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Mei","year":"2020"},{"key":"2021073111501675300_bib22","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1109\/CSNT.2011.106","article-title":"Hybrid approach for single image super resolution using ISEF and IBP","volume-title":"2011 International Conference on Communication Systems and Network Technologies","author":"Patel","year":"2011"},{"key":"2021073111501675300_bib23","first-page":"234","article-title":"U-net: Convolutional networks for biomedical image segmentation","volume-title":"International Conference on Medical Image Computing and Computer-Assisted Intervention","author":"Ronneberger","year":"2015"},{"key":"2021073111501675300_bib24","first-page":"501","article-title":"Deep photometric stereo network","volume-title":"Proceedings of the IEEE International Conference on Computer Vision Workshops","author":"Santo","year":"2017"},{"key":"2021073111501675300_bib25","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.1109\/TPAMI.2013.196","article-title":"Bi-polynomial modeling of low-frequency reflectances","volume":"36","author":"Shi","year":"2013","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2021073111501675300_bib26","first-page":"3707","article-title":"A benchmark dataset and evaluation for non-Lambertian and uncalibrated photometric stereo","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Shi","year":"2016"},{"key":"2021073111501675300_bib27","doi-asserted-by":"crossref","first-page":"191139","DOI":"10.1117\/12.7972479","article-title":"Photometric method for determining surface orientation from multiple images","volume":"19","author":"Woodham","year":"1980","journal-title":"Optical Engineering"},{"key":"2021073111501675300_bib28","doi-asserted-by":"crossref","DOI":"10.1109\/TPAMI.2020.2982166","article-title":"Deep learning for image super-resolution: A survey","volume-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence","author":"Wang","year":"2020"},{"key":"2021073111501675300_bib29","first-page":"703","article-title":"Robust photometric stereo via low-rank matrix completion and recovery","volume-title":"Asian Conference on Computer Vision","author":"Wu","year":"2010"},{"key":"2021073111501675300_bib30","first-page":"286","article-title":"Image super-resolution using very deep residual channel attention networks","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV)","author":"Zhang","year":"2018"},{"key":"2021073111501675300_bib31","doi-asserted-by":"crossref","first-page":"2817","DOI":"10.1109\/ICIP.2010.5651488","article-title":"Wavelet-based nonlocal-means super resolution for video sequences","volume-title":"Proceedings of 2010 IEEE 17th International Conference on Image Processing","author":"Zheng","year":"2010"},{"key":"2021073111501675300_bib32","first-page":"8549","article-title":"SPLINE-Net: Sparse photometric stereo through lighting interpolation and normal estimation networks","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Zheng","year":"2019"},{"key":"2021073111501675300_bib33","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.vrih.2020.03.001","article-title":"Summary study of data-driven photometric stereo methods","volume":"2","author":"Zheng","year":"2020","journal-title":"Virtual Reality & Intelligent Hardware"}],"container-title":["Journal of Computational Design and Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jcde\/article-pdf\/8\/4\/995\/39505518\/qwab025.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jcde\/article-pdf\/8\/4\/995\/39505518\/qwab025.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,31]],"date-time":"2021-07-31T11:51:15Z","timestamp":1627732275000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jcde\/article\/8\/4\/995\/6299054"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,14]]},"references-count":33,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,6,14]]}},"URL":"https:\/\/doi.org\/10.1093\/jcde\/qwab025","relation":{},"ISSN":["2288-5048"],"issn-type":[{"type":"electronic","value":"2288-5048"}],"subject":[],"published-other":{"date-parts":[[2021,8]]},"published":{"date-parts":[[2021,6,14]]}}}