{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T10:02:37Z","timestamp":1751536957475},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,9,16]],"date-time":"2022-09-16T00:00:00Z","timestamp":1663286400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,9,16]],"date-time":"2022-09-16T00:00:00Z","timestamp":1663286400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["SIViP"],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Modelling the mapping from scene irradiance to image intensity is essential for many computer vision tasks. Such mapping is known as the camera response. Most digital cameras use a nonlinear function to map irradiance, as measured by the sensor to an image intensity used to record the photograph. Modelling of the response is necessary for the nonlinear calibration. In this paper, a new high-performance camera response model that uses a single latent variable and fully connected neural network is proposed. The model is produced using unsupervised learning with an autoencoder on real-world (example) camera responses. Neural architecture searching is then used to find the optimal neural network architecture. A latent distribution learning approach was introduced to constrain the latent distribution. The proposed model achieved state-of-the-art CRF representation accuracy in a number of benchmark tests, but is over twice as fast as the best current models when performing the maximum likelihood estimation during camera response calibration due to the simple yet efficient model representation.<\/jats:p>","DOI":"10.1007\/s11760-022-02351-8","type":"journal-article","created":{"date-parts":[[2022,9,16]],"date-time":"2022-09-16T12:04:46Z","timestamp":1663329886000},"page":"1429-1437","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Representing Camera Response Function by a Single Latent Variable and Fully Connected Neural Network"],"prefix":"10.1007","volume":"17","author":[{"given":"Yunfeng","family":"Zhao","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stuart","family":"Ferguson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huiyu","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karen","family":"Rafferty","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,9,16]]},"reference":[{"key":"2351_CR1","doi-asserted-by":"publisher","unstructured":"Ng, T.T., Tsui, M.P.: Camera response function signature for digital forensics - Part I: Theory and data selection. In: Proceedings of the 2009 1st IEEE International Workshop on Information Forensics and Security, WIFS 2009, pp. 156\u2013160 (2009). https:\/\/doi.org\/10.1109\/WIFS.2009.5386464","DOI":"10.1109\/WIFS.2009.5386464"},{"issue":"10","key":"2351_CR2","doi-asserted-by":"publisher","first-page":"1272","DOI":"10.1109\/TPAMI.2004.88","volume":"26","author":"MD Grossberg","year":"2004","unstructured":"Grossberg, M.D., Nayar, S.K.: Modeling the space of camera response functions. IEEE Trans. Pattern Anal. Machine Intell. 26(10), 1272\u20131282 (2004). https:\/\/doi.org\/10.1109\/TPAMI.2004.88","journal-title":"IEEE Trans. Pattern Anal. Machine Intell."},{"key":"2351_CR3","doi-asserted-by":"publisher","unstructured":"Fu, L., Qi, Y.: Camera response function estimation and application with a single image. In: Lecture Notes in Electrical Engineering, vol. 133 LNEE, pp. 149\u2013156. Springer (2011). https:\/\/doi.org\/10.1007\/978-3-642-25992-0_21","DOI":"10.1007\/978-3-642-25992-0_21"},{"key":"2351_CR4","doi-asserted-by":"publisher","unstructured":"Ng, T.-t., Chang, S.-f., Tsui, M.-P.: Using geometry invariants for camera response function estimation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1\u20138. IEEE (2007). https:\/\/doi.org\/10.1109\/CVPR.2007.383000","DOI":"10.1109\/CVPR.2007.383000"},{"issue":"4","key":"2351_CR5","doi-asserted-by":"publisher","first-page":"562","DOI":"10.1109\/TPAMI.2007.70732","volume":"30","author":"SJ Kim","year":"2008","unstructured":"Kim, S.J., Pollefeys, M.: Robust radiometric calibration and vignetting correction. IEEE Trans. Pattern Anal. Machine Intell. 30(4), 562\u2013576 (2008). https:\/\/doi.org\/10.1109\/TPAMI.2007.70732","journal-title":"IEEE Trans. Pattern Anal. Machine Intell."},{"issue":"8","key":"2351_CR6","doi-asserted-by":"publisher","first-page":"1389","DOI":"10.1109\/83.855434","volume":"9","author":"S Mann","year":"2000","unstructured":"Mann, S.: Comparametric equations with practical applications in quantigraphic image processing. IEEE Trans. Image Process. 9(8), 1389\u20131406 (2000). https:\/\/doi.org\/10.1109\/83.855434","journal-title":"IEEE Trans. Image Process."},{"issue":"10","key":"2351_CR7","doi-asserted-by":"publisher","first-page":"2498","DOI":"10.1109\/TPAMI.2013.40","volume":"35","author":"YW Tai","year":"2013","unstructured":"Tai, Y.W., Chen, X., Kim, S., Kim, S.J., Li, F., Yang, J., Yu, J., Matsushita, Y., Brown, M.S.: Nonlinear camera response functions and image deblurring: Theoretical analysis and practice. IEEE Trans. Pattern Anal. Machine Intell. 35(10), 2498\u20132512 (2013). https:\/\/doi.org\/10.1109\/TPAMI.2013.40","journal-title":"IEEE Trans. Pattern Anal. Machine Intell."},{"key":"2351_CR8","doi-asserted-by":"publisher","unstructured":"Li, H., Peers, P.: CRF-net: Single image radiometric calibration using CNNs. In: ACM International Conference Proceeding Series. Association for Computing Machinery (2017). https:\/\/doi.org\/10.1145\/3150165.3150170","DOI":"10.1145\/3150165.3150170"},{"key":"2351_CR9","doi-asserted-by":"publisher","unstructured":"Lin, S., Zhang, L.: Determining the radiometric response function from a single grayscale image II, 66\u201373 (2005). https:\/\/doi.org\/10.1109\/CVPR.2005.128","DOI":"10.1109\/CVPR.2005.128"},{"key":"2351_CR10","doi-asserted-by":"publisher","unstructured":"Bergmann, P., Wang, R., Cremers, D.: Online Photometric Calibration of Auto Exposure Video for Realtime Visual Odometry and SLAM. IEEE Robotics and Automation Letters 3(2), 627\u2013634 (2018) arXiv:1710.02081. https:\/\/doi.org\/10.1109\/LRA.2017.2777002","DOI":"10.1109\/LRA.2017.2777002"},{"key":"2351_CR11","doi-asserted-by":"publisher","unstructured":"Matsushita, Y., Lin, S.: Radiometric calibration from noise distributions. (2007). https:\/\/doi.org\/10.1109\/CVPR.2007.383213","DOI":"10.1109\/CVPR.2007.383213"},{"key":"2351_CR12","doi-asserted-by":"publisher","unstructured":"Seon, J.K., Frahm, J.M., Pollefeys, M.: Radiometric calibration with illumination change for outdoor scene analysis. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2008). https:\/\/doi.org\/10.1109\/CVPR.2008.4587648","DOI":"10.1109\/CVPR.2008.4587648"},{"key":"2351_CR13","doi-asserted-by":"publisher","unstructured":"Zhao, Y., Elliott, C., Zhou, H., Rafferty, K.: Spectral illumination correction: Achieving relative color constancy under the spectral domain. In: IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), pp. 690\u2013695. IEEE (2018). https:\/\/doi.org\/10.1109\/ISSPIT.2018.8642637","DOI":"10.1109\/ISSPIT.2018.8642637"},{"issue":"10","key":"2351_CR14","doi-asserted-by":"publisher","first-page":"1428","DOI":"10.1109\/83.951529","volume":"10","author":"H Farid","year":"2001","unstructured":"Farid, H.: Blind inverse gamma correction. IEEE Trans. Image Process. 10(10), 1428\u20131433 (2001). https:\/\/doi.org\/10.1109\/83.951529","journal-title":"IEEE Trans. Image Process."},{"key":"2351_CR15","doi-asserted-by":"publisher","unstructured":"Rodrigues, P., Barreto, J.P.: Single-image estimation of the camera response function in near-lighting. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1028\u20131036. IEEE Computer Society (2015). https:\/\/doi.org\/10.1109\/CVPR.2015.7298705","DOI":"10.1109\/CVPR.2015.7298705"},{"key":"2351_CR16","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1016\/j.neucom.2020.04.057","volume":"404","author":"D Charte","year":"2020","unstructured":"Charte, D., Charte, F., del Jesus, M.J., Herrera, F.: An analysis on the use of autoencoders for representation learning: Fundamentals, learning task case studies, explainability and challenges. Neurocomput. 404, 93\u2013107 (2020)","journal-title":"Neurocomput."},{"key":"2351_CR17","first-page":"3","volume":"6","author":"GE Hinton","year":"1994","unstructured":"Hinton, G.E., Zemel, R.S.: Autoencoders, minimum description length, and Helmholtz free energy. Adv. Neural Inform. Process. Syst. 6, 3\u201310 (1994)","journal-title":"Adv. Neural Inform. Process. Syst."},{"key":"2351_CR18","unstructured":"Makhzani, A., Shlens, J., Jaitly, N., Goodfellow, I., Frey, B.: Adversarial Autoencoders (2015) arXiv:1511.05644"},{"key":"2351_CR19","doi-asserted-by":"publisher","unstructured":"Beggel, L., Pfeiffer, M., Bischl, B.: Robust Anomaly Detection in Images Using Adversarial Autoencoders. In: Lecture Notes in Computer Science (including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11906 LNAI, pp. 206\u2013222. Springer (2020). https:\/\/doi.org\/10.1007\/978-3-030-46150-8_13","DOI":"10.1007\/978-3-030-46150-8_13"},{"key":"2351_CR20","unstructured":"Kingma, D.P., Welling, M.: Auto-Encoding Variational Bayes (2014)"},{"key":"2351_CR21","doi-asserted-by":"crossref","unstructured":"Elsken, T., Metzen, J.H., Hutter, F.: Neural Architecture Search: A Survey. arXiv 20, 1\u201321 (2018) arXiv:1808.05377","DOI":"10.1007\/978-3-030-05318-5_11"},{"issue":"1","key":"2351_CR22","first-page":"1929","volume":"15","author":"N Srivastava","year":"2014","unstructured":"Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929\u20131958 (2014)","journal-title":"J. Mach. Learn. Res."},{"key":"2351_CR23","unstructured":"Liashchynskyi, P., Liashchynskyi, P.: Grid Search, Random Search, Genetic Algorithm: A Big Comparison for NAS (2019) arXiv:1912.06059"},{"key":"2351_CR24","doi-asserted-by":"crossref","unstructured":"Chakrabarti, A., Scharstein, D., Zickler, T.E.: An Empirical Camera Model for Internet Color Vision. In: Proceedings of the British Machine Vision Conference, vol. 1, p. 4 (2009). Citeseer","DOI":"10.5244\/C.23.51"},{"key":"2351_CR25","doi-asserted-by":"publisher","unstructured":"Lin, S., Jinwei Gu, Yamazaki, S., Heung-Yeung Shum: Radiometric calibration from a single image. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 938\u2013945. IEEE (2004). https:\/\/doi.org\/10.1109\/CVPR.2004.1315266","DOI":"10.1109\/CVPR.2004.1315266"},{"key":"2351_CR26","doi-asserted-by":"publisher","unstructured":"Sharma, A., Tan, R.T., Cheong, L.-F.: Single-Image Camera Response Function Using Prediction Consistency and Gradual Refinement. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12627 LNCS, 19\u201335 (2020). https:\/\/doi.org\/10.1007\/978-3-030-69544-6_2","DOI":"10.1007\/978-3-030-69544-6_2"},{"key":"2351_CR27","doi-asserted-by":"publisher","unstructured":"Gehler, P.V., Rother, C., Blake, A., Minka, T., Sharp, T.: Bayesian color constancy revisited. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2008). https:\/\/doi.org\/10.1109\/CVPR.2008.4587765","DOI":"10.1109\/CVPR.2008.4587765"},{"key":"2351_CR28","doi-asserted-by":"publisher","unstructured":"Grana, C., Pellacani, G., Seidenari, S., Cucchiara, R.: Color calibration for a dermatological video camera system. In: Proceedings - International Conference on Pattern Recognition, vol. 3, pp. 798\u2013801 (2004). https:\/\/doi.org\/10.1109\/ICPR.2004.1334649","DOI":"10.1109\/ICPR.2004.1334649"}],"container-title":["Signal, Image and Video Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11760-022-02351-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11760-022-02351-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11760-022-02351-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,24]],"date-time":"2023-04-24T16:21:52Z","timestamp":1682353312000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11760-022-02351-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,16]]},"references-count":28,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["2351"],"URL":"https:\/\/doi.org\/10.1007\/s11760-022-02351-8","relation":{},"ISSN":["1863-1703","1863-1711"],"issn-type":[{"value":"1863-1703","type":"print"},{"value":"1863-1711","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,16]]},"assertion":[{"value":"14 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 June 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 August 2022","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 September 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Consent has been obtained from the authors for the publication.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}}]}}