{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:46:26Z","timestamp":1777657586035,"version":"3.51.4"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2018,10,31]],"date-time":"2018-10-31T00:00:00Z","timestamp":1540944000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"H2020 Marie SkBodowska-Curie Actions","award":["765911"],"award-info":[{"award-number":["765911"]}]},{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["725253"],"award-info":[{"award-number":["725253"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004281","name":"Narodowe Centrum Nauki","doi-asserted-by":"publisher","award":["DEC-2013\/09\/B\/ST6\/02270"],"award-info":[{"award-number":["DEC-2013\/09\/B\/ST6\/02270"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,10,31]]},"abstract":"<jats:p>A large number of imaging and computer graphics applications require localized information on the visibility of image distortions. Existing image quality metrics are not suitable for this task as they provide a single quality value per image. Existing visibility metrics produce visual difference maps, and are specifically designed for detecting just noticeable distortions but their predictions are often inaccurate. In this work, we argue that the key reason for this problem is the lack of large image collections with a good coverage of possible distortions that occur in different applications. To address the problem, we collect an extensive dataset of reference and distorted image pairs together with user markings indicating whether distortions are visible or not. We propose a statistical model that is designed for the meaningful interpretation of such data, which is affected by visual search and imprecision of manual marking. We use our dataset for training existing metrics and we demonstrate that their performance significantly improves. We show that our dataset with the proposed statistical model can be used to train a new CNN-based metric, which outperforms the existing solutions. We demonstrate the utility of such a metric in visually lossless JPEG compression, super-resolution and watermarking.<\/jats:p>","DOI":"10.1145\/3196493","type":"journal-article","created":{"date-parts":[[2018,11,27]],"date-time":"2018-11-27T13:18:59Z","timestamp":1543324739000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Dataset and Metrics for Predicting Local Visible Differences"],"prefix":"10.1145","volume":"37","author":[{"given":"Krzysztof","family":"Wolski","sequence":"first","affiliation":[{"name":"MPI Informatik, Saarbr\u00fccken"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniele","family":"Giunchi","sequence":"additional","affiliation":[{"name":"University College London, Gower Street, London"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nanyang","family":"Ye","sequence":"additional","affiliation":[{"name":"University of Cambridge, JJ Thomson Avenue, Cambridge"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Piotr","family":"Didyk","sequence":"additional","affiliation":[{"name":"Saarland University, MMCI, MPI Informatik, Universit\u00e0 della Svizzera italiana, Lugano, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karol","family":"Myszkowski","sequence":"additional","affiliation":[{"name":"MPI Informatik, Saarbr\u00fccken"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rados\u0142aw","family":"Mantiuk","sequence":"additional","affiliation":[{"name":"West Pomeranian University of Technology, Szczecin"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hans-Peter","family":"Seidel","sequence":"additional","affiliation":[{"name":"MPI Informatik, Saarbr\u00fccken"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anthony","family":"Steed","sequence":"additional","affiliation":[{"name":"University College London, Gower Street, London"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2353-0349","authenticated-orcid":false,"given":"Rafa\u0142 K.","family":"Mantiuk","sequence":"additional","affiliation":[{"name":"University of Cambridge, JJ Thomson Avenue, Cambridge"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,11,26]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.396"},{"key":"e_1_2_2_2_1","volume-title":"Guetzli: Perceptually guided JPEG encoder. arXiv:1703.04421.","author":"Alakuijala Jyrki","year":"2017","unstructured":"Jyrki Alakuijala , Robert Obryk , Ostap Stoliarchuk , Zoltan Szabadka , Lode Vandevenne , and Jan Wassenberg . 2017 . Guetzli: Perceptually guided JPEG encoder. arXiv:1703.04421. Retrieved from https:\/\/arxiv.org\/abs\/1703.04421. Jyrki Alakuijala, Robert Obryk, Ostap Stoliarchuk, Zoltan Szabadka, Lode Vandevenne, and Jan Wassenberg. 2017. Guetzli: Perceptually guided JPEG encoder. arXiv:1703.04421. Retrieved from https:\/\/arxiv.org\/abs\/1703.04421."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1167\/14.8.22"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.2352\/J.ImagingSci.Technol.2016.60.6.060410"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360668"},{"key":"e_1_2_2_6_1","unstructured":"Simone Bianco Luigi Celona Paolo Napoletano and Raimondo Schettini. 2016. On the use of deep learning for blind image quality assessment. arXiv:1602.05531. Retrieved from https:\/\/arxiv.org\/abs\/1602.05531.  Simone Bianco Luigi Celona Paolo Napoletano and Raimondo Schettini. 2016. On the use of deep learning for blind image quality assessment. arXiv:1602.05531. Retrieved from https:\/\/arxiv.org\/abs\/1602.05531."},{"key":"e_1_2_2_7_1","volume-title":"International Conference on Quality of Multimedia Experience (QoMEX). IEEE.","author":"Bosse Sebastian","year":"2016","unstructured":"Sebastian Bosse , Dominique Maniry , Klaus-Robert Mueller , Thomas Wiegand , and Wojciech Samek . 2016 . Full-reference image quality assessment using neural networks . In International Conference on Quality of Multimedia Experience (QoMEX). IEEE. Sebastian Bosse, Dominique Maniry, Klaus-Robert Mueller, Thomas Wiegand, and Wojciech Samek. 2016. Full-reference image quality assessment using neural networks. In International Conference on Quality of Multimedia Experience (QoMEX). IEEE."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2760518"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2016.7533065"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/PCS.2016.7906376"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12248"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366166"},{"key":"e_1_2_2_13_1","volume-title":"Seven challenges in image quality assessment: Past, present, and future research. ISRN Signal Processing","author":"Chandler Damon M.","year":"2013","unstructured":"Damon M. Chandler . 2013. Seven challenges in image quality assessment: Past, present, and future research. ISRN Signal Processing ( 2013 ), Article ID 905685. Damon M. Chandler. 2013. Seven challenges in image quality assessment: Past, present, and future research. ISRN Signal Processing (2013), Article ID 905685."},{"key":"e_1_2_2_14_1","volume-title":"Digital Images and Human Vision","author":"Daly Scott","unstructured":"Scott Daly . 1993. The visible differences predictor: An algorithm for the assessment of image fidelity . In Digital Images and Human Vision . MIT Press , 179--206. Scott Daly. 1993. The visible differences predictor: An algorithm for the assessment of image fidelity. In Digital Images and Human Vision. MIT Press, 179--206."},{"key":"e_1_2_2_15_1","volume-title":"Human Vision, Visual Processing, and Digital Display III","author":"Daly Scott J.","unstructured":"Scott J. Daly . 1992. Visible differences predictor: An algorithm for the assessment of image fidelity . In Human Vision, Visual Processing, and Digital Display III , Vol. 1666 . International Society for Optics and Photonics , 2--16. Scott J. Daly. 1992. Visible differences predictor: An algorithm for the assessment of image fidelity. In Human Vision, Visual Processing, and Digital Display III, Vol. 1666. International Society for Optics and Photonics, 2--16."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03055.x"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.224"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2017.01.002"},{"key":"e_1_2_2_19_1","volume-title":"Hinton","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey E . Hinton . 2012 . ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25, F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger (Eds.). Curran Associates, Inc ., 1097--1105. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25, F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger (Eds.). Curran Associates, Inc., 1097--1105."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2011.01.005"},{"key":"e_1_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Jeffrey Lubin. 1995. A visual discrimination model for imaging system design and evaluation. In Vision Models for Target Detection and Recognition. World Scientific. 245--283.  Jeffrey Lubin. 1995. A visual discrimination model for imaging system design and evaluation. In Vision Models for Target Detection and Recognition. World Scientific. 245--283.","DOI":"10.1142\/9789812831200_0010"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964935"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2010.2043888"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2010.2040192"},{"key":"e_1_2_2_25_1","unstructured":"Sudam S. Panda M. S. R. S. Prasad and G. Jena. 2011. POCS based super-resolution image reconstruction using an adaptive regularization parameter. CoRR abs\/1112.1484. arXiv:1112.1484. Retrieved from https:\/\/arxiv.org\/abs\/1112.1484.  Sudam S. Panda M. S. R. S. Prasad and G. Jena. 2011. POCS based super-resolution image reconstruction using an adaptive regularization parameter. CoRR abs\/1112.1484. arXiv:1112.1484. Retrieved from https:\/\/arxiv.org\/abs\/1112.1484."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3047407"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2014.10.009"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2012.2191563"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2006.881959"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995446"},{"key":"e_1_2_2_31_1","volume-title":"Bovik","author":"Wang Zhou","year":"2006","unstructured":"Zhou Wang and Alan C . Bovik . 2006 . Modern Image Quality Assessment. Morgan 8 Claypool Publishers . Zhou Wang and Alan C. Bovik. 2006. Modern Image Quality Assessment. Morgan 8 Claypool Publishers."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2346028"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2011.2109730"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1889\/1.1985127"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3196493","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3196493","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:39:05Z","timestamp":1750210745000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3196493"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,31]]},"references-count":34,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2018,10,31]]}},"alternative-id":["10.1145\/3196493"],"URL":"https:\/\/doi.org\/10.1145\/3196493","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,31]]},"assertion":[{"value":"2018-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-11-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}