{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T06:07:26Z","timestamp":1784268446858,"version":"3.55.0"},"reference-count":72,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T00:00:00Z","timestamp":1626652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["725253"],"award-info":[{"award-number":["725253"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>FovVideoVDP is a video difference metric that models the spatial, temporal, and peripheral aspects of perception. While many other metrics are available, our work provides the first practical treatment of these three central aspects of vision simultaneously. The complex interplay between spatial and temporal sensitivity across retinal locations is especially important for displays that cover a large field-of-view, such as Virtual and Augmented Reality displays, and associated methods, such as foveated rendering. Our metric is derived from psychophysical studies of the early visual system, which model spatio-temporal contrast sensitivity, cortical magnification and contrast masking. It accounts for physical specification of the display (luminance, size, resolution) and viewing distance. To validate the metric, we collected a novel foveated rendering dataset which captures quality degradation due to sampling and reconstruction. To demonstrate our algorithm's generality, we test it on 3 independent foveated video datasets, and on a large image quality dataset, achieving the best performance across all datasets when compared to the state-of-the-art.<\/jats:p>","DOI":"10.1145\/3450626.3459831","type":"journal-article","created":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T00:04:26Z","timestamp":1626739466000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":154,"title":["FovVideoVDP"],"prefix":"10.1145","volume":"40","author":[{"given":"Rafa\u0142 K.","family":"Mantiuk","sequence":"first","affiliation":[{"name":"University of Cambridge"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gyorgy","family":"Denes","sequence":"additional","affiliation":[{"name":"University of Cambridge"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandre","family":"Chapiro","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anton","family":"Kaplanyan","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gizem","family":"Rufo","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Romain","family":"Bachy","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Trisha","family":"Lian","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anjul","family":"Patney","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,7,19]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882261.1866187"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559755.1559757"},{"key":"e_1_2_2_3_1","volume-title":"Contrast sensitivity of the human eye and its effects on image quality","author":"Barten Peter G. J.","unstructured":"Peter G. J. Barten . 1999. Contrast sensitivity of the human eye and its effects on image quality . SPIE Press . 208 pages. Peter G. J. Barten. 1999. Contrast sensitivity of the human eye and its effects on image quality. SPIE Press. 208 pages."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.537476"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/0141-9382(96)01011-6"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.70.001121"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCOM.1983.1095851"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338696"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.135952"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.320110"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(82)90113-4"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392411"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1167\/3.10.1"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-8914(52)80230-7"},{"key":"e_1_2_2_15_1","volume-title":"Human luminance pattern-vision mechanisms: masking experiments require a new model. Journal of the Optical Society of America A","author":"Foley J. M.","year":"1994","unstructured":"J. M. Foley . 1994. Human luminance pattern-vision mechanisms: masking experiments require a new model. Journal of the Optical Society of America A ( 1994 ). J. M. Foley. 1994. Human luminance pattern-vision mechanisms: masking experiments require a new model. Journal of the Optical Society of America A (1994)."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.320120"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.1975.sp011162"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366183"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(92)90139-A"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(79)90227-X"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1001\/archopht.1991.01080060080030"},{"key":"e_1_2_2_22_1","volume-title":"Scope of validity of PSNR in image\/video quality assessment. Electronics letters 44, 13","author":"Huynh-Thu Quan","year":"2008","unstructured":"Quan Huynh-Thu and Mohammed Ghanbari . 2008. Scope of validity of PSNR in image\/video quality assessment. Electronics letters 44, 13 ( 2008 ), 800--801. Quan Huynh-Thu and Mohammed Ghanbari. 2008. Scope of validity of PSNR in image\/video quality assessment. Electronics letters 44, 13 (2008), 800--801."},{"key":"e_1_2_2_23_1","volume-title":"Zhaolin Wan, and Alan Bovik.","author":"Jin Yize","year":"2020","unstructured":"Yize Jin , Meixu Chen , Todd Goodall Bell , Zhaolin Wan, and Alan Bovik. 2020 . Study of 2D foveated video quality in virtual reality. In Applications of Digital Image Processing XLIII, Vol. 11510 . International Society for Optics and Photonics , 1151007. Yize Jin, Meixu Chen, Todd Goodall Bell, Zhaolin Wan, and Alan Bovik. 2020. Study of 2D foveated video quality in virtual reality. In Applications of Digital Image Processing XLIII, Vol. 11510. International Society for Optics and Photonics, 1151007."},{"key":"e_1_2_2_24_1","unstructured":"Yize Jin Meixu Chen Todd Goodall Anjul Patney and Alan Bovik. 2019. LIVE-Facebook Technologies-Compressed Virtual Reality (LIVE-FBT-FCVR) Databases. http:\/\/live.ece.utexas.edu\/research\/LIVEFBTFCVR\/index.html.  Yize Jin Meixu Chen Todd Goodall Anjul Patney and Alan Bovik. 2019. LIVE-Facebook Technologies-Compressed Virtual Reality (LIVE-FBT-FCVR) Databases. http:\/\/live.ece.utexas.edu\/research\/LIVEFBTFCVR\/index.html."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2021.3087322"},{"key":"e_1_2_2_26_1","article-title":"DeepFovea: Neural Reconstruction for Foveated Rendering and Video Compression using Learned Statistics of Natural Videos","volume":"38","author":"Kaplanyan Anton S.","year":"2019","unstructured":"Anton S. Kaplanyan , Anton Sochenov , Thomas Leimkuehler , Mikhail Okunev , Todd Goodall , and Gizem Rufo . 2019 . DeepFovea: Neural Reconstruction for Foveated Rendering and Video Compression using Learned Statistics of Natural Videos . ACM Trans. Graph. (Proc. SIGGRAPH Asia) 38 , 4 (2019), 212:1--212:13. Anton S. Kaplanyan, Anton Sochenov, Thomas Leimkuehler, Mikhail Okunev, Todd Goodall, and Gizem Rufo. 2019. DeepFovea: Neural Reconstruction for Foveated Rendering and Video Compression using Learned Statistics of Natural Videos. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 38, 4 (2019), 212:1--212:13.","journal-title":"ACM Trans. Graph. (Proc. SIGGRAPH Asia)"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.69.001340"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.73.000742"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(95)00164-6"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/QoMEX.2015.7148119"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.647870"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.70.001458"},{"key":"e_1_2_2_33_1","volume-title":"Picture Coding Symposium.","author":"Rafa\u0142","unstructured":"Rafa\u0142 K. Mantiuk and Maryam Azimi. 2021. PU21: A novel perceptually uniform encoding for adapting existing quality metrics for HDR . In Picture Coding Symposium. Rafa\u0142 K. Mantiuk and Maryam Azimi. 2021. PU21: A novel perceptually uniform encoding for adapting existing quality metrics for HDR. In Picture Coding Symposium."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964935"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.2352\/issn.2169-2629.2020.28.1"},{"key":"e_1_2_2_36_1","doi-asserted-by":"crossref","unstructured":"A. Mikhailiuk M. P\u00e9rez-Ortiz D. Yue W. Suen and R. K. Mantiuk. 2021. Consolidated dataset and metrics for high-dynamic-range image quality. IEEE Transactions on Multimedia (2021) (in print).  A. Mikhailiuk M. P\u00e9rez-Ortiz D. Yue W. Suen and R. K. Mantiuk. 2021. Consolidated dataset and metrics for high-dynamic-range image quality. IEEE Transactions on Multimedia (2021) (in print).","DOI":"10.1109\/TMM.2021.3076298"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1117\/1.OE.52.10.102008"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2015.04.009"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980246"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.7.002032"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1364\/josaa.8.001762"},{"key":"e_1_2_2_42_1","volume-title":"Mantiuk","author":"Perez-Ortiz Maria","year":"2017","unstructured":"Maria Perez-Ortiz and Rafal K . Mantiuk . 2017 . A practical guide and software for analysing pairwise comparison experiments. arXiv preprint (dec 2017). arXiv:1712.03686 http:\/\/arxiv.org\/abs\/1712.03686 Maria Perez-Ortiz and Rafal K. Mantiuk. 2017. A practical guide and software for analysing pairwise comparison experiments. arXiv preprint (dec 2017). arXiv:1712.03686 http:\/\/arxiv.org\/abs\/1712.03686"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/tip.2019.2936103"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2014.10.009"},{"key":"e_1_2_2_45_1","volume-title":"2011 18th International Conference on Systems, Signals and Image Processing. IEEE, 1--4.","author":"Rimac-Drlje Snje\u017eana","year":"2011","unstructured":"Snje\u017eana Rimac-Drlje , Goran Martinovi\u0107 , and Branka Zovko-Cihlar . 2011 . Foveation-based content Adaptive Structural Similarity index . In 2011 18th International Conference on Systems, Signals and Image Processing. IEEE, 1--4. Snje\u017eana Rimac-Drlje, Goran Martinovi\u0107, and Branka Zovko-Cihlar. 2011. Foveation-based content Adaptive Structural Similarity index. In 2011 18th International Conference on Systems, Signals and Image Processing. IEEE, 1--4."},{"key":"e_1_2_2_46_1","volume-title":"Foveated mean squared error---a novel video quality metric. Multimedia tools and applications 49, 3","author":"Rimac-Drlje Snje\u017eana","year":"2010","unstructured":"Snje\u017eana Rimac-Drlje , Mario Vranje\u0161 , and Drago \u017dagar . 2010. Foveated mean squared error---a novel video quality metric. Multimedia tools and applications 49, 3 ( 2010 ), 425--445. Snje\u017eana Rimac-Drlje, Mario Vranje\u0161, and Drago \u017dagar. 2010. Foveated mean squared error---a novel video quality metric. Multimedia tools and applications 49, 3 (2010), 425--445."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(81)90169-3"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1111411.1111431"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00236819"},{"key":"e_1_2_2_50_1","volume-title":"Motion tuned spatio-temporal quality assessment of natural videos","author":"Seshadrinathan Kalpana","year":"2009","unstructured":"Kalpana Seshadrinathan and Alan Conrad Bovik . 2009. Motion tuned spatio-temporal quality assessment of natural videos . IEEE transactions on image processing 19, 2 ( 2009 ), 335--350. Kalpana Seshadrinathan and Alan Conrad Bovik. 2009. Motion tuned spatio-temporal quality assessment of natural videos. IEEE transactions on image processing 19, 2 (2009), 335--350."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2006.881959"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.1995.537667"},{"key":"e_1_2_2_53_1","volume-title":"How do people explore virtual environments? IEEE Transactions on Visualization and Computer Graphics","author":"Sitzmann Vincent","year":"2017","unstructured":"Vincent Sitzmann , Ana Serrano , Amy Pavel , Maneesh Agrawala , Diego Gutierrez , Belen Masia , and Gordon Wetzstein . 2017. How do people explore virtual environments? IEEE Transactions on Visualization and Computer Graphics ( 2017 ). Vincent Sitzmann, Ana Serrano, Amy Pavel, Maneesh Agrawala, Diego Gutierrez, Belen Masia, and Gordon Wetzstein. 2017. How do people explore virtual environments? IEEE Transactions on Visualization and Computer Graphics (2017)."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1080\/00049539808258790"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2214933"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168556.2168568"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.62.001221"},{"key":"e_1_2_2_58_1","doi-asserted-by":"crossref","unstructured":"Qi Sun A. Patney L.-Y. Wei O. Shapira J. Lu P. Asente S. Zhu M. McGuire D. Luebke and A. Kaufman. 2018. Towards virtual reality infinite walking: Dynamic saccadic redirection. ACM Trans. on Graph. (2018) 16.  Qi Sun A. Patney L.-Y. Wei O. Shapira J. Lu P. Asente S. Zhu M. McGuire D. Luebke and A. Kaufman. 2018. Towards virtual reality infinite walking: Dynamic saccadic redirection. ACM Trans. on Graph. (2018) 16.","DOI":"10.1145\/3197517.3201294"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931002.2931011"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322985"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818086"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/bf00236818"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.449797"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACSSC.2003.1292216"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.14.002379"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0734-189X(87)80184-6"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.2352\/ISSN.2470-1173.2016.16HVEI-102"},{"key":"e_1_2_2_68_1","volume-title":"Vision Models and Applications to Image and Video Processing","author":"Winkler Stefan","unstructured":"Stefan Winkler , Murat Kunt , and Christian J van den Branden Lambrecht . 2001. Vision and video: models and applications . In Vision Models and Applications to Image and Video Processing . Springer , 201--229. Stefan Winkler, Murat Kunt, and Christian J van den Branden Lambrecht. 2001. Vision and video: models and applications. In Vision Models and Applications to Image and Video Processing. Springer, 201--229."},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196493"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618481"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00558"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00068"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459831","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3450626.3459831","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:20Z","timestamp":1750191440000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459831"}},"subtitle":["a visible difference predictor for wide field-of-view video"],"short-title":[],"issued":{"date-parts":[[2021,7,19]]},"references-count":72,"aliases":["10.1145\/3476576.3476595"],"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3450626.3459831"],"URL":"https:\/\/doi.org\/10.1145\/3450626.3459831","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,19]]},"assertion":[{"value":"2021-07-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}