{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,25]],"date-time":"2025-11-25T20:26:46Z","timestamp":1764102406848},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2006,7]]},"abstract":"<jats:p>This paper introduces a new psychophysical experiment developed to enable observers to judge the quality of computer graphics imagery with respect to the real scene it depicts. This new framework facilitates perceptual judgment of images against a real scene. Unlike previous work, which examined primitive objects under basic illumination, this experiment examines complex geometry illuminated using a calibrated light source. To ensure valid results, a commercial lighting booth containing rapid prototyped three-dimensional (3D) objects serves as the real scene. For comparison, a series of representative images, of varying quality, were rendered using the physically based Radiance lighting simulation software. Results from these experiments show that higher parameter settings, which lead to longer processing times, do not necessarily lead to higher quality images. To demonstrate that there is only modest benefit to setting parameters higher, images are subjected to further testing using two different visual quality discrimination operators; the Visual Differences Predictor (VDP) and the Structural SIMilarity (SSIM) for image-quality assessment. The results from the automatic operators correspond well with each other, in addition to yielding comparable outcomes as the psychophysical experiment. Although, a single scene was considered in the experiment, several scenes are tested using the image-quality metrics to lend further reliability to the assertion that higher parameter settings, which lead to extended processing times, do not necessarily lead to superior quality results.<\/jats:p>","DOI":"10.1145\/1166087.1166092","type":"journal-article","created":{"date-parts":[[2006,10,18]],"date-time":"2006-10-18T18:11:32Z","timestamp":1161195092000},"page":"217-238","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Exploring visual and automatic measures of perceptual fidelity in real and simulated imagery"],"prefix":"10.1145","volume":"3","author":[{"given":"Ann","family":"McNamara","sequence":"first","affiliation":[{"name":"Saint Louis University, Louis, MO"}]}],"member":"320","published-online":{"date-parts":[[2006,7]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"40","article-title":"A simple vision model for inhomogeneous image quality assessment","volume":"6","author":"Ahumada A.","year":"1998","unstructured":"Ahumada , A. and Beard , B. 1998 . A simple vision model for inhomogeneous image quality assessment . International Symposium Digest of Technical Papers 6 , 1, 40 -- 41 . Ahumada, A. and Beard, B. 1998. A simple vision model for inhomogeneous image quality assessment. International Symposium Digest of Technical Papers 6, 1, 40--41.","journal-title":"International Symposium Digest of Technical Papers"},{"key":"e_1_2_1_2_1","volume-title":"CIE Proceedings","author":"CIE.","year":"1924","unstructured":"CIE. 1924 . CIE Proceedings . Cambridge University Press, Cambridge. CIE. 1924. CIE Proceedings. Cambridge University Press, Cambridge."},{"key":"e_1_2_1_3_1","unstructured":"CMB. 2005. The gti colormatcher series. http:\/\/www.gtilite.com\/colormatcher-series.htm.  CMB. 2005. The gti colormatcher series. http:\/\/www.gtilite.com\/colormatcher-series.htm."},{"key":"e_1_2_1_4_1","volume-title":"Research Methods and Statistics in Psychology. Hodder and Stoughton","author":"Coolican H.","unstructured":"Coolican , H. 1999. Research Methods and Statistics in Psychology. Hodder and Stoughton , Oxford . Coolican, H. 1999. Research Methods and Statistics in Psychology. Hodder and Stoughton, Oxford."},{"key":"e_1_2_1_5_1","volume-title":"Digital Images and Human Vision","author":"Daly S.","unstructured":"Daly , S. 1993. The visible differences predictor: An algorithm for the assessment of image fidelity . In Digital Images and Human Vision . MIT Press , Cambridge, MA, USA , 179--206. Daly, S. 1993. The visible differences predictor: An algorithm for the assessment of image fidelity. In Digital Images and Human Vision. MIT Press, Cambridge, MA, USA, 179--206."},{"key":"e_1_2_1_6_1","volume-title":"Star: Tone reproduction and physically based spectral rendering. In State of the Art Reports, Eurographics","author":"Devlin K.","year":"2002","unstructured":"Devlin , K. , Chalmers , A. , Wilkie , A. , and Purgathofer , W . 2002 . Star: Tone reproduction and physically based spectral rendering. In State of the Art Reports, Eurographics 2002, D. Fellner and R. Scopignio, Eds . The Eurographics Association , Vienna, 101--123. Devlin, K., Chalmers, A., Wilkie, A., and Purgathofer, W. 2002. Star: Tone reproduction and physically based spectral rendering. In State of the Art Reports, Eurographics 2002, D. Fellner and R. Scopignio, Eds. The Eurographics Association, Vienna, 101--123."},{"key":"e_1_2_1_7_1","unstructured":"FDM. 2005. Slu product realization lab. http:\/\/parks.slu.edu.  FDM. 2005. Slu product realization lab. http:\/\/parks.slu.edu."},{"key":"e_1_2_1_8_1","volume-title":"ACM SIGGRAPH '97 Conference Proceedings 31, Annual Conference Series. 143--152","author":"Ferwerda J.","unstructured":"Ferwerda , J. , Pattanaik , S. , Shirley , P. , and Greenberg , D . 1997. A model of visual masking for computer graphics . ACM SIGGRAPH '97 Conference Proceedings 31, Annual Conference Series. 143--152 . 10.1145\/258734.258818 Ferwerda, J., Pattanaik, S., Shirley, P., and Greenberg, D. 1997. A model of visual masking for computer graphics. ACM SIGGRAPH '97 Conference Proceedings 31, Annual Conference Series. 143--152. 10.1145\/258734.258818"},{"key":"e_1_2_1_9_1","volume-title":"Lawerence Erlbaum Assoc","author":"Gilchrist A.","unstructured":"Gilchrist , A. 1996. Lightness , Brightness and Transparency. Lawerence Erlbaum Assoc ., Hillsdale, NJ . Gilchrist, A. 1996. Lightness, Brightness and Transparency. Lawerence Erlbaum Assoc., Hillsdale, NJ."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1068\/p130005"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican0379-112"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/964965.808601"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.646233"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1191\/1365782803li069oa"},{"key":"e_1_2_1_15_1","unstructured":"Mania A. 2001. Fidelity metrics for virtual environment simulations based on human judgements of spatial memory awareness states.  Mania A. 2001. Fidelity metrics for virtual environment simulations based on human judgements of spatial memory awareness states."},{"key":"e_1_2_1_16_1","volume-title":"ACM SIGGRAPH 2000 Sketches Program.","author":"McNamara A.","year":"2000","unstructured":"McNamara , A. 2000 a. Evaluating image quality metrics vs. human evaluation . ACM SIGGRAPH 2000 Sketches Program. McNamara, A. 2000a. Evaluating image quality metrics vs. human evaluation. ACM SIGGRAPH 2000 Sketches Program."},{"key":"e_1_2_1_17_1","volume-title":"SIGGRAPH 2000 Image Quality Metrics Course Notes. ACM SIGGRAPH","author":"McNamara A.","year":"2000","unstructured":"McNamara , A. 2000 b. Image quality metrics . In SIGGRAPH 2000 Image Quality Metrics Course Notes. ACM SIGGRAPH , New York, NY. McNamara, A. 2000b. Image quality metrics. In SIGGRAPH 2000 Image Quality Metrics Course Notes. ACM SIGGRAPH, New York, NY."},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 11th Eurographics Rendering Workshop, B. Peroche and H. E. Rushmeier, Eds. Springer-Verlag, Brno, Czech Republic, 207--218","author":"McNamara A.","unstructured":"McNamara , A. , Chalmers , A. , Trocianko , T. , and Gilchrist , I . 2000. Comparing real & synthetic scenes using human judgements of lightness . In Proceedings of the 11th Eurographics Rendering Workshop, B. Peroche and H. E. Rushmeier, Eds. Springer-Verlag, Brno, Czech Republic, 207--218 . McNamara, A., Chalmers, A., Trocianko, T., and Gilchrist, I. 2000. Comparing real & synthetic scenes using human judgements of lightness. In Proceedings of the 11th Eurographics Rendering Workshop, B. Peroche and H. E. Rushmeier, Eds. Springer-Verlag, Brno, Czech Republic, 207--218."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/7529.7920"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 2005 Eurographics Ireland Workshop. Eurographics Ireland","author":"Morvan Y.","year":"2003","unstructured":"Morvan , Y. and McNamara , A. 2003 . Assessing the visual perception impact of indirect lighting . In Proceedings of the 2005 Eurographics Ireland Workshop. Eurographics Ireland , Queens University, Belfast, Ireland, 87--103. Morvan, Y. and McNamara, A. 2003. Assessing the visual perception impact of indirect lighting. In Proceedings of the 2005 Eurographics Ireland Workshop. Eurographics Ireland, Queens University, Belfast, Ireland, 87--103."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 12th Eurographics Workshop on Rendering Techniques. Springer-Verlag","author":"Rademacher P.","unstructured":"Rademacher , P. , Lengyel , J. , Cutrell , E. , and Whitted , T . 2001. Measuring the perception of visual realism in images . In Proceedings of the 12th Eurographics Workshop on Rendering Techniques. Springer-Verlag , London, UK, 235--248. Rademacher, P., Lengyel, J., Cutrell, E., and Whitted, T. 2001. Measuring the perception of visual realism in images. In Proceedings of the 12th Eurographics Workshop on Rendering Techniques. Springer-Verlag, London, UK, 235--248."},{"key":"e_1_2_1_22_1","unstructured":"RADIANCE. 2005. Radiance lighting simulation. http:\/\/radsite.lbl.gov.  RADIANCE. 2005. Radiance lighting simulation. http:\/\/radsite.lbl.gov."},{"key":"e_1_2_1_23_1","volume-title":"SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques. ACM Press","author":"Reinhard E.","unstructured":"Reinhard , E. , Stark , M. , Shirley , P. , and Ferwerda , J . 2002. Photographic tone reproduction for digital images . In SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques. ACM Press , New York, NY, USA, 267--276. 10.1145\/566570.566575 Reinhard, E., Stark, M., Shirley, P., and Ferwerda, J. 2002. Photographic tone reproduction for digital images. In SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques. ACM Press, New York, NY, USA, 267--276. 10.1145\/566570.566575"},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Reinhard E. Ward G. Pattanaik S. and Debevec P. 2005. High Dynamic Range Imaging: Acquisition Display and Image-Based Lighting. Morgan Kaufmann Publishers San Francisco USA.   Reinhard E. Ward G. Pattanaik S. and Debevec P. 2005. High Dynamic Range Imaging: Acquisition Display and Image-Based Lighting. Morgan Kaufmann Publishers San Francisco USA.","DOI":"10.1016\/B978-012585263-0\/50010-5"},{"key":"e_1_2_1_25_1","unstructured":"Stanford. 2005. The stanford bunny. http:\/\/graphics.stanford.edu\/data\/3Dscanrep.  Stanford. 2005. The stanford bunny. http:\/\/graphics.stanford.edu\/data\/3Dscanrep."},{"key":"e_1_2_1_26_1","volume-title":"Ninth International Conference in Central Europe on Computer Graphics, Visualization and Interactive Digital Media (WSCG 2001)","author":"Szirmay-Kalos L.","unstructured":"Szirmay-Kalos , L. , Kovacs , L. , and Abbas , A. M . 2001. Testing monte-carlo global illumination methods with analytically computable scenes . Ninth International Conference in Central Europe on Computer Graphics, Visualization and Interactive Digital Media (WSCG 2001) 1, 419--430. Szirmay-Kalos, L., Kovacs, L., and Abbas, A. M. 2001. Testing monte-carlo global illumination methods with analytically computable scenes. Ninth International Conference in Central Europe on Computer Graphics, Visualization and Interactive Digital Media (WSCG 2001) 1, 419--430."},{"key":"e_1_2_1_27_1","volume-title":"Effective Color Displays","author":"Travis D.","unstructured":"Travis , D. 1991. Effective Color Displays . Academic Press , New York . Travis, D. 1991. Effective Color Displays. Academic Press, New York."},{"key":"e_1_2_1_28_1","volume-title":"STAR Proceedings of Eurographics","author":"Ulbricht C.","year":"2005","unstructured":"Ulbricht , C. , Wilkie , A. , and Purgathofer , W . 2005. Verification of physically based rendering algorithms . In STAR Proceedings of Eurographics 2005 , Y. Chrysanthou and M. Magnor, Eds. Eurographics Association, Geneva, Switzerland, 95--112. Eurographics 05 STAR. Ulbricht, C., Wilkie, A., and Purgathofer, W. 2005. Verification of physically based rendering algorithms. In STAR Proceedings of Eurographics 2005, Y. Chrysanthou and M. Magnor, Eds. Eurographics Association, Geneva, Switzerland, 95--112. Eurographics 05 STAR."},{"key":"e_1_2_1_29_1","volume-title":"SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques. ACM Press\/Addison-Wesley Publishing Co.","author":"Usoh M.","unstructured":"Usoh , M. , Arthur , K. , Whitton , M. C. , Bastos , R. , Steed , A. , Slater , M. , and Frederick P . Brooks, J. 1999. Walking, walking-in-place, flying, in virtual environments . In SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques. ACM Press\/Addison-Wesley Publishing Co. , New York, NY, USA, 359--364. 10.1145\/311535.311589 Usoh, M., Arthur, K., Whitton, M. C., Bastos, R., Steed, A., Slater, M., and Frederick P. Brooks, J. 1999. Walking, walking-in-place, flying, in virtual environments. In SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques. ACM Press\/Addison-Wesley Publishing Co., New York, NY, USA, 359--364. 10.1145\/311535.311589"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.6.000012"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1166087.1166092","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T21:09:09Z","timestamp":1672261749000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1166087.1166092"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,7]]},"references-count":31,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2006,7]]}},"alternative-id":["10.1145\/1166087.1166092"],"URL":"https:\/\/doi.org\/10.1145\/1166087.1166092","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"value":"1544-3558","type":"print"},{"value":"1544-3965","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,7]]},"assertion":[{"value":"2006-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}