{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T08:41:40Z","timestamp":1758271300266,"version":"3.41.0"},"reference-count":22,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2008,6,18]],"date-time":"2008-06-18T00:00:00Z","timestamp":1213747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2010,6]]},"abstract":"<jats:p>The estimation of image quality is a demanding task, especially when estimating different high-quality imaging products or their components. The challenge is the multivariate nature of image quality as well as the need to use na\u00efve observers as test subjects, since they are the actual end-users of the products. Here, we use a subjective approach suitable for estimating the quality performance of different imaging device components with na\u00efve observers\u2014the interpretation-based quality (IBQ) approach. From two studies with 61 na\u00efve observers, 17 natural image contents, and 13 different camera image signal processor pipelines, we determined the subjectively crucial image quality attributes and dimensions and the description of each pipeline's perceived image quality performance. We found that the subjectively most important image quality dimensions were color shift\/naturalness, darkness, and sharpness. The first dimension, which was related to naturalness and colors, distinguished the good-quality pipelines from the middle- and low-quality groups, and the dimensions of darkness and sharpness described why the quality failed in the low-quality pipelines. The study suggests that the high-level concept naturalness is a requirement for high-quality images, whereas quality can fail for other reasons in low-quality images, and this failure can be described by low-level concepts, such as darkness and sharpness.<\/jats:p>","DOI":"10.1145\/1773965.1773967","type":"journal-article","created":{"date-parts":[[2010,6,22]],"date-time":"2010-06-22T12:20:45Z","timestamp":1277209245000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Evaluating the multivariate visual quality performance of image-processing components"],"prefix":"10.1145","volume":"7","author":[{"given":"Jenni","family":"Radun","sequence":"first","affiliation":[{"name":"University of Helsinki, Finland"}]},{"given":"Tuomas","family":"Leisti","sequence":"additional","affiliation":[{"name":"University of Helsinki, Finland"}]},{"given":"Toni","family":"Virtanen","sequence":"additional","affiliation":[{"name":"University of Helsinki, Finland"}]},{"given":"Jukka","family":"H\u00e4kkinen","sequence":"additional","affiliation":[{"name":"University of Helsinki, Finland and Nokia Corporation, Finland"}]},{"given":"Tero","family":"Vuori","sequence":"additional","affiliation":[{"name":"Nokia Corporation, Finland"}]},{"given":"G\u00f6te","family":"Nyman","sequence":"additional","affiliation":[{"name":"University of Helsinki, Finland"}]}],"member":"320","published-online":{"date-parts":[[2008,6,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-1684(98)00124-8"},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","first-page":"160","DOI":"10.2352\/J.ImagingSci.Technol.2004.48.2.art00013","article-title":"A short image quality model taxonomy","volume":"48","author":"Engeldrum P. G.","year":"2004","unstructured":"Engeldrum , P. G. 2004 . A short image quality model taxonomy . J. Imag. Sci. Technol. 48 , 160 -- 165 . Engeldrum, P. G. 2004. A short image quality model taxonomy. J. Imag. Sci. Technol. 48, 160--165.","journal-title":"J. Imag. Sci. Technol."},{"key":"e_1_2_1_3_1","volume-title":"Psychometric Scaling: A Toolkit for Imaging Systems Development","author":"Engeldrum P. G.","year":"2000","unstructured":"Engeldrum , P. G. 2000 . Psychometric Scaling: A Toolkit for Imaging Systems Development . Imcotek Press , Winchester, MA . Engeldrum, P. G. 2000. Psychometric Scaling: A Toolkit for Imaging Systems Development. Imcotek Press, Winchester, MA."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.foodqual.2004.04.009"},{"key":"e_1_2_1_5_1","volume-title":"Correspondence Analysis in Practice","author":"Greenacre M.","unstructured":"Greenacre , M. 2007. Correspondence Analysis in Practice 2 nd Ed. Taylor &amp; Francis Group , Boca Raton, FL. Greenacre, M. 2007. Correspondence Analysis in Practice 2nd Ed. Taylor &amp; Francis Group, Boca Raton, FL.","edition":"2"},{"key":"e_1_2_1_6_1","unstructured":"Hair J. Anderson R. Tatham R. and Black W. 1998. Multivariate Data Analysis. Prentice Hall Englewood Cliffs NJ. Hair J. Anderson R. Tatham R. and Black W. 1998. Multivariate Data Analysis. Prentice Hall Englewood Cliffs NJ."},{"volume-title":"Proceedings of the IS&T's International Conference on Digital Printing Technologies (NIP24)","author":"Halonen R.","key":"e_1_2_1_7_1","unstructured":"Halonen , R. , Leisti , T. , and Oittinen , P . 2008. The influence of image content and paper grade on quality attributes computed from printed natural images . In Proceedings of the IS&T's International Conference on Digital Printing Technologies (NIP24) . Society for Imaging Sciences and Technology, Springfield, VA. Halonen, R., Leisti, T., and Oittinen, P. 2008. The influence of image content and paper grade on quality attributes computed from printed natural images. In Proceedings of the IS&T's International Conference on Digital Printing Technologies (NIP24). Society for Imaging Sciences and Technology, Springfield, VA."},{"volume-title":"Proceedings of the Symposium on Electronic Imaging: Science and Technology. SPIE","author":"H\u00e4kkinen J.","key":"e_1_2_1_8_1","unstructured":"H\u00e4kkinen , J. , Kawai , T. , Takatalo , J. , Leisti , T. , Radun , J. , Hirsaho , A. , and Nyman , G . 2008. Measuring stereoscopic image quality experience with interpretation based quality methodology . In Proceedings of the Symposium on Electronic Imaging: Science and Technology. SPIE , Philadelphia. H\u00e4kkinen, J., Kawai, T., Takatalo, J., Leisti, T., Radun, J., Hirsaho, A., and Nyman, G. 2008. Measuring stereoscopic image quality experience with interpretation based quality methodology. In Proceedings of the Symposium on Electronic Imaging: Science and Technology. SPIE, Philadelphia."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0141-9382(00)00056-1"},{"volume-title":"Handbook of Image Quality: Characterization and Prediction","author":"Keelan B. W.","key":"e_1_2_1_10_1","unstructured":"Keelan , B. W. 2002. Handbook of Image Quality: Characterization and Prediction . Marcel Decker Inc., New York . Keelan, B. W. 2002. Handbook of Image Quality: Characterization and Prediction. Marcel Decker Inc., New York."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.982411"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 12th International Display Workshops (IDW'05). 1825","author":"Nyman G.","year":"1828","unstructured":"Nyman , G. , Radun , J. , Leisti , T. , and Vuori , T . 2005. From image fidelity to subjective quality: a hybrid qualitative\/quantitative methodology for measuring subjective image quality for different image contents . In Proceedings of the 12th International Display Workshops (IDW'05). 1825 -- 1828 . Nyman, G., Radun, J., Leisti, T., and Vuori, T. 2005. From image fidelity to subjective quality: a hybrid qualitative\/quantitative methodology for measuring subjective image quality for different image contents. In Proceedings of the 12th International Display Workshops (IDW'05). 1825--1828."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2003.08.001"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1278760.1278762"},{"volume-title":"Proceedings of the Electronic Imaging: Science and Technology. SPIE","author":"Radun J.","key":"e_1_2_1_15_1","unstructured":"Radun , J. , Virtanen , T. , Olives , J. L. , Vaahteranoksa , M. , Vuori , T. , and Nyman , G . 2007. Audiovisual quality estimation of mobile phone video cameras with interpretation-based quality approach . In Proceedings of the Electronic Imaging: Science and Technology. SPIE , Philadelphia. Radun, J., Virtanen, T., Olives, J. L., Vaahteranoksa, M., Vuori, T., and Nyman, G. 2007. Audiovisual quality estimation of mobile phone video cameras with interpretation-based quality approach. In Proceedings of the Electronic Imaging: Science and Technology. SPIE, Philadelphia."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 30th International Congress of Imaging Science Conference (ICIS'06). International Congress of Imaging Science, 119--121","author":"Radun J.","year":"2006","unstructured":"Radun , J. , Virtanen , T. , Nyman , G. , and Olives , J-L . 2006 . Explaining multivariate image quality: interpretation-based quality approach . In Proceedings of the 30th International Congress of Imaging Science Conference (ICIS'06). International Congress of Imaging Science, 119--121 . Radun, J., Virtanen, T., Nyman, G., and Olives, J-L. 2006. Explaining multivariate image quality: interpretation-based quality approach. In Proceedings of the 30th International Congress of Imaging Science Conference (ICIS'06). International Congress of Imaging Science, 119--121."},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","first-page":"487","DOI":"10.2352\/J.ImagingSci.Technol.1996.40.6.art00003","article-title":"Naturalness and image quality: saturation and lightness variation in color images of natural scenes","volume":"40","author":"De Ridder H.","year":"1996","unstructured":"De Ridder , H. 1996 . Naturalness and image quality: saturation and lightness variation in color images of natural scenes . J. Imag. Sci. Technol. 40 , 487 -- 493 . De Ridder, H. 1996. Naturalness and image quality: saturation and lightness variation in color images of natural scenes. J. Imag. Sci. Technol. 40, 487--493.","journal-title":"J. Imag. Sci. Technol."},{"volume-title":"Proceedings of Electronic Imaging: Science and Technology. SPIE","author":"Shibata T.","key":"e_1_2_1_18_1","unstructured":"Shibata , T. , Kurihara , S. , Kawai , T , Takahashi , T. , Shimizu , T. , Kawada , R. , Ito , A. , H\u00e4kkinen , J. , Takatalo , J. , and Nyman , G . 2009. Evaluation of stereoscopic image quality for mobile devices using interpretation based quality methodology . In Proceedings of Electronic Imaging: Science and Technology. SPIE , Philadelphia. Shibata, T., Kurihara, S., Kawai, T, Takahashi, T., Shimizu, T., Kawada, R., Ito, A., H\u00e4kkinen, J., Takatalo, J., and Nyman, G. 2009. Evaluation of stereoscopic image quality for mobile devices using interpretation based quality methodology. In Proceedings of Electronic Imaging: Science and Technology. SPIE, Philadelphia."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.2008.0692"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1520-6378(199902)24:1<52::AID-COL10>3.0.CO;2-4"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1080\/13682199.1999.11736360"},{"volume-title":"Proceedings of Electronic: Imaging Science and Technology. SPIE","author":"Virtanen T.","key":"e_1_2_1_22_1","unstructured":"Virtanen , T. , Radun , J. , Lindroos , P. , Suomi , S. , S\u00e4\u00e4m\u00e4nen , T. , Vuori , T. , Vaahteranoksa , M. , and Nyman , G . 2008. Forming valid scales for subjective video quality measurement based on a hybrid qualitative\/quantitative methodology . In Proceedings of Electronic: Imaging Science and Technology. SPIE , Philadelphia. Virtanen, T., Radun, J., Lindroos, P., Suomi, S., S\u00e4\u00e4m\u00e4nen, T., Vuori, T., Vaahteranoksa, M., and Nyman, G. 2008. Forming valid scales for subjective video quality measurement based on a hybrid qualitative\/quantitative methodology. In Proceedings of Electronic: Imaging Science and Technology. SPIE, Philadelphia."}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1773965.1773967","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1773965.1773967","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T11:39:27Z","timestamp":1750246767000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1773965.1773967"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,6,18]]},"references-count":22,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2010,6]]}},"alternative-id":["10.1145\/1773965.1773967"],"URL":"https:\/\/doi.org\/10.1145\/1773965.1773967","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"type":"print","value":"1544-3558"},{"type":"electronic","value":"1544-3965"}],"subject":[],"published":{"date-parts":[[2008,6,18]]},"assertion":[{"value":"2009-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-06-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}