{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:26:13Z","timestamp":1776083173075,"version":"3.50.1"},"reference-count":28,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2007,11,1]],"date-time":"2007-11-01T00:00:00Z","timestamp":1193875200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2007,11]]},"abstract":"<jats:p>The goal of stylization is to provide an abstracted representation of an image that highlights specific types of visual information. Recent advances in computer graphics techniques have made it possible to render many varieties of stylized imagery efficiently making stylization into a useful technique, not only for artistic, but also for visualization applications. In this paper, we report results from two sets of experiments that aim at characterizing the perceptual impact and effectiveness of three different stylization techniques in the context of dynamic facial expressions. In the first set of experiments, animated facial expressions are stylized using three common techniques (brush, cartoon, and illustrative stylization) and investigated using different experimental measures. Going beyond the usual questionnaire approach, these experiments compare the techniques according to several criteria ranging from subjective preference to task-dependent measures (such as recognizability, intensity) allowing us to compare behavioral and introspective approaches. The second set of experiments use the same stylization techniques on real-world video sequences in order to compare the effect of stylization on natural and artificial stimuli. Our results shed light on how stylization of image contents affects the perception and subjective evaluation of both real and computer-generated facial expressions.<\/jats:p>","DOI":"10.1145\/1278387.1278390","type":"journal-article","created":{"date-parts":[[2007,11,30]],"date-time":"2007-11-30T14:24:58Z","timestamp":1196432698000},"page":"16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":29,"title":["Evaluation of real-world and computer-generated stylized facial expressions"],"prefix":"10.1145","volume":"4","author":[{"given":"Christian","family":"Wallraven","sequence":"first","affiliation":[{"name":"Max Planck Institute for Biological Cybernetics, T\u00fcbingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Heinrich H.","family":"B\u00fclthoff","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Biological Cybernetics, T\u00fcbingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Douglas W.","family":"Cunningham","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Biological Cybernetics and WSI-GRIS, T\u00fcbingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jan","family":"Fischer","sequence":"additional","affiliation":[{"name":"WSI-GRIS, T\u00fcbingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dirk","family":"Bartz","sequence":"additional","affiliation":[{"name":"Visual Computing (ICCAS), Leipzig, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2007,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1177\/1534582302001001003"},{"key":"e_1_2_1_2_1","volume-title":"Proc. of ACM SIGGRAPH. ACM Press","author":"Agrawala M.","unstructured":"Agrawala , M. and Stolte , C . 2001. Rendering effective route maps: Improving usability through generalization . In Proc. of ACM SIGGRAPH. ACM Press , New York. 241--249. 10.1145\/383259.383286 Agrawala, M. and Stolte, C. 2001. Rendering effective route maps: Improving usability through generalization. In Proc. of ACM SIGGRAPH. ACM Press, New York. 241--249. 10.1145\/383259.383286"},{"key":"e_1_2_1_3_1","volume-title":"SIGGRAPH '03 Sketches &amp; Applications.","author":"Breidt M.","unstructured":"Breidt , M. , Wallraven , C. , Cunningham , D. W. , and B\u00fclthoff , H. H . 2003. Facial animation based on 3d scans and motion capture . SIGGRAPH '03 Sketches &amp; Applications. Breidt, M., Wallraven, C., Cunningham, D. W., and B\u00fclthoff, H. H. 2003. Facial animation based on 3d scans and motion capture. SIGGRAPH '03 Sketches &amp; Applications."},{"key":"e_1_2_1_4_1","first-page":"644","article-title":"State of the art: Nonverbal communication","volume":"14","author":"Bull P.","year":"2001","unstructured":"Bull , P. 2001 . State of the art: Nonverbal communication . The Psychologist 14 , 644 -- 647 . Bull, P. 2001. State of the art: Nonverbal communication. The Psychologist 14, 644--647.","journal-title":"The Psychologist"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Cunningham D. W. Breidt M. Kleiner M. Wallraven C. and B\u00fclthoff H. H. 2003. How believable are real faces: Towards a perceptual basis for conversational animation. In Computer Animation and Social Agents 2003. 23--39. Cunningham D. W. Breidt M. Kleiner M. Wallraven C. and B\u00fclthoff H. H. 2003. How believable are real faces: Towards a perceptual basis for conversational animation. In Computer Animation and Social Agents 2003. 23--39.","DOI":"10.1109\/CASA.2003.1199300"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Cunningham D. Nusseck M. Wallraven C. and B\u00fclthoff H. 2004. The role of image size in the recognition of conversational facial expressions. Computer Animation &amp; Virtual Worlds 15 3--4 (07) 305--310. 10.1002\/cav.v15:3\/4 Cunningham D. Nusseck M. Wallraven C. and B\u00fclthoff H. 2004. The role of image size in the recognition of conversational facial expressions. Computer Animation &amp; Virtual Worlds 15 3--4 (07) 305--310. 10.1002\/cav.v15:3\/4","DOI":"10.1002\/cav.33"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1077399.1077404"},{"key":"e_1_2_1_8_1","volume-title":"Proc. of ACM SIGGRAPH. 769--776","author":"DeCarlo D.","unstructured":"DeCarlo , D. and Santella , A . 2002. Stylization and abstraction of photographs . In Proc. of ACM SIGGRAPH. 769--776 . 10.1145\/566570.566650 DeCarlo, D. and Santella, A. 2002. Stylization and abstraction of photographs. In Proc. of ACM SIGGRAPH. 769--776. 10.1145\/566570.566650"},{"key":"e_1_2_1_9_1","volume-title":"Universal and Cultural Differences in Facial Expressions of Emotion","author":"Ekman P.","unstructured":"Ekman , P. 1972. Universal and Cultural Differences in Facial Expressions of Emotion . University of Nebraska Press , Lincoln, NB . 207--283. Ekman, P. 1972. Universal and Cultural Differences in Facial Expressions of Emotion. University of Nebraska Press, Lincoln, NB. 207--283."},{"key":"e_1_2_1_10_1","volume-title":"Proc. of SPIE Human Vision and Electronic Imaging. 290--297","author":"Ferwerda J.","year":"2003","unstructured":"Ferwerda , J. 2003 . Three varieties of realism in computer graphics . In Proc. of SPIE Human Vision and Electronic Imaging. 290--297 . Ferwerda, J. 2003. Three varieties of realism in computer graphics. In Proc. of SPIE Human Vision and Electronic Imaging. 290--297."},{"key":"e_1_2_1_11_1","volume-title":"Proc. of ACM Symposium on Virtual Reality Software and Technology (VRST). 155--158","author":"Fischer J.","unstructured":"Fischer , J. , Bartz , D. , and Strassr , W . 2005a. Artistic reality: Fast brush stroke stylization for augmented reality . In Proc. of ACM Symposium on Virtual Reality Software and Technology (VRST). 155--158 . 10.1145\/1101616.1101649 Fischer, J., Bartz, D., and Strassr, W. 2005a. Artistic reality: Fast brush stroke stylization for augmented reality. In Proc. of ACM Symposium on Virtual Reality Software and Technology (VRST). 155--158. 10.1145\/1101616.1101649"},{"key":"e_1_2_1_12_1","volume-title":"Proc. of IEEE Visualization. 663--670","author":"Fischer J.","unstructured":"Fischer , J. , Bartz , D. , and Strassr , W . 2005b. Illustrative display of hidden iso-surface structures . In Proc. of IEEE Visualization. 663--670 . Fischer, J., Bartz, D., and Strassr, W. 2005b. Illustrative display of hidden iso-surface structures. In Proc. of IEEE Visualization. 663--670."},{"key":"e_1_2_1_13_1","first-page":"053","volume-title":"Eurographics Symposium on Virtual Environments (EGVE). 10","author":"Fischer J.","unstructured":"Fischer , J. , Cunningham , D. , Bartz , D. , Wallraven , C. , B\u00fclthoff , H. , and Strassr , W . 2006a. Measuring the discernability of virtual objects in conventional and stylized augmented reality . In Eurographics Symposium on Virtual Environments (EGVE). 10 .2312\/EGVE\/EGVE06\/ 053 - 061 Fischer, J., Cunningham, D., Bartz, D., Wallraven, C., B\u00fclthoff, H., and Strassr, W. 2006a. Measuring the discernability of virtual objects in conventional and stylized augmented reality. In Eurographics Symposium on Virtual Environments (EGVE). 10.2312\/EGVE\/EGVE06\/053-061"},{"key":"e_1_2_1_14_1","first-page":"071","volume-title":"Eurographics Symposium on Virtual Environments (EGVE). 10","author":"Fischer J.","unstructured":"Fischer , J. , Eichler , M. , Bartz , D. , and Strassr , W . 2006b. Model-based hybrid tracking for medical augmented reality . In Eurographics Symposium on Virtual Environments (EGVE). 10 .2312\/EGVE\/EGVE06\/ 071 - 080 Fischer, J., Eichler, M., Bartz, D., and Strassr, W. 2006b. Model-based hybrid tracking for medical augmented reality. In Eurographics Symposium on Virtual Environments (EGVE). 10.2312\/EGVE\/EGVE06\/071-080"},{"key":"e_1_2_1_15_1","volume-title":"Proc. of Eurographics Workshop on Rendering. 227--231","author":"Freudenberg B.","unstructured":"Freudenberg , B. , Masuch , M. , and Strothotte , T . 2002. Real-time halftoning: A primitive for non-photorealistic shading . In Proc. of Eurographics Workshop on Rendering. 227--231 . Freudenberg, B., Masuch, M., and Strothotte, T. 2002. Real-time halftoning: A primitive for non-photorealistic shading. In Proc. of Eurographics Workshop on Rendering. 227--231."},{"key":"e_1_2_1_16_1","volume-title":"NPAR '02: Proceedings of the 2nd International Symposium on Non-Photorealistic Animation and Rendering. ACM Press","author":"Gooch A. A.","unstructured":"Gooch , A. A. and Willemsen , P . 2002. Evaluating space perception in npr immersive environments . In NPAR '02: Proceedings of the 2nd International Symposium on Non-Photorealistic Animation and Rendering. ACM Press , New York. 105--110. 10.1145\/508530.508549 Gooch, A. A. and Willemsen, P. 2002. Evaluating space perception in npr immersive environments. In NPAR '02: Proceedings of the 2nd International Symposium on Non-Photorealistic Animation and Rendering. ACM Press, New York. 105--110. 10.1145\/508530.508549"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/966131.966133"},{"key":"e_1_2_1_18_1","volume-title":"Proc. of ACM SIGGRAPH. 207--214","author":"Haeberli P.","year":"1990","unstructured":"Haeberli , P. 1990 . Paint by numbers: Abstract image representations . In Proc. of ACM SIGGRAPH. 207--214 . 10.1145\/97879.97902 Haeberli, P. 1990. Paint by numbers: Abstract image representations. In Proc. of ACM SIGGRAPH. 207--214. 10.1145\/97879.97902"},{"key":"e_1_2_1_19_1","volume-title":"Tech. Rep. 123. May.","author":"Kleiner M.","year":"2004","unstructured":"Kleiner , M. , Wallraven , C. , and B\u00fclthoff , H . 2004 . The mpi videolab - a system for high quality synchronous recording of video and audio from multiple viewpoints. Tech. Rep. 123. May. Kleiner, M., Wallraven, C., and B\u00fclthoff, H. 2004. The mpi videolab - a system for high quality synchronous recording of video and audio from multiple viewpoints. Tech. Rep. 123. May."},{"key":"e_1_2_1_20_1","volume-title":"Proc. of ACM SIGGRAPH. 407--414","author":"Litwinowicz P.","year":"1997","unstructured":"Litwinowicz , P. 1997 . Processing images and video for an impressionist effect . In Proc. of ACM SIGGRAPH. 407--414 . 10.1145\/258734.258893 Litwinowicz, P. 1997. Processing images and video for an impressionist effect. In Proc. of ACM SIGGRAPH. 407--414. 10.1145\/258734.258893"},{"key":"e_1_2_1_21_1","volume-title":"NPAR '04: Proceedings of the 3rd international symposium on Non-Photorealistic Animation and Rendering. ACM Press","author":"Santella A.","year":"2004","unstructured":"Santella , A. and DeCarlo , D. 2004 . Visual interest and npr: An evaluation and manifesto . In NPAR '04: Proceedings of the 3rd international symposium on Non-Photorealistic Animation and Rendering. ACM Press , New York. 71--150. 10.1145\/987657.987669 Santella, A. and DeCarlo, D. 2004. Visual interest and npr: An evaluation and manifesto. In NPAR '04: Proceedings of the 3rd international symposium on Non-Photorealistic Animation and Rendering. ACM Press, New York. 71--150. 10.1145\/987657.987669"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015795"},{"key":"e_1_2_1_23_1","unstructured":"Strothotte T. and Schlechtweg S. 2002. Non-Photorealistic Computer Graphics - Modelling Rendering and Animation. Morgan Kaufmann Publi. San Francisco CA. Strothotte T. and Schlechtweg S. 2002. Non-Photorealistic Computer Graphics - Modelling Rendering and Animation. Morgan Kaufmann Publi. San Francisco CA."},{"key":"e_1_2_1_24_1","volume-title":"Proc. of IEEE International Conference on Computer Vision (ICCV). 839--846","author":"Tomasi C.","unstructured":"Tomasi , C. and Manduchi , R . 1998. Bilateral filtering for gray and color images . In Proc. of IEEE International Conference on Computer Vision (ICCV). 839--846 . Tomasi, C. and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proc. of IEEE International Conference on Computer Vision (ICCV). 839--846."},{"key":"e_1_2_1_25_1","volume-title":"Eds. Proceedings of the First Symposium on Applied Perception in Graphics and Visualization, 181","author":"Wallraven C.","unstructured":"Wallraven , C. , Cunningham , D. , Breidt , M. , and B\u00fclthoff , H . 2004. View dependence of complex versus simple facial motions. H. H. B\u00fclthoff and H. Rushmeier , Eds. Proceedings of the First Symposium on Applied Perception in Graphics and Visualization, 181 . 10.1145\/1012551.1012603 Wallraven, C., Cunningham, D., Breidt, M., and B\u00fclthoff, H. 2004. View dependence of complex versus simple facial motions. H. H. B\u00fclthoff and H. Rushmeier, Eds. Proceedings of the First Symposium on Applied Perception in Graphics and Visualization, 181. 10.1145\/1012551.1012603"},{"key":"e_1_2_1_26_1","volume-title":"Proc. of APGV '05","author":"Wallraven C.","unstructured":"Wallraven , C. , Breidt , M. , Cunningham , D. W. , and B\u00fclthoff , H. H . 2005. Psychophysical evaluation of animated facial expressions . In Proc. of APGV '05 . ACM Press, New York, NY, USA, 17--24. 10.1145\/1080402.1080405 Wallraven, C., Breidt, M., Cunningham, D. W., and B\u00fclthoff, H. H. 2005. Psychophysical evaluation of animated facial expressions. In Proc. of APGV '05. ACM Press, New York, NY, USA, 17--24. 10.1145\/1080402.1080405"},{"key":"e_1_2_1_27_1","volume-title":"SIGGRAPH '06: ACM SIGGRAPH 2006 Papers. ACM Press","author":"Winnem\u00f6ller H.","year":"2018","unstructured":"Winnem\u00f6ller , H. , Olsen , S. C. , and Gooch , B . 2006. Real-time video abstraction . In SIGGRAPH '06: ACM SIGGRAPH 2006 Papers. ACM Press , New York. 1221--1226. 10.1145\/1179352.114 2018 Winnem\u00f6ller, H., Olsen, S. C., and Gooch, B. 2006. Real-time video abstraction. In SIGGRAPH '06: ACM SIGGRAPH 2006 Papers. ACM Press, New York. 1221--1226. 10.1145\/1179352.1142018"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1068\/p3376"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1278387.1278390","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1278387.1278390","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T14:47:29Z","timestamp":1750258049000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1278387.1278390"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,11]]},"references-count":28,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2007,11]]}},"alternative-id":["10.1145\/1278387.1278390"],"URL":"https:\/\/doi.org\/10.1145\/1278387.1278390","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"value":"1544-3558","type":"print"},{"value":"1544-3965","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,11]]},"assertion":[{"value":"2007-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}