{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,19]],"date-time":"2026-01-19T04:36:23Z","timestamp":1768797383169,"version":"3.49.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"ETRA","license":[{"start":{"date-parts":[[2022,5,13]],"date-time":"2022-05-13T00:00:00Z","timestamp":1652400000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"L3S Research Center, Hannover"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,5,13]]},"abstract":"<jats:p>We present a novel framework for the evaluation of eye tracking data in portrait videos including the automatic generation of customized areas of interest (AOIs) based on facial landmarks. In contrast to previous work, our framework allows the user to flexibly create AOIs by grouping the detected landmarks. Moreover, their shape and size can be modified to better fit both the research question and the precision of the eye tracker. The framework can be used as an integrated solution to not only generate AOIs but also to evaluate viewing behavior like the overall fixation times, the similarity of scanpaths, and the number of saccades between AOIs. Other functionalities include the visualization of gaze paths and the creation of heatmaps. We demonstrate the benefits of our framework and user-defined AOI layouts via an exemplary application, i.e., the investigation of face swapping artifacts.<\/jats:p>","DOI":"10.1145\/3530885","type":"journal-article","created":{"date-parts":[[2022,5,13]],"date-time":"2022-05-13T22:17:43Z","timestamp":1652480263000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Automatic Generation of Customized Areas of Interest and Evaluation of Observers' Gaze in Portrait Videos"],"prefix":"10.1145","volume":"6","author":[{"given":"Leslie","family":"Woehler","sequence":"first","affiliation":[{"name":"TU Braunschweig, Braunschweig, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Moritz","family":"von Estorff","sequence":"additional","affiliation":[{"name":"TU Braunschweig, Braunschweig, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Susana","family":"Castillo","sequence":"additional","affiliation":[{"name":"TU Braunschweig, Braunschweig, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcus","family":"Magnor","sequence":"additional","affiliation":[{"name":"TU Braunschweig, Braunschweig, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,5,13]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1037\/0278-7393.25.4.997"},{"key":"e_1_2_2_2_1","volume-title":"IEEE Winter Conference on Applications of Computer Vision. IEEE, IEEE","author":"Tadas Baltruvs","year":"2016","unstructured":"Tadas Baltruvs aitis, Peter Robinson , and Louis-Philippe Morency . 2016 . Openface: an open source facial behavior analysis toolkit . In IEEE Winter Conference on Applications of Computer Vision. IEEE, IEEE , Manhattan, NY, USA, 1--10. https:\/\/doi.org\/10.1109\/WACV. 2016.7477553 10.1109\/WACV.2016.7477553 Tadas Baltruvs aitis, Peter Robinson, and Louis-Philippe Morency. 2016. Openface: an open source facial behavior analysis toolkit. In IEEE Winter Conference on Applications of Computer Vision. IEEE, IEEE, Manhattan, NY, USA, 1--10. https:\/\/doi.org\/10.1109\/WACV.2016.7477553"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931002.2931005"},{"key":"e_1_2_2_4_1","volume-title":"Human social attention. Progress in brain research","author":"Birmingham Elina","year":"2009","unstructured":"Elina Birmingham and Alan Kingstone . 2009. Human social attention. Progress in brain research , Vol. 176 ( 2009 ), 309--320. https:\/\/doi.org\/10.1016\/S0079--6123(09)17618--5 10.1016\/S0079--6123(09)17618--5 Elina Birmingham and Alan Kingstone. 2009. Human social attention. Progress in brain research , Vol. 176 (2009), 309--320. https:\/\/doi.org\/10.1016\/S0079--6123(09)17618--5"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1068\/p6117"},{"key":"e_1_2_2_6_1","volume-title":"Computer Graphics Forum","author":"Martin","unstructured":"Martin vC ad'ik, Robert Herzog , Rafa\u0142 Mantiuk , Rados\u0142aw Mantiuk , Karol Myszkowski , and Hans-Peter Seidel . 2013. Learning to predict localized distortions in rendered images . In Computer Graphics Forum , Vol. 32 . Wiley Online Library , Hoboken, New Jersey, USA, 401--410. https:\/\/doi.org\/10.1111\/cgf.12248 10.1111\/cgf.12248 Martin vC ad'ik, Robert Herzog, Rafa\u0142 Mantiuk, Rados\u0142aw Mantiuk, Karol Myszkowski, and Hans-Peter Seidel. 2013. Learning to predict localized distortions in rendered images. In Computer Graphics Forum , Vol. 32. Wiley Online Library, Hoboken, New Jersey, USA, 401--410. https:\/\/doi.org\/10.1111\/cgf.12248"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.3758\/CABN.9.4.398"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2077451.2077453"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3317958.3319809"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0022758"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2016.2609843"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-019-01275-0"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3382507.3418857"},{"key":"e_1_2_2_14_1","volume-title":"Hooge","author":"Hessels Roy S.","year":"2018","unstructured":"Roy S. Hessels , Jeroen S. Benjamins , Tim H.W. Cornelissen , and Ignace T.C . Hooge . 2018 a. A validation of automatically-generated Areas-of-Interest in videos of a face for eye-tracking research. Frontiers in psychology , Vol. 9 (2018), 1367. https:\/\/doi.org\/10.3389\/fpsyg.2018.01367 10.3389\/fpsyg.2018.01367 Roy S. Hessels, Jeroen S. Benjamins, Tim H.W. Cornelissen, and Ignace T.C. Hooge. 2018a. A validation of automatically-generated Areas-of-Interest in videos of a face for eye-tracking research. Frontiers in psychology , Vol. 9 (2018), 1367. https:\/\/doi.org\/10.3389\/fpsyg.2018.01367"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.5127\/jep.062917"},{"key":"e_1_2_2_16_1","volume-title":"Hooge","author":"Hessels Roy S.","year":"2016","unstructured":"Roy S. Hessels , Chantal Kemner , Carlijn van den Boomen , and Ignace T.C . Hooge . 2016 . The area-of-interest problem in eyetracking research: A noise-robust solution for face and sparse stimuli. Behavior research methods , Vol. 48 , 4 (2016), 1694--1712. https:\/\/doi.org\/10.3758\/s13428-015-0676-y 10.3758\/s13428-015-0676-y Roy S. Hessels, Chantal Kemner, Carlijn van den Boomen, and Ignace T.C. Hooge. 2016. The area-of-interest problem in eyetracking research: A noise-robust solution for face and sparse stimuli. Behavior research methods , Vol. 48, 4 (2016), 1694--1712. https:\/\/doi.org\/10.3758\/s13428-015-0676-y"},{"key":"e_1_2_2_17_1","volume-title":"Eye tracking: A comprehensive guide to methods and measures","author":"Holmqvist Kenneth","unstructured":"Kenneth Holmqvist , Marcus Nystr\u00f6m , Richard Andersson , Richard Dewhurst , Halszka Jarodzka , and Joost Van de Weijer . 2011. Eye tracking: A comprehensive guide to methods and measures . Oxford University Press , United Kingdom . Kenneth Holmqvist, Marcus Nystr\u00f6m, Richard Andersson, Richard Dewhurst, Halszka Jarodzka, and Joost Van de Weijer. 2011. Eye tracking: A comprehensive guide to methods and measures .Oxford University Press, United Kingdom."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2013.00996"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV45572.2020.9093508"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.2466\/pms.1978.47.3.857"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743666.1743718"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-021-01521-4"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/1577069.1755843"},{"key":"e_1_2_2_24_1","volume-title":"Wells and Pia Rotshtein","author":"Gillespie Steven M.","year":"2016","unstructured":"Steven M. Gillespie Laura J. Wells and Pia Rotshtein . 2016 . Identification of emotional facial expressions: Effects of expression, intensity, and sex on eye gaze. PloS ONE , Vol. 11 , 12 (2016). https:\/\/doi.org\/10.1371\/journal.pone.0168307 10.1371\/journal.pone.0168307 Steven M. Gillespie Laura J. Wells and Pia Rotshtein. 2016. Identification of emotional facial expressions: Effects of expression, intensity, and sex on eye gaze. PloS ONE , Vol. 11, 12 (2016). https:\/\/doi.org\/10.1371\/journal.pone.0168307"},{"key":"e_1_2_2_25_1","volume-title":"Soviet physics doklady","author":"Levenshtein Vladimir I.","unstructured":"Vladimir I. Levenshtein . 1966. Binary codes capable of correcting deletions, insertions, and reversals . In Soviet physics doklady , Vol. 10 . 707--710. Vladimir I. Levenshtein. 1966. Binary codes capable of correcting deletions, insertions, and reversals. In Soviet physics doklady, Vol. 10. 707--710."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/13506285.2017.1301614"},{"key":"e_1_2_2_27_1","volume-title":"Communication without words. Communication theory","author":"Mehrabian Albert","year":"2008","unstructured":"Albert Mehrabian . 2008. Communication without words. Communication theory , Vol. 6 ( 2008 ), 193--200. Albert Mehrabian. 2008. Communication without words. Communication theory , Vol. 6 (2008), 193--200."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/0028-3932(93)90154-R"},{"key":"e_1_2_2_29_1","volume-title":"Orquin and Kenneth Holmqvist","author":"Jacob","year":"2018","unstructured":"Jacob L. Orquin and Kenneth Holmqvist . 2018 . Threats to the validity of eye-movement research in psychology. Behavior research methods , Vol. 50 , 4 (2018), 1645--1656. Jacob L. Orquin and Kenneth Holmqvist. 2018. Threats to the validity of eye-movement research in psychology. Behavior research methods , Vol. 50, 4 (2018), 1645--1656."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1167\/3.6.5"},{"key":"#cr-split#-e_1_2_2_31_1.1","doi-asserted-by":"crossref","unstructured":"K. H. Ruddock D. S. Wooding and S. Mannan. 1995. Automatic control of saccadic eye movements made in visual inspection of briefly presented 2-D images. Spatial vision Vol. 9 3 (1995) 363--386. https:\/\/doi.org\/10.1163\/156856895X00052 10.1163\/156856895X00052","DOI":"10.1163\/156856895X00052"},{"key":"#cr-split#-e_1_2_2_31_1.2","doi-asserted-by":"crossref","unstructured":"K. H. Ruddock D. S. Wooding and S. Mannan. 1995. Automatic control of saccadic eye movements made in visual inspection of briefly presented 2-D images. Spatial vision Vol. 9 3 (1995) 363--386. https:\/\/doi.org\/10.1163\/156856895X00052","DOI":"10.1163\/156856895X00052"},{"key":"e_1_2_2_32_1","doi-asserted-by":"crossref","unstructured":"K. H. Ruddock D. S. Wooding and S. K. Mannan. 1996. The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. Spatial vision Vol. 10 3 (1996) 165--188.  K. H. Ruddock D. S. Wooding and S. K. Mannan. 1996. The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. Spatial vision Vol. 10 3 (1996) 165--188.","DOI":"10.1163\/156856896X00123"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-018-1588-6"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3129289"},{"key":"e_1_2_2_35_1","first-page":"20","article-title":"Fixation patterns during recognition of personally familiar and unfamiliar faces","volume":"1","author":"Belle Goedele Van","year":"2010","unstructured":"Goedele Van Belle , Meike Ramon , Philippe Lef\u00e8vre , and Bruno Rossion . 2010 . Fixation patterns during recognition of personally familiar and unfamiliar faces . Frontiers in Psychology , Vol. 1 (2010), 20 . https:\/\/doi.org\/10.3389\/fpsyg.2010.00020 10.3389\/fpsyg.2010.00020 Goedele Van Belle, Meike Ramon, Philippe Lef\u00e8vre, and Bruno Rossion. 2010. Fixation patterns during recognition of personally familiar and unfamiliar faces. Frontiers in Psychology , Vol. 1 (2010), 20. https:\/\/doi.org\/10.3389\/fpsyg.2010.00020","journal-title":"Frontiers in Psychology"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1167\/12.13.3"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2017.05.013"},{"key":"e_1_2_2_38_1","volume-title":"PEFS: A Validated Dataset for Perceptual Experiments on Face Swap Portrait Videos. In International Conference on Computer Animation and Social Agents. Springer, Springer, Cham, 120--127","author":"W\u00f6hler Leslie","year":"2020","unstructured":"Leslie W\u00f6hler , Jann-Ole Henningson , Susana Castillo , and Marcus Magnor . 2020 . PEFS: A Validated Dataset for Perceptual Experiments on Face Swap Portrait Videos. In International Conference on Computer Animation and Social Agents. Springer, Springer, Cham, 120--127 . https:\/\/doi.org\/10.1007\/978--3-030--63426--1_13 10.1007\/978--3-030--63426--1_13 Leslie W\u00f6hler, Jann-Ole Henningson, Susana Castillo, and Marcus Magnor. 2020. PEFS: A Validated Dataset for Perceptual Experiments on Face Swap Portrait Videos. In International Conference on Computer Animation and Social Agents. Springer, Springer, Cham, 120--127. https:\/\/doi.org\/10.1007\/978--3-030--63426--1_13"},{"key":"e_1_2_2_39_1","volume-title":"ACM Human Factors in Computing Systems","author":"W\u00f6hler Leslie","unstructured":"Leslie W\u00f6hler , Martin Zembaty , Susana Castillo , and Marcus Magnor . 2021. Towards Understanding Perceptual Differences between Genuine and Face-Swapped Videos . In ACM Human Factors in Computing Systems . Association for Computing Machinery , New York, NY, USA , 1--13. https:\/\/doi.org\/10.1145\/3411764.3445627 10.1145\/3411764.3445627 Leslie W\u00f6hler, Martin Zembaty, Susana Castillo, and Marcus Magnor. 2021. Towards Understanding Perceptual Differences between Genuine and Face-Swapped Videos. In ACM Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--13. https:\/\/doi.org\/10.1145\/3411764.3445627"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3530885","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3530885","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:26Z","timestamp":1750183766000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3530885"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,13]]},"references-count":40,"journal-issue":{"issue":"ETRA","published-print":{"date-parts":[[2022,5,13]]}},"alternative-id":["10.1145\/3530885"],"URL":"https:\/\/doi.org\/10.1145\/3530885","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,13]]},"assertion":[{"value":"2022-05-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}