{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T03:34:21Z","timestamp":1777692861318,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":38,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,6,2]],"date-time":"2020-06-02T00:00:00Z","timestamp":1591056000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100013296","name":"EIT Digital","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100013296","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Bundesministerium f\u00fcr Bildung und Forschung"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,6,2]]},"DOI":"10.1145\/3379155.3391314","type":"proceedings-article","created":{"date-parts":[[2020,5,6]],"date-time":"2020-05-06T00:31:32Z","timestamp":1588725092000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Visual Search Target Inference in Natural Interaction Settings with Machine Learning"],"prefix":"10.1145","author":[{"given":"Michael","family":"Barz","sequence":"first","affiliation":[{"name":"German Research Center for Artificial Intelligence, Germany"}]},{"given":"Sven","family":"Stauden","sequence":"additional","affiliation":[{"name":"Saarland University"}]},{"given":"Daniel","family":"Sonntag","sequence":"additional","affiliation":[{"name":"German Research Center for Artificial Intelligence"}]}],"member":"320","published-online":{"date-parts":[[2020,6,2]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858127"},{"key":"e_1_3_2_1_2_1","volume-title":"Eye Gaze in Intelligent User Interfaces","author":"Bader Thomas","unstructured":"Thomas Bader and J\u00fcrgen Beyerer . 2013. Natural Gaze Behavior as Input Modality for Human-Computer Interaction . In Eye Gaze in Intelligent User Interfaces . Springer London , London , 161\u2013183. https:\/\/doi.org\/10.1007\/978-1-4471-4784-8_9 Thomas Bader and J\u00fcrgen Beyerer. 2013. Natural Gaze Behavior as Input Modality for Human-Computer Interaction. In Eye Gaze in Intelligent User Interfaces. Springer London, London, 161\u2013183. https:\/\/doi.org\/10.1007\/978-1-4471-4784-8_9"},{"key":"e_1_3_2_1_3_1","unstructured":"Vijay Badrinarayanan Alex Kendall and Roberto Cipolla. 2015. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. CoRR abs\/1511.00561(2015) 14. arxiv:1511.00561http:\/\/arxiv.org\/abs\/1511.00561  Vijay Badrinarayanan Alex Kendall and Roberto Cipolla. 2015. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. CoRR abs\/1511.00561(2015) 14. arxiv:1511.00561http:\/\/arxiv.org\/abs\/1511.00561"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2857491.2857493"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3204493.3204536"},{"key":"e_1_3_2_1_6_1","volume-title":"PB","author":"Borji Ali","year":"2015","unstructured":"Ali Borji , Andreas Lennartz , and Marc Pomplun . 2015. What do eyes reveal about the mind?. Algorithmic inference of search targets from fixations. Neurocomputing 149 , PB ( 2015 ), 788\u2013799. https:\/\/doi.org\/10.1016\/j.neucom.2014.07.055 Ali Borji, Andreas Lennartz, and Marc Pomplun. 2015. What do eyes reveal about the mind?. Algorithmic inference of search targets from fixations. Neurocomputing 149, PB (2015), 788\u2013799. https:\/\/doi.org\/10.1016\/j.neucom.2014.07.055"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/13506280902793843"},{"key":"e_1_3_2_1_8_1","first-page":"4","article-title":"Automatic Detection of Visual Search for the Elderly using Eye and Head Tracking Data","volume":"31","author":"Dietz Michael","year":"2017","unstructured":"Michael Dietz , Daniel Schork , Ionut Damian , Anika Steinert , Marten Haesner , and Elisabeth Andr\u00e9 . 2017 . Automatic Detection of Visual Search for the Elderly using Eye and Head Tracking Data . KI - K\u00fcnstliche Intelligenz 31 , 4 (nov 2017), 339\u2014-348. https:\/\/doi.org\/10.1007\/s13218-017-0502-z Michael Dietz, Daniel Schork, Ionut Damian, Anika Steinert, Marten Haesner, and Elisabeth Andr\u00e9. 2017. Automatic Detection of Visual Search for the Elderly using Eye and Head Tracking Data. KI - K\u00fcnstliche Intelligenz 31, 4 (nov 2017), 339\u2014-348. https:\/\/doi.org\/10.1007\/s13218-017-0502-z","journal-title":"KI - K\u00fcnstliche Intelligenz"},{"key":"e_1_3_2_1_9_1","first-page":"647","article-title":"DeCAF","volume":"32","author":"Donahue Jeff","year":"2014","unstructured":"Jeff Donahue , Yangqing Jia , Oriol Vinyals , Judy Hoffman , Ning Zhang , Eric Tzeng , and Trevor Darrell . 2014 . DeCAF : A Deep Convolutional Activation Feature for Generic Visual Recognition. Icml 32 (2014), 647 \u2013 655 . arxiv:1310.1531http:\/\/arxiv.org\/abs\/1310.1531 Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. 2014. DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition. Icml 32(2014), 647\u2013655. arxiv:1310.1531http:\/\/arxiv.org\/abs\/1310.1531","journal-title":"Icml"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature01861"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/3110856"},{"key":"e_1_3_2_1_12_1","volume-title":"An inverse Yarbus process: Predicting observers","author":"Haji-Abolhassani Amin","year":"2014","unstructured":"Amin Haji-Abolhassani and James\u00a0 J. Clark . 2014. An inverse Yarbus process: Predicting observers \u2019 task from eye movement patterns. Vision Research 103 (oct 2014 ), 127\u2013142. https:\/\/doi.org\/10.1016\/J.VISRES.2014.08.014 Amin Haji-Abolhassani and James\u00a0J. Clark. 2014. An inverse Yarbus process: Predicting observers\u2019 task from eye movement patterns. Vision Research 103 (oct 2014), 127\u2013142. https:\/\/doi.org\/10.1016\/J.VISRES.2014.08.014"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2016.7451737"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025171.3025172"},{"key":"e_1_3_2_1_15_1","volume-title":"What do saliency models predict?Journal of Vision 14, 3","author":"Koehler K.","year":"2014","unstructured":"K. Koehler , F. Guo , S. Zhang , and M.\u00a0 P. Eckstein . 2014. What do saliency models predict?Journal of Vision 14, 3 ( 2014 ), 14\u201314. https:\/\/doi.org\/10.1167\/14.3.14 K. Koehler, F. Guo, S. Zhang, and M.\u00a0P. Eckstein. 2014. What do saliency models predict?Journal of Vision 14, 3 (2014), 14\u201314. https:\/\/doi.org\/10.1167\/14.3.14"},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the 25th International Conference on Neural Information Processing Systems -","volume":"1","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey\u00a0 E. Hinton . 2012 . ImageNet Classification with Deep Convolutional Neural Networks . In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1 (Lake Tahoe, Nevada) (NIPS\u201912). Curran Associates Inc., USA, 1097\u20131105. http:\/\/dl.acm.org\/citation.cfm?id=2999134.2999257 Alex Krizhevsky, Ilya Sutskever, and Geoffrey\u00a0E. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1 (Lake Tahoe, Nevada) (NIPS\u201912). Curran Associates Inc., USA, 1097\u20131105. http:\/\/dl.acm.org\/citation.cfm?id=2999134.2999257"},{"key":"e_1_3_2_1_17_1","volume-title":"DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 1096\u20131104","author":"Liu Ziwei","year":"2016","unstructured":"Ziwei Liu , Ping Luo , Shi Qiu , Xiaogang Wang , and Xiaoou Tang . 2016 . DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 1096\u20131104 . https:\/\/doi.org\/10.1109\/CVPR.2016.124 Ziwei Liu, Ping Luo, Shi Qiu, Xiaogang Wang, and Xiaoou Tang. 2016. DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 1096\u20131104. https:\/\/doi.org\/10.1109\/CVPR.2016.124"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.1999.790410"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Sharon. Oviatt Bj\u00f6rn Schuller Philip\u00a0R. Cohen Daniel Sonntag Gerasimos Potamianos and Antonio Kr\u00fcger (Eds.). 2017. The Handbook of Multimodal-Multisensor Interfaces: Foundations User Modeling and Common Modality Combinations(volume 1 ed.). Association for Computing Machinery and Morgan & Claypool New York NY USA. 662 pages. https:\/\/doi.org\/10.1145\/3015783  Sharon. Oviatt Bj\u00f6rn Schuller Philip\u00a0R. Cohen Daniel Sonntag Gerasimos Potamianos and Antonio Kr\u00fcger (Eds.). 2017. The Handbook of Multimodal-Multisensor Interfaces: Foundations User Modeling and Common Modality Combinations(volume 1 ed.). Association for Computing Machinery and Morgan & Claypool New York NY USA. 662 pages. https:\/\/doi.org\/10.1145\/3015783","DOI":"10.1145\/3015783"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Sharon Oviatt Bj\u00f6rn Schuller Philip\u00a0R Cohen Daniel Sonntag Gerasimos Potamianos and Antonio Kr\u00fcger (Eds.). 2018. The Handbook of Multimodal-Multisensor Interfaces: Signal Processing Architectures and Detection of Emotion and Cognition (volume 2 ed.). Vol.\u00a02. Association for Computing Machinery and Morgan & Claypool New York NY USA. https:\/\/doi.org\/10.1145\/3107990  Sharon Oviatt Bj\u00f6rn Schuller Philip\u00a0R Cohen Daniel Sonntag Gerasimos Potamianos and Antonio Kr\u00fcger (Eds.). 2018. The Handbook of Multimodal-Multisensor Interfaces: Signal Processing Architectures and Detection of Emotion and Cognition (volume 2 ed.). Vol.\u00a02. Association for Computing Machinery and Morgan & Claypool New York NY USA. https:\/\/doi.org\/10.1145\/3107990","DOI":"10.1145\/3107990"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2014.131"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1167\/7.14.16"},{"key":"e_1_3_2_1_23_1","volume-title":"Eye movements when observing predictable and unpredictable actions.Journal of neurophysiology 96, 3 (sep","author":"Rotman Gerben","year":"2006","unstructured":"Gerben Rotman , Nikolaus\u00a0 F Troje , Roland\u00a0 S. Johansson , and J.\u00a0 Randall Flanagan . 2006. Eye movements when observing predictable and unpredictable actions.Journal of neurophysiology 96, 3 (sep 2006 ), 1358\u201369. https:\/\/doi.org\/10.1152\/jn.00227.2006 Gerben Rotman, Nikolaus\u00a0F Troje, Roland\u00a0S. Johansson, and J.\u00a0Randall Flanagan. 2006. Eye movements when observing predictable and unpredictable actions.Journal of neurophysiology 96, 3 (sep 2006), 1358\u201369. https:\/\/doi.org\/10.1152\/jn.00227.2006"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_3_2_1_25_1","volume-title":"Predicting the Category and Attributes of Visual Search Targets Using Deep Gaze Pooling. In 2017 IEEE International Conference on Computer Vision Workshops (ICCVW). IEEE, 2740\u20132748","author":"Sattar Hosnieh","year":"2017","unstructured":"Hosnieh Sattar , Andreas Bulling , and Mario Fritz . 2017 a. Predicting the Category and Attributes of Visual Search Targets Using Deep Gaze Pooling. In 2017 IEEE International Conference on Computer Vision Workshops (ICCVW). IEEE, 2740\u20132748 . https:\/\/doi.org\/10.1109\/ICCVW.2017.322 Hosnieh Sattar, Andreas Bulling, and Mario Fritz. 2017a. Predicting the Category and Attributes of Visual Search Targets Using Deep Gaze Pooling. In 2017 IEEE International Conference on Computer Vision Workshops (ICCVW). IEEE, 2740\u20132748. https:\/\/doi.org\/10.1109\/ICCVW.2017.322"},{"key":"e_1_3_2_1_26_1","unstructured":"Hosnieh Sattar Mario Fritz and Andreas Bulling. 2017b. Visual Decoding of Targets During Visual Search From Human Eye Fixations. CoRR abs\/1706.05993(2017) 9. arxiv:1706.05993http:\/\/arxiv.org\/abs\/1706.05993  Hosnieh Sattar Mario Fritz and Andreas Bulling. 2017b. Visual Decoding of Targets During Visual Search From Human Eye Fixations. CoRR abs\/1706.05993(2017) 9. arxiv:1706.05993http:\/\/arxiv.org\/abs\/1706.05993"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298700"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298655"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13218-012-0169-4"},{"key":"e_1_3_2_1_30_1","volume-title":"Kognit: Intelligent Cognitive Enhancement Technology by Cognitive Models and Mixed Reality for Dementia Patients. In 2015 AAAI Fall Symposia","author":"Sonntag Daniel","year":"2015","unstructured":"Daniel Sonntag . 2015 . Kognit: Intelligent Cognitive Enhancement Technology by Cognitive Models and Mixed Reality for Dementia Patients. In 2015 AAAI Fall Symposia , Arlington, Virginia, USA , November 12-14, 2015. AAAI Press , 47\u201353. https:\/\/www.aaai.org\/ocs\/index.php\/FSS\/FSS15\/paper\/view\/11702 Daniel Sonntag. 2015. Kognit: Intelligent Cognitive Enhancement Technology by Cognitive Models and Mixed Reality for Dementia Patients. In 2015 AAAI Fall Symposia, Arlington, Virginia, USA, November 12-14, 2015. AAAI Press, 47\u201353. https:\/\/www.aaai.org\/ocs\/index.php\/FSS\/FSS15\/paper\/view\/11702"},{"key":"e_1_3_2_1_31_1","volume-title":"KI 2018: Advances in Artificial Intelligence, Frank Trollmann and Anni-Yasmin Turhan (Eds.)","author":"Stauden Sven","unstructured":"Sven Stauden , Michael Barz , and Daniel Sonntag . 2018. Visual Search Target Inference Using Bag of Deep Visual Words . In KI 2018: Advances in Artificial Intelligence, Frank Trollmann and Anni-Yasmin Turhan (Eds.) . Springer International Publishing , Cham , 297\u2013304. Sven Stauden, Michael Barz, and Daniel Sonntag. 2018. Visual Search Target Inference Using Bag of Deep Visual Words. In KI 2018: Advances in Artificial Intelligence, Frank Trollmann and Anni-Yasmin Turhan (Eds.). Springer International Publishing, Cham, 297\u2013304."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3229434.3229439"},{"key":"e_1_3_2_1_33_1","volume-title":"KI 2015: Advances in Artificial Intelligence, Steffen H\u00f6lldobler, Rafael Pe\u00f1aloza","author":"Toyama Takumi","unstructured":"Takumi Toyama and Daniel Sonntag . 2015. Towards Episodic Memory Support for Dementia Patients by Recognizing Objects, Faces and Text in Eye Gaze . In KI 2015: Advances in Artificial Intelligence, Steffen H\u00f6lldobler, Rafael Pe\u00f1aloza , and Sebastian Rudolph (Eds.). Springer International Publishing , Cham , 316\u2013323. Takumi Toyama and Daniel Sonntag. 2015. Towards Episodic Memory Support for Dementia Patients by Recognizing Objects, Faces and Text in Eye Gaze. In KI 2015: Advances in Artificial Intelligence, Steffen H\u00f6lldobler, Rafael Pe\u00f1aloza, and Sebastian Rudolph (Eds.). Springer International Publishing, Cham, 316\u2013323."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03200774"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1290082.1290111"},{"key":"e_1_3_2_1_36_1","first-page":"222","article-title":"Eye movements and vision","volume":"6","author":"Yarbus L.","year":"1967","unstructured":"Alfred\u00a0 L. Yarbus . 1967 . Eye movements and vision . Neuropsychologia 6 , 4 (1967), 222 . https:\/\/doi.org\/10.1016\/0028-3932(68)90012-2 arxiv:arXiv:1011.1669v3 Alfred\u00a0L. Yarbus. 1967. Eye movements and vision. Neuropsychologia 6, 4 (1967), 222. https:\/\/doi.org\/10.1016\/0028-3932(68)90012-2 arxiv:arXiv:1011.1669v3","journal-title":"Neuropsychologia"},{"key":"e_1_3_2_1_37_1","volume-title":"A Survey on Deep Learning Toolkits and Libraries for Intelligent User Interfaces. CoRR (mar","author":"Zacharias Jan","year":"2018","unstructured":"Jan Zacharias , Michael Barz , and Daniel Sonntag . 2018. A Survey on Deep Learning Toolkits and Libraries for Intelligent User Interfaces. CoRR (mar 2018 ). arxiv:1803.04818http:\/\/arxiv.org\/abs\/1803.04818 Jan Zacharias, Michael Barz, and Daniel Sonntag. 2018. A Survey on Deep Learning Toolkits and Libraries for Intelligent User Interfaces. CoRR (mar 2018). arxiv:1803.04818http:\/\/arxiv.org\/abs\/1803.04818"},{"key":"e_1_3_2_1_38_1","volume-title":"Eye can read your mind: decoding gaze fixations to reveal categorical search targets.Journal of vision 13, 14 (dec","author":"Zelinsky J","year":"2013","unstructured":"Gregory\u00a0 J Zelinsky , Yifan Peng , and Dimitris Samaras . 2013. Eye can read your mind: decoding gaze fixations to reveal categorical search targets.Journal of vision 13, 14 (dec 2013 ), 1\u201313. https:\/\/doi.org\/10.1167\/13.14.10 Gregory\u00a0J Zelinsky, Yifan Peng, and Dimitris Samaras. 2013. Eye can read your mind: decoding gaze fixations to reveal categorical search targets.Journal of vision 13, 14 (dec 2013), 1\u201313. https:\/\/doi.org\/10.1167\/13.14.10"}],"event":{"name":"ETRA '20: 2020 Symposium on Eye Tracking Research and Applications","location":"Stuttgart Germany","acronym":"ETRA '20","sponsor":["SIGGRAPH ACM Special Interest Group on Computer Graphics and Interactive Techniques","SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["ACM Symposium on Eye Tracking Research and Applications"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3379155.3391314","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3379155.3391314","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:48Z","timestamp":1750203888000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3379155.3391314"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,2]]},"references-count":38,"alternative-id":["10.1145\/3379155.3391314","10.1145\/3379155"],"URL":"https:\/\/doi.org\/10.1145\/3379155.3391314","relation":{},"subject":[],"published":{"date-parts":[[2020,6,2]]},"assertion":[{"value":"2020-06-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}