{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,2]],"date-time":"2025-10-02T05:57:23Z","timestamp":1759384643407,"version":"3.41.0"},"reference-count":61,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,5,31]],"date-time":"2017-05-31T00:00:00Z","timestamp":1496188800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2017,8,31]]},"abstract":"<jats:p>Traditional comics are increasingly being augmented with digital effects, such as recoloring, stereoscopy, and animation. An open question in this endeavor is identifying where in a comic panel the effects should be placed. We propose a fast, semi-automatic technique to identify effects-worthy segments in a comic panel by utilizing gaze locations as a proxy for the importance of a region. We take advantage of the fact that comic artists influence viewer gaze towards narrative important regions. By capturing gaze locations from multiple viewers, we can identify important regions and direct a computer vision segmentation algorithm to extract these segments. The challenge is that these gaze data are noisy and difficult to process. Our key contribution is to leverage a theoretical breakthrough in the computer networks community towards robust and meaningful clustering of gaze locations into semantic regions, without needing the user to specify the number of clusters. We present a method based on the concept of relative eigen quality that takes a scanned comic image and a set of gaze points and produces an image segmentation. We demonstrate a variety of effects such as defocus, recoloring, stereoscopy, and animations. We also investigate the use of artificially generated gaze locations from saliency models in place of actual gaze locations.<\/jats:p>","DOI":"10.1145\/3078836","type":"journal-article","created":{"date-parts":[[2017,6,5]],"date-time":"2017-06-05T12:50:00Z","timestamp":1496667000000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Creating Segments and Effects on Comics by Clustering Gaze Data"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0061-7700","authenticated-orcid":false,"given":"Ishwarya","family":"Thirunarayanan","sequence":"first","affiliation":[{"name":"University of Florida, Gainesville, FL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Khimya","family":"Khetarpal","sequence":"additional","affiliation":[{"name":"University of Florida, Gainesville, FL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sanjeev","family":"Koppal","sequence":"additional","affiliation":[{"name":"University of Florida, Gainesville, FL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olivier Le","family":"Meur","sequence":"additional","affiliation":[{"name":"IRISA University of Rennes 1, Rennes Cedex, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Shea","sequence":"additional","affiliation":[{"name":"University of Florida, Gainesville, FL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eakta","family":"Jain","sequence":"additional","affiliation":[{"name":"University of Florida, Gainesville, FL"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,5,31]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Radhakrishna Achanta Appu Shaji Kevin Smith Aurelien Lucchi Pascal Fua and Sabine S\u00fcsstrunk. 2010. Slic Superpixels. Technical Report.  Radhakrishna Achanta Appu Shaji Kevin Smith Aurelien Lucchi Pascal Fua and Sabine S\u00fcsstrunk. 2010. Slic Superpixels. Technical Report."},{"key":"e_1_2_2_2_1","volume-title":"Proceedings of the 6th York Doctoral Symposium on Computer Science 8 Electronics","volume":"1","author":"Al-Showarah Suleyman","year":"2013","unstructured":"Suleyman Al-Showarah , Naseer Al-Jawad , and Harin Sellahewa . 2013 . Examining eye-tracker scan paths for elderly people using smart phones . In Proceedings of the 6th York Doctoral Symposium on Computer Science 8 Electronics , Vol. 1 . 7. Suleyman Al-Showarah, Naseer Al-Jawad, and Harin Sellahewa. 2013. Examining eye-tracker scan paths for elderly people using smart phones. In Proceedings of the 6th York Doctoral Symposium on Computer Science 8 Electronics, Vol. 1. 7."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2614217.2614255"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.161"},{"key":"e_1_2_2_5_1","unstructured":"Archive. 2015. Internet Archive. Retrieved from http:\/\/archive.org\/.  Archive. 2015. Internet Archive. Retrieved from http:\/\/archive.org\/."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2007.01080.x"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.3758\/APP.71.4.881"},{"key":"e_1_2_2_8_1","volume-title":"CAT2000: A large scale fixation dataset for boosting saliency research. In Proceedings of the Computer Vision and Pattern Recognition 2015 Workshop on \u201cFuture of Datasets\u201d","author":"Borji Ali","year":"2015","unstructured":"Ali Borji and Laurent Itti . 2015 . CAT2000: A large scale fixation dataset for boosting saliency research. In Proceedings of the Computer Vision and Pattern Recognition 2015 Workshop on \u201cFuture of Datasets\u201d Ali Borji and Laurent Itti. 2015. CAT2000: A large scale fixation dataset for boosting saliency research. In Proceedings of the Computer Vision and Pattern Recognition 2015 Workshop on \u201cFuture of Datasets\u201d"},{"key":"e_1_2_2_9_1","unstructured":"Zoya Bylinskii Tilke Judd Ali Borji Laurent Itti Fr\u00e9do Durand Aude Oliva and Antonio Torralba. 2016. MIT Saliency Benchmark. Retrieved from http:\/\/saliency.mit.edu\/.  Zoya Bylinskii Tilke Judd Ali Borji Laurent Itti Fr\u00e9do Durand Aude Oliva and Antonio Torralba. 2016. MIT Saliency Benchmark. Retrieved from http:\/\/saliency.mit.edu\/."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766978"},{"key":"e_1_2_2_11_1","volume-title":"Human attention estimation for natural images: An automatic gaze refinement approach. arXiv Preprint arXiv:1601.02852","author":"Choi Jinsoo","year":"2016","unstructured":"Jinsoo Choi , Tae-Hyun Oh , and In So Kweon . 2016. Human attention estimation for natural images: An automatic gaze refinement approach. arXiv Preprint arXiv:1601.02852 ( 2016 ). Jinsoo Choi, Tae-Hyun Oh, and In So Kweon. 2016. Human attention estimation for natural images: An automatic gaze refinement approach. arXiv Preprint arXiv:1601.02852 (2016)."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073273"},{"key":"e_1_2_2_13_1","unstructured":"ComicBookPlus. 2015. Comics in public domain. Retrieved From http:\/\/comicbookplus.com\/.  ComicBookPlus. 2015. Comics in public domain. Retrieved From http:\/\/comicbookplus.com\/."},{"key":"e_1_2_2_14_1","unstructured":"Comichron. 2015. Comichron sales data. Retrieved from http:\/\/www.comichron.com\/monthlycomicssales.html.  Comichron. 2015. Comichron sales data. Retrieved from http:\/\/www.comichron.com\/monthlycomicssales.html."},{"key":"e_1_2_2_15_1","volume-title":"A deep multi-level network for saliency prediction. arXiv Preprint arXiv:1609.01064","author":"Cornia Marcella","year":"2016","unstructured":"Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , and Rita Cucchiara . 2016. A deep multi-level network for saliency prediction. arXiv Preprint arXiv:1609.01064 ( 2016 ). Marcella Cornia, Lorenzo Baraldi, Giuseppe Serra, and Rita Cucchiara. 2016. A deep multi-level network for saliency prediction. arXiv Preprint arXiv:1609.01064 (2016)."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566650"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.231"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743666.1743721"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.730558"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2338676.2338688"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298710"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1167\/11.4.14"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459462"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33715-4_56"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298944"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874047"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2556987"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMEW.2016.7574728"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601209"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366159"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.239"},{"key":"e_1_2_2_34_1","volume-title":"Deepfix: A fully convolutional neural network for predicting human eye fixations. arXiv Preprint arXiv:1510.02927","author":"Kruthiventi Srinivas S. S.","year":"2015","unstructured":"Srinivas S. S. Kruthiventi , Kumar Ayush , and R. Venkatesh Babu . 2015 . Deepfix: A fully convolutional neural network for predicting human eye fixations. arXiv Preprint arXiv:1510.02927 (2015). Srinivas S. S. Kruthiventi, Kumar Ayush, and R. Venkatesh Babu. 2015. Deepfix: A fully convolutional neural network for predicting human eye fixations. arXiv Preprint arXiv:1510.02927 (2015)."},{"key":"e_1_2_2_35_1","volume-title":"DeepGaze II: Reading fixations from deep features trained on object recognition. arXiv Preprint arXiv:1610.01563","author":"K\u00fcmmerer Matthias","year":"2016","unstructured":"Matthias K\u00fcmmerer , Thomas S. A. Wallis , and Matthias Bethge . 2016. DeepGaze II: Reading fixations from deep features trained on object recognition. arXiv Preprint arXiv:1610.01563 ( 2016 ). Matthias K\u00fcmmerer, Thomas S. A. Wallis, and Matthias Bethge. 2016. DeepGaze II: Reading fixations from deep features trained on object recognition. arXiv Preprint arXiv:1610.01563 (2016)."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2016.01.005"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2014.12.026"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015780"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1177"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882261.1866173"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s004220100274"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459254"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218442"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2011.02062.x"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_24"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1142017"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/1888089.1888093"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0090-8"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/355017.355028"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124886"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/968363.968368"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/MILCOM.2013.32"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.868688"},{"key":"e_1_2_2_54_1","volume-title":"Application of clustering algorithms in eye gaze visualizations. Information Technology And Control 36, 2","author":"\u0160pakov Oleg","year":"2015","unstructured":"Oleg \u0160pakov and Darius Miniotas . 2015. Application of clustering algorithms in eye gaze visualizations. Information Technology And Control 36, 2 ( 2015 ). Oleg \u0160pakov and Darius Miniotas. 2015. Application of clustering algorithms in eye gaze visualizations. Information Technology And Control 36, 2 (2015)."},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465780.2465784"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/946247.946639"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/984952.984989"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01400.x"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168556.2168617"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/1314303.1314308"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2006.10.001"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409070"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.9"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3078836","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3078836","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:03:08Z","timestamp":1750215788000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3078836"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5,31]]},"references-count":61,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,8,31]]}},"alternative-id":["10.1145\/3078836"],"URL":"https:\/\/doi.org\/10.1145\/3078836","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2017,5,31]]},"assertion":[{"value":"2016-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-05-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}