{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,1]],"date-time":"2025-12-01T11:23:46Z","timestamp":1764588226647,"version":"3.37.3"},"reference-count":50,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,8,18]],"date-time":"2021-08-18T00:00:00Z","timestamp":1629244800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,18]],"date-time":"2021-08-18T00:00:00Z","timestamp":1629244800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100010446","name":"Institute for Basic Science","doi-asserted-by":"crossref","award":["IBS-R029-C"],"award-info":[{"award-number":["IBS-R029-C"]}],"id":[{"id":"10.13039\/501100010446","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF-2017R1E1A1A01076400"],"award-info":[{"award-number":["NRF-2017R1E1A1A01076400"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"national research foundation of korea","doi-asserted-by":"publisher","award":["NRF-2021R1F1A1062691"],"award-info":[{"award-number":["NRF-2021R1F1A1062691"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["EPJ Data Sci."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Live streaming services enable the audience to interact with one another and the streamer over live content. The surging popularity of live streaming platforms has created a competitive environment. To retain existing viewers and attract newcomers, streamers and fans often create a well-condensed summary of the streamed content. However, this process is manual and costly due to the length of online live streaming events. The current study identifies enjoyable moments in user-generated live video content by examining the audiences\u2019 collective evaluation of its epicness. We characterize what features \u201cepic\u201d moments and present a deep learning model to extract them based on analyzing two million user-recommended clips and the associated chat conversations. The evaluation shows that our data-driven approach can identify epic moments from user-generated streamed content that cover various contexts (e.g., victory, funny, awkward, embarrassing). Our user study further demonstrates that the proposed automatic model performs comparably to expert suggestions. We discuss implications of the collective decision-driven extraction in identifying diverse epic moments in a scalable way.<\/jats:p>","DOI":"10.1140\/epjds\/s13688-021-00295-6","type":"journal-article","created":{"date-parts":[[2021,8,18]],"date-time":"2021-08-18T10:03:59Z","timestamp":1629281039000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Finding epic moments in live content through deep learning on collective decisions"],"prefix":"10.1140","volume":"10","author":[{"given":"Hyeonho","family":"Song","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2913-9711","authenticated-orcid":false,"given":"Kunwoo","family":"Park","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4085-9648","authenticated-orcid":false,"given":"Meeyoung","family":"Cha","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,8,18]]},"reference":[{"key":"295_CR1","volume-title":"Twitch revenue and usage statistics","author":"I Mansoor","year":"2021","unstructured":"Mansoor I (2021) Twitch revenue and usage statistics. https:\/\/www.businessofapps.com\/data\/twitch-statistics\/ (Accessed July 24, 2021)"},{"key":"295_CR2","first-page":"261","volume-title":"European conference on computer vision","author":"M Rochan","year":"2020","unstructured":"Rochan M, Reddy MKK, Ye L, Wang Y (2020) Adaptive video highlight detection by learning from user history. In: European conference on computer vision. Springer, Berlin, pp\u00a0261\u2013278"},{"key":"295_CR3","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1007\/978-981-15-5925-9_37","volume-title":"International conference on intelligent decision technologies","author":"P Drankou","year":"2020","unstructured":"Drankou P, Zykov S (2020) Chat-based approach applied to automatic livestream highlight generation. In: International conference on intelligent decision technologies. Springer, Berlin, pp\u00a0437\u2013447"},{"key":"295_CR4","first-page":"1258","volume-title":"Proc. of the IEEE conference on computer vision and pattern recognition","author":"B Xiong","year":"2019","unstructured":"Xiong B, Kalantidis Y, Ghadiyaram D, Grauman K (2019) Less is more: learning highlight detection from video duration. In: Proc. of the IEEE conference on computer vision and pattern recognition, pp\u00a01258\u20131267"},{"key":"295_CR5","first-page":"972","volume-title":"Proc. of the conference on empirical methods in natural language processing","author":"C-Y Fu","year":"2017","unstructured":"Fu C-Y, Lee J, Bansal M, Berg A (2017) Video highlight prediction using audience chat reactions. In: Proc. of the conference on empirical methods in natural language processing, pp\u00a0972\u2013978"},{"key":"295_CR6","first-page":"982","volume-title":"Proc. of the IEEE conference on computer vision and pattern recognition","author":"T Yao","year":"2016","unstructured":"Yao T, Mei T, Rui Y (2016) Highlight detection with pairwise deep ranking for first-person video summarization. In: Proc. of the IEEE conference on computer vision and pattern recognition, pp\u00a0982\u2013990"},{"issue":"4","key":"295_CR7","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1109\/TMM.2004.830811","volume":"6","author":"N Babaguchi","year":"2004","unstructured":"Babaguchi N, Kawai Y, Ogura T, Kitahashi T (2004) Personalized abstraction of broadcasted American football video by highlight selection. IEEE Trans Multimed 6(4):575\u2013586","journal-title":"IEEE Trans Multimed"},{"issue":"10","key":"295_CR8","doi-asserted-by":"publisher","first-page":"2693","DOI":"10.1109\/TMM.2018.2815998","volume":"20","author":"Y Jiao","year":"2018","unstructured":"Jiao Y, Li Z, Huang S, Yang X, Liu B, Zhang T (2018) Three-dimensional attention-based deep ranking model for video highlight detection. IEEE Trans Multimed 20(10):2693\u20132705","journal-title":"IEEE Trans Multimed"},{"key":"295_CR9","doi-asserted-by":"publisher","first-page":"1181","DOI":"10.1145\/2187980.2188259","volume-title":"Proc. of the international conference on world wide web","author":"M Kaytoue","year":"2012","unstructured":"Kaytoue M, Silva A, Cerf L, Meira W Jr, Ra\u00efssi C (2012) Watch me playing, I am a professional: a first study on video game live streaming. In: Proc. of the international conference on world wide web, pp\u00a01181\u20131188"},{"key":"295_CR10","first-page":"99","volume-title":"International conference on social computing and social media","author":"K Scheibe","year":"2018","unstructured":"Scheibe K (2018) The impact of gamification in social live streaming services. In: International conference on social computing and social media. Springer, Berlin, pp\u00a099\u2013113"},{"issue":"3","key":"295_CR11","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1177\/1555412018788161","volume":"15","author":"T Wulf","year":"2020","unstructured":"Wulf T, Schneider FM, Beckert S (2020) Watching players: an exploration of media enjoyment on twitch. Games Cult 15(3):328\u2013346. https:\/\/doi.org\/10.1177\/1555412018788161","journal-title":"Games Cult"},{"key":"295_CR12","doi-asserted-by":"publisher","first-page":"1315","DOI":"10.1145\/2556288.2557048","volume-title":"Proc. of the ACM conference on human factors in computing systems","author":"WA Hamilton","year":"2014","unstructured":"Hamilton WA, Garretson O, Kerne A (2014) Streaming on twitch: fostering participatory communities of play within live mixed media. In: Proc. of the ACM conference on human factors in computing systems, pp\u00a01315\u20131324"},{"key":"295_CR13","first-page":"1","volume-title":"Proc. of the ACM conference on computer-supported cooperative work and social computing 4","author":"JT Sheng","year":"2020","unstructured":"Sheng JT, Kairam SR (2020) From virtual strangers to irl friends: relationship development in livestreaming communities on twitch. In: Proc. of the ACM conference on computer-supported cooperative work and social computing 4, pp\u00a01\u201334"},{"key":"295_CR14","first-page":"858","volume-title":"Extended abstracts on human factors in computing systems","author":"C Ford","year":"2017","unstructured":"Ford C, Gardner D, Horgan LE, Liu C, Tsaasan AM, Nardi B, Rickman J (2017) Chat speed op pogchamp: practices of coherence in massive twitch chat. In: Extended abstracts on human factors in computing systems, pp\u00a0858\u2013871"},{"issue":"10","key":"295_CR15","doi-asserted-by":"publisher","DOI":"10.1098\/rsos.191412","volume":"6","author":"A Nematzadeh","year":"2019","unstructured":"Nematzadeh A, Ciampaglia GL, Ahn Y-Y, Flammini A (2019) Information overload in group communication: from conversation to cacophony in the twitch chat. R Soc Open Sci 6(10):191412","journal-title":"R Soc Open Sci"},{"key":"295_CR16","unstructured":"Musabirov I, Bulygin D, Okopny P, Konstantinova K (2018) Between an arena and a sports bar: online chats of esports spectators. arXiv preprint. arXiv:1801.02862"},{"key":"295_CR17","first-page":"263","volume-title":"Proc. of the ACM conference on computer supported cooperative work and social computing","author":"J Guo","year":"2020","unstructured":"Guo J, Fussell SR (2020) A preliminary study of emotional contagion in live streaming. In: Proc. of the ACM conference on computer supported cooperative work and social computing, pp\u00a0263\u2013268"},{"key":"295_CR18","first-page":"111","volume-title":"Proc. of the ACM conference on computer supported cooperative work and social computing","author":"J Seering","year":"2017","unstructured":"Seering J, Kraut R, Dabbish L (2017) Shaping pro and anti-social behavior on twitch through moderation and example-setting. In: Proc. of the ACM conference on computer supported cooperative work and social computing, pp\u00a0111\u2013125"},{"key":"295_CR19","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1145\/3342220.3344926","volume-title":"Proc. of the ACM conference on hypertext and social media","author":"C Flores-Saviaga","year":"2019","unstructured":"Flores-Saviaga C, Hammer J, Flores JP, Seering J, Reeves S, Savage S (2019) Audience and streamer participation at scale on twitch. In: Proc. of the ACM conference on hypertext and social media, pp\u00a0277\u2013278"},{"key":"295_CR20","volume-title":"Proc. of the international AAAI conference on web and social","author":"SC Nakandala","year":"2017","unstructured":"Nakandala SC, Ciampaglia GL, Su NM, Ahn Y-Y (2017) Gendered conversation in a social game-streaming platform. In: Proc. of the international AAAI conference on web and social, Media"},{"issue":"4","key":"295_CR21","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1177\/0193723518773287","volume":"42","author":"O Ruvalcaba","year":"2018","unstructured":"Ruvalcaba O, Shulze J, Kim A, Berzenski SR, Otten MP (2018) Women\u2019s experiences in esports: gendered differences in peer and spectator feedback during competitive video game play. J Sport Soc Iss 42(4):295\u2013311","journal-title":"J Sport Soc Iss"},{"key":"295_CR22","doi-asserted-by":"crossref","unstructured":"Eisner B, Rockt\u00e4schel T, Augenstein I, Bo\u0161njak M, Riedel S (2016) emoji2vec: learning emoji representations from their description. arXiv preprint. arXiv:1609.08359","DOI":"10.18653\/v1\/W16-6208"},{"key":"295_CR23","unstructured":"Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint. arXiv:1301.3781"},{"issue":"2","key":"295_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3365523","volume":"3","author":"K Kobs","year":"2020","unstructured":"Kobs K, Zehe A, Bernstetter A, Chibane J, Pfister J, Tritscher J, Hotho A (2020) Emote-controlled: obtaining implicit viewer feedback through emote-based sentiment analysis on comments of popular twitch. tv channels. ACM Trans Soc Comput 3(2):1\u201334","journal-title":"ACM Trans Soc Comput"},{"key":"295_CR25","volume-title":"Proc. of the AAAI international conference on weblogs and social","author":"C Gilbert","year":"2014","unstructured":"Gilbert C, Hutto E (2014) Vader: a parsimonious rule-based model for sentiment analysis of social media text. In: Proc. of the AAAI international conference on weblogs and social, Media"},{"key":"295_CR26","unstructured":"Ha J-W, Kim A, Kim C, Park J, Kim S (2017) Automatic music highlight extraction using convolutional recurrent attention networks. arXiv preprint. arXiv:1712.05901"},{"key":"295_CR27","first-page":"949","volume-title":"Proc. of the IEEE international conference on multimedia and expo","author":"L-C Hsieh","year":"2012","unstructured":"Hsieh L-C, Lee C-W, Chiu T-H, Hsu W (2012) Live semantic sport highlight detection based on analyzing tweets of Twitter. In: Proc. of the IEEE international conference on multimedia and expo, pp\u00a0949\u2013954"},{"key":"295_CR28","first-page":"25","volume-title":"Proc. of the ACM workshop on network and operating systems support for digital audio and video","author":"C Zhang","year":"2017","unstructured":"Zhang C, Liu J, Ma M, Sun L, Li B (2017) Seeker: topic-aware viewing pattern prediction in crowdsourced interactive live streaming. In: Proc. of the ACM workshop on network and operating systems support for digital audio and video, pp\u00a025\u201330"},{"issue":"7","key":"295_CR29","doi-asserted-by":"publisher","first-page":"9735","DOI":"10.1007\/s11042-016-3577-x","volume":"76","author":"W-T Chu","year":"2017","unstructured":"Chu W-T, Chou Y-C (2017) On broadcasted game video analysis: event detection, highlight detection, and highlight forecast. Multimed Tools Appl 76(7):9735\u20139758","journal-title":"Multimed Tools Appl"},{"key":"295_CR30","first-page":"787","volume-title":"Proc. of the European conference on computer vision","author":"M Sun","year":"2014","unstructured":"Sun M, Farhadi A, Seitz S (2014) Ranking domain-specific highlights by analyzing edited videos. In: Proc. of the European conference on computer vision, pp\u00a0787\u2013802"},{"key":"295_CR31","first-page":"1","volume-title":"Proc. of the IEEE international conference on affective computing and intelligent interaction","author":"K Makantasis","year":"2019","unstructured":"Makantasis K, Liapis A, Yannakakis GN (2019) From pixels to affect: a study on games and player experience. In: Proc. of the IEEE international conference on affective computing and intelligent interaction, pp\u00a01\u20137"},{"key":"295_CR32","first-page":"1","volume-title":"Proc. of the international conference on the foundations of digital games","author":"D Melhart","year":"2020","unstructured":"Melhart D, Gravina D, Yannakakis GN (2020) Moment-to-moment engagement prediction through the eyes of the observer: pubg streaming on twitch. In: Proc. of the international conference on the foundations of digital games, pp\u00a01\u201310"},{"key":"295_CR33","unstructured":"TwitchMetric. https:\/\/www.twitchmetrics.net\/ (Accessed Jul 24, 2021)"},{"key":"295_CR34","unstructured":"Twitchstats. https:\/\/www.twitchstats.net\/ (Accessed Jul 24, 2021)"},{"key":"295_CR35","first-page":"564","volume-title":"Extended abstracts of the ACM CHI conference on human factors in computing systems","author":"I Musabirov","year":"2018","unstructured":"Musabirov I, Bulygin D, Okopny P, Konstantinova K (2018) Event-driven spectators\u2019 communication in massive esports online chats. In: Extended abstracts of the ACM CHI conference on human factors in computing systems, p\u00a0564"},{"key":"295_CR36","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1145\/3311350.3347160","volume-title":"Proc. of the ACM annual symposium on computer-human interaction in play","author":"DY Wohn","year":"2019","unstructured":"Wohn DY, Jough P, Eskander P, Siri JS, Shimobayashi M, Desai P (2019) Understanding digital patronage: why do people subscribe to streamers on twitch?. In: Proc. of the ACM annual symposium on computer-human interaction in play, pp\u00a099\u2013110"},{"key":"295_CR37","first-page":"247","volume-title":"Proc. of the ACM conference on computer supported cooperative work and social computing","author":"J Kim","year":"2019","unstructured":"Kim J, Bae K, Park E, del Pobil AP (2019) Who will subscribe to my streaming channel? The case of twitch. In: Proc. of the ACM conference on computer supported cooperative work and social computing, pp\u00a0247\u2013251"},{"key":"295_CR38","first-page":"147","volume-title":"Proc. of the IEEE international conference on big data and smart computing","author":"J Kim","year":"2020","unstructured":"Kim J, Park K, Song H, Park JY, Cha M (2020) Learning how spectator reactions affect popularity on twitch. In: Proc. of the IEEE international conference on big data and smart computing, pp\u00a0147\u2013154"},{"key":"295_CR39","volume-title":"Proceedings of the international AAAI conference on web and social media","author":"S Kairam","year":"2013","unstructured":"Kairam S, Morris M, Teevan J, Liebling D, Dumais S (2013) Towards supporting search over trending events with social media. In: Proceedings of the international AAAI conference on web and social media, vol\u00a07"},{"key":"295_CR40","first-page":"329","volume-title":"Redefining community in intercultural context","author":"J Olejniczak","year":"2015","unstructured":"Olejniczak J (2015) A linguistic study of language variety used on twitch. tv: desriptive and corpus-based approaches. In: Redefining community in intercultural context, pp\u00a0329\u2013344"},{"issue":"1","key":"295_CR41","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-014-0007-7","volume":"2","author":"MM Najafabadi","year":"2015","unstructured":"Najafabadi MM, Villanustre F, Khoshgoftaar TM, Seliya N, Wald R, Muharemagic E (2015) Deep learning applications and challenges in big data analytics. J Big Data 2(1):1","journal-title":"J Big Data"},{"key":"295_CR42","first-page":"791","volume-title":"Proc. of the AAAI conference on artificial intelligence","author":"S Yoon","year":"2019","unstructured":"Yoon S, Park K, Shin J, Lim H, Won S, Cha M, Jung K (2019) Detecting incongruity between news headline and body text via a deep hierarchical encoder. In: Proc. of the AAAI conference on artificial intelligence, vol\u00a033, pp\u00a0791\u2013800"},{"key":"295_CR43","first-page":"1","volume-title":"Proc. of the international conference on the foundations of digital games","author":"C Ringer","year":"2018","unstructured":"Ringer C, Nicolaou MA (2018) Deep unsupervised multi-view detection of video game stream highlights. In: Proc. of the international conference on the foundations of digital games, pp\u00a01\u20136"},{"key":"295_CR44","first-page":"770","volume-title":"Proc. of the IEEE conference on computer vision and pattern recognition","author":"K He","year":"2016","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proc. of the IEEE conference on computer vision and pattern recognition, pp\u00a0770\u2013778"},{"key":"295_CR45","first-page":"248","volume-title":"Proc. of the IEEE conference on computer vision and pattern recognition","author":"J Deng","year":"2009","unstructured":"Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: Proc. of the IEEE conference on computer vision and pattern recognition, pp\u00a0248\u2013255"},{"key":"295_CR46","unstructured":"Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint. arXiv:1409.1556"},{"key":"295_CR47","first-page":"1","volume-title":"Proc. of the IEEE conference on games","author":"C Ringer","year":"2019","unstructured":"Ringer C, Walker JA, Nicolaou MA (2019) Multimodal joint emotion and game context recognition in league of legends livestreams. In: Proc. of the IEEE conference on games, pp\u00a01\u20138"},{"key":"295_CR48","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1145\/3311350.3347197","volume-title":"Proceedings of the annual symposium on computer-human interaction in play","author":"S Roohi","year":"2019","unstructured":"Roohi S, Mekler ED, Tavast M, Blomqvist T, H\u00e4m\u00e4l\u00e4inen P (2019) Recognizing emotional expression in game streams. In: Proceedings of the annual symposium on computer-human interaction in play, pp\u00a0301\u2013311"},{"key":"295_CR49","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint. arXiv:1810.04805"},{"key":"295_CR50","doi-asserted-by":"crossref","unstructured":"Park K, Pan Z, Joo J, (2021) Who Blames or Endorses Whom? Entity-to-Entity Directed Sentiment Extraction in News Text. arXiv:2106.01033","DOI":"10.18653\/v1\/2021.findings-acl.358"}],"container-title":["EPJ Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-021-00295-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1140\/epjds\/s13688-021-00295-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-021-00295-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,18]],"date-time":"2021-08-18T22:03:04Z","timestamp":1629324184000},"score":1,"resource":{"primary":{"URL":"https:\/\/epjdatascience.springeropen.com\/articles\/10.1140\/epjds\/s13688-021-00295-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,18]]},"references-count":50,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["295"],"URL":"https:\/\/doi.org\/10.1140\/epjds\/s13688-021-00295-6","relation":{},"ISSN":["2193-1127"],"issn-type":[{"type":"electronic","value":"2193-1127"}],"subject":[],"published":{"date-parts":[[2021,8,18]]},"assertion":[{"value":"3 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 July 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"This paper meets the guidelines from Twitch\u2019s terms of service that there are no copyright or privacy infringement issues regarding the use of the images in the paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}],"article-number":"43"}}