{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T22:37:43Z","timestamp":1774737463930,"version":"3.50.1"},"reference-count":26,"publisher":"Association for Computing Machinery (ACM)","issue":"3s","license":[{"start":{"date-parts":[[2017,6,28]],"date-time":"2017-06-28T00:00:00Z","timestamp":1498608000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Ghent University, iMinds, the Institute for the Promotion of Innovation by Science and Technology in Flanders (IWT) and Appiness bvba"},{"name":"IWT\/VLAIO O8O Spotshop project"},{"name":"The project\u2019s related e-commerce service - under the name \u201cSpott\u201d"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2017,8,31]]},"abstract":"<jats:p>Spott is an innovative second screen mobile multimedia application which offers viewers relevant information on objects (e.g., clothing, furniture, food) they see and like on their television screens. The application enables interaction between TV audiences and brands, so producers and advertisers can offer potential consumers tailored promotions, e-shop items, and\/or free samples. In line with the current views on innovation management, the technological excellence of the Spott application is coupled with iterative user involvement throughout the entire development process. This article discusses both of these aspects and how they impact each other. First, we focus on the technological building blocks that facilitate the (semi-) automatic interactive tagging process of objects in the video streams. The majority of these building blocks extensively make use of novel and state-of-the-art deep learning concepts and methodologies. We show how these deep learning based video analysis techniques facilitate video summarization, semantic keyframe clustering, and (similar) object retrieval. Secondly, we provide insights in user tests that have been performed to evaluate and optimize the application\u2019s user experience. The lessons learned from these open field tests have already been an essential input in the technology development and will further shape the future modifications to the Spott application.<\/jats:p>","DOI":"10.1145\/3092834","type":"journal-article","created":{"date-parts":[[2017,6,30]],"date-time":"2017-06-30T12:36:19Z","timestamp":1498826179000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Spott"],"prefix":"10.1145","volume":"13","author":[{"given":"Florian","family":"Vandecasteele","sequence":"first","affiliation":[{"name":"Ghent University - imec, ELIS - IDLab, Pietersnieuwstraat, Ghent"}]},{"given":"Karel","family":"Vandenbroucke","sequence":"additional","affiliation":[{"name":"Ghent University - imec - MICT, Korte Meer, Ghent"}]},{"given":"Dimitri","family":"Schuurman","sequence":"additional","affiliation":[{"name":"Ghent University - imec - MICT, Korte Meer, Ghent"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1094-2184","authenticated-orcid":false,"given":"Steven","family":"Verstockt","sequence":"additional","affiliation":[{"name":"Ghent University - imec, ELIS - IDLab, Pietersnieuwstraat, Ghent"}]}],"member":"320","published-online":{"date-parts":[[2017,6,28]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Muhammad Shakir, Yasir Abbas, and Faiz Ali Shah.","author":"Ajmal Muhammad","year":"2012"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-23192-1_67"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1282280.1282340"},{"key":"e_1_2_1_4_1","first-page":"4","article-title":"SUS-A quick and dirty usability scale","volume":"189","author":"Brooke John","year":"1996","journal-title":"Usability Evaluation in Industry"},{"key":"e_1_2_1_5_1","volume-title":"Chatzichristofis and Yiannis S Boutalis","author":"Savvas","year":"2008"},{"key":"e_1_2_1_6_1","volume-title":"The challenge of user-and QoE-centric research and product development in today\u2019s ICT-environment. Observatorio (OBS*) 1, 3","author":"Marez Lieven De","year":"2007"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jt.5740130"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.08.057"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.382"},{"key":"e_1_2_1_10_1","unstructured":"iMinds Digimeter. 2014. Adoption and usage of media and ICT in Flanders. Research report Ghent iMinds. Retrieved from https:\/\/www.iminds.be\/en\/gain-insights\/digimeter.  iMinds Digimeter. 2014. Adoption and usage of media and ICT in Flanders. Research report Ghent iMinds. Retrieved from https:\/\/www.iminds.be\/en\/gain-insights\/digimeter."},{"key":"e_1_2_1_11_1","volume-title":"Hinton","author":"Krizhevsky Alex","year":"2012"},{"key":"e_1_2_1_12_1","volume-title":"Semantic object parsing with graph LSTM. ArXiv Preprint ArXiv:1603.07063","author":"Liang Xiaodan","year":"2016"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the European Conference on Computer Vision. Springer, 740--755","author":"Lin Tsung-Yi"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911996.2912058"},{"key":"e_1_2_1_15_1","volume-title":"IEEE International Conference on Multimedia and Expo. IEEE, 1517--1520","author":"Qiu Xuekan","year":"2008"},{"key":"e_1_2_1_16_1","unstructured":"Shaoqing Ren Kaiming He Ross Girshick and Jian Sun. 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems. 91--99.   Shaoqing Ren Kaiming He Ross Girshick and Jian Sun. 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems. 91--99."},{"key":"e_1_2_1_17_1","volume-title":"Diffusion of Innovations","author":"Rogers Everett M."},{"key":"e_1_2_1_19_1","volume-title":"Asian Conference on Computer Vision. Springer, 64--81","author":"Simo-Serra Edgar","year":"2014"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.233"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-39513-5_42"},{"key":"e_1_2_1_22_1","volume-title":"APPTVATE: The mobile shopping technology that enriches your TV experience. IMinds-Appiness-Medialaan","author":"Vandenbroucke Karel","year":"2016"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2011.2165531"},{"key":"e_1_2_1_24_1","volume-title":"Multimedia Data Mining and Analytics","author":"Wang Haoran"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299064"},{"key":"e_1_2_1_26_1","volume-title":"A multipath network for object detection. ArXiv Preprint ArXiv:1604.02135","author":"Zagoruyko Sergey","year":"2016"},{"key":"e_1_2_1_27_1","volume-title":"Zeiler and Rob Fergus","author":"Matthew","year":"2014"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3092834","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3092834","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:37:27Z","timestamp":1750217847000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3092834"}},"subtitle":["On-the-Spot e-Commerce for Television Using Deep Learning-Based Video Analysis Techniques"],"short-title":[],"issued":{"date-parts":[[2017,6,28]]},"references-count":26,"journal-issue":{"issue":"3s","published-print":{"date-parts":[[2017,8,31]]}},"alternative-id":["10.1145\/3092834"],"URL":"https:\/\/doi.org\/10.1145\/3092834","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,6,28]]},"assertion":[{"value":"2016-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}