{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T06:30:32Z","timestamp":1769063432412,"version":"3.49.0"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2017,4,12]],"date-time":"2017-04-12T00:00:00Z","timestamp":1491955200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2017,4,12]],"date-time":"2017-04-12T00:00:00Z","timestamp":1491955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Hum. Cent. Comput. Inf. Sci."],"published-print":{"date-parts":[[2017,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Efficient access to large scale video assets, may it be our life memories in our hard drive or a broadcaster archive which the company is eager to sell, requires content to be conveniently annotated. Manually annotating video content is, however, an intellectually expensive and time-consuming process. In this paper we argue that crowdsourcing, an approach that relies on a remote task force to perform activities that are costly or time-consuming using traditional methods, is a suitable alternative and we describe a solution based on gamification mechanisms for collaboratively collecting timed metadata. Tags introduced by registered players are validated based on a collaborative scoring mechanism that excludes erratic annotations. Voting mechanisms, enabling users to approve or refuse existing tags, provide an extra guarantee on the quality of the annotations. The sense of community is also created as users may watch the crowd\u2019s favourite moments of the video provided by a summarization functionality. The system was tested with a pool of volunteers in order to evaluate the quality of the contributions. The results suggest that crowdsourced annotation can describe objects, persons, places, etc. correctly, as well as be very accurate in time.<\/jats:p>","DOI":"10.1186\/s13673-017-0094-5","type":"journal-article","created":{"date-parts":[[2017,3,24]],"date-time":"2017-03-24T08:49:09Z","timestamp":1490345349000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["A collaborative approach for semantic time-based video annotation using gamification"],"prefix":"10.1186","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8447-2360","authenticated-orcid":false,"given":"Paula","family":"Viana","sequence":"first","affiliation":[]},{"given":"Jos\u00e9 Pedro","family":"Pinto","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2017,4,12]]},"reference":[{"key":"94_CR1","doi-asserted-by":"crossref","unstructured":"Marlow C, Naaman M, Boyd D, Davis M (2006) HT06, tagging paper, taxonomy, flickr, academic article, to read. In: Proceedings of the seventeenth conference on hypertext and hypermedia. ACM, pp 31\u201340","DOI":"10.1145\/1149941.1149949"},{"key":"94_CR2","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1177\/0165551506062337","volume":"32","author":"SA Golder","year":"2006","unstructured":"Golder SA, Huberman BA (2006) Usage patterns of collaborative tagging systems. J Inf Sci 32:198\u2013208. doi:10.1177\/0165551506062337","journal-title":"J Inf Sci"},{"key":"94_CR3","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1109\/MMUL.2008.54","volume":"15","author":"Q Li","year":"2008","unstructured":"Li Q, Lu SCY (2008) Collaborative tagging applications and approaches. IEEE Multimed 15:14\u201321. doi:10.1109\/MMUL.2008.54","journal-title":"IEEE Multimed"},{"key":"94_CR4","doi-asserted-by":"crossref","unstructured":"Eggink J, Raimond Y (2013) Recent advances in affective and semantic media applications at the BBC. In: 2013 14th international workshop on image analysis for multimedia interactive services (WIAMIS), pp 1\u20134","DOI":"10.1109\/WIAMIS.2013.6616134"},{"key":"94_CR5","doi-asserted-by":"crossref","unstructured":"Hildebrand M, Brinkerink M, Gligorov R et al (2013) Waisda?: Video Labeling Game. In: Proceedings of the 21st ACM international conference on multimedia. ACM, Barcelona, pp 823\u2013826","DOI":"10.1145\/2502081.2502221"},{"key":"94_CR6","unstructured":"Metadata Games (2015) Metadata Games - Play. Tag. Connect.\u00a0http:\/\/www.metadatagames.org\/. Accessed 15 Apr 2015"},{"key":"94_CR7","unstructured":"Viddler (2015) Viddler: interactive video training and practice. http:\/\/www.viddler.com\/. Accessed 28 Jan 2015"},{"key":"94_CR8","doi-asserted-by":"crossref","unstructured":"Pinto JP, Viana P (2013) TAG4VD: a game for collaborative video annotation. In: Proceedings of the 2013 ACM international workshop on immersive media experiences. ACM, Barcelona, pp 25\u201328","DOI":"10.1145\/2512142.2512154"},{"key":"94_CR9","doi-asserted-by":"crossref","unstructured":"Pinto JP, Viana P (2015) Using the crowd to boost video annotation processes: a game based approach. In: Proceedings of the 12th European conference on visual media production. ACM, London, pp 22:1\u201322:1","DOI":"10.1145\/2824840.2824853"},{"key":"94_CR10","doi-asserted-by":"crossref","unstructured":"Miettinen V (2011) Digitalkoot: electrifying the finnish cultural heritage. In: Proceedings of the 4th ACM workshop on online books, complementary social media and crowdsourcing. ACM, Glasgow, pp 55\u201356","DOI":"10.1145\/2064058.2064071"},{"key":"94_CR11","doi-asserted-by":"crossref","unstructured":"Riek LD, O\u2019Connor MF, Robinson P (2011) Guess what? a game for affective annotation of video using crowd sourcing. In: Proceedings of the 4th international conference on affective computing and intelligent interaction-volume part I. Springer, Berlin, pp 277\u2013285","DOI":"10.1007\/978-3-642-24600-5_31"},{"key":"94_CR12","unstructured":"OntoGames (2015) Games for semantic content creation. www.ontogame.sti2.at\/games. Accessed 20 Feb 2015"},{"key":"94_CR13","unstructured":"videoTag (2015) videotag\u2014video tagging games\u2014a social tagging experiment. http:\/\/www.videotag.co.uk\/. Accessed 25 Feb 2015"},{"key":"94_CR14","unstructured":"Brooklyn Museum\u2014Tag! You\u2019re it! (2015) Tag! You\u2019re it!\u2014BKM TECH. https:\/\/www.brooklynmuseum.org\/community\/blogosphere\/2008\/08\/01\/tag-youre-it\/. Accessed 5 May 2015"},{"key":"94_CR15","unstructured":"Tiltfactor (2015) Tiltfactor - Games. http:\/\/www.tiltfactor.org\/games. Accessed 5 Jun 2015"},{"key":"94_CR16","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1109\/MIS.2008.45","volume":"23","author":"K Siorpaes","year":"2008","unstructured":"Siorpaes K, Hepp M (2008) Games with a purpose for the semantic web. IEEE Intell Syst 23:50\u201360. doi:10.1109\/MIS.2008.45","journal-title":"IEEE Intell Syst"},{"issue":"4","key":"94_CR17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/MMUL.2009.95","volume":"16","author":"S Davis","year":"2009","unstructured":"Davis S, Burnett I, Ritz C (2009) Using social networking and collections to enable video semantics acquisition. IEEE Multimed 16(4):1. doi:10.1109\/MMUL.2009.72","journal-title":"IEEE Multimed"},{"key":"94_CR18","doi-asserted-by":"crossref","unstructured":"Snoek CGM, Freiburg B, Oomen J, Ordelman R (2010) Crowdsourcing rock N\u2019 roll multimedia retrieval. In: Proceedings of the 18th ACM international conference on multimedia. ACM, Firenze, pp 1535\u20131538","DOI":"10.1145\/1873951.1874278"},{"key":"94_CR19","doi-asserted-by":"crossref","unstructured":"Mishne G (2006) AutoTag: a collaborative approach to automated tag assignment for weblog posts. In: Proceedings of the 15th international conference on world wide web. ACM, Edinburgh, pp 953\u2013954","DOI":"10.1145\/1135777.1135961"},{"key":"94_CR20","unstructured":"Sood S, Owsley S, Hammond K, Birnbaum L (2007) TagAssist: Automatic tag suggestion for blog posts"},{"key":"94_CR21","doi-asserted-by":"crossref","unstructured":"Wu B, Zhong E, Tan B, et al (2014) Crowdsourced time-sync video tagging using temporal and personalized topic modeling. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, New York, pp 721\u2013730","DOI":"10.1145\/2623330.2623625"},{"key":"94_CR22","doi-asserted-by":"crossref","unstructured":"Yao T, Mei T, Ngo C-W, Li S (2013) Annotation for free: video tagging by mining user search behaviour. In: Proceedings of the 21st ACM international conference on multimedia. ACM, Barcelona, pp 977\u2013986","DOI":"10.1145\/2502081.2502085"},{"key":"94_CR23","doi-asserted-by":"crossref","unstructured":"Xu P, Larson M (2014) Users tagging visual moments: timed tags in social video. In: Proceedings of the 2014 international ACM workshop on crowdsourcing for multimedia. ACM, Orlando, pp 57\u201362","DOI":"10.1145\/2660114.2660124"},{"key":"94_CR24","doi-asserted-by":"crossref","unstructured":"Bertini M, Del Bimbo A, Torniai C (2005) Automatic video annotation using ontologies extended with visual information. In: Proceedings of the 13th annual ACM international conference on multimedia. ACM, pp 395\u2013398","DOI":"10.1145\/1101149.1101235"},{"key":"94_CR25","doi-asserted-by":"crossref","unstructured":"Moxley E, Mei T, Hua XS, et al (2008) Automatic video annotation through search and mining. In: 2008 IEEE international conference on multimedia and expo, pp 685\u2013688","DOI":"10.1109\/ICME.2008.4607527"},{"key":"94_CR26","doi-asserted-by":"crossref","unstructured":"Larson M, Soleymani M, Serdyukov P, et al (2011) Automatic tagging and geotagging in video collections and communities. In: Proceedings of the 1st ACM international conference on multimedia retrieval. ACM, Trento, pp 51:1\u201351:8","DOI":"10.1145\/1991996.1992047"},{"key":"94_CR27","doi-asserted-by":"publisher","first-page":"1167","DOI":"10.1007\/s11042-013-1363-6","volume":"72","author":"A Altadmri","year":"2013","unstructured":"Altadmri A, Ahmed A (2013) A framework for automatic semantic video annotation. Multimed Tools Appl 72:1167\u20131191. doi:10.1007\/s11042-013-1363-6","journal-title":"Multimed Tools Appl"},{"key":"94_CR28","doi-asserted-by":"crossref","unstructured":"Ferracani A, Pezzatini D, Bertini M et al (2015) A system for video recommendation using visual saliency, crowdsourced and automatic annotations. In: Proceedings of the 23rd ACM international conference on multimedia. ACM, Brisbane, pp 757\u2013758","DOI":"10.1145\/2733373.2807982"},{"key":"94_CR29","doi-asserted-by":"crossref","unstructured":"Nga DH, Yanai K (2013) Large-scale web video shot ranking based on visual features and tag co-occurrence. In: Proceedings of the 21st ACM international conference on multimedia. ACM, Barcelona, pp 525\u2013528","DOI":"10.1145\/2502081.2502139"},{"key":"94_CR30","doi-asserted-by":"crossref","unstructured":"Ballan L, Bertini M, Del Bimbo A et al (2010) Tag suggestion and localization in user-generated videos based on social knowledge. In: Proceedings of second ACM SIGMM workshop on social media. ACM, Firenze, pp 3\u20138","DOI":"10.1145\/1878151.1878155"},{"key":"94_CR31","doi-asserted-by":"crossref","unstructured":"Chu W-T, Li C-J, Chou Y-K (2011) Tag suggestion and localization for web videos by bipartite graph matching. In: Proceedings of the 3rd ACM SIGMM international workshop on social media. ACM, pp 35\u201340","DOI":"10.1145\/2072609.2072621"},{"key":"94_CR32","doi-asserted-by":"crossref","unstructured":"Li G, Wang M, Zheng Y-T, et al (2011) ShotTagger: tag location for internet videos. In: Proceedings of the 1st ACM international conference on multimedia retrieval. ACM, Trento, p 37:1\u201337:8","DOI":"10.1145\/1991996.1992033"},{"key":"94_CR33","doi-asserted-by":"crossref","unstructured":"Yang Y, Yang Y, Huang Z, Shen HT (2011) transfer tagging from image to video. In: Proceedings of the 19th ACM international conference on multimedia. ACM, Scottsdale, pp 1137\u20131140","DOI":"10.1145\/2072298.2071958"},{"key":"94_CR34","first-page":"461","volume-title":"Extraction et gestion des connaissances (EGC\u20192013)","author":"H-T Tran","year":"2013","unstructured":"Tran H-T, Fromont E, Jacquenet F et al (2013) Unsupervised Video Tag Correction system. In: Christel Vrain Andr\u00e9 P\u00e9ninou FS (ed) Extraction et gestion des connaissances (EGC\u20192013). Hermann-\u00c9ditions, Paris, pp 461\u2013466"},{"key":"94_CR35","doi-asserted-by":"crossref","unstructured":"Baidya E, Goel S (2014) LectureKhoj: automatic tagging and semantic segmentation of online lecture videos. In: 2014 Seventh international conference on contemporary computing (IC3), pp 37\u201343","DOI":"10.1109\/IC3.2014.6897144"},{"key":"94_CR36","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1007\/s11042-012-1250-6","volume":"69","author":"H Yang","year":"2014","unstructured":"Yang H, Quehl B, Sack H (2014) A framework for improved video text detection and recognition. Multimed Tools Appl 69:217\u2013245. doi:10.1007\/s11042-012-1250-6","journal-title":"Multimed Tools Appl"},{"key":"94_CR37","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1109\/TLT.2014.2307305","volume":"7","author":"H Yang","year":"2014","unstructured":"Yang H, Meinel C (2014) Content based lecture video retrieval using speech and video text information. IEEE Trans Learn Technol 7:142\u2013154. doi:10.1109\/TLT.2014.2307305","journal-title":"IEEE Trans Learn Technol"},{"key":"94_CR38","doi-asserted-by":"crossref","unstructured":"Chua T-S, Tang J, Hong R et al (2009) NUS-WIDE: a real-world web image database from National University of Singapore. ACM International conference on image and video retrieval","DOI":"10.1145\/1646396.1646452"},{"key":"94_CR39","doi-asserted-by":"crossref","unstructured":"Yang Q, Chen X, Wang G (2008) web 2.0 dictionary. In: Proceedings of the 2008 international conference on content-based image and video retrieval. ACM, Niagara Falls, pp 591\u2013600","DOI":"10.1145\/1386352.1386438"},{"key":"94_CR40","doi-asserted-by":"publisher","first-page":"7015","DOI":"10.1007\/s11042-014-1950-1","volume":"74","author":"M Soares","year":"2015","unstructured":"Soares M, Viana P (2015) Tuning metadata for better movie content-based recommendation systems. Multimed Tools Appl 74:7015\u20137036. doi:10.1007\/s11042-014-1950-1","journal-title":"Multimed Tools Appl"}],"container-title":["Human-centric Computing and Information Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13673-017-0094-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13673-017-0094-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13673-017-0094-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T08:06:05Z","timestamp":1627632365000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s13673-017-0094-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,4,12]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2017,12]]}},"alternative-id":["94"],"URL":"https:\/\/doi.org\/10.1186\/s13673-017-0094-5","relation":{},"ISSN":["2192-1962"],"issn-type":[{"value":"2192-1962","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,4,12]]},"assertion":[{"value":"3 November 2016","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 March 2017","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 April 2017","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"13"}}