{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:19:03Z","timestamp":1750306743419,"version":"3.41.0"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2015,1,7]],"date-time":"2015-01-07T00:00:00Z","timestamp":1420588800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Singapore National Research Foundation under its International Research Centre @ Singapore Funding Initiative"},{"name":"IDM Programme Office through the Centre of Social Media Innovations for Communities"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2015,1,7]]},"abstract":"<jats:p>Videos are increasingly geotagged and used in practical and powerful GIS applications. However, video search and management operations are typically supported by manual textual annotations, which are subjective and laborious. Therefore, research has been conducted to automate or semi-automate this process. Since a diverse vocabulary for video annotations is of paramount importance towards good search results, this article proposes to leverage crowdsourced data from social multimedia applications that host tags of diverse semantics to build a spatio-temporal tag repository, consequently acting as input to our auto-annotation approach. In particular, to build the tag store, we retrieve the necessary data from several social multimedia applications, mine both the spatial and temporal features of the tags, and then refine and index them accordingly. To better integrate the tag repository, we extend our previous approach by leveraging the temporal characteristics of videos as well. Moreover, we set up additional ranking criteria on the basis of tag similarity, popularity and location bias. Experimental results demonstrate that, by making use of such a tag repository, the generated tags have a wide range of semantics, and the resulting rankings are more consistent with human perception.<\/jats:p>","DOI":"10.1145\/2658981","type":"journal-article","created":{"date-parts":[[2015,1,12]],"date-time":"2015-01-12T20:02:10Z","timestamp":1421092930000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Spatial-Temporal Tag Mining for Automatic Geospatial Video Annotation"],"prefix":"10.1145","volume":"11","author":[{"given":"Yifang","family":"Yin","sequence":"first","affiliation":[{"name":"National University of Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhijie","family":"Shen","sequence":"additional","affiliation":[{"name":"Hortonworks Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luming","family":"Zhang","sequence":"additional","affiliation":[{"name":"National University of Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roger","family":"Zimmermann","sequence":"additional","affiliation":[{"name":"National University of Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,1,7]]},"reference":[{"volume-title":"Proceedings of the IEEE International Conference on Multimedia and Expo.","author":"Abdollahian Golnaz","key":"e_1_2_1_1_1","unstructured":"Golnaz Abdollahian and Edward J. Delp . 2009. User generated video annotation using geo-tagged image databases . In Proceedings of the IEEE International Conference on Multimedia and Expo. Golnaz Abdollahian and Edward J. Delp. 2009. User generated video annotation using geo-tagged image databases. In Proceedings of the IEEE International Conference on Multimedia and Expo."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1255175.1255177"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240772"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1459359.1459401"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1878151.1878155"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2072060"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0198-9715(01)00009-6"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/345662"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"A. P. Dempster N. M. Laird and D. B. Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. J. Royal Statistical Soc. Series B.  A. P. Dempster N. M. Laird and D. B. Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. J. Royal Statistical Soc. Series B.","DOI":"10.1111\/j.2517-6161.1977.tb01600.x"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining.","author":"Ester Martin","year":"1996","unstructured":"Martin Ester , Hans-peter Kriegel, J\u00f6rg Sander , and Xiaowei Xu . 1996 . A density-based algorithm for discovering clusters in large spatial databases with noise . In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining. Martin Ester, Hans-peter Kriegel, J\u00f6rg Sander, and Xiaowei Xu. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining."},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Feng S. L.","key":"e_1_2_1_12_1","unstructured":"S. L. Feng , R. Manmatha , and V. Lavrenko . 2004. Multiple Bernoulli relevance models for image and video annotation . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. S. L. Feng, R. Manmatha, and V. Lavrenko. 2004. Multiple Bernoulli relevance models for image and video annotation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1873970"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484154"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing","volume":"4","author":"John","unstructured":"John R. Hershey and Peder A. Olsen. 2007. Approximating the Kullback Leibler divergence between Gaussian mixture models . In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing , Vol. 4 . 317--320. John R. Hershey and Peder A. Olsen. 2007. Approximating the Kullback Leibler divergence between Gaussian mixture models. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Vol. 4. 317--320."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2043612.2043613"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2093973.2094039"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874199"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860459"},{"volume-title":"Proceedings of the Multimedia Benchmark Workshop.","author":"Larson Martha","key":"e_1_2_1_21_1","unstructured":"Martha Larson , Maria Eskevich , Roeland Ordelman , Christoph Kofler , Sebastian Schmiedeke , and Gareth J . F Jones. 2011a. Overview of MediaEval 2011 rich speech retrieval task and genre tagging task . In Proceedings of the Multimedia Benchmark Workshop. Martha Larson, Maria Eskevich, Roeland Ordelman, Christoph Kofler, Sebastian Schmiedeke, and Gareth J. F Jones. 2011a. Overview of MediaEval 2011 rich speech retrieval task and genre tagging task. In Proceedings of the Multimedia Benchmark Workshop."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1991996.1992047"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1291233.1291380"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1873972"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/957013.957070"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460096.1460102"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1291233.1291245"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1865106.1865112"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277762"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2072312"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1572010"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1367497.1367542"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718487.1718522"},{"volume-title":"The MediaMill TRECVID 2011 semantic video search engine.","author":"Snoek Cees G. M.","key":"e_1_2_1_34_1","unstructured":"Cees G. M. Snoek , Koen E. A. van de Sande, Xirong Li, Masoud Mazloom, Yu-Gang Jiang, Dennis C. Koelma, and Arnold W. M. Smeulders. 2011 . The MediaMill TRECVID 2011 semantic video search engine. Cees G. M. Snoek, Koen E. A. van de Sande, Xirong Li, Masoud Mazloom, Yu-Gang Jiang, Dennis C. Koelma, and Arnold W. M. Smeulders. 2011. The MediaMill TRECVID 2011 semantic video search engine."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1458082.1458114"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488500"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2240136.2240139"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/957013.957046"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526758"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Yan Rong","year":"2008","unstructured":"Rong Yan , Apostol Natsev , and Murray Campbell . 2008 . A learning-based hybrid tagging and browsing approach for efficient manual image annotation . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Rong Yan, Apostol Natsev, and Murray Campbell. 2008. A learning-based hybrid tagging and browsing approach for efficient manual image annotation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1646396.1646414"},{"key":"e_1_2_1_42_1","volume-title":"Huang","author":"Yin Zhijun","year":"2011","unstructured":"Zhijun Yin , Liangliang Cao , Jiawei Han , Jiebo Luo , and Thomas S . Huang . 2011 a. Diversified trajectory pattern ranking in geo-tagged social media. In Proceedings of the SIAM International Conference on Data Mining. 980--991. Zhijun Yin, Liangliang Cao, Jiawei Han, Jiebo Luo, and Thomas S. Huang. 2011a. Diversified trajectory pattern ranking in geo-tagged social media. In Proceedings of the SIAM International Conference on Data Mining. 980--991."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1963405.1963443"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2124295.2124302"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2658981","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2658981","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:28:18Z","timestamp":1750231698000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2658981"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,1,7]]},"references-count":44,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2015,1,7]]}},"alternative-id":["10.1145\/2658981"],"URL":"https:\/\/doi.org\/10.1145\/2658981","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2015,1,7]]},"assertion":[{"value":"2013-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-01-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}