{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:34:32Z","timestamp":1750307672533,"version":"3.41.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2008,10,1]],"date-time":"2008-10-01T00:00:00Z","timestamp":1222819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2008,10]]},"abstract":"<jats:p>\n            Automatic video annotation is an important ingredient for semantic-level video browsing, search and navigation. Much attention has been paid to this topic in recent years. These researches have evolved through two paradigms. In the first paradigm, each concept is individually annotated by a pre-trained binary classifier. However, this method ignores the rich information between the video concepts and only achieves limited success. Evolved from the first paradigm, the methods in the second paradigm add an extra step on the top of the first individual classifiers to fuse the multiple detections of the concepts. However, the performance of these methods can be degraded by the error propagation incurred in the first step to the second fusion one. In this article, another paradigm of the video annotation method is proposed to address these problems. It simultaneously annotates the concepts as well as model correlations between them in one step by the proposed\n            <jats:italic>Correlative Multilabel<\/jats:italic>\n            (CML) method, which benefits from the compensation of complementary information between different labels. Furthermore, since the video clips are composed by temporally ordered frame sequences, we extend the proposed method to exploit the rich temporal information in the videos. Specifically, a temporal-kernel is incorporated into the CML method based on the discriminative information between\n            <jats:italic>Hidden Markov Models<\/jats:italic>\n            (HMMs) that are learned from the videos. We compare the performance between the proposed approach and the state-of-the-art approaches in the first and second paradigms on the widely used TRECVID data set. As to be shown, superior performance of the proposed method is gained.\n          <\/jats:p>","DOI":"10.1145\/1404880.1404883","type":"journal-article","created":{"date-parts":[[2008,11,6]],"date-time":"2008-11-06T13:49:43Z","timestamp":1225979383000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":35,"title":["Correlative multilabel video annotation with temporal kernels"],"prefix":"10.1145","volume":"5","author":[{"given":"Guo-Jun","family":"Qi","sequence":"first","affiliation":[{"name":"University of Science and Technology of China, Anhui, China"}]},{"given":"Xian-Sheng","family":"Hua","sequence":"additional","affiliation":[{"name":"Microsoft Corporation, Beijing, China"}]},{"given":"Yong","family":"Rui","sequence":"additional","affiliation":[{"name":"Microsoft Corporation, Beijing, China"}]},{"given":"Jinhui","family":"Tang","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Anhui, China"}]},{"given":"Tao","family":"Mei","sequence":"additional","affiliation":[{"name":"Microsoft Corporation, Beijing, China"}]},{"given":"Meng","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Anhui, China"}]},{"given":"Hong-Jiang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Microsoft Corporation, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2008,10,30]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Berg B. A. 2004. Markov Chain Monte Carlo Simulations and Their Statistical Analysis. World Scientific.  Berg B. A. 2004. Markov Chain Monte Carlo Simulations and Their Statistical Analysis. World Scientific.","DOI":"10.1142\/5602"},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Boyd S. Vandenberghe L. 2004. Convex Optimization. Cambridge University Press.   Boyd S. Vandenberghe L. 2004. Convex Optimization. Cambridge University Press.","DOI":"10.1017\/CBO9780511804441"},{"volume-title":"TREC Video Retrieval Evaluation (TRECVID) Proceedings.","year":"2006","author":"Campbell M.","key":"e_1_2_1_3_1"},{"volume-title":"TREC Video Retrieval Evaluation (TRECVID) Proceedings.","year":"2006","author":"Chang S.-F.","key":"e_1_2_1_4_1"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Cover T. and Thomas J. 1991. Elements of Information Theory. John Wiley and Sons New York NY.   Cover T. and Thomas J. 1991. Elements of Information Theory. John Wiley and Sons New York NY.","DOI":"10.1002\/0471200611"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Cristianini N. and Shawe-Taylor J. 2000. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press.   Cristianini N. and Shawe-Taylor J. 2000. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press.","DOI":"10.1017\/CBO9780511801389"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2003.809034"},{"volume-title":"Proceedings of the IEEE International Conference on Multimedia and Expo.","author":"Ebadollahi S.","key":"e_1_2_1_8_1"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/89.279278"},{"volume-title":"Proceedings of the Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining.","author":"Godbole S.","key":"e_1_2_1_10_1"},{"volume-title":"Proceedings of the International Conference on Spoken Language Processes.","author":"Goldberger J.","key":"e_1_2_1_11_1"},{"volume-title":"TREC Video Retrieval Evaluation (TRECVID) Proceedings.","author":"Hauptmann A. G.","key":"e_1_2_1_12_1"},{"key":"e_1_2_1_13_1","unstructured":"Hauptmann A. G. etal 2006. Multi-lingual broadcast news retrieval. In TREC Video Retrieval Evaluation (TRECVID) Procedings.  Hauptmann A. G. et al. 2006. Multi-lingual broadcast news retrieval. In TREC Video Retrieval Evaluation (TRECVID) Procedings."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2007.900150"},{"volume-title":"TREC Video Retrieval Evaluation (TRECVID) Proceedings.","author":"Hua X.-S.","key":"e_1_2_1_15_1"},{"volume-title":"Proceedings of the IEEE International Conference on Image Processing.","author":"Jiang W.","key":"e_1_2_1_16_1"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1282280.1282352"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2007.900137"},{"volume-title":"Proceedings of the IEEE International Conference on Machine Learning.","author":"Kumar S.","key":"e_1_2_1_19_1"},{"volume-title":"Proceedings of the International Conference on Machine Learning.","author":"Lafferty J.","key":"e_1_2_1_20_1"},{"volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing.","author":"Liu P.","key":"e_1_2_1_21_1"},{"key":"e_1_2_1_22_1","unstructured":"Marr D. 1982. Vision. W. H. Freeman and Company.  Marr D. 1982. Vision. W. H. Freeman and Company."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/76.981844"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2006.63"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMSP.2002.1203284"},{"key":"e_1_2_1_26_1","unstructured":"Naphade M. R. Kennedy L. Kender J. R. Chang S.-F. Smith J. R. Over P. and Hauptmann A. G. 2005. A light scale concept ontology for multimedia understanding for TRECVID 2005. IBM Research Report RC23612 (W0505-104).  Naphade M. R. Kennedy L. Kender J. R. Chang S.-F. Smith J. R. Over P. and Hauptmann A. G. 2005. A light scale concept ontology for multimedia understanding for TRECVID 2005. IBM Research Report RC23612 (W0505-104)."},{"volume-title":"Proceedings of the IJCAI-99 Workshop on Machine Learning for Information Filtering. 61--67","year":"1999","author":"Nigam K.","key":"e_1_2_1_27_1"},{"volume-title":"TREC Video Retrieval Evaluation (TRECVID) Proceedings.","year":"2004","author":"Petersohn C.","key":"e_1_2_1_28_1"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.18626"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1178677.1178722"},{"volume-title":"Proceedings of the IEEE Internaional Conference on Multimedia and Expo.","author":"Smith J. R.","key":"e_1_2_1_31_1"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.212"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180639.1180727"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1291233.1291430"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015341"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1290082.1290094"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2006.190"},{"key":"e_1_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Winkler G. 1995. Image Analysis Random Fields and Dynamic Monte Carlo Methods: A Mathematical Introduction. Springer-Verlag Berlin Heidelberg.   Winkler G. 1995. Image Analysis Random Fields and Dynamic Monte Carlo Methods: A Mathematical Introduction. Springer-Verlag Berlin Heidelberg.","DOI":"10.1007\/978-3-642-97522-6"},{"volume-title":"Proceedings of the IEEE Internaional Conference on Multimedia and Expo.","author":"Wu Y.","key":"e_1_2_1_39_1"},{"volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing.","author":"Xie L.","key":"e_1_2_1_40_1"},{"volume-title":"Proceedings of the IEEE Internaional Conference on Multimedia and Expo.","author":"Yan R.","key":"e_1_2_1_41_1"},{"volume-title":"Tech. Rep. 222-2006-8","year":"2007","author":"Yanagawa A.","key":"e_1_2_1_42_1"},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Yao Y. Y. 2003. Entropy Measures Maximum Entropy Principle and Emerging Applications. Springer Chapter Information-theoretic measures for knowledge discovery and data mining 115--136.   Yao Y. Y. 2003. Entropy Measures Maximum Entropy Principle and Emerging Applications. Springer Chapter Information-theoretic measures for knowledge discovery and data mining 115--136.","DOI":"10.1007\/978-3-540-36212-8_6"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1291233.1291308"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.301"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1404880.1404883","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1404880.1404883","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:29:38Z","timestamp":1750253378000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1404880.1404883"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,10]]},"references-count":45,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2008,10]]}},"alternative-id":["10.1145\/1404880.1404883"],"URL":"https:\/\/doi.org\/10.1145\/1404880.1404883","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2008,10]]},"assertion":[{"value":"2008-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-10-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}