{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:38:55Z","timestamp":1750307935808,"version":"3.41.0"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2007,8,1]],"date-time":"2007-08-01T00:00:00Z","timestamp":1185926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2007,8]]},"abstract":"<jats:p>As the amount of multimedia data is increasing day-by-day thanks to less expensive storage devices and increasing numbers of information sources, machine learning algorithms are faced with large-sized and noisy datasets. Fortunately, the use of a good sampling set for training influences the final results significantly. But using a simple random sample (SRS) may not obtain satisfactory results because such a sample may not adequately represent the large and noisy dataset due to its blind approach in selecting samples. The difficulty is particularly apparent for huge datasets where, due to memory constraints, only very small sample sizes are used. This is typically the case for multimedia applications, where data size is usually very large. In this article we propose a new and efficient method to sample of large and noisy multimedia data. The proposed method is based on a simple distance measure that compares the histograms of the sample set and the whole set in order to estimate the representativeness of the sample. The proposed method deals with noise in an elegant manner which SRS and other methods are not able to deal with. We experiment on image and audio datasets. Comparison with SRS and other methods shows that the proposed method is vastly superior in terms of sample representativeness, particularly for small sample sizes although time-wise it is comparable to SRS, the least expensive method in terms of time.<\/jats:p>","DOI":"10.1145\/1236471.1236473","type":"journal-article","created":{"date-parts":[[2007,9,14]],"date-time":"2007-09-14T13:44:55Z","timestamp":1189777495000},"page":"14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Efficient sampling of training set in large and noisy multimedia data"],"prefix":"10.1145","volume":"3","author":[{"given":"Surong","family":"Wang","sequence":"first","affiliation":[{"name":"Nanyang Technological University, Nanyang Avenue, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manoranjan","family":"Dash","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Nanyang Avenue, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liang-Tien","family":"Chia","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Nanyang Avenue, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min","family":"Xu","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Nanyang Avenue, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2007,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/170035.170072"},{"volume-title":"Proceedings of the International Conference on Very Large Databases.","author":"Agrawal R.","key":"e_1_2_1_2_1","unstructured":"Agrawal , R. and Srikant , R . 1994. Fast algorithms for mining association rules . In Proceedings of the International Conference on Very Large Databases. Agrawal, R. and Srikant, R. 1994. Fast algorithms for mining association rules. In Proceedings of the International Conference on Very Large Databases."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022821128753"},{"key":"e_1_2_1_4_1","unstructured":"Astashyn A. 2004. Deterministic data reduction methods for transactional data sets. Master thesis.  Astashyn A. 2004. Deterministic data reduction methods for transactional data sets. Master thesis."},{"key":"e_1_2_1_5_1","volume-title":"I","author":"Atlas L.","year":"1990","unstructured":"Atlas , L. , Cohn , D. , Ladner , R. , El-Sharkawi , M. A. , and R. J. Marks , I . 1990 . Training connectionist networks with queries and selective sampling. In Advances in Neural Information Processing Systems, vol. 2 . Morgan Kaufmann , San Fransisco, CA. 566--573. Atlas, L., Cohn, D., Ladner, R., El-Sharkawi, M. A., and R. J. Marks, I. 1990. Training connectionist networks with queries and selective sampling. In Advances in Neural Information Processing Systems, vol. 2. Morgan Kaufmann, San Fransisco, CA. 566--573."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018054314350"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/3013545.3013548"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/956750.956761"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.788646"},{"volume-title":"Proceedings of the International Conference on Data Mining. 580--581","author":"Chawla N.","key":"e_1_2_1_10_1","unstructured":"Chawla , N. , Eschrich , S. , and Hall , L. O . 2001. Creating ensembles of classifiers . In Proceedings of the International Conference on Data Mining. 580--581 . Chawla, N., Eschrich, S., and Hall, L. O. 2001. Creating ensembles of classifiers. In Proceedings of the International Conference on Data Mining. 580--581."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775114"},{"key":"e_1_2_1_12_1","volume-title":"Advances in Neural Information Processing Systems","volume":"7","author":"Cohn D. A.","unstructured":"Cohn , D. A. , Ghahramani , Z. , and Jordan , M. I . 1995. Active learning with statistical models . In Advances in Neural Information Processing Systems , vol. 7 . MIT Press, New Yark. 705--712. Cohn, D. A., Ghahramani, Z., and Jordan, M. I. 1995. Active learning with statistical models. In Advances in Neural Information Processing Systems, vol. 7. MIT Press, New Yark. 705--712."},{"volume-title":"International Conference on Machine Learning. 194--202","author":"Dougherty J.","key":"e_1_2_1_13_1","unstructured":"Dougherty , J. , Kohavi , R. , and Sahami , M . 1995. Supervised and unsupervised discretization of continuous features . In International Conference on Machine Learning. 194--202 . Dougherty, J., Kohavi, R., and Sahami, M. 1995. Supervised and unsupervised discretization of continuous features. In International Conference on Machine Learning. 194--202."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/957013.957020"},{"key":"e_1_2_1_15_1","volume-title":"Tech. Rep. School of Computing","author":"Gu B., F.","year":"2000","unstructured":"Gu , B., F. Hu , F. , and Liu , H . 2000 . Sampling and its applications in data mining: A survey. Tech. Rep. School of Computing , National University of Singapore, Singapore . Gu, B., F. Hu, F., and Liu, H. 2000. Sampling and its applications in data mining: A survey. Tech. Rep. School of Computing, National University of Singapore, Singapore."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335372"},{"key":"e_1_2_1_17_1","unstructured":"ISO\/IEC15938-8\/FDIS3. IED. 2005. Information technology---Multimedia content description interface---Part 8: Extraction and use of MPEG-7 descriptions.  ISO\/IEC15938-8\/FDIS3. IED. 2005. Information technology---Multimedia content description interface---Part 8: Extraction and use of MPEG-7 descriptions."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/347090.347110"},{"volume-title":"AAAI Spring Symposium on Intelligent Multimedia Knowledge Management.","author":"Jin R.","key":"e_1_2_1_19_1","unstructured":"Jin , R. , Yan , R. , and Hauptmann , A . 2003. Image classification using a bigram model . In AAAI Spring Symposium on Intelligent Multimedia Knowledge Management. Jin, R., Yan, R., and Hauptmann, A. 2003. Image classification using a bigram model. In AAAI Spring Symposium on Intelligent Multimedia Knowledge Management."},{"volume-title":"Proceedings of the 11th International Conference on Machine Learning, W. W. Cohen and H. Hirsh, eds. Morgan Kaufmann","author":"Lewis D. D.","key":"e_1_2_1_20_1","unstructured":"Lewis , D. D. and Catlett , J . 1994. Heterogeneous uncertainty sampling for supervised learning . In Proceedings of the 11th International Conference on Machine Learning, W. W. Cohen and H. Hirsh, eds. Morgan Kaufmann , San Francisco, CA. 148--156. Lewis, D. D. and Catlett, J. 1994. Heterogeneous uncertainty sampling for supervised learning. In Proceedings of the 11th International Conference on Machine Learning, W. W. Cohen and H. Hirsh, eds. Morgan Kaufmann, San Francisco, CA. 148--156."},{"volume-title":"Proceedings of the SIGIR 17th ACM International Conference on Research and Development in Information Retrieval, W. B. Croft and C. J. van Rijsbergen, eds. Springer Verlag","author":"Lewis D. D.","key":"e_1_2_1_21_1","unstructured":"Lewis , D. D. and Gale , W. A . 1994. A sequential algorithm for training text classifiers . In Proceedings of the SIGIR 17th ACM International Conference on Research and Development in Information Retrieval, W. B. Croft and C. J. van Rijsbergen, eds. Springer Verlag , Berlin. 3--12. Lewis, D. D. and Gale, W. A. 1994. A sequential algorithm for training text classifiers. In Proceedings of the SIGIR 17th ACM International Conference on Research and Development in Information Retrieval, W. B. Croft and C. J. van Rijsbergen, eds. Springer Verlag, Berlin. 3--12."},{"key":"e_1_2_1_22_1","unstructured":"Manjunath B. S. Salembier P. and Sikora T. 2002. Introduction to MPEG-7. John Wiley New Yark.  Manjunath B. S. Salembier P. and Sikora T. 2002. Introduction to MPEG-7. John Wiley New Yark."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1162\/153244302760200678"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/500141.500181"},{"volume-title":"Proceedings of the 16th International Conference on Pattern Recognition","author":"Ojala T.","key":"e_1_2_1_25_1","unstructured":"Ojala , T. , Aittola , M. , and Matinmikko , E . 2002. Empirical evaluation MPEG-7 XM color descriptors in content-based retrieval of semantic image categories . In Proceedings of the 16th International Conference on Pattern Recognition ( Quebec, Canada). 1021--1024. Ojala, T., Aittola, M., and Matinmikko, E. 2002. Empirical evaluation MPEG-7 XM color descriptors in content-based retrieval of semantic image categories. In Proceedings of the 16th International Conference on Pattern Recognition (Quebec, Canada). 1021--1024."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.207618"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/354384.354443"},{"volume-title":"Proceedings of the 17th International Joint Conference on Artificial Intelligence. 911--920","author":"Saar-Tsechansky M.","key":"e_1_2_1_29_1","unstructured":"Saar-Tsechansky , M. and Provost , F . 2001. Active learning for class probability estimation and ranking . In Proceedings of the 17th International Joint Conference on Artificial Intelligence. 911--920 . Saar-Tsechansky, M. and Provost, F. 2001. Active learning for class probability estimation and ranking. In Proceedings of the 17th International Joint Conference on Artificial Intelligence. 911--920."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775087"},{"volume-title":"Proceedings of the International Symposium on Intelligent Data Analysis.","author":"Scheffer T.","key":"e_1_2_1_31_1","unstructured":"Scheffer , T. , Decomain , C. , and Wrobel , S . 2001. Active hidden Markov models for information extraction . In Proceedings of the International Symposium on Intelligent Data Analysis. Scheffer, T., Decomain, C., and Wrobel, S. 2001. Active hidden Markov models for information extraction. In Proceedings of the International Symposium on Intelligent Data Analysis."},{"volume-title":"Proceedings of the 17th International Conference on Machine Learning, P. Langley, ed. Morgan Kaufmann","author":"Tong S.","key":"e_1_2_1_32_1","unstructured":"Tong , S. and Koller , D . 2000. Support vector machine active learning with applications to text classification . In Proceedings of the 17th International Conference on Machine Learning, P. Langley, ed. Morgan Kaufmann , San Francisco, CA. 999--1006. Tong, S. and Koller, D. 2000. Support vector machine active learning with applications to text classification. In Proceedings of the 17th International Conference on Machine Learning, P. Langley, ed. Morgan Kaufmann, San Francisco, CA. 999--1006."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3147.3165"},{"volume-title":"Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining.","author":"Wang S.","key":"e_1_2_1_34_1","unstructured":"Wang , S. , Dash , M. , and Chia , L . -T. 2005a. Efficient sampling for image application . In Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining. Wang, S., Dash, M., and Chia, L.-T. 2005a. Efficient sampling for image application. In Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining."},{"volume-title":"Proceedings of the International Conference on Multimedia and Expo.","author":"Wang S.","key":"e_1_2_1_35_1","unstructured":"Wang , S. , Xu , M. , Chia , L.-T. , and Dash , M . 2005b. Easier sampling for audio event identification . In Proceedings of the International Conference on Multimedia and Expo. Wang, S., Xu, M., Chia, L.-T., and Dash, M. 2005b. Easier sampling for audio event identification. In Proceedings of the International Conference on Multimedia and Expo."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30543-9_71"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1027527.1027702"},{"key":"e_1_2_1_38_1","unstructured":"Young S. Everman G. Gales M. Hain T. Kershaw D. Moore G. Odell J. Ollason D. Povey D. Valtchev V. and Woodland P. 2002. The HTK book (for HTK version 3.1). Cambridge University Engineering Department.  Young S. Everman G. Gales M. Hain T. Kershaw D. Moore G. Odell J. Ollason D. Povey D. Valtchev V. and Woodland P. 2002. The HTK book (for HTK version 3.1). Cambridge University Engineering Department."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-004-0751-8"},{"volume-title":"Proceedings of the 20th ICML International Conference on Machine Learning. 920--927","author":"Zhu X.","key":"e_1_2_1_40_1","unstructured":"Zhu , X. , Wu , X. , and Chen , S . 2003. Eliminating class noise in large datasets . In Proceedings of the 20th ICML International Conference on Machine Learning. 920--927 . Zhu, X., Wu, X., and Chen, S. 2003. Eliminating class noise in large datasets. In Proceedings of the 20th ICML International Conference on Machine Learning. 920--927."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1236471.1236473","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1236471.1236473","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T14:52:07Z","timestamp":1750258327000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1236471.1236473"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,8]]},"references-count":39,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2007,8]]}},"alternative-id":["10.1145\/1236471.1236473"],"URL":"https:\/\/doi.org\/10.1145\/1236471.1236473","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2007,8]]},"assertion":[{"value":"2007-08-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}