{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T06:32:13Z","timestamp":1790749933186,"version":"4.1.0"},"reference-count":70,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,1,30]],"date-time":"2018-01-30T00:00:00Z","timestamp":1517270400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003329","name":"Ministerio de Econom\u00eda y Competitividad","doi-asserted-by":"publisher","award":["TIN-2014-55252-P"],"award-info":[{"award-number":["TIN-2014-55252-P"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2018,7,31]]},"abstract":"<jats:p>Multi-label learning has become an important area of research owing to the increasing number of real-world problems that contain multi-label data. Data labeling is an expensive process that requires expert handling. The annotation of multi-label data is laborious since a human expert needs to consider the presence\/absence of each possible label. Consequently, numerous modern multi-label problems may involve a small number of labeled examples and plentiful unlabeled examples simultaneously. Active learning methods allow us to induce better classifiers by selecting the most useful unlabeled data, thus considerably reducing the labeling effort and the cost of training an accurate model. Batch-mode active learning methods focus on selecting a set of unlabeled examples in each iteration in such a way that the selected examples are informative and as diverse as possible. This article presents a strategy to perform batch-mode active learning on multi-label data. The batch-mode active learning is formulated as a multi-objective problem, and it is solved by means of an evolutionary algorithm. Extensive experiments were conducted in a large collection of datasets, and the experimental results confirmed the effectiveness of our proposal for better batch-mode multi-label active learning.<\/jats:p>","DOI":"10.1145\/3161606","type":"journal-article","created":{"date-parts":[[2018,1,31]],"date-time":"2018-01-31T08:25:40Z","timestamp":1517387140000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":35,"title":["Evolutionary Strategy to Perform Batch-Mode Active Learning on Multi-Label Data"],"prefix":"10.1145","volume":"9","author":[{"given":"Oscar","family":"Reyes","sequence":"first","affiliation":[{"name":"University of C\u00f3rdoba, Spain; Maimonides Biomedical Research Institute of C\u00f3rdoba, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4216-6378","authenticated-orcid":false,"given":"Sebasti\u00e1n","family":"Ventura","sequence":"additional","affiliation":[{"name":"University of C\u00f3rdoba, Spain; King Abdulaziz University, Jeddah, Saudi Arabia; Maimonides Biomedical Research Institute of C\u00f3rdoba, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,1,30]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/170035.170072"},{"key":"e_1_2_2_2_1","volume-title":"Proceedings of the Congress on Evolutionary Computing IEEE, 765--772","author":"Anile A. M.","unstructured":"A. M. Anile , V. Cutello , G. Nicosia , R. Rascuna , and S. Spinella . 2005. Comparison among evolutionary algorithms and classical optimization methods for circuit design problems . In Proceedings of the Congress on Evolutionary Computing IEEE, 765--772 . A. M. Anile, V. Cutello, G. Nicosia, R. Rascuna, and S. Spinella. 2005. Comparison among evolutionary algorithms and classical optimization methods for circuit design problems. In Proceedings of the Congress on Evolutionary Computing IEEE, 765--772."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944965"},{"key":"e_1_2_2_4_1","doi-asserted-by":"crossref","unstructured":"S. Bechikh R. Datta and A. Gupta. 2017. Recent Advances in Evolutionary Multi-objective Optimization. Vol. 20. Springer.   S. Bechikh R. Datta and A. Gupta. 2017. Recent Advances in Evolutionary Multi-objective Optimization. Vol. 20. Springer.","DOI":"10.1007\/978-3-319-42978-6"},{"key":"e_1_2_2_5_1","doi-asserted-by":"crossref","unstructured":"B. Bergmann and G. Hommel. 1988. Multiple Hypotheses Testing. Improvements of General Multiple Test Procedures for Redundant Systems of Hypotheses Springer Berlin 100--115.  B. Bergmann and G. Hommel. 1988. Multiple Hypotheses Testing. Improvements of General Multiple Test Procedures for Redundant Systems of Hypotheses Springer Berlin 100--115.","DOI":"10.1007\/978-3-642-52307-6_8"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2004.03.009"},{"key":"e_1_2_2_7_1","volume-title":"From Data and Information Analysis to Knowledge Engineering. Active Learning in Multi-label Classification","author":"Brinker K.","unstructured":"K. Brinker . 2006. From Data and Information Analysis to Knowledge Engineering. Active Learning in Multi-label Classification , Springer-Verlag , 206--213. K. Brinker. 2006. From Data and Information Analysis to Knowledge Engineering. Active Learning in Multi-label Classification, Springer-Verlag, 206--213."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2072028"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2513092.2513094"},{"key":"e_1_2_2_10_1","volume-title":"Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery. Springer Berlin, 42--53","author":"Clare A.","unstructured":"A. Clare and R. King . 2001. Knowledge discovery in multi-label phenotype data . In Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery. Springer Berlin, 42--53 . A. Clare and R. King. 2001. Knowledge discovery in multi-label phenotype data. In Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery. Springer Berlin, 42--53."},{"key":"e_1_2_2_11_1","volume-title":"Proceedings of the International Conference on Image Processing. IEEE, 3437--3441","author":"Ye C.","unstructured":"C. Ye , J. Wu , V. Sheng , P. Zhao , and Z. Cui . 2015. Multi-label active learning with label correlation for image classification . In Proceedings of the International Conference on Image Processing. IEEE, 3437--3441 . C. Ye, J. Wu, V. Sheng, P. Zhao, and Z. Cui. 2015. Multi-label active learning with label correlation for image classification. In Proceedings of the International Conference on Image Processing. IEEE, 3437--3441."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248548"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/11573036_42"},{"key":"e_1_2_2_15_1","doi-asserted-by":"crossref","unstructured":"A. E. Eiben and S. K. Smit. 2012. Autonomous Search. Evolutionary Algorithm Parameters and Methods to Tune Them Springer Berlin 15--36.  A. E. Eiben and S. K. Smit. 2012. Autonomous Search. Evolutionary Algorithm Parameters and Methods to Tune Them Springer Berlin 15--36.","DOI":"10.1007\/978-3-642-21434-9_2"},{"key":"e_1_2_2_16_1","volume-title":"Advanced Neural Information Processing Systems","volume":"14","author":"Elisseeff A.","unstructured":"A. Elisseeff and J. Weston . 2001. A kernel method for multi-labelled classification . In Advanced Neural Information Processing Systems , Vol. 14 . MIT Press, 681--687. A. Elisseeff and J. Weston. 2001. A kernel method for multi-labelled classification. In Advanced Neural Information Processing Systems, Vol. 14. MIT Press, 681--687."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-00958-7_12"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177731944"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2012.2209177"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-012-0507-8"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11704-016-5421-x"},{"key":"e_1_2_2_22_1","first-page":"2677","article-title":"An extension on \u201cStatistical comparisons of classifiers over multiple data sets\u2019\u2019 for all pairwise comparisons","volume":"9","author":"Garc\u00eda S.","year":"2008","unstructured":"S. Garc\u00eda and F. Herrera . 2008 . An extension on \u201cStatistical comparisons of classifiers over multiple data sets\u2019\u2019 for all pairwise comparisons . Journal of Machine Learning Research 9 (2008), 2677 -- 2694 . S. Garc\u00eda and F. Herrera. 2008. An extension on \u201cStatistical comparisons of classifiers over multiple data sets\u2019\u2019 for all pairwise comparisons. Journal of Machine Learning Research 9 (2008), 2677--2694.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1139"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1986.289288"},{"key":"e_1_2_2_25_1","volume-title":"Proceedings of Advanced Neural Information Processing Systems. MIT Press, 593--600","author":"Guo Y.","unstructured":"Y. Guo and D. Schuurmans . 2008. Discriminative batch mode active learning . In Proceedings of Advanced Neural Information Processing Systems. MIT Press, 593--600 . Y. Guo and D. Schuurmans. 2008. Discriminative batch mode active learning. In Proceedings of Advanced Neural Information Processing Systems. MIT Press, 593--600."},{"key":"e_1_2_2_26_1","volume-title":"Proceedings of 24th International Conference on Artificial Intelligence. AAI Press, 946--952","author":"Huang S.","unstructured":"S. Huang , S. Chen , and Z. Zhou . 2015. Multi-label active learning: Query type matters . In Proceedings of 24th International Conference on Artificial Intelligence. AAI Press, 946--952 . S. Huang, S. Chen, and Z. Zhou. 2015. Multi-label active learning: Query type matters. In Proceedings of 24th International Conference on Artificial Intelligence. AAI Press, 946--952."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2307881"},{"key":"e_1_2_2_28_1","volume-title":"Proceedings of the 13th International Conference on Data Mining. IEEE, 1079--1084","author":"Huang S. J.","unstructured":"S. J. Huang and Z. H. Zhou . 2013. Active query driven by uncertainty and diversity for incremental multi-label learning . In Proceedings of the 13th International Conference on Data Mining. IEEE, 1079--1084 . S. J. Huang and Z. H. Zhou. 2013. Active query driven by uncertainty and diversity for incremental multi-label learning. In Proceedings of the 13th International Conference on Data Mining. IEEE, 1079--1084."},{"key":"e_1_2_2_29_1","volume-title":"Proceedings of the Asian Conference on Machine Learning. JMLR, 315--330","author":"Hung C. W.","unstructured":"C. W. Hung and H. T. Lin . 2011. Multi-label active learning with auxiliary learner . In Proceedings of the Asian Conference on Machine Learning. JMLR, 315--330 . C. W. Hung and H. T. Lin. 2011. Multi-label active learning with auxiliary learner. In Proceedings of the Asian Conference on Machine Learning. JMLR, 315--330."},{"key":"e_1_2_2_30_1","volume-title":"Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML\/PKDD) Discovery Challenge.","author":"Katakis I.","unstructured":"I. Katakis , G. Tsoumakas , and I. Vlahavas . 2008. Multilabel text classification for automated tag suggestion . In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML\/PKDD) Discovery Challenge. I. Katakis, G. Tsoumakas, and I. Vlahavas. 2008. Multilabel text classification for automated tag suggestion. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML\/PKDD) Discovery Challenge."},{"key":"e_1_2_2_31_1","volume-title":"Proceedings of the 17th Annual International Conference on Developing Information Retrieval. ACM, 3--12","author":"Lewis D.","unstructured":"D. Lewis and W. Gale . 1994. A sequential algorithm for training text classifier . In Proceedings of the 17th Annual International Conference on Developing Information Retrieval. ACM, 3--12 . D. Lewis and W. Gale. 1994. A sequential algorithm for training text classifier. In Proceedings of the 17th Annual International Conference on Developing Information Retrieval. ACM, 3--12."},{"key":"e_1_2_2_32_1","unstructured":"S. Y. Li Y. Jiang and Z. H. Zhou. 2015. Multi-label active learning from crowds. arXiv preprint arXiv:1508.00722. (2015).  S. Y. Li Y. Jiang and Z. H. Zhou. 2015. Multi-label active learning from crowds. arXiv preprint arXiv:1508.00722. (2015)."},{"key":"e_1_2_2_33_1","volume-title":"Proceedings of the International Symposium on Music Information Retrieval. Washington DC, USA, 239--240","author":"Li T.","unstructured":"T. Li and M. Ogihara . 2003. Detecting emotion in music . In Proceedings of the International Symposium on Music Information Retrieval. Washington DC, USA, 239--240 . T. Li and M. Ogihara. 2003. Detecting emotion in music. In Proceedings of the International Symposium on Music Information Retrieval. Washington DC, USA, 239--240."},{"key":"e_1_2_2_34_1","volume-title":"Proceedings of the 23rd International Joint Conference on Artificial Intelligence AAAI Press, 1479--1485","author":"Li X.","unstructured":"X. Li and Y. Guo . 2013. Active learning with multi-label SVM classification . In Proceedings of the 23rd International Joint Conference on Artificial Intelligence AAAI Press, 1479--1485 . X. Li and Y. Guo. 2013. Active learning with multi-label SVM classification. In Proceedings of the 23rd International Joint Conference on Artificial Intelligence AAAI Press, 1479--1485."},{"key":"e_1_2_2_35_1","volume-title":"Proceedings of the 15th International Conference on Knowledge Discovery and Data Mining.","volume":"4","author":"Li X.","unstructured":"X. Li , L. Wang , and E. Sung . 2004. Multi-label SVM active learning for image classification . In Proceedings of the 15th International Conference on Knowledge Discovery and Data Mining. Vol. 4 . ACM, 2207--2210. X. Li, L. Wang, and E. Sung. 2004. Multi-label SVM active learning for image classification. In Proceedings of the 15th International Conference on Knowledge Discovery and Data Mining. Vol. 4. ACM, 2207--2210."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMIT.2008.97"},{"key":"e_1_2_2_37_1","first-page":"1","article-title":"Speeding-up association rule mining with inverted index compression","volume":"99","author":"Luna J. M.","year":"2016","unstructured":"J. M. Luna , A. Cano , M. Pechenizkiy , and S. Ventura . 2016 . Speeding-up association rule mining with inverted index compression . IEEE Transactions on Cybernetics 99 (2016), 1 -- 14 . J. M. Luna, A. Cano, M. Pechenizkiy, and S. Ventura. 2016. Speeding-up association rule mining with inverted index compression. IEEE Transactions on Cybernetics 99 (2016), 1--14.","journal-title":"IEEE Transactions on Cybernetics"},{"key":"e_1_2_2_38_1","unstructured":"J. M. Luna and S. Ventura. 2016. Pattern Mining with Evolutionary Algorithms. Springer.   J. M. Luna and S. Ventura. 2016. Pattern Mining with Evolutionary Algorithms. Springer."},{"key":"e_1_2_2_39_1","volume-title":"Proceedings of the Workshop on Biological, Translational, and Clinical Language Processing (BioNLP\u201907)","author":"Pestian J. P.","unstructured":"J. P. Pestian , C. Brew , P. Matykiewicz , D. J. Hovermale , N. Johnson , K. B. Cohen , and W. Duch . 2007. A shared task involving multi-label classification of clinical free text . In Proceedings of the Workshop on Biological, Translational, and Clinical Language Processing (BioNLP\u201907) . Association for Computational Linguistics, Stroudsburg, PA, USA, 97--104. J. P. Pestian, C. Brew, P. Matykiewicz, D. J. Hovermale, N. Johnson, K. B. Cohen, and W. Duch. 2007. A shared task involving multi-label classification of clinical free text. In Proceedings of the Workshop on Biological, Translational, and Clinical Language Processing (BioNLP\u201907). Association for Computational Linguistics, Stroudsburg, PA, USA, 97--104."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.218"},{"key":"e_1_2_2_41_1","unstructured":"C. Qian Y. Yang and Z. H. Zhou. 2015a. Subset selection by pareto optimization. In Advanced Neural Information Processing Systems. Montreal Canada 1765--1773.   C. Qian Y. Yang and Z. H. Zhou. 2015a. Subset selection by pareto optimization. In Advanced Neural Information Processing Systems. Montreal Canada 1765--1773."},{"key":"e_1_2_2_42_1","volume-title":"Proceedings of the 29th AAAI Conference on Artificial Intelligence Austin, TX, 2935--2941","author":"Qian C.","unstructured":"C. Qian , Y. Yu , and Z. H. Zhou . 2015b. Pareto ensemble pruning . In Proceedings of the 29th AAAI Conference on Artificial Intelligence Austin, TX, 2935--2941 . C. Qian, Y. Yu, and Z. H. Zhou. 2015b. Pareto ensemble pruning. In Proceedings of the 29th AAAI Conference on Artificial Intelligence Austin, TX, 2935--2941."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-012-5279-6"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2017.08.001"},{"key":"e_1_2_2_45_1","first-page":"1","article-title":"JCLAL: A Java framework for active learning","volume":"17","author":"Reyes O.","year":"2016","unstructured":"O. Reyes , E. P\u00e9rez , M. C. Rodr\u00edguez-Hern\u00e1ndez , H. M. Fardoun , and S. Ventura . 2016 . JCLAL: A Java framework for active learning . Journal of Machine Learning Research 17 , 95 (2016), 1 -- 5 . O. Reyes, E. P\u00e9rez, M. C. Rodr\u00edguez-Hern\u00e1ndez, H. M. Fardoun, and S. Ventura. 2016. JCLAL: A Java framework for active learning. Journal of Machine Learning Research 17, 95 (2016), 1--5.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_2_46_1","doi-asserted-by":"crossref","unstructured":"B. Settles. 2012. Active Learning (1 ed.). Morgan 8 Claypool.   B. Settles. 2012. Active Learning (1 ed.). Morgan 8 Claypool.","DOI":"10.2200\/S00429ED1V01Y201207AIM018"},{"key":"e_1_2_2_47_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing. ACL Press, 1069--1078","author":"Settles B.","unstructured":"B. Settles and M. Craven . 2008. An analysis of active learning strategies for sequence labeling tasks . In Proceedings of the Conference on Empirical Methods in Natural Language Processing. ACL Press, 1069--1078 . B. Settles and M. Craven. 2008. An analysis of active learning strategies for sequence labeling tasks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. ACL Press, 1069--1078."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505272"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2089094.2089109"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31880-4_22"},{"key":"e_1_2_2_51_1","volume-title":"Proceedings of the 19th Irish Conference on Artificial Intelligence and Cognitive Science. 173--182","author":"Singh M.","unstructured":"M. Singh , E. Curran , and P. Cunningham . 2009. Active learning for multi-label image annotation . In Proceedings of the 19th Irish Conference on Artificial Intelligence and Cognitive Science. 173--182 . M. Singh, E. Curran, and P. Cunningham. 2009. Active learning for multi-label image annotation. In Proceedings of the 19th Irish Conference on Artificial Intelligence and Cognitive Science. 173--182."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-87881-0_40"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2011.2180916"},{"key":"e_1_2_2_54_1","doi-asserted-by":"crossref","unstructured":"G. Tsoumakas I. Katakis and I. Vlahavas. 2010. Data Mining and Knowledge Discovery Handbook (2 ed.). Mining Multi-label Data Springer-Verlag New York 667--686.  G. Tsoumakas I. Katakis and I. Vlahavas. 2010. Data Mining and Knowledge Discovery Handbook (2 ed.). Mining Multi-label Data Springer-Verlag New York 667--686.","DOI":"10.1007\/978-0-387-09823-4_34"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2007.913750"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623759"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-007-0172-0"},{"key":"e_1_2_2_58_1","volume-title":"Proceedings of the Conference on Computer Vision Pattern Recognition. IEEE, 2262--2269","author":"Vijayanarasimhan S.","unstructured":"S. Vijayanarasimhan and K. Grauman . 2009. What\u2019s it going to cost you?: Predicting effort vs. informativeness for multi-label image annotations . In Proceedings of the Conference on Computer Vision Pattern Recognition. IEEE, 2262--2269 . S. Vijayanarasimhan and K. Grauman. 2009. What\u2019s it going to cost you?: Predicting effort vs. informativeness for multi-label image annotations. In Proceedings of the Conference on Computer Vision Pattern Recognition. IEEE, 2262--2269."},{"key":"e_1_2_2_59_1","volume-title":"Proceedings of the 12th SIAM International Conference on Data Mining, 1131--1140","author":"Wang P.","unstructured":"P. Wang , P. Zhang , and L. Guo . 2012. Mining multi-label data streams using ensemble-based active learning . In Proceedings of the 12th SIAM International Conference on Data Mining, 1131--1140 . P. Wang, P. Zhang, and L. Guo. 2012. Mining multi-label data streams using ensemble-based active learning. In Proceedings of the 12th SIAM International Conference on Data Mining, 1131--1140."},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622767.1622768"},{"key":"e_1_2_2_61_1","volume-title":"Proceedings of the International Conference on Image Processing. IEEE, 5227--5231","author":"Wu J.","unstructured":"J. Wu , V. Sheng , J. Zhang , P. Zhao , and Z. Cui . 2014. Multi-label active learning for image classification . In Proceedings of the International Conference on Image Processing. IEEE, 5227--5231 . J. Wu, V. Sheng, J. Zhang, P. Zhao, and Z. Cui. 2014. Multi-label active learning for image classification. In Proceedings of the International Conference on Image Processing. IEEE, 5227--5231."},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2652065"},{"key":"e_1_2_2_63_1","volume-title":"Proceedings of the European Conference on Information Retrieval. Springer, Berlin Heidelberg, 246--257","author":"Xu Z.","unstructured":"Z. Xu , R. Akella , and Y. Zhang . 2007. Incorporating diversity and density in active learning for relevance feedback . In Proceedings of the European Conference on Information Retrieval. Springer, Berlin Heidelberg, 246--257 . Z. Xu, R. Akella, and Y. Zhang. 2007. Incorporating diversity and density in active learning for relevance feedback. In Proceedings of the European Conference on Information Retrieval. Springer, Berlin Heidelberg, 246--257."},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1557019.1557119"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2302675"},{"key":"e_1_2_2_66_1","article-title":"Active learning with imbalanced multiple noisy labeling","volume":"44","author":"Zhang J.","year":"2014","unstructured":"J. Zhang , X. Wu , and V. S. Sheng . 2014 b. Active learning with imbalanced multiple noisy labeling . IEEE Transactions on Cybernetics 44 , 3 (2014). J. Zhang, X. Wu, and V. S. Sheng. 2014b. Active learning with imbalanced multiple noisy labeling. IEEE Transactions on Cybernetics 44, 3 (2014).","journal-title":"IEEE Transactions on Cybernetics"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2013.39"},{"key":"e_1_2_2_68_1","volume-title":"Proceedings of the International Conference on Multimedia. Expo. IEEE, 258--261","author":"Zhang X.","unstructured":"X. Zhang , J. Cheng , C. Xu , H. Lu , and S. Ma . 2009. Multi-view multi-label active learning for image classification . In Proceedings of the International Conference on Multimedia. Expo. IEEE, 258--261 . X. Zhang, J. Cheng, C. Xu, H. Lu, and S. Ma. 2009. Multi-view multi-label active learning for image classification. In Proceedings of the International Conference on Multimedia. Expo. IEEE, 258--261."},{"key":"e_1_2_2_69_1","volume-title":"Proceedings of the 24th AAAI Conference on Artificial Intelligence AAAI Press, 667--672","author":"Zhang Y.","year":"2010","unstructured":"Y. Zhang . 2010 . Multi-task active learning with output constraints . In Proceedings of the 24th AAAI Conference on Artificial Intelligence AAAI Press, 667--672 . Y. Zhang. 2010. Multi-task active learning with output constraints. In Proceedings of the 24th AAAI Conference on Artificial Intelligence AAAI Press, 667--672."},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2806298"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3161606","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3161606","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:26:53Z","timestamp":1750199213000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3161606"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1,30]]},"references-count":70,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,7,31]]}},"alternative-id":["10.1145\/3161606"],"URL":"https:\/\/doi.org\/10.1145\/3161606","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1,30]]},"assertion":[{"value":"2017-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-01-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}