{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T13:56:38Z","timestamp":1760709398606,"version":"3.41.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2017,8,31]],"date-time":"2017-08-31T00:00:00Z","timestamp":1504137600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003399","name":"STCSM","doi-asserted-by":"crossref","award":["12DZ2272600"],"award-info":[{"award-number":["12DZ2272600"]}],"id":[{"id":"10.13039\/501100003399","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["61521062"],"award-info":[{"award-number":["61521062"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"High Technology Research and Development Program of China","award":["2015AA015801"],"award-info":[{"award-number":["2015AA015801"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2018,4,30]]},"abstract":"<jats:p>\n            Most existing active learning studies focus on designing sample selection algorithms. However, several fundamental problems deserve investigation to provide deep insight into active learning. In this article, we conduct an in-depth investigation on active learning for classification from the perspective of model change. We derive a general active learning framework for classification called\n            <jats:italic>maximum model change<\/jats:italic>\n            (MMC), which aims at querying the influential examples. The model change is quantified as the difference between the model parameters before and after training with the expanded training set. Inspired by the stochastic gradient update rule, the gradient of the loss with respect to a given candidate example is adopted to approximate the model change. This framework is applied to two popular classifiers: support vector machines and logistic regression. We analyze the convergence property of MMC and theoretically justify it. We explore the connection between MMC and uncertainty-based sampling to provide a uniform view. In addition, we discuss its potential usability to other learning models and show its applicability in a wide range of applications. We validate the MMC strategy on two kinds of benchmark datasets, the UCI repository and ImageNet, and show that it outperforms many state-of-the-art methods.\n          <\/jats:p>","DOI":"10.1145\/3086820","type":"journal-article","created":{"date-parts":[[2017,9,1]],"date-time":"2017-09-01T12:27:42Z","timestamp":1504268862000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Active Learning for Classification with Maximum Model Change"],"prefix":"10.1145","volume":"36","author":[{"given":"Wenbin","family":"Cai","sequence":"first","affiliation":[{"name":"Bing, Microsoft, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5390-9053","authenticated-orcid":false,"given":"Yexun","family":"Zhang","sequence":"additional","affiliation":[{"name":"Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai, China"}]},{"given":"Ya","family":"Zhang","sequence":"additional","affiliation":[{"name":"Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai, China"}]},{"given":"Siyuan","family":"Zhou","sequence":"additional","affiliation":[{"name":"Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai, China"}]},{"given":"Wenquan","family":"Wang","sequence":"additional","affiliation":[{"name":"Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai, China"}]},{"given":"Zhuoxiang","family":"Chen","sequence":"additional","affiliation":[{"name":"Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai, China"}]},{"given":"Chris","family":"Ding","sequence":"additional","affiliation":[{"name":"University of Texas at Arlington, TX"}]}],"member":"320","published-online":{"date-parts":[[2017,8,31]]},"reference":[{"volume-title":"Proceedings of the 15th International Conference on Machine Learning (ICML\u201998)","author":"Abe N.","key":"e_1_2_1_1_1","unstructured":"N. Abe and H. Mamitsuka . 1998. Query learning strategies using boosting and bagging . In Proceedings of the 15th International Conference on Machine Learning (ICML\u201998) . 1--10. N. Abe and H. Mamitsuka. 1998. Query learning strategies using boosting and bagging. In Proceedings of the 15th International Conference on Machine Learning (ICML\u201998). 1--10."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143853"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 20th International Conference on Machine Learning (ICML\u201903)","author":"Brinker K.","year":"2003","unstructured":"K. Brinker . 2003 . Incorporating diversity in active learning with support vector machines . In Proceedings of the 20th International Conference on Machine Learning (ICML\u201903) . 59--66. K. Brinker. 2003. Incorporating diversity in active learning with support vector machines. In Proceedings of the 20th International Conference on Machine Learning (ICML\u201903). 59--66."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009715923555"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-015-9250-6"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2013.104"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/3120260.3120275"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148205"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.295"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390183"},{"volume-title":"Proceedings of Advances in Neural Information Processing Systems (NIPS\u201907)","author":"Dasgupta S.","key":"e_1_2_1_13_1","unstructured":"S. Dasgupta , D. Hsu , and C. Monteleoni . 2007. A general agnostic active learning algorithm . In Proceedings of Advances in Neural Information Processing Systems (NIPS\u201907) . 353--360. S. Dasgupta, D. Hsu, and C. Monteleoni. 2007. A general agnostic active learning algorithm. In Proceedings of Advances in Neural Information Processing Systems (NIPS\u201907). 353--360."},{"volume-title":"Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201909)","author":"Deng J.","key":"e_1_2_1_14_1","unstructured":"J. Deng , W. Dong , R. Socher , L. Li , K. Li , and L. Fei . 2009. ImageNet: A large-scale hierarchical image database . In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201909) . 248--255. J. Deng, W. Dong, R. Socher, L. Li, K. Li, and L. Fei. 2009. ImageNet: A large-scale hierarchical image database. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201909). 248--255."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.21236\/ADA531307"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74958-5_15"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007330508534"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"A. Freytag E. Rodner and J. Denzler. 2014. Selecting influential examples: Active learning with expected model output changesIn Proceedings of the European Conference on Computer Vision (ECCV\u201914). 562--577.  A. Freytag E. Rodner and J. Denzler. 2014. Selecting influential examples: Active learning with expected model output changesIn Proceedings of the European Conference on Computer Vision (ECCV\u201914). 562--577.","DOI":"10.1007\/978-3-319-10593-2_37"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-012-0507-8"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of Advances in Neural Information Processing Systems (NIPS\u201910)","author":"Guo Y.","year":"2010","unstructured":"Y. Guo . 2010 . Active instance sampling via matrix partition . In Proceedings of Advances in Neural Information Processing Systems (NIPS\u201910) . 802--810. Y. Guo. 2010. Active instance sampling via matrix partition. In Proceedings of Advances in Neural Information Processing Systems (NIPS\u201910). 802--810."},{"volume-title":"Proceedings of Advances in Neural Information Processing Systems (NIPS\u201907)","author":"Guo Y.","key":"e_1_2_1_21_1","unstructured":"Y. Guo and D. Schuurmans . 2007. Discriminative batch mode active learning . In Proceedings of Advances in Neural Information Processing Systems (NIPS\u201907) . 593--600. Y. Guo and D. Schuurmans. 2007. Discriminative batch mode active learning. In Proceedings of Advances in Neural Information Processing Systems (NIPS\u201907). 593--600."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273541"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.60"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1508850.1508854"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2011.231"},{"volume-title":"Proceedings of Advances in Neural Information Processing Systems (NIPS\u201910)","author":"Huang S.","key":"e_1_2_1_26_1","unstructured":"S. Huang , R. Jin , and Z. Zhou . 2010. Active learning by querying informative and representative examples . In Proceedings of Advances in Neural Information Processing Systems (NIPS\u201910) . 892--900. S. Huang, R. Jin, and Z. Zhou. 2010. Active learning by querying informative and representative examples. In Proceedings of Advances in Neural Information Processing Systems (NIPS\u201910). 892--900."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2307881"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.178"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2004.830991"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-2099-5_1"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339701"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.156"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2213836.2213958"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2009.63"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2013.01.051"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015385"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015349"},{"volume-title":"Proceedings of the 18th International Conference on Machine Learning (ICML\u201901)","author":"Roy N.","key":"e_1_2_1_38_1","unstructured":"N. Roy and A. McCallum . 2001. Toward optimal active learning through sampling estimation of error reduction . In Proceedings of the 18th International Conference on Machine Learning (ICML\u201901) . 441--448. N. Roy and A. McCallum. 2001. Toward optimal active learning through sampling estimation of error reduction. In Proceedings of the 18th International Conference on Machine Learning (ICML\u201901). 441--448."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-007-5019-5"},{"volume-title":"Proceedings of the 17th International Conference on Machine Learning (ICML\u201900)","author":"Schohn G.","key":"e_1_2_1_40_1","unstructured":"G. Schohn and D. Cohn . 2000. Less is more: Active learning with support vector machines . In Proceedings of the 17th International Conference on Machine Learning (ICML\u201900) . 839--846. G. Schohn and D. Cohn. 2000. Less is more: Active learning with support vector machines. In Proceedings of the 17th International Conference on Machine Learning (ICML\u201900). 839--846."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.3115\/1613715.1613855"},{"volume-title":"Proceedings of Advances in Neural Information Processing Systems (NIPS\u201908)","author":"Settles B.","key":"e_1_2_1_43_1","unstructured":"B. Settles , M. Craven , and S. Ray . 2008. Multiple-instance active learning . In Proceedings of Advances in Neural Information Processing Systems (NIPS\u201908) . 1289--1296. B. Settles, M. Craven, and S. Ray. 2008. Multiple-instance active learning. In Proceedings of Advances in Neural Information Processing Systems (NIPS\u201908). 1289--1296."},{"key":"e_1_2_1_44_1","volume-title":"Learning Non-Linear SVM in Input Space for Image Classification. Retrieved","author":"Sharma G.","year":"2017","unstructured":"G. Sharma , F. Jurie , and P. Perez . 2014 . Learning Non-Linear SVM in Input Space for Image Classification. Retrieved May 23, 2017 , from https:\/\/hal.inria.fr\/hal-00977304v1\/document. G. Sharma, F. Jurie, and P. Perez. 2014. Learning Non-Linear SVM in Input Space for Image Classification. Retrieved May 23, 2017, from https:\/\/hal.inria.fr\/hal-00977304v1\/document."},{"volume-title":"Proceedings of the 24th International Conference on Machine Learning (ICML\u201907)","author":"Shwartz S.","key":"e_1_2_1_45_1","unstructured":"S. Shwartz , Y. Singer , and N. Srebro . 2007. Pegasos: Primal estimated sub-gradient solver for SVM . In Proceedings of the 24th International Conference on Machine Learning (ICML\u201907) . 807--814. S. Shwartz, Y. Singer, and N. Srebro. 2007. Pegasos: Primal estimated sub-gradient solver for SVM. In Proceedings of the 24th International Conference on Machine Learning (ICML\u201907). 807--814."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-009-5100-3"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/500141.500159"},{"key":"e_1_2_1_48_1","first-page":"45","article-title":"Support vector machine active learning with applications to text classification","volume":"2","author":"Tong S.","year":"2001","unstructured":"S. Tong and D. Koller . 2001 . Support vector machine active learning with applications to text classification . Journal of Machine Learning Research 2 , 45 -- 66 . S. Tong and D. Koller. 2001. Support vector machine active learning with applications to text classification. Journal of Machine Learning Research 2, 45--66.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1165774.1165777"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3264-1"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623759"},{"volume-title":"Active Learning with Support Vector Machines. Master\u2019s Thesis. School of Informatics","author":"Vlachos A.","key":"e_1_2_1_52_1","unstructured":"A. Vlachos . 2004. Active Learning with Support Vector Machines. Master\u2019s Thesis. School of Informatics , University of Edinburgh. A. Vlachos. 2004. Active Learning with Support Vector Machines. Master\u2019s Thesis. School of Informatics, University of Edinburgh."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.5555\/2503308.2503341"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-36618-0_28"},{"volume-title":"Proceedings of the 20th International Conference on Machine Learning (ICML\u201903)","author":"Zhang J.","key":"e_1_2_1_55_1","unstructured":"J. Zhang , R. Jin , Y. Yang , and A. G. Hauptmann . 2003. Modified logistic regression: An approximation to SVM and its applications in large-scale text categorization . In Proceedings of the 20th International Conference on Machine Learning (ICML\u201903) . 888--895. J. Zhang, R. Jin, Y. Yang, and A. G. Hauptmann. 2003. Modified logistic regression: An approximation to SVM and its applications in large-scale text categorization. In Proceedings of the 20th International Conference on Machine Learning (ICML\u201903). 888--895."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-00831-3_1"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3086820","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3086820","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:30:13Z","timestamp":1750217413000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3086820"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,31]]},"references-count":55,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,4,30]]}},"alternative-id":["10.1145\/3086820"],"URL":"https:\/\/doi.org\/10.1145\/3086820","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"type":"print","value":"1046-8188"},{"type":"electronic","value":"1558-2868"}],"subject":[],"published":{"date-parts":[[2017,8,31]]},"assertion":[{"value":"2016-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-08-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}