{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T03:24:40Z","timestamp":1782789880663,"version":"3.54.5"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,5,24]],"date-time":"2016-05-24T00:00:00Z","timestamp":1464048000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation CAREER","award":["1452425 and IIS 1017181"],"award-info":[{"award-number":["1452425 and IIS 1017181"]}]},{"name":"R&D grant from Northrop Grumman Aerospace Systems"},{"name":"DARPA Transparent Computing Program","award":["FA8650-15-C-7561"],"award-info":[{"award-number":["FA8650-15-C-7561"]}]},{"name":"Army Research Office Young Investigator Program","award":["W911NF-14-1-0029"],"award-info":[{"award-number":["W911NF-14-1-0029"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2016,7,27]]},"abstract":"<jats:p>\n            Ensemble learning for anomaly detection has been barely studied, due to difficulty in acquiring ground truth and the lack of inherent objective functions. In contrast, ensemble approaches for classification and clustering have been studied and effectively used for long. Our work taps into this gap and builds a new ensemble approach for anomaly detection, with application to event detection in temporal graphs as well as outlier detection in no-graph settings. It handles and combines multiple heterogeneous detectors to yield improved and robust performance. Importantly, trusting results from\n            <jats:italic>all<\/jats:italic>\n            the constituent detectors may deteriorate the overall performance of the ensemble, as some detectors could provide inaccurate results depending on the type of data in hand and the underlying assumptions of a detector. This suggests that combining the detectors\n            <jats:italic>selectively<\/jats:italic>\n            is key to building effective anomaly ensembles\u2014hence \u201cless is more\u201d.\n          <\/jats:p>\n          <jats:p>In this paper we propose a novel ensemble approach called SELECT for anomaly detection, which automatically and systematically selects the results from constituent detectors to combine in a fully unsupervised fashion. We apply our method to event detection in temporal graphs and outlier detection in multi-dimensional point data (no-graph), where SELECT successfully utilizes five base detectors and seven consensus methods under a unified ensemble framework. We provide extensive quantitative evaluation of our approach for event detection on five real-world datasets (four with ground truth events), including Enron email communications, RealityMining SMS and phone call records, New York Times news corpus, and World Cup 2014 Twitter news feed. We also provide results for outlier detection on seven real-world multi-dimensional point datasets from UCI Machine Learning Repository. Thanks to its selection mechanism, SELECT yields superior performance compared to the individual detectors alone, the full ensemble (naively combining all results), an existing diversity-based ensemble, and an existing weighted ensemble approach.<\/jats:p>","DOI":"10.1145\/2890508","type":"journal-article","created":{"date-parts":[[2016,5,25]],"date-time":"2016-05-25T18:07:06Z","timestamp":1464199626000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":96,"title":["Less is More"],"prefix":"10.1145","volume":"10","author":[{"given":"Shebuti","family":"Rayana","sequence":"first","affiliation":[{"name":"Department of Computer Science, Stony Brook University, Stony Brook, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leman","family":"Akoglu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Stony Brook University, Stony Brook, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,5,24]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2481244.2481252"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2830544.2830549"},{"key":"e_1_2_1_3_1","volume-title":"27th Army Science.","author":"Akoglu Leman"},{"key":"e_1_2_1_4_1","volume-title":"Graph-based anomaly detection and description: A survey. DAMI 28, 4","author":"Akoglu Leman","year":"2014"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018054314350"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/335191.335388"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2004.04.004"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"A. Cameron and P. K. Trivedi. 1998. Regression Analysis of Count Data (1st ed.). Cambridge Univ. Press.  A. Cameron and P. K. Trivedi. 1998. Regression Analysis of Count Data (1st ed.). Cambridge Univ. Press.","DOI":"10.1017\/CBO9780511814365"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1541880.1541882"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/648054.743935"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38562-9_7"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/371920.372165"},{"key":"e_1_2_1_13_1","volume-title":"Inferring friendship network structure by using mobile phone data. PNAS","author":"Eagle Nathan","year":"2009"},{"key":"e_1_2_1_14_1","volume-title":"Brodley","author":"Fern Xiaoli Zhang","year":"2003"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/sam.v1:3"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFCOM.2011.5934982"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30217-6_35"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2006.43"},{"key":"e_1_2_1_19_1","unstructured":"Joydeep Ghosh and Ayan Acharya. 2013. Cluster ensembles: Theory and applications. In Data Clustering: Alg. and Appl.  Joydeep Ghosh and Ayan Acharya. 2013. Cluster ensembles: Theory and applications. In Data Clustering: Alg. and Appl."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2013.184"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2005.01.008"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.58871"},{"key":"e_1_2_1_23_1","volume-title":"Identification of Outliers","author":"Hawkins Douglas M."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1009212519"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1214\/07-AOS546"},{"key":"e_1_2_1_26_1","unstructured":"John Kemeny. 1959. Mathematics without numbers. In Daedalus. 577--591.  John Kemeny. 1959. Mathematics without numbers. In Daedalus. 577--591."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74958-5_60"},{"key":"e_1_2_1_28_1","volume-title":"Ng","author":"Knorr Edwin M.","year":"1997"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btr709"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646195"},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Hans-Peter Kriegel Peer Kr\u00f6ger Erich Schubert and Arthur Zimek. 2011. Interpreting and unifying outlier scores. In SDM. 13--24.  Hans-Peter Kriegel Peer Kr\u00f6ger Erich Schubert and Arthur Zimek. 2011. Interpreting and unifying outlier scores. In SDM. 13--24.","DOI":"10.1137\/1.9781611972818.2"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022859003006"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1030194.1015492"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.2307\/1269547"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1081870.1081891"},{"key":"e_1_2_1_36_1","unstructured":"Barbora Micenkov\u00e4 Brian McWilliams and Ira Assent. 2014. Learing outlier ensembles: The best of both worlds - supervised and unsupervised. In KDD ODD2 Workshop.  Barbora Micenkov\u00e4 Brian McWilliams and Ira Assent. 2014. Learing outlier ensembles: The best of both worlds - supervised and unsupervised. In KDD ODD 2 Workshop."},{"key":"e_1_2_1_37_1","volume-title":"Martinez","author":"Monteith Kristine","year":"2011"},{"key":"e_1_2_1_38_1","volume-title":"LOCI: Fast outlier detection using the local correlation integral. In ICDE. 315--326.","author":"Papadimitriou Spiros","year":"2003"},{"key":"e_1_2_1_39_1","unstructured":"Spiros Papadimitriou Jimeng Sun and Christos Faloutsos. 2005. Streaming pattern discovery in multiple time-series. In VLDB.   Spiros Papadimitriou Jimeng Sun and Christos Faloutsos. 2005. Streaming pattern discovery in multiple time-series. In VLDB."},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","unstructured":"Oskar Perron. 1907. Zur theorie der matrices. In Mathematische Annalen.  Oskar Perron. 1907. Zur theorie der matrices. In Mathematische Annalen.","DOI":"10.1007\/BF01449896"},{"key":"e_1_2_1_41_1","volume-title":"Porter and Gentry White","author":"Michael","year":"2012"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-007-0093-3"},{"key":"e_1_2_1_43_1","unstructured":"Shebuti Rayana and Leman Akoglu. 2014. An ensemble approach for event detection in dynamic graphs. In KDD ODD2 Workshop.  Shebuti Rayana and Leman Akoglu. 2014. An ensemble approach for event detection in dynamic graphs. In KDD ODD 2 Workshop."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-009-9124-7"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022648800760"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Erich Schubert Remigius Wojdanowski Arthur Zimek and Hans-Peter Kriegel. 2012. On evaluation of outlier rankings and outlier scores. In SDM. 1047--1058.  Erich Schubert Remigius Wojdanowski Arthur Zimek and Hans-Peter Kriegel. 2012. On evaluation of outlier rankings and outlier scores. In SDM. 1047--1058.","DOI":"10.1137\/1.9781611972825.90"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.237"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1079120131"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Giorgio Valentini and Francesco Masulli. 2002. Ensembles of learning machines. In WIRN.   Giorgio Valentini and Francesco Masulli. 2002. Ensembles of learning machines. In WIRN.","DOI":"10.1007\/3-540-45808-5_1"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2011.28"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12026-8_29"},{"key":"e_1_2_1_52_1","doi-asserted-by":"crossref","unstructured":"Quang H. Vuong. 1989. Likelihood ratio tests for model selection and non-nested hypotheses. In Econometrica.  Quang H. Vuong. 1989. Likelihood ratio tests for model selection and non-nested hypotheses. In Econometrica.","DOI":"10.2307\/1912557"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(05)80023-1"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00354-011-0303-0"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-01307-2_84"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594473.2594476"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487676"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2890508","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2890508","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:38:55Z","timestamp":1750221535000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2890508"}},"subtitle":["Building Selective Anomaly Ensembles"],"short-title":[],"issued":{"date-parts":[[2016,5,24]]},"references-count":57,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,7,27]]}},"alternative-id":["10.1145\/2890508"],"URL":"https:\/\/doi.org\/10.1145\/2890508","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,5,24]]},"assertion":[{"value":"2015-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-05-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}