{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T09:27:50Z","timestamp":1778146070036,"version":"3.51.4"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,6,22]],"date-time":"2023-06-22T00:00:00Z","timestamp":1687392000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGKDD Explor. Newsl."],"published-print":{"date-parts":[[2023,6,22]]},"abstract":"<jats:p>Given an unsupervised outlier detection task, how should one select i) a detection algorithm, and ii) associated hyperparameter values (jointly called a model)? E ective outlier model selection is essential as di erent algorithms may work well for varying detection tasks, and moreover their performance can be quite sensitive to the values of the hyperparameters (HPs). On the other hand, unsupervised model selection is notoriously difficult, in the absence of hold-out validation data with ground-truth labels. Therefore, the problem is vastly understudied in the outlier mining literature. There exists a body of work that propose internal model evaluation strate- gies for selecting a model. These so-called internal strategies solely rely on the input data (without labels) and the output (outlier scores) of the candidate models. In this paper, we rst survey internal model evaluation strategies including both those proposed speci cally for outlier detection, as well as those that can be adapted from the unsupervised deep representation learning literature. Then, we investigate their e ectiveness empirically in comparison to simple baselines such as random selection and the popular state-of-the-art detector Isolation Forest (iForest) with default HPs. To this end, we set up (and open-source) a large testbed with 39 detection tasks and 297 candidate models comprised of 8 different detectors and various HP con gurations. We evaluate internal strategies from 7 di erent families on their ability to discriminate between models w.r.t. detection performance, without using any labels. Our study reports a striking nding, that none of the existing and adapted strategies would be practically useful: stand-alone ones are not signi cantly di erent from random, and consensus-based ones do not outperform iForest (w\/ default HPs) while being more expensive (as all candidate models need to be trained for evaluation). Our survey stresses the importance of and the standing need for e ective unsupervised outlier model selection, and acts as a call for future work on the problem.<\/jats:p>","DOI":"10.1145\/3606274.3606277","type":"journal-article","created":{"date-parts":[[2023,7,5]],"date-time":"2023-07-05T17:33:05Z","timestamp":1688578385000},"page":"19-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["The Need for Unsupervised Outlier Model Selection: A Review and Evaluation of Internal Evaluation Strategies"],"prefix":"10.1145","volume":"25","author":[{"given":"Martin Q.","family":"Ma","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yue","family":"Zhao","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaorong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leman","family":"Akoglu","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,7,5]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"An introduction to outlier analysis","author":"Aggarwal C. C.","year":"2017","unstructured":"C. C. Aggarwal and C. C. Aggarwal . An introduction to outlier analysis . Springer , 2017 . C. C. Aggarwal and C. C. Aggarwal. An introduction to outlier analysis. Springer, 2017."},{"key":"e_1_2_1_2_1","volume-title":"Theoretical foundations and algorithms for outlier ensembles. Acm sigkdd explo- rations newsletter, 17(1):24{47","author":"Aggarwal C. C.","year":"2015","unstructured":"C. C. Aggarwal and S. Sathe . Theoretical foundations and algorithms for outlier ensembles. Acm sigkdd explo- rations newsletter, 17(1):24{47 , 2015 . C. C. Aggarwal and S. Sathe. Theoretical foundations and algorithms for outlier ensembles. Acm sigkdd explo- rations newsletter, 17(1):24{47, 2015."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/3103589"},{"key":"e_1_2_1_4_1","volume-title":"Quantifying political polarity based on bipartite opinion networks","author":"Akoglu L.","year":"2014","unstructured":"L. Akoglu . Quantifying political polarity based on bipartite opinion networks . In ICWSM. The AAAI Press , 2014 . L. Akoglu. Quantifying political polarity based on bipartite opinion networks. In ICWSM. The AAAI Press, 2014."},{"key":"e_1_2_1_5_1","first-page":"104","volume-title":"SIG- MOD","author":"Breunig M. M.","year":"2000","unstructured":"M. M. Breunig , H.-P. Kriegel , R. T. Ng , and J. Sander . Lof: identifying density-based local outliers . In SIG- MOD , pages 93{ 104 , 2000 . M. M. Breunig, H.-P. Kriegel, R. T. Ng, and J. Sander. Lof: identifying density-based local outliers. In SIG- MOD, pages 93{104, 2000."},{"key":"e_1_2_1_6_1","first-page":"104","volume-title":"SIG- MOD","author":"Breunig M. M.","unstructured":"M. M. Breunig , H.-P. Kriegel , R. T. Ng , and J. Sander . Lof: Identifying density-based local outliers . In SIG- MOD , pages 93{ 104 . ACM, 2000. SIGMOD Record 29(2), June 2000. M. M. Breunig, H.-P. Kriegel, R. T. Ng, and J. Sander. Lof: Identifying density-based local outliers. In SIG- MOD, pages 93{104. ACM, 2000. SIGMOD Record 29(2), June 2000."},{"issue":"4","key":"e_1_2_1_7_1","first-page":"927","article-title":"On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study","volume":"30","author":"Campos G. O.","year":"2016","unstructured":"G. O. Campos , A. Zimek , J. Sander , R. J. G. B. Campello , B. Micenkov--a, E. Schubert , I. Assent , and M. E. Houle . On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study . DMKD , 30 ( 4 ):891{ 927 , July 2016 . G. O. Campos, A. Zimek, J. Sander, R. J. G. B. Campello, B. Micenkov--a, E. Schubert, I. Assent, and M. E. Houle. On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study. DMKD, 30(4):891{927, July 2016.","journal-title":"DMKD"},{"key":"e_1_2_1_8_1","first-page":"98","volume-title":"SDM","author":"Chen J.","unstructured":"J. Chen , S. Sathe , C. C. Aggarwal , and D. S. Turaga . Outlier detection with autoencoder ensembles . In SDM , pages 90{ 98 . SIAM, 2017. J. Chen, S. Sathe, C. C. Aggarwal, and D. S. Turaga. Outlier detection with autoencoder ensembles. In SDM, pages 90{98. SIAM, 2017."},{"key":"e_1_2_1_9_1","first-page":"858","volume-title":"ICDM","author":"Das S.","unstructured":"S. Das , W.-K. Wong , T. G. Dietterich , A. Fern , and A. Emmott . Incorporating expert feedback into active anomaly discovery . In ICDM , pages 853{ 858 . IEEE Computer Society, 2016. S. Das, W.-K. Wong, T. G. Dietterich, A. Fern, and A. Emmott. Incorporating expert feedback into active anomaly discovery. In ICDM, pages 853{858. IEEE Computer Society, 2016."},{"key":"e_1_2_1_10_1","volume-title":"Advances in Neural Infor- mation Processing Systems","author":"Ding X.","year":"2022","unstructured":"X. Ding , L. Zhao , and L. Akoglu . Hyperparameter sensitivity in deep outlier detection: Analysis and a scalable hyper-ensemble solution . In Advances in Neural Infor- mation Processing Systems , 2022 . X. Ding, L. Zhao, and L. Akoglu. Hyperparameter sensitivity in deep outlier detection: Analysis and a scalable hyper-ensemble solution. In Advances in Neural Infor- mation Processing Systems, 2022."},{"key":"e_1_2_1_11_1","volume-title":"ICLR. OpenReview.net","author":"Duan S.","year":"2020","unstructured":"S. Duan , L. Matthey , A. Saraiva , N. Watters , C. Burgess , A. Lerchner , and I. Higgins . Unsupervised model selection for variational disentangled representation learning . In ICLR. OpenReview.net , 2020 . S. Duan, L. Matthey, A. Saraiva, N.Watters, C. Burgess, A. Lerchner, and I. Higgins. Unsupervised model selection for variational disentangled representation learning. In ICLR. OpenReview.net, 2020."},{"key":"e_1_2_1_12_1","volume-title":"A meta-analysis of the anomaly detection problem. arXiv preprint arXiv:1503.01158","author":"Emmott A.","year":"2015","unstructured":"A. Emmott , S. Das , T. Dietterich , A. Fern , and W.- K. Wong . A meta-analysis of the anomaly detection problem. arXiv preprint arXiv:1503.01158 , 2015 . A. Emmott, S. Das, T. Dietterich, A. Fern, and W.- K. Wong. A meta-analysis of the anomaly detection problem. arXiv preprint arXiv:1503.01158, 2015."},{"key":"e_1_2_1_13_1","volume-title":"How to evaluate the quality of unsupervised anomaly detection algorithms? CoRR, abs\/1607.01152","author":"Goix N.","year":"2016","unstructured":"N. Goix . How to evaluate the quality of unsupervised anomaly detection algorithms? CoRR, abs\/1607.01152 , 2016 . N. Goix. How to evaluate the quality of unsupervised anomaly detection algorithms? CoRR, abs\/1607.01152, 2016."},{"key":"e_1_2_1_14_1","first-page":"63","volume-title":"Histogram-based outlier score (hbos): A fast unsupervised anomaly detection algorithm. KI-2012: Poster and Demo Track","author":"Goldstein M.","year":"2012","unstructured":"M. Goldstein and A. Dengel . Histogram-based outlier score (hbos): A fast unsupervised anomaly detection algorithm. KI-2012: Poster and Demo Track , pages 59{ 63 , 2012 . M. Goldstein and A. Dengel. Histogram-based outlier score (hbos): A fast unsupervised anomaly detection algorithm. KI-2012: Poster and Demo Track, pages 59{63, 2012."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0152173"},{"key":"e_1_2_1_16_1","series-title":"Proceedings of Machine Learning Research","first-page":"2721","volume-title":"Proceed- ings of The 33rd International Conference on Machine Learning","author":"Guha S.","year":"2016","unstructured":"S. Guha , N. Mishra , G. Roy , and O. Schrijvers . Robust random cut forest based anomaly detection on streams . In M. F. Balcan and K. Q. Weinberger, editors, Proceed- ings of The 33rd International Conference on Machine Learning , volume 48 of Proceedings of Machine Learning Research , pages 2712{ 2721 , New York, New York, USA , 20{22 Jun 2016 . PMLR. S. Guha, N. Mishra, G. Roy, and O. Schrijvers. Robust random cut forest based anomaly detection on streams. In M. F. Balcan and K. Q. Weinberger, editors, Proceed- ings of The 33rd International Conference on Machine Learning, volume 48 of Proceedings of Machine Learning Research, pages 2712{2721, New York, New York, USA, 20{22 Jun 2016. PMLR."},{"key":"e_1_2_1_17_1","volume-title":"Advances in Neural Information Processing Systems","author":"Han S.","year":"2022","unstructured":"S. Han , X. Hu , H. Huang , M. Jiang , and Y. Zhao . ADBench: Anomaly detection benchmark . In Advances in Neural Information Processing Systems , 2022 . S. Han, X. Hu, H. Huang, M. Jiang, and Y. Zhao. ADBench: Anomaly detection benchmark. In Advances in Neural Information Processing Systems, 2022."},{"key":"e_1_2_1_18_1","first-page":"992","volume-title":"2022 IEEE International Conference on Data Mining (ICDM)","author":"Jiang S.","unstructured":"S. Jiang , R. L. Cordeiro , and L. Akoglu . D. mca: Outlier detection with explicit micro-cluster assignments . In 2022 IEEE International Conference on Data Mining (ICDM) , pages 987{ 992 . IEEE, 2022. S. Jiang, R. L. Cordeiro, and L. Akoglu. D. mca: Outlier detection with explicit micro-cluster assignments. In 2022 IEEE International Conference on Data Mining (ICDM), pages 987{992. IEEE, 2022."},{"issue":"5","key":"e_1_2_1_19_1","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1145\/324133.324140","article-title":"Authoritative sources in a hyperlinked environment","volume":"46","author":"Kleinberg J. M.","year":"1999","unstructured":"J. M. Kleinberg . Authoritative sources in a hyperlinked environment . J. ACM , 46 ( 5 ):604{ 632 , Sept. 1999 . J. M. Kleinberg. Authoritative sources in a hyperlinked environment. J. ACM, 46(5):604{632, Sept. 1999.","journal-title":"J. ACM"},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/s007780050006","article-title":"Distance-based outliers: Algorithms and applications","volume":"3","author":"Knorr E. M.","year":"2000","unstructured":"E. M. Knorr , R. T. Ng , and V. Tucakov . Distance-based outliers: Algorithms and applications . VLDB J., 8( 3- 4 ): 237 {253, 2000 . E. M. Knorr, R. T. Ng, and V. Tucakov. Distance-based outliers: Algorithms and applications. VLDB J., 8(3- 4):237{253, 2000.","journal-title":"VLDB J., 8("},{"key":"e_1_2_1_21_1","first-page":"838","volume-title":"PAKDD 2009 Bangkok, Thailand, April 27--30, 2009 Proceedings 13","author":"Kriegel H.-P.","unstructured":"H.-P. Kriegel , P. Kroger , E. Schubert , and A. Zimek . Outlier detection in axis-parallel subspaces of high dimensional data. In Advances in Knowledge Discov- ery and Data Mining: 13th Paci c-Asia Conference , PAKDD 2009 Bangkok, Thailand, April 27--30, 2009 Proceedings 13 , pages 831{ 838 . Springer, 2009. H.-P. Kriegel, P. Kroger, E. Schubert, and A. Zimek. Outlier detection in axis-parallel subspaces of high dimensional data. In Advances in Knowledge Discov- ery and Data Mining: 13th Paci c-Asia Conference, PAKDD 2009 Bangkok, Thailand, April 27--30, 2009 Proceedings 13, pages 831{838. Springer, 2009."},{"key":"e_1_2_1_22_1","first-page":"24","volume-title":"SDM","author":"Kriegel H.-P.","unstructured":"H.-P. Kriegel , P. Kroger , E. Schubert , and A. Zimek . Interpreting and unifying outlier scores . In SDM , pages 13{ 24 . SIAM \/ Omnipress, 2011. H.-P. Kriegel, P. Kroger, E. Schubert, and A. Zimek. Interpreting and unifying outlier scores. In SDM, pages 13{24. SIAM \/ Omnipress, 2011."},{"key":"e_1_2_1_23_1","first-page":"452","volume-title":"SIGKDD","author":"Kriegel H.-P.","year":"2008","unstructured":"H.-P. Kriegel , M. Schubert , and A. Zimek . Angle-based outlier detection in high-dimensional data . In SIGKDD , pages 444{ 452 , 2008 . H.-P. Kriegel, M. Schubert, and A. Zimek. Angle-based outlier detection in high-dimensional data. In SIGKDD, pages 444{452, 2008."},{"key":"e_1_2_1_24_1","first-page":"341","volume-title":"WSDM","author":"Kumar S.","unstructured":"S. Kumar , B. Hooi , D. Makhija , M. Kumar , C. Faloutsos , and V. S. Subrahmanian . Rev2: Fraudulent user prediction in rating platforms . In WSDM , pages 333{ 341 . ACM, 2018. S. Kumar, B. Hooi, D. Makhija, M. Kumar, C. Faloutsos, and V. S. Subrahmanian. Rev2: Fraudulent user prediction in rating platforms. In WSDM, pages 333{341. ACM, 2018."},{"key":"e_1_2_1_25_1","first-page":"620","volume-title":"SDM","author":"Lamba H.","unstructured":"H. Lamba and L. Akoglu . Learning on-the-job to re-rank anomalies from top-1 feedback . In SDM , pages 612{ 620 . SIAM, 2019. H. Lamba and L. Akoglu. Learning on-the-job to re-rank anomalies from top-1 feedback. In SDM, pages 612{620. SIAM, 2019."},{"key":"e_1_2_1_26_1","first-page":"9674","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Li C.-L.","year":"2021","unstructured":"C.-L. Li , K. Sohn , J. Yoon , and T. P ster. Cutpaste : Self-supervised learning for anomaly detection and localization . In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition , pages 9664{ 9674 , 2021 . C.-L. Li, K. Sohn, J. Yoon, and T. P ster. Cutpaste: Self-supervised learning for anomaly detection and localization. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pages 9664{9674, 2021."},{"key":"e_1_2_1_27_1","volume-title":"Autood: automated outlier detection via curiosity-guided search and self-imitation learning. arXiv preprint arXiv:2006.11321","author":"Li Y.","year":"2020","unstructured":"Y. Li , Z. Chen , D. Zha , K. Zhou , H. Jin , H. Chen , and X. Hu . Autood: automated outlier detection via curiosity-guided search and self-imitation learning. arXiv preprint arXiv:2006.11321 , 2020 . Y. Li, Z. Chen, D. Zha, K. Zhou, H. Jin, H. Chen, and X. Hu. Autood: automated outlier detection via curiosity-guided search and self-imitation learning. arXiv preprint arXiv:2006.11321, 2020."},{"key":"e_1_2_1_28_1","first-page":"157","volume-title":"Companion Proceedings of the Web Conference 2020","author":"Li Y.","year":"2020","unstructured":"Y. Li , D. Zha , P. Venugopal , N. Zou , and X. Hu . Pyodds: An end-to-end outlier detection system with automated machine learning . In Companion Proceedings of the Web Conference 2020 , pages 153{ 157 , 2020 . Y. Li, D. Zha, P. Venugopal, N. Zou, and X. Hu. Pyodds: An end-to-end outlier detection system with automated machine learning. In Companion Proceedings of the Web Conference 2020, pages 153{157, 2020."},{"key":"e_1_2_1_29_1","first-page":"2172","volume-title":"CIKM","author":"Liang J.","unstructured":"J. Liang and S. Parthasarathy . Robust contextual outlier detection: Where context meets sparsity . In CIKM , pages 2167{ 2172 . ACM, 2016. J. Liang and S. Parthasarathy. Robust contextual outlier detection: Where context meets sparsity. In CIKM, pages 2167{2172. ACM, 2016."},{"key":"e_1_2_1_30_1","first-page":"6139","volume-title":"International Conference on Machine Learning","author":"Lin Z.","unstructured":"Z. Lin , K. Thekumparampil , G. Fanti , and S. Oh . InfoGAN-CR and ModelCentrality: Self-supervised model training and selection for disentangling GANs . In International Conference on Machine Learning , pages 6127{ 6139 . PMLR, 2020. Z. Lin, K. Thekumparampil, G. Fanti, and S. Oh. InfoGAN-CR and ModelCentrality: Self-supervised model training and selection for disentangling GANs. In International Conference on Machine Learning, pages 6127{6139. PMLR, 2020."},{"key":"e_1_2_1_31_1","first-page":"98","volume-title":"ICTIR","author":"Lioma C.","unstructured":"C. Lioma , J. G. Simonsen , and B. Larsen . Evaluation measures for relevance and credibility in ranked lists . In ICTIR , pages 91{ 98 . ACM, 2017. C. Lioma, J. G. Simonsen, and B. Larsen. Evaluation measures for relevance and credibility in ranked lists. In ICTIR, pages 91{98. ACM, 2017."},{"key":"e_1_2_1_32_1","first-page":"422","volume-title":"ICDM","author":"Liu F. T.","unstructured":"F. T. Liu , K. M. Ting , and Z.-H. Zhou . Isolation forest . In ICDM , pages 413{ 422 . IEEE, 2008. F. T. Liu, K. M. Ting, and Z.-H. Zhou. Isolation forest. In ICDM, pages 413{422. IEEE, 2008."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-018-0585-7"},{"key":"e_1_2_1_34_1","first-page":"1972","volume-title":"KDD","author":"Manzoor E. A.","unstructured":"E. A. Manzoor , H. Lamba , and L. Akoglu . xstream: Outlier detection in feature-evolving data streams . In KDD , pages 1963{ 1972 . ACM, 2018. E. A. Manzoor, H. Lamba, and L. Akoglu. xstream: Outlier detection in feature-evolving data streams. In KDD, pages 1963{1972. ACM, 2018."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394053"},{"key":"e_1_2_1_36_1","first-page":"12","volume-title":"SSDBM","author":"Marques H. O.","unstructured":"H. O. Marques , R. J. G. B. Campello , A. Zimek , and J. Sander . On the internal evaluation of unsupervised outlier detection . In SSDBM , pages 7:1{7: 12 . ACM, 2015. H. O. Marques, R. J. G. B. Campello, A. Zimek, and J. Sander. On the internal evaluation of unsupervised outlier detection. In SSDBM, pages 7:1{7:12. ACM, 2015."},{"key":"e_1_2_1_37_1","volume-title":"Springer","author":"Meghanath M. M.","year":"2018","unstructured":"M. M. Meghanath , D. Pai , and L. Akoglu . Conout: Contextual outlier detection with multiple contexts: Application to ad fraud. In ECML\/PKDD (1), volume 11051, pages 139{156 . Springer , 2018 . M. M. Meghanath, D. Pai, and L. Akoglu. Conout: Contextual outlier detection with multiple contexts: Application to ad fraud. In ECML\/PKDD (1), volume 11051, pages 139{156. Springer, 2018."},{"key":"e_1_2_1_38_1","first-page":"416","volume-title":"SDM","author":"Mishra A.","unstructured":"A. Mishra , J. S. Pudipeddi , and L. Akoglu . Ranking in heterogeneous networks with geo-location information . In SDM , pages 408{ 416 . SIAM, 2017. A. Mishra, J. S. Pudipeddi, and L. Akoglu. Ranking in heterogeneous networks with geo-location information. In SDM, pages 408{416. SIAM, 2017."},{"key":"e_1_2_1_39_1","first-page":"10","volume-title":"Proceedings of the Sixth International Symposium on Information and Commu- nication Technology","author":"Nguyen T. T.","unstructured":"T. T. Nguyen , A. T. Nguyen , T. A. H. Nguyen , L. T. Vu , Q. U. Nguyen , and L. D. Hai . Unsupervised anomaly detection in online game . In Proceedings of the Sixth International Symposium on Information and Commu- nication Technology , pages 4{ 10 . ACM, 2015. T. T. Nguyen, A. T. Nguyen, T. A. H. Nguyen, L. T. Vu, Q. U. Nguyen, and L. D. Hai. Unsupervised anomaly detection in online game. In Proceedings of the Sixth International Symposium on Information and Commu- nication Technology, pages 4{10. ACM, 2015."},{"issue":"3","key":"e_1_2_1_40_1","doi-asserted-by":"crossref","first-page":"272","DOI":"10.15625\/1813-9663\/32\/3\/8455","article-title":"An evaluation method for unsupervised anomaly detection algorithms","volume":"32","author":"Nguyen V.","year":"2017","unstructured":"V. Nguyen , T. Nguyen , and U. Nguyen . An evaluation method for unsupervised anomaly detection algorithms . Journal of Computer Science and Cybernetics , 32 ( 3 ):259{ 272 , 2017 . V. Nguyen, T. Nguyen, and U. Nguyen. An evaluation method for unsupervised anomaly detection algorithms. Journal of Computer Science and Cybernetics, 32(3):259{ 272, 2017.","journal-title":"Journal of Computer Science and Cybernetics"},{"issue":"2","key":"e_1_2_1_41_1","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1007\/s10994-015-5521-0","article-title":"Lightweight on-line detector of anomalies","volume":"102","author":"Pevny T.","year":"2016","unstructured":"T. Pevny . Loda : Lightweight on-line detector of anomalies . Machine Learning , 102 ( 2 ):275{ 304 , 2016 . T. Pevny. Loda: Lightweight on-line detector of anomalies. Machine Learning, 102(2):275{304, 2016.","journal-title":"Machine Learning"},{"key":"e_1_2_1_42_1","first-page":"438","volume-title":"SIGMOD","author":"Ramaswamy S.","year":"2000","unstructured":"S. Ramaswamy , R. Rastogi , and K. Shim . Efficient algorithms for mining outliers from large data sets . In SIGMOD , pages 427{ 438 , 2000 . S. Ramaswamy, R. Rastogi, and K. Shim. Efficient algorithms for mining outliers from large data sets. In SIGMOD, pages 427{438, 2000."},{"key":"e_1_2_1_43_1","volume-title":"ODDS library","author":"Rayana S.","year":"2016","unstructured":"S. Rayana . ODDS library , 2016 . S. Rayana. ODDS library, 2016."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2890508"},{"issue":"1","key":"e_1_2_1_45_1","first-page":"65","article-title":"A graphical aid to the interpretation and validation of cluster analysis","volume":"20","author":"Rousseeuw P.","year":"1987","unstructured":"P. Rousseeuw . Silhouettes : A graphical aid to the interpretation and validation of cluster analysis . Journal of Computational and Applied Mathematics , 20 ( 1 ):53{ 65 , Nov. 1987 . P. Rousseeuw. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics, 20(1):53{65, Nov. 1987.","journal-title":"Journal of Computational and Applied Mathematics"},{"key":"e_1_2_1_46_1","volume-title":"R. A. Vandermeulen, G. Montavon, W. Samek, M. Kloft, T. G. Dietterich, and K.-R. Muller. A unifying review of deep and shallow anomaly detection. CoRR, abs\/2009.11732","author":"L. Ru","year":"2020","unstructured":"L. Ru , J. R. Kau mann , R. A. Vandermeulen, G. Montavon, W. Samek, M. Kloft, T. G. Dietterich, and K.-R. Muller. A unifying review of deep and shallow anomaly detection. CoRR, abs\/2009.11732 , 2020 . L. Ru , J. R. Kau mann, R. A. Vandermeulen, G. Montavon, W. Samek, M. Kloft, T. G. Dietterich, and K.-R. Muller. A unifying review of deep and shallow anomaly detection. CoRR, abs\/2009.11732, 2020."},{"issue":"7","key":"e_1_2_1_47_1","doi-asserted-by":"crossref","first-page":"1471","DOI":"10.1162\/089976601750264965","article-title":"Estimating the support of a high-dimensional distribution","volume":"13","author":"Scholkopf B.","year":"2001","unstructured":"B. Scholkopf , J. C. Platt , J. Shawe-Taylor , A. J. Smola , and R. C. Williamson . Estimating the support of a high-dimensional distribution . Neural computation , 13 ( 7 ):1443{ 1471 , 2001 . B. Scholkopf, J. C. Platt, J. Shawe-Taylor, A. J. Smola, and R. C. Williamson. Estimating the support of a high-dimensional distribution. Neural computation, 13(7):1443{1471, 2001.","journal-title":"Neural computation"},{"key":"e_1_2_1_48_1","first-page":"1516","volume-title":"IJCAI","author":"Tan S. C.","unstructured":"S. C. Tan , K. M. Ting , and F. T. Liu . Fast anomaly detection for streaming data . In IJCAI , pages 1511{ 1516 . IJCAI\/AAAI, 2011. S. C. Tan, K. M. Ting, and F. T. Liu. Fast anomaly detection for streaming data. In IJCAI, pages 1511{1516. IJCAI\/AAAI, 2011."},{"key":"e_1_2_1_49_1","first-page":"548","volume-title":"PAKDD","author":"Tang J.","unstructured":"J. Tang , Z. Chen , A. W.-C. Fu , and D. W. Cheung . Enhancing e ectiveness of outlier detections for low density patterns . In PAKDD , pages 535{ 548 . Springer, 2002. J. Tang, Z. Chen, A. W.-C. Fu, and D. W. Cheung. Enhancing e ectiveness of outlier detections for low density patterns. In PAKDD, pages 535{548. Springer, 2002."},{"key":"e_1_2_1_50_1","first-page":"1247","volume-title":"ICDM","author":"Wang G.","unstructured":"G. Wang , S. Xie , B. Liu , and P. S. Yu . Review graph based online store review spammer detection . In ICDM , pages 1242{ 1247 . IEEE Computer Society, 2011. G. Wang, S. Xie, B. Liu, and P. S. Yu. Review graph based online store review spammer detection. In ICDM, pages 1242{1247. IEEE Computer Society, 2011."},{"key":"e_1_2_1_51_1","first-page":"896","volume-title":"WSDM","author":"Wang R.","unstructured":"R. Wang , K. Nie , T. Wang , Y. Yang , and B. Long . Deep learning for anomaly detection . In WSDM , pages 894{ 896 . ACM, 2020. R. Wang, K. Nie, T. Wang, Y. Yang, and B. Long. Deep learning for anomaly detection. In WSDM, pages 894{896. ACM, 2020."},{"issue":"8","key":"e_1_2_1_52_1","first-page":"847","article-title":"A validity measure for fuzzy clustering","volume":"13","author":"Xie X. L.","year":"1991","unstructured":"X. L. Xie and G. Beni . A validity measure for fuzzy clustering . IEEE Trans. Pattern Anal. Mach. Intell. , 13 ( 8 ):841{ 847 , 1991 . X. L. Xie and G. Beni. A validity measure for fuzzy clustering. IEEE Trans. Pattern Anal. Mach. Intell., 13(8):841{847, 1991.","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"e_1_2_1_53_1","first-page":"1052","volume-title":"KDD","author":"Yin X.","unstructured":"X. Yin , J. Han , and P. S. Yu . Truth discovery with multiple con icting information providers on the web . In KDD , pages 1048{ 1052 . ACM, 2007. X. Yin, J. Han, and P. S. Yu. Truth discovery with multiple con icting information providers on the web. In KDD, pages 1048{1052. ACM, 2007."},{"key":"e_1_2_1_54_1","volume-title":"IEEE ICDM","author":"Zhao Y.","year":"2022","unstructured":"Y. Zhao and L. Akoglu . Toward unsupervised outlier model selection . IEEE ICDM , 2022 . Y. Zhao and L. Akoglu. Toward unsupervised outlier model selection. IEEE ICDM, 2022."},{"key":"e_1_2_1_55_1","volume-title":"Towards unsupervised hyperparameter optimization for outlier detection. arXiv preprint arXiv:2208.11727","author":"Zhao Y.","year":"2022","unstructured":"Y. Zhao and L. Akoglu . Towards unsupervised hyperparameter optimization for outlier detection. arXiv preprint arXiv:2208.11727 , 2022 . Y. Zhao and L. Akoglu. Towards unsupervised hyperparameter optimization for outlier detection. arXiv preprint arXiv:2208.11727, 2022."},{"issue":"96","key":"e_1_2_1_56_1","first-page":"7","article-title":"A python toolbox for scalable outlier detection","volume":"20","author":"Zhao Y.","year":"2019","unstructured":"Y. Zhao , Z. Nasrullah , and Z. Li. Pyod : A python toolbox for scalable outlier detection . JMLR , 20 ( 96 ):1{ 7 , 2019 . Y. Zhao, Z. Nasrullah, and Z. Li. Pyod: A python toolbox for scalable outlier detection. JMLR, 20(96):1{ 7, 2019.","journal-title":"JMLR"},{"key":"e_1_2_1_57_1","first-page":"4489","article-title":"Automatic unsupervised outlier model selection","volume":"34","author":"Zhao Y.","year":"2021","unstructured":"Y. Zhao , R. Rossi , and L. Akoglu . Automatic unsupervised outlier model selection . Advances in Neural Information Processing Systems , 34 : 4489 {4502, 2021 . Y. Zhao, R. Rossi, and L. Akoglu. Automatic unsupervised outlier model selection. Advances in Neural Information Processing Systems, 34:4489{4502, 2021.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"1","key":"e_1_2_1_58_1","first-page":"22","article-title":"Ensembles for unsupervised outlier detection: challenges and research questions a position paper","volume":"15","author":"Zimek A.","year":"2013","unstructured":"A. Zimek , R. J. G. B. Campello , and J. Sander . Ensembles for unsupervised outlier detection: challenges and research questions a position paper . SIGKDD Explor. , 15 ( 1 ):11{ 22 , 2013 . A. Zimek, R. J. G. B. Campello, and J. Sander. Ensembles for unsupervised outlier detection: challenges and research questions a position paper. SIGKDD Explor., 15(1):11{22, 2013.","journal-title":"SIGKDD Explor."}],"container-title":["ACM SIGKDD Explorations Newsletter"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3606274.3606277","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3606274.3606277","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:47:07Z","timestamp":1750178827000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3606274.3606277"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,22]]},"references-count":58,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,6,22]]}},"alternative-id":["10.1145\/3606274.3606277"],"URL":"https:\/\/doi.org\/10.1145\/3606274.3606277","relation":{},"ISSN":["1931-0145","1931-0153"],"issn-type":[{"value":"1931-0145","type":"print"},{"value":"1931-0153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,22]]},"assertion":[{"value":"2023-07-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}