{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T16:50:53Z","timestamp":1783702253480,"version":"3.55.0"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"7","license":[{"start":{"date-parts":[[2024,6,19]],"date-time":"2024-06-19T00:00:00Z","timestamp":1718755200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2024,8,31]]},"abstract":"<jats:p>Outlier detection stands as a critical cornerstone in the field of data mining, with a wide range of applications spanning from fraud detection to network security. However, real-world scenarios often lack labeled data for training, necessitating unsupervised outlier detection methods. This study centers on Unsupervised Outlier Model Selection (UOMS), with a specific focus on the family of Internal, Relative Evaluation of Outlier Solutions (IREOS) algorithms. IREOS measures outlier candidate separability by evaluating multiple maximum-margin classifiers and, while effective, it is constrained by its high computational demands. We investigate the impact of several different separation methods in UOMS in terms of ranking quality and runtime. Surprisingly, our findings indicate that different separability measures have minimal impact on IREOS\u2019 effectiveness. However, using linear separation methods within IREOS significantly reduces its computation time. These insights hold significance for real-world applications where efficient outlier detection is critical. In the context of this work, we provide the code for the IREOS algorithm and our separability techniques.<\/jats:p>","DOI":"10.1145\/3653719","type":"journal-article","created":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T12:00:24Z","timestamp":1712318424000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Enhancing Unsupervised Outlier Model Selection: A Study on IREOS Algorithms"],"prefix":"10.1145","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8792-3355","authenticated-orcid":false,"given":"Philipp","family":"Schlieper","sequence":"first","affiliation":[{"name":"Friedrich-Alexander-University, Erlangen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-3770-2460","authenticated-orcid":false,"given":"Hermann","family":"Luft","sequence":"additional","affiliation":[{"name":"Friedrich-Alexander-University, Erlangen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1284-541X","authenticated-orcid":false,"given":"Kai","family":"Klede","sequence":"additional","affiliation":[{"name":"Friedrich-Alexander-University, Erlangen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3982-4499","authenticated-orcid":false,"given":"Christoph","family":"Strohmeyer","sequence":"additional","affiliation":[{"name":"Schaeffler Technologies AG &amp; Co. KG, Herzogenaurach, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0417-0336","authenticated-orcid":false,"given":"Bjoern","family":"Eskofier","sequence":"additional","affiliation":[{"name":"Friedrich-Alexander-University, Erlangen, Germany and Institute of AI for Health Helmholtz Center Munich, German Research Center for Environmental Health, Neuherberg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5886-0597","authenticated-orcid":false,"given":"Dario","family":"Zanca","sequence":"additional","affiliation":[{"name":"Friedrich-Alexander-University, Erlangen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,6,19]]},"reference":[{"key":"e_1_3_3_2_2","article-title":"The bonferonni and \u0160id\u00e1k corrections for multiple comparisons","volume":"3","author":"Abdi Herv\u00e9","year":"2007","unstructured":"Herv\u00e9 Abdi. 2007. The bonferonni and \u0160id\u00e1k corrections for multiple comparisons. Encyclopedia of Measurement and Statistics 3.01 (2007).","journal-title":"Encyclopedia of Measurement and Statistics"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45681-3_2"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3381028"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335388"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-015-0444-8"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-14717-8_39"},{"key":"e_1_3_3_8_2","unstructured":"S. Duan L. Matthey A. Saraiva N. Watters C. P. Burgess A. Lerchner and I. Higgins. 2019. Unsupervised model selection for variational disentangled representation learning. arXiv preprint arXiv:1905.12614."},{"key":"e_1_3_3_9_2","unstructured":"N. Goix. 2016. How to evaluate the quality of unsupervised anomaly detection algorithms? arXiv preprint arXiv:1607.01152."},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.1969.10490657"},{"key":"e_1_3_3_11_2","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"He Xiaofei","year":"2005","unstructured":"Xiaofei He, Deng Cai, and Partha Niyogi. 2005. Laplacian score for feature selection. In Proceedings of the Advances in Neural Information Processing Systems. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2005\/hash\/b5b03f06271f8917685d14cea7c6c50a-Abstract.html"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/324133.324140"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972818.2"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401946"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-73499-4_6"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2023.3345251"},{"key":"e_1_3_3_17_2","first-page":"6127","volume-title":"Proceedings of the 37th International Conference on Machine Learning","author":"Lin Zinan","year":"2020","unstructured":"Zinan Lin, Kiran Thekumparampil, Giulia Fanti, and Sewoong Oh. 2020. InfoGAN-CR and modelcentrality: Self-supervised model training and selection for disentangling GANs. In Proceedings of the 37th International Conference on Machine Learning. PMLR, 6127\u20136139. Retrieved from https:\/\/proceedings.mlr.press\/v119\/lin20e.html"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2008.17"},{"key":"e_1_3_3_19_2","article-title":"Histogram-based outlier score (hbos): A fast unsupervised anomaly detection algorithm.","author":"Goldstein M.","year":"2012","unstructured":"M. Goldstein and A. Dengel. 2012. Histogram-based outlier score (hbos): A fast unsupervised anomaly detection algorithm. KI-2012 Poster and Demo Track (2012), 59--63.","journal-title":"KI-2012 Poster and Demo Track"},{"key":"e_1_3_3_20_2","article-title":"The need for unsupervised outlier model selection: A review and evaluation of internal evaluation strategies","volume":"25","author":"Ma Martin Q.","year":"2023","unstructured":"Martin Q. Ma, Yue Zhao, Xiaorong Zhang, and Leman Akoglu. 2023. The need for unsupervised outlier model selection: A review and evaluation of internal evaluation strategies. ACM SIGKDD Explorations Newsletter 1, 25.1 (2023).","journal-title":"ACM SIGKDD Explorations Newsletter"},{"key":"e_1_3_3_21_2","unstructured":"Markelle Kelly Rachel Longjohn and Kolby Nottingham. [n. d.]. The UCI Machine Learning Repository. Retrieved 05 September 2023 from http:\/\/archive.ics.uci.edu\/"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394053"},{"key":"e_1_3_3_23_2","volume-title":"A Novel Anomaly Detection Scheme Based on Principal Component Classifier","author":"Shyu Mei-Ling","year":"2003","unstructured":"Mei-Ling Shyu. 2003. A Novel Anomaly Detection Scheme Based on Principal Component Classifier. Technical Report. Retrieved from https:\/\/apps.dtic.mil\/sti\/citations\/ADA465712"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2013.132"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.15625\/1813-9663\/32\/3\/8455"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3439950"},{"key":"e_1_3_3_27_2","article-title":"Scikit-learn: Machine learning in python","author":"Pedregosa Fabian","year":"2011","unstructured":"Fabian Pedregosa, Gael Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, and David Cournapeau. 2011. Scikit-learn: Machine learning in python. MACHINE LEARNING IN PYTHON 12 (2011), 2825--2830.","journal-title":"MACHINE LEARNING IN PYTHON"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2021.3052449"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1162\/089976601750264965"},{"key":"e_1_3_3_30_2","unstructured":"Shebuti Rayana. 2016. ODDS \u2013 Outlier Detection DataSets. Retrieved 11 September 2023 from https:\/\/odds.cs.stonybrook.edu\/"},{"key":"e_1_3_3_31_2","unstructured":"A. Talwalkar and A. Rostamizadeh. 2014. Matrix coherence and the nystrom method. arXiv preprint arXiv:1408.2044."},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-47887-6_53"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2932769"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-4380-9_16"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2021.3049250"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2021.3119140"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2022.3185149"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2022.06.082"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2017.2673241"},{"key":"e_1_3_3_40_2","volume-title":"CRC Standard Probability and Statistics Tables and Formulae","author":"Zwillinger Daniel","year":"1999","unstructured":"Daniel Zwillinger and Stephen Kokoska. 1999. CRC Standard Probability and Statistics Tables and Formulae. CRC Press."}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3653719","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3653719","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:58Z","timestamp":1750291438000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3653719"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,19]]},"references-count":39,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,8,31]]}},"alternative-id":["10.1145\/3653719"],"URL":"https:\/\/doi.org\/10.1145\/3653719","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,19]]},"assertion":[{"value":"2023-10-24","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-19","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}