{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:47:01Z","timestamp":1750308421799,"version":"3.41.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,3,27]],"date-time":"2021-03-27T00:00:00Z","timestamp":1616803200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["GRK 2153"],"award-info":[{"award-number":["GRK 2153"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2021,4,30]]},"abstract":"<jats:p>By definition, outliers are rarely observed in reality, making them difficult to detect or analyze. Artificial outliers approximate such genuine outliers and can, for instance, help with the detection of genuine outliers or with benchmarking outlier-detection algorithms. The literature features different approaches to generate artificial outliers. However, systematic comparison of these approaches remains absent. This surveys and compares these approaches. We start by clarifying the terminology in the field, which varies from publication to publication, and we propose a general problem formulation. Our description of the connection of generating outliers to other research fields like experimental design or generative models frames the field of artificial outliers. Along with offering a concise description, we group the approaches by their general concepts and how they make use of genuine instances. An extensive experimental study reveals the differences between the generation approaches when ultimately being used for outlier detection. This survey shows that the existing approaches already cover a wide range of concepts underlying the generation, but also that the field still has potential for further development. Our experimental study does confirm the expectation that the quality of the generation approaches varies widely, for example, in terms of the dataset they are used on. Ultimately, to guide the choice of the generation approach in a specific context, we propose an appropriate general-decision process. In summary, this survey comprises, describes, and connects all relevant work regarding the generation of artificial outliers and may serve as a basis to guide further research in the field.<\/jats:p>","DOI":"10.1145\/3447822","type":"journal-article","created":{"date-parts":[[2021,3,27]],"date-time":"2021-03-27T16:11:16Z","timestamp":1616861476000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Generating Artificial Outliers in the Absence of Genuine Ones \u2014 A Survey"],"prefix":"10.1145","volume":"15","author":[{"given":"Georg","family":"Steinbuss","sequence":"first","affiliation":[{"name":"Karlsruhe Institute of Technology, Baden-W\u00fcrttemberg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Klemens","family":"B\u00f6hm","sequence":"additional","affiliation":[{"name":"Karlsruhe Institute of Technology, Baden-W\u00fcrttemberg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,3,27]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1150402.1150459"},{"volume-title":"Encyclopedia of Mathematics. Retrieved","year":"2018","author":"ANOVA","key":"e_1_2_1_2_1"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74958-5_51"},{"key":"e_1_2_1_4_1","first-page":"3","article-title":"Generative or discriminative? Getting the best of both worlds","volume":"8","author":"Bernardo J. M.","year":"2007","journal-title":"Bayesian Statistics"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2018.07.023"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0177678"},{"volume-title":"Decision-based adversarial attacks: Reliable attacks against black-box machine learning models. arxiv:1712.04248 Retrieved","year":"2018","author":"Brendel Wieland","key":"e_1_2_1_7_1"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-015-0444-8"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1541880.1541882"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976601750399335"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622407.1622416"},{"volume-title":"Proceedings of the European Conference on Genetic Programming (EuroGP\u201909)","author":"Curry Robert","key":"e_1_2_1_12_1"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2007.896406"},{"volume-title":"Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS\u201917)","author":"Dai Zihang","key":"e_1_2_1_14_1"},{"volume-title":"Proceedings of the 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing (MLSP\u201906)","year":"2006","author":"Davenport M. A.","key":"e_1_2_1_15_1"},{"volume-title":"Proceedings of the IEEE Symposium on Computational Intelligence and Data Mining (CIDM\u201907)","year":"2007","author":"Deng H.","key":"e_1_2_1_16_1"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2013.05.022"},{"volume-title":"UCI Machine Learning Repository. Retrieved","year":"2019","author":"Dheeru Dua","key":"e_1_2_1_18_1"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems (NIPS\u201906)","volume":"19","author":"El-Yaniv Ran","year":"2007"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2001.989509"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-003-0132-7"},{"volume-title":"Proceedings of the IEEE Computer Society Symposium on Research in Security and Privacy (RSIP\u201994)","year":"1994","author":"Forrest S.","key":"e_1_2_1_22_1"},{"volume-title":"Proceedings of the 2002 Congress on Evolutionary Computation (CEC\u201902)","year":"2002","author":"Gonzalez F.","key":"e_1_2_1_23_1"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026195112518"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems (NIPS\u201914)","volume":"27","author":"Goodfellow Ian","year":"2014"},{"volume-title":"The Elements of Statistical Learning (2nd. ed.)","series-title":"Springer Series in Statistics","author":"Hastie Trevor","key":"e_1_2_1_26_1"},{"volume-title":"Witten","year":"2008","author":"Hempstalk Kathryn","key":"e_1_2_1_27_1"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:AIRE.0000045502.10941.a9"},{"key":"e_1_2_1_29_1","first-page":"65","article-title":"A simple sequentially rejective multiple test procedure","volume":"6","author":"Holm Sture","year":"1979","journal-title":"Scandinavian Journal of Statistics, Theory and Applications"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2003.1232271"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-72413-3_20"},{"volume-title":"Kernel methods in computer vision. Foundations and Trends\u00aein Computer Graphics and Vision 4, 3 (Sept","year":"2009","author":"Lampert Christoph H.","key":"e_1_2_1_32_1"},{"volume-title":"Proceedings of the Annual SIGRAD Conference (SIGRAD\u201908)","year":"2008","author":"Larsson Thomas","key":"e_1_2_1_33_1"},{"volume-title":"Training confidence-calibrated classifiers for detecting out-of-distribution samples. arxiv:1711.09325v3 Retrieved","year":"2019","author":"Lee Kimin","key":"e_1_2_1_34_1"},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/TPAMI.2010.188","article-title":"Selecting critical patterns based on local geometrical and statistical information","volume":"33","author":"Li Yuhua","year":"2011","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"volume-title":"International Encyclopedia of Statistical Science","author":"Lovric Miodrag","key":"e_1_2_1_36_1"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177730491"},{"key":"e_1_2_1_38_1","first-page":"3","article-title":"Multiple comparison analysis testing in ANOVA","volume":"21","author":"McHugh Mary L.","year":"2011","journal-title":"Biochemia Medica"},{"volume-title":"Proceedings of the IEEE 12th International Conference on Data Mining (ICDM\u201912)","year":"2012","author":"M\u00fcller E.","key":"e_1_2_1_39_1"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5220\/0005702100960104"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.8.4.434"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676585.2676618"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1198\/1061860043515"},{"volume-title":"Kendall Coefficient of Rank Correlation. Encyclopedia of Mathematics. Retrieved","year":"2018","author":"Prokhorov A. V.","key":"e_1_2_1_44_1"},{"volume-title":"Notz","year":"2013","author":"Santner Thomas J.","key":"e_1_2_1_45_1"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976601750264965"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1198\/106186006X94072"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41060-017-0068-8"},{"key":"e_1_2_1_49_1","article-title":"A classification framework for anomaly detection","author":"Steinwart Ingo","year":"2005","journal-title":"Journal of Machine Learning Research. 6"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8655(99)00087-2"},{"key":"e_1_2_1_51_1","article-title":"Uniform object generation for optimizing one-class classifiers","author":"Tax David M. J.","year":"2001","journal-title":"Journal of Machine Learning Research 2"},{"volume-title":"Proceedings of the Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery IX. SPIE","author":"Theiler James P.","key":"e_1_2_1_52_1"},{"volume-title":"Proceedings of the International Symposium on Industrial Electronics (ISIE\u201909)","year":"2009","author":"Wang Chi-Kai","key":"e_1_2_1_53_1"},{"volume-title":"C (Feb.","year":"2018","author":"Wang Siqi","key":"e_1_2_1_54_1"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447822","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447822","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T17:49:27Z","timestamp":1750268967000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447822"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,27]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,4,30]]}},"alternative-id":["10.1145\/3447822"],"URL":"https:\/\/doi.org\/10.1145\/3447822","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"type":"print","value":"1556-4681"},{"type":"electronic","value":"1556-472X"}],"subject":[],"published":{"date-parts":[[2021,3,27]]},"assertion":[{"value":"2018-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}