{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T08:20:42Z","timestamp":1771489242273,"version":"3.50.1"},"reference-count":37,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,3,8]],"date-time":"2022-03-08T00:00:00Z","timestamp":1646697600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>There is relatively little research on deep learning for anomaly detection within the field of deep learning. Existing deep anomaly detection methods focus on the learning of feature reconstruction, but such methods mainly learn new feature representations, and the new features do not fully reflect the original features, leading to inaccurate anomaly scores; in addition, there is an end-to-end deep anomaly detection algorithm, but the method cannot accurately obtain a reference score that matches the data themselves. In addition, in most practical scenarios, the data are unlabeled, and there exist some datasets with labels, but the confidence and accuracy of the labels are very low, resulting in inaccurate results when put into the model, which makes them often designed for unsupervised learning, and thus in such algorithms, the prior knowledge of known anomalous data is often not used to optimize the anomaly scores. To address the two problems raised above, this paper proposes a new anomaly detection model that learns anomaly scores mainly through a variational deviation network (i.e., not by learning the reconstruction error of new features, distance metrics, or random generation, but by learning the normal distribution of normal data). In this model, we force the anomaly scores to deviate significantly from the normal data by a small amount of anomalous data and a reference score generated by variational self-encoding. The experimental results in multiple classes of data show that the new variational deviation network proposed in this paper has higher accuracy among the mainstream anomaly detection algorithms.<\/jats:p>","DOI":"10.3390\/fi14030080","type":"journal-article","created":{"date-parts":[[2022,3,8]],"date-time":"2022-03-08T12:35:37Z","timestamp":1646742937000},"page":"80","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Deep Anomaly Detection Based on Variational Deviation Network"],"prefix":"10.3390","volume":"14","author":[{"given":"Junwen","family":"Lu","sequence":"first","affiliation":[{"name":"School of Computer and Information and Engineering, Xiamen University of Technology, Xiamen 361024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinhui","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer and Information and Engineering, Xiamen University of Technology, Xiamen 361024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaojun","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Computer and Information and Engineering, Xiamen University of Technology, Xiamen 361024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keshou","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer and Information and Engineering, Xiamen University of Technology, Xiamen 361024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guanfeng","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer and Information and Engineering, Xiamen University of Technology, Xiamen 361024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Moustafa, N., and Slay, J. (2015, January 10\u201312). UNSW-NB15: A Comprehensive Data Set for Network Intrusion Detection Systems (UNSW-NB15 Network Data Set). Proceedings of the 2015 Military Communications and Information Systems Conference (MilCIS), Canberra, Australia.","DOI":"10.1109\/MilCIS.2015.7348942"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Thapa, N., Liu, Z., Kc, D.B., Gokaraju, B., and Roy, K. (2020). Comparison of Machine Learning and Deep Learning Models for Network Intrusion Detection Systems. Future Internet, 12.","DOI":"10.3390\/fi12100167"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ryan, S., Corizzo, R., Kiringa, I., and Japkowicz, N. (2019, January 16\u201319). Pattern and Anomaly Localization in Complex and Dynamic Data. Proceedings of the 2019 18th IEEE International Conference on Machine Learning and Applications (ICMLA), Boca Raton, FL, USA.","DOI":"10.1109\/ICMLA.2019.00285"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Vlaminck, M., Heidbuchel, R., Philips, W., and Luong, H. (2022). Region-Based CNN for Anomaly Detection in PV Power Plants Using Aerial Imagery. Sensors, 22.","DOI":"10.3390\/s22031244"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Pang, G., Cao, L., Chen, L., and Liu, H. (2018, January 19\u201323). Learning Representations of Ultrahigh-Dimensional Data for Random Distance-Based Outlier Detection. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK.","DOI":"10.1145\/3219819.3220042"},{"key":"ref_6","unstructured":"Ruff, L., Vandermeulen, R., Goernitz, N., Deecke, L., Siddiqui, S.A., Binder, A., M\u00fcller, E., and Kloft, M. (2018, January 10\u201315). Deep One-Class Classification. Proceedings of the International Conference on Machine Learning, Stockholm, Sweden."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep Learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Chen, J., Sathe, S., Aggarwal, C., and Turaga, D. (2017, January 27\u201329). Outlier Detection with Autoencoder Ensembles. Proceedings of the 2017 SIAM International Conference on Data Mining, Houston, TX, USA.","DOI":"10.1137\/1.9781611974973.11"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Hawkins, S., He, H., Williams, G., and Baxter, R. (2002, January 3\u20136). Outlier Detection Using Replicator Neural Networks. Proceedings of the International Conference on Data Warehousing and Knowledge Discovery, Vienna, Austria.","DOI":"10.1007\/3-540-46145-0_17"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Schlegl, T., Seeb\u00f6ck, P., Waldstein, S.M., Schmidt-Erfurth, U., and Langs, G. (2017, January 25\u201330). Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery. Proceedings of the International Conference on Information Processing in Medical Imaging, Boone, NC, USA.","DOI":"10.1007\/978-3-319-59050-9_12"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zenati, H., Romain, M., Foo, C.-S., Lecouat, B., and Chandrasekhar, V. (2018, January 17\u201320). Adversarially Learned Anomaly Detection. Proceedings of the 2018 IEEE International Conference on Data Mining (ICDM), Beijing, China.","DOI":"10.1109\/ICDM.2018.00088"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhou, C., and Paffenroth, R.C. (2017, January 13\u201317). Anomaly Detection with Robust Deep Autoencoders. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.","DOI":"10.1145\/3097983.3098052"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2584","DOI":"10.1109\/TPAMI.2018.2860995","article-title":"Efficient Training for Positive Unlabeled Learning","volume":"41","author":"Sansone","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C. (2017). Supervised Outlier Detection. Outlier Analysis, Springer.","DOI":"10.1007\/978-3-319-47578-3_7"},{"key":"ref_15","first-page":"587","article-title":"Learning to Classify Texts Using Positive and Unlabeled Data","volume":"Volume 3","author":"Li","year":"2003","journal-title":"Proceedings of the IJCAI"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Pang, G., Shen, C., and van den Hengel, A. (2019, January 4\u20138). Deep Anomaly Detection with Deviation Networks. Proceedings of the Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330871"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2133360.2133363","article-title":"Isolation-Based Anomaly Detection","volume":"6","author":"Liu","year":"2012","journal-title":"ACM Trans. Knowl. Discov. Data TKDD"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Keller, F., Muller, E., and Bohm, K. (2012, January 1\u20135). HiCS: High Contrast Subspaces for Density-Based Outlier Ranking. Proceedings of the 2012 IEEE 28th International Conference on Data Engineering, Arlington, VA, USA.","DOI":"10.1109\/ICDE.2012.88"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Pang, G., Cao, L., Chen, L., Lian, D., and Liu, H. (2018, January 2\u20137). Sparse Modeling-Based Sequential Ensemble Learning for Effective Outlier Detection in High-Dimensional Numeric Data. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11692"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Li, P., Hastie, T.J., and Church, K.W. (2006, January 20\u201323). Very Sparse Random Projections. Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Philadelphia, PA, USA.","DOI":"10.1145\/1150402.1150436"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1023\/B:MACH.0000008084.60811.49","article-title":"Support Vector Data Description","volume":"54","author":"Tax","year":"2004","journal-title":"Mach. Learn."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Elkan, C., and Noto, K. (2008, January 24\u201327). Learning Classifiers from only Positive and Unlabeled Data. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, NV, USA.","DOI":"10.1145\/1401890.1401920"},{"key":"ref_23","unstructured":"Ma, Y., Lei, Y., and Wang, T. (2020). A Natural Scene Recognition Learning Based on Label Correlation. IEEE Transactions on Emerging Topics in Computational Intelligence, IEEE."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1109\/TPAMI.2006.79","article-title":"One-Shot Learning of Object Categories","volume":"28","author":"Fergus","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","unstructured":"Kingma, D.P., and Welling, M. (2013). Auto-Encoding Variational Bayes. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1109\/JPETS.2015.2477598","article-title":"A Bayesian Approach for Fault Location in Medium Voltage Grids with Underground Cables","volume":"2","author":"Xiang","year":"2015","journal-title":"IEEE Power Energy Technol. Syst. J."},{"key":"ref_27","unstructured":"Doersch, C. (2016). Tutorial on Variational Autoencoders. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Oluwasanmi, A., Aftab, M.U., Baagyere, E., Qin, Z., Ahmad, M., and Mazzara, M. (2022). Attention Autoencoder for Generative Latent Representational Learning in Anomaly Detection. Sensors, 22.","DOI":"10.3390\/s22010123"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Corizzo, R., Ceci, M., Pio, G., Mignone, P., and Japkowicz, N. (2021, January 11\u201313). Spatially-Aware Autoencoders for Detecting Contextual Anomalies in Geo-Distributed Data. Proceedings of the International Conference on Discovery Science, Halifax, NS, Canada.","DOI":"10.1007\/978-3-030-88942-5_36"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kriegel, H.-P., Kroger, P., Schubert, E., and Zimek, A. (2011, January 6). Interpreting and Unifying Outlier Scores. Proceedings of the 2011 SIAM International Conference on Data Mining, Philadelphia, PA, USA.","DOI":"10.1137\/1.9781611972818.2"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1109\/CVPR.2006.100","article-title":"Dimensionality Reduction by Learning an Invariant Mapping","volume":"Volume 2","author":"Hadsell","year":"2006","journal-title":"Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906)"},{"key":"ref_32","unstructured":"Snell, J., Swersky, K., and Zemel, R.S. (2017). Prototypical Networks for Few-Shot Learning. arXiv."},{"key":"ref_33","unstructured":"Gulli, A., and Pal, S. (2017). Deep Learning with Keras, Packt Publishing Ltd."},{"key":"ref_34","unstructured":"Hinton, G., Srivastava, N., and Swersky, K. (2022, February 28). Neural Networks for Machine Learning Lecture 6a Overview of Mini-Batch Gradient Descent. Available online: https:\/\/www.cs.toronto.edu\/~tijmen\/csc321\/slides\/lecture_slides_lec6.pdf."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Davis, J., and Goadrich, M. (2006, January 25\u201329). The Relationship between Precision-Recall and ROC Curves. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.","DOI":"10.1145\/1143844.1143874"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Sch\u00fctze, H., Manning, C.D., and Raghavan, P. (2008). Introduction to Information Retrieval, Cambridge University Press Cambridge.","DOI":"10.1017\/CBO9780511809071"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Woolson, R.F. (2007). Wilcoxon Signed-Rank Test. Wiley Encyclopedia of Clinical Trials, John Wiley & Sons, Inc.","DOI":"10.1002\/9780471462422.eoct979"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/3\/80\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:34:15Z","timestamp":1760135655000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/3\/80"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,8]]},"references-count":37,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["fi14030080"],"URL":"https:\/\/doi.org\/10.3390\/fi14030080","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,8]]}}}