{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T14:55:06Z","timestamp":1790693706886,"version":"4.1.0"},"reference-count":29,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T00:00:00Z","timestamp":1620000000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Co-financed by the European Union with the European Regional Development Fund, the French state and the Hauts de France Region Council","award":["ORIO ELSAT2020"],"award-info":[{"award-number":["ORIO ELSAT2020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Recently, most state-of-the-art anomaly detection methods are based on apparent motion and appearance reconstruction networks and use error estimation between generated and real information as detection features. These approaches achieve promising results by only using normal samples for training steps. In this paper, our contributions are two-fold. On the one hand, we propose a flexible multi-channel framework to generate multi-type frame-level features. On the other hand, we study how it is possible to improve the detection performance by supervised learning. The multi-channel framework is based on four Conditional GANs (CGANs) taking various type of appearance and motion information as input and producing prediction information as output. These CGANs provide a better feature space to represent the distinction between normal and abnormal events. Then, the difference between those generative and ground-truth information is encoded by Peak Signal-to-Noise Ratio (PSNR). We propose to classify those features in a classical supervised scenario by building a small training set with some abnormal samples of the original test set of the dataset. The binary Support Vector Machine (SVM) is applied for frame-level anomaly detection. Finally, we use Mask R-CNN as detector to perform object-centric anomaly localization. Our solution is largely evaluated on Avenue, Ped1, Ped2, and ShanghaiTech datasets. Our experiment results demonstrate that PSNR features combined with supervised SVM are better than error maps computed by previous methods. We achieve state-of-the-art performance for frame-level AUC on Ped1 and ShanghaiTech. Especially, for the most challenging Shanghaitech dataset, a supervised training model outperforms up to 9% the state-of-the-art an unsupervised strategy.<\/jats:p>","DOI":"10.3390\/s21093179","type":"journal-article","created":{"date-parts":[[2021,5,5]],"date-time":"2021-05-05T22:51:42Z","timestamp":1620255102000},"page":"3179","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Multi-Channel Generative Framework and Supervised Learning for Anomaly Detection in Surveillance Videos"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8798-7850","authenticated-orcid":false,"given":"Tuan-Hung","family":"Vu","sequence":"first","affiliation":[{"name":"CERI SN, IMT Lille Douai, 941 Rue Charles Bourseul, 59500 Douai, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8594-6959","authenticated-orcid":false,"given":"Jacques","family":"Boonaert","sequence":"additional","affiliation":[{"name":"CERI SN, IMT Lille Douai, 941 Rue Charles Bourseul, 59500 Douai, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3719-1934","authenticated-orcid":false,"given":"Sebastien","family":"Ambellouis","sequence":"additional","affiliation":[{"name":"COSYS Department, LEOST, Gustave Eiffel University, 59666 Villeneuve d\u2019Ascq, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abdelmalik","family":"Taleb-Ahmed","sequence":"additional","affiliation":[{"name":"Opto-Acoustic-Electronics Department, IEMN, CNRS, UMR 8520, Universit\u00e9 Polytechnique Hauts de France, 59313 Valenciennes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A.K., and Davis, L.S. (2016, January 27\u201330). Learning Temporal Regularity in Video Sequences. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.86"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Luo, W., Liu, W., and Gao, S. (2017, January 10\u201314). Remembering history with convolutional LSTM for anomaly detection. Proceedings of the 2017 IEEE International Conference on Multimedia and Expo (ICME), Hong Kong, China.","DOI":"10.1109\/ICME.2017.8019325"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ionescu, R.T., Smeureanu, S., Alexe, B., and Popescu, M. (2017, January 22\u201329). Unmasking the Abnormal Events in Video. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.315"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Liu, W., Luo, W., Lian, D., and Gao, S. (2018, January 18\u201323). Future Frame Prediction for Anomaly Detection\u2014A New Baseline. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00684"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Nguyen, T.N., and Meunier, J. (November, January 27). Anomaly Detection in Video Sequence with Appearance-Motion Correspondence. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00136"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ionescu, R.T., Khan, F., Georgescu, M.I., and Shao, L. (2019). Object-Centric Auto-Encoders and Dummy Anomalies for Abnormal Event Detection in Video. arXiv.","DOI":"10.1109\/CVPR.2019.00803"},{"key":"ref_7","unstructured":"Giorno, A.D., Bagnell, J.A., and Hebert, M. (2016, January 8\u201316). A Discriminative Framework for Anomaly Detection in Large Videos. Proceedings of the 14th European Conference on Computer Vision, Amsterdam, The Netherlands."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mahadevan, V., Li, W., Bhalodia, V., and Vasconcelos, N. (2010, January 13\u201318). Anomaly detection in crowded scenes. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539872"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lu, C., Shi, J., and Jia, J. (2013, January 1\u20138). Abnormal Event Detection at 150 FPS in Matlab. Proceedings of the 2013 IEEE International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.338"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Luo, W., Liu, W., and Gao, S. (2017, January 22\u201329). A Revisit of Sparse Coding Based Anomaly Detection in Stacked RNN Framework. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.45"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1109\/34.946990","article-title":"Event detection and analysis from video streams","volume":"23","author":"Medioni","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Machine Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhang, T., Lu, H., and Li, S.Z. (2009, January 20\u201325). Learning semantic scene models by object classification and trajectory clustering. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206809"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kim, J., and Grauman, K. (2009, January 20\u201325). Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206569"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, T., and Snoussi, H. (2012, January 18\u201321). Histograms of Optical Flow Orientation for Visual Abnormal Events Detection. Proceedings of the 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance, Beijing, China.","DOI":"10.1109\/AVSS.2012.39"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hinami, R., Mei, T., and Satoh, S. (2017, January 22\u201329). Joint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledge. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.391"},{"key":"ref_17","first-page":"1097","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"Volume 25","author":"Pereira","year":"2012","journal-title":"Advances in Neural Information Processing Systems"},{"key":"ref_18","unstructured":"Mathieu, M., Couprie, C., and LeCun, Y. (2016, January 2\u20134). Deep multi-scale video prediction beyond mean square error. Proceedings of the 4th International Conference on Learning Representations, San Juan, Puerto Rico."},{"key":"ref_19","unstructured":"Vu, H., Nguyen, T., Le, T., Luo, W., and Phung, D.Q. (February, January 27). Robust Anomaly Detection in Videos Using Multilevel Representations. Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence (AAAI-19), Honolulu, HI, USA."},{"key":"ref_20","unstructured":"Pinkney, J. (2021, May 02). Pix2pix, Matlab. Available online: https:\/\/www.mathworks.com\/matlabcentral\/fileexchange\/74779-pix2pix."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chen, Q., and Koltun, V. (2016, January 27\u201330). Full Flow: Optical Flow Estimation By Global Optimization over Regular Grids. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.509"},{"key":"ref_22","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An Iterative Image Registration Technique with an Application to Stereo Vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI \u201981), Vancouver, BC, Canada."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ouyang, Y., and Sanchez, V. (2021). Video Anomaly Detection by Estimating Likelihood of Representations. arXiv.","DOI":"10.1109\/ICPR48806.2021.9412694"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, W., Luo, W., Li, Z., Zhao, P., and Gao, S. (2019, January 10\u201316). Margin Learning Embedded Prediction for Video Anomaly Detection with A Few Anomalies. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, Macao, China.","DOI":"10.24963\/ijcai.2019\/419"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Vu, H., Nguyen, T., Travers, A., Venkatesh, S., and Phung, D. (2017). Energy-based localized anomaly detection in video surveillance. Advances in Knowledge Discovery and Data Mining,  Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-319-57454-7_50"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sultani, W., Chen, C., and Shah, M. (2018, January 18\u201323). Real-World Anomaly Detection in Surveillance Videos. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00678"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hassner, T., Itcher, Y., and Kliper-Gross, O. (2012, January 16\u201321). Violent flows: Real-time detection of violent crowd behavior. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6239348"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Leyva, R., Sanchez, V., and Li, C.T. (2017, January 4\u20135). The LV dataset: A realistic surveillance video dataset for abnormal event detection. Proceedings of the 2017 5th International Workshop on Biometrics and Forensics (IWBF), Coventry, UK.","DOI":"10.1109\/IWBF.2017.7935096"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/9\/3179\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:56:52Z","timestamp":1760162212000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/9\/3179"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,3]]},"references-count":29,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["s21093179"],"URL":"https:\/\/doi.org\/10.3390\/s21093179","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,3]]}}}