{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,20]],"date-time":"2026-11-20T17:31:18Z","timestamp":1795195878235,"version":"4.10.3"},"reference-count":41,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,6,20]],"date-time":"2022-06-20T00:00:00Z","timestamp":1655683200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>As an essential task in computer vision, video anomaly detection technology is used in video surveillance, scene understanding, road traffic analysis and other fields. However, the definition of anomaly, scene change and complex background present great challenges for video anomaly detection tasks. The insight that motivates this study is that the reconstruction error for normal samples would be lower since they are closer to the training data, while the anomalies could not be reconstructed well. In this paper, we proposed a Convolutional Recurrent AutoEncoder (CR-AE), which combines an attention-based Convolutional Long\u2013Short-Term Memory (ConvLSTM) network and a Convolutional AutoEncoder. The ConvLSTM network and the Convolutional AutoEncoder could capture the irregularity of the temporal pattern and spatial irregularity, respectively. The attention mechanism was used to obtain the current output characteristics from the hidden state of each Covn-LSTM layer. Then, a convolutional decoder was utilized to reconstruct the input video clip and the testing video clip with higher reconstruction error, which were further judged to be anomalies. The proposed method was tested on two popular benchmarks (UCSD ped2 Dataset and Avenue Dataset), and the experimental results demonstrated that CR-AE achieved 95.6% and 73.1% frame-level AUC on two public datasets, respectively.<\/jats:p>","DOI":"10.3390\/s22124647","type":"journal-article","created":{"date-parts":[[2022,6,22]],"date-time":"2022-06-22T04:12:01Z","timestamp":1655871121000},"page":"4647","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Video Anomaly Detection Based on Convolutional Recurrent AutoEncoder"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1091-3324","authenticated-orcid":false,"given":"Bokun","family":"Wang","sequence":"first","affiliation":[{"name":"College of Civil Engineering and Mechanics, Xiangtan University, Xiangtan 411100, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2226-1618","authenticated-orcid":false,"given":"Caiqian","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Civil Engineering, Southeast University, Nanjing 210096, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.compeleceng.2019.02.017","article-title":"Region-based scalable smart system for anomaly detection in pedestrian walkways","volume":"75","author":"Murugan","year":"2019","journal-title":"Comput. Electr. Eng."},{"key":"ref_2","first-page":"184","article-title":"A Survey on Deep Learning Techniques for Video Anomaly Detection","volume":"10","author":"Park","year":"2021","journal-title":"Int. J. Comput. Eng. Inf. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1070","DOI":"10.1109\/TPAMI.2019.2944377","article-title":"Video anomaly detection with sparse coding inspired deep neural networks","volume":"43","author":"Luo","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1109\/TCSVT.2016.2589859","article-title":"Toward abnormal trajectory and event detection in video surveillance","volume":"27","author":"Cosar","year":"2016","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"104229","DOI":"10.1016\/j.imavis.2021.104229","article-title":"Intelligent video anomaly detection and classification using faster RCNN with deep reinforcement learning model","volume":"112","author":"Mansour","year":"2021","journal-title":"Image Vis. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3464423","article-title":"Deep Learning for Medical Anomaly Detection A Survey","volume":"54","author":"Fernando","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1062","DOI":"10.1109\/TMM.2018.2818942","article-title":"Anomaly detection based on stacked sparse coding with intraframe classification strategy","volume":"20","author":"Xu","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Cheng, K., Chen, Y., and Fang, W. (2015, January 7\u201312). Video anomaly detection and localization using hierarchical feature representation and gaussian process regression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298909"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"107394","DOI":"10.1016\/j.patcog.2020.107394","article-title":"Video anomaly detection and localization using motion-field shape description and homogeneity testing","volume":"105","author":"Zhang","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3463","DOI":"10.1109\/TIP.2017.2695105","article-title":"Video anomaly detection with compact feature sets for online performance","volume":"26","author":"Leyva","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","first-page":"527","article-title":"A state perception method for infrared dim and small targets with deep learning","volume":"13","author":"Huang","year":"2020","journal-title":"Chin. Opt."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ionescu, R., Georgescu, M., and Shao, L. (2019, January 15\u201320). Object-centric auto-encoders and dummy anomalies for abnormal event detection in video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00803"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.cviu.2016.10.010","article-title":"Detecting anomalous events in videos by learning deep representations of appearance and motion","volume":"156","author":"Xu","year":"2017","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hasan, M., Choi, J., and Neumanny, J. (2016, January 7\u201312). Learning temporal regularity in video sequences. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.86"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"102920","DOI":"10.1016\/j.cviu.2020.102920","article-title":"Video Anomaly Detection and Localization via Gaussian Mixture Fully Convolutional Variational Autoencoder","volume":"195","author":"Fan","year":"2020","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the Dimensionality of Data with Neural Networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ramachandra, B., Jones, M., and Vatsavai, R. (2020, January 2\u20135). Learning a distance function with a Siamese network to localize anomalies in videos. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Snowmass Village, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093417"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ravanbakhsh, M., Nabi, M., Mousavi, H., Sangineto, E., and Sebe, N. (2017, January 17\u201320). Abnormal event detection in videos using generative adversarial nets. Proceedings of the IEEE International Conference on Image Processing, Beijing, China.","DOI":"10.1109\/ICIP.2017.8296547"},{"key":"ref_19","unstructured":"Ruff, L., Vandermulen, R., Gornitz, N., Deecke, L., Siddiqui, S., Binder, A., Muller, E., and Kloft, M. (2019, January 10\u201315). Deep One-Class Classification. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Abati, D., Porrello, A., Calderara, S., and Cucchiara, R. (2019, January 15\u201320). Latent space autoregression for novelty detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00057"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Luo, W., Liu, W., and Gao, S. (2017, January 22\u201329). A revisit of sparse coding based anomaly detection in stacked rnn framework. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.45"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Teed, Z., and Deng, J. (2020, January 23\u201328). RAFT: Recurrent All Pairs Field Transforms for Optical Flow. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.24963\/ijcai.2021\/662"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Dong, G., Liu, L., Vuong, L., Budhaditya, S., Moussa, M.R., Svetha, V., and Hengel, A. (2019, January 15\u201321). Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection. Proceedings of the IEEE International Conference on Computer Vision, Los Angeles, CA, USA.","DOI":"10.1109\/ICCV.2019.00179"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11760-008-0099-7","article-title":"Using dynamic Bayesian network for scene modeling and anomaly detection","volume":"4","author":"Junejo","year":"2010","journal-title":"Signal Image Video Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"16643","DOI":"10.1007\/s00500-020-04967-9","article-title":"Video trajectory analysis using unsupervised clustering and multi-criteria ranking","volume":"24","author":"Sekh","year":"2020","journal-title":"Soft Comput."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1007\/s11263-012-0594-8","article-title":"Dense trajectories and motion boundary descriptors for action recognition","volume":"103","author":"Wang","year":"2013","journal-title":"Int. J. Comput. Vis."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wang, H., and Schmid, C. (2013, January 15\u201317). Action recognition with improved trajectories. Proceedings of the IEEE International Conference on Computer Vision, San Francisco, CA, USA.","DOI":"10.1109\/ICCV.2013.441"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Convertini, N., Dentamaro, V., and Impedovo, D. (2020). A controlled benchmark of video violence detection techniques. Information, 11.","DOI":"10.3390\/info11060321"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Xu, L., Gong, C., and Yang, J. (2014, January 4\u20139). Violent video detection based on MoSIFT feature and sparse coding. Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing, Florence, Italy.","DOI":"10.1109\/ICASSP.2014.6854259"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Roshtkhari, M.J., and Levine, M.D. (2013, January 7\u201313). Online dominant and anomalous behavior detection in videos. Proceedings of the IEEE International Conference on Computer Vision, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.337"},{"key":"ref_31","unstructured":"Dalal, N., and Triggs, B. (2005, January 5\u201311). Histograms of Oriented Gradients for Human Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"107865","DOI":"10.1016\/j.patcog.2021.107865","article-title":"Online Anomaly Detection in Surveillance Videos with Asymptotic Bounds on False Alarm Rate","volume":"114","author":"Keval","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2138","DOI":"10.1109\/TMM.2019.2950530","article-title":"Learning Normal Patterns via Adversarial Attention-Based Autoencoder for Abnormal Event Detection in Videos","volume":"22","author":"Song","year":"2020","journal-title":"IEEE Trans. Multimed."},{"key":"ref_34","unstructured":"Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., and Woo, W.-C. (2015, January 7\u201312). Convolutional lstm network: A machine learning approach for precipitation nowcasting. Proceedings of the Conference and Workshop on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Mahadevan, V., Li, W., Bhalodia, V., and Vasconcelos, N. (2010, January 15\u201317). Anomaly detection in crowded scenes. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539872"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Luo, W., Liu, W., and Gao, S. (2017, January 10\u201314). Remembering history with convolutional lstm for anomaly detection. Proceedings of the IEEE International Conference on Multimedia and Expo, Hong Kong, China.","DOI":"10.1109\/ICME.2017.8019325"},{"key":"ref_37","unstructured":"Kingma, D., and Ba, J. (2014, January 22\u201324). Adam: A Method for Stochastic Optimization. Proceedings of the 3rd International Conference on Learning Representations, Bejing, China."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Liu, W., Luo, W., Lian, D., and Gao, S. (2018, January 18\u201322). Future frame prediction for anomaly detection\u2014A new baseline. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00684"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Hu, Y., Zhang, Y., and Davis, L. (2013, January 15\u201317). Unsupervised Abnormal Crowd Activity Detection Using Semiparametric Scan Statistic. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2013.115"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.patcog.2016.09.016","article-title":"Online Growing Neural Gas for Anomaly Detection in Changing Surveillance Scenes","volume":"64","author":"Sun","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Ionescu, R., Smeureanu, S., Alexe, B., and Popescu, M. (2017, January 22\u201329). Unmasking the Abnormal Events in Video. Proceedings of the International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.315"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/12\/4647\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:35:45Z","timestamp":1760139345000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/12\/4647"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,20]]},"references-count":41,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22124647"],"URL":"https:\/\/doi.org\/10.3390\/s22124647","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,20]]}}}