{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T23:50:32Z","timestamp":1769557832510,"version":"3.49.0"},"reference-count":34,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,2,13]],"date-time":"2023-02-13T00:00:00Z","timestamp":1676246400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The interest in video anomaly detection systems that can detect different types of anomalies, such as violent behaviours in surveillance videos, has gained traction in recent years. The current approaches employ deep learning to perform anomaly detection in videos, but this approach has multiple problems. For example, deep learning in general has issues with noise, concept drift, explainability, and training data volumes. Additionally, anomaly detection in itself is a complex task and faces challenges such as unknownness, heterogeneity, and class imbalance. Anomaly detection using deep learning is therefore mainly constrained to generative models such as generative adversarial networks and autoencoders due to their unsupervised nature; however, even they suffer from general deep learning issues and are hard to properly train. In this paper, we explore the capabilities of the Hierarchical Temporal Memory (HTM) algorithm to perform anomaly detection in videos, as it has favorable properties such as noise tolerance and online learning which combats concept drift. We introduce a novel version of HTM, named GridHTM, which is a grid-based HTM architecture specifically for anomaly detection in complex videos such as surveillance footage. We have tested GridHTM using the VIRAT video surveillance dataset, and the subsequent evaluation results and online learning capabilities prove the great potential of using our system for real-time unsupervised anomaly detection in complex videos.<\/jats:p>","DOI":"10.3390\/s23042087","type":"journal-article","created":{"date-parts":[[2023,2,13]],"date-time":"2023-02-13T04:07:19Z","timestamp":1676261239000},"page":"2087","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["GridHTM: Grid-Based Hierarchical Temporal Memory for Anomaly Detection in Videos"],"prefix":"10.3390","volume":"23","author":[{"given":"Vladimir","family":"Monakhov","sequence":"first","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"},{"name":"Department of Informatics, University of Oslo, 0316 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6026-0929","authenticated-orcid":false,"given":"Vajira","family":"Thambawita","sequence":"additional","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2073-7029","authenticated-orcid":false,"given":"P\u00e5l","family":"Halvorsen","sequence":"additional","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"},{"name":"Department of Computer Science, Oslo Metropolitan University, 0130 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3153-2064","authenticated-orcid":false,"given":"Michael A.","family":"Riegler","sequence":"additional","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"},{"name":"Department of Computer Science, UiT The Arctic University of Norway, 9037 Troms\u00f8, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,13]]},"reference":[{"key":"ref_1","unstructured":"Tewari, D.U.S. (2019). Available online: https:\/\/www.alliedmarketresearch.com\/us-video-surveillance-market-A06741."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1016\/j.procs.2015.08.220","article-title":"Survey on anomaly detection using data mining techniques","volume":"60","author":"Agrawal","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1541880.1541882","article-title":"Anomaly detection: A survey","volume":"41","author":"Chandola","year":"2009","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chalapathy, R., and Chawla, S. (2019). Deep learning for anomaly detection: A survey. arXiv.","DOI":"10.1145\/3394486.3406704"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3439950","article-title":"Deep learning for anomaly detection: A review","volume":"54","author":"Pang","year":"2021","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, R., Nie, K., Wang, T., Yang, Y., and Long, B. (2020, January 14\u201316). Deep learning for anomaly detection. Proceedings of the 13th International Conference On Web Search Furthermore, Data Mining, Yanuca Island, Cuvu, Fiji.","DOI":"10.1145\/3336191.3371876"},{"key":"ref_7","first-page":"1","article-title":"A Review on Outlier\/Anomaly Detection in Time Series Data","volume":"54","author":"Conde","year":"2021","journal-title":"ACM Comput. Surv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ye, N., Li, K., Bai, H., Yu, R., Hong, L., Zhou, F., Li, Z., and Zhu, J. (2021). OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalization. arXiv.","DOI":"10.1109\/CVPR52688.2022.00779"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1016\/j.procs.2019.11.146","article-title":"Dealing with Noise Problem in Machine Learning Data-sets: A Systematic Review","volume":"161","author":"Gupta","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_10","unstructured":"Hendrycks, D., and Dietterich, T. (2019). Benchmarking Neural Network Robustness to Common Corruptions and Perturbations. arXiv, 1226."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Cui, Y., Ahmad, S., and Hawkins, J. (2017). The HTM Spatial Pooler\u2014A Neocortical Algorithm for Online Sparse Distributed Coding. Front. Comput. Neurosci., 11.","DOI":"10.3389\/fncom.2017.00111"},{"key":"ref_12","unstructured":"Hawkins, J., Ahmad, S., Purdy, S., and Lavin, A. (2023, January 09). Biological and Machine Intelligence (BAMI), 2016. Initial online release 0.4. Available online: https:\/\/numenta.com\/resources\/biological-and-machine-intelligence\/."},{"key":"ref_13","unstructured":"Zhu, S., Chen, C., and Sultani, W. (2004). Video Anomaly Detection for Smart Surveillance. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gong, D., Liu, L., Le, V., Saha, B., Mansour, M.R., Venkatesh, S., and Hengel, A.v.d. (2019). Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detection. arXiv, 2639.","DOI":"10.1109\/ICCV.2019.00179"},{"key":"ref_15","unstructured":"Liu, W., Luo, W., Lian, D., and Gao, S. Future Frame Prediction for Anomaly Detection \u2013 A New Baseline. arXiv, 9867."},{"key":"ref_16","unstructured":"Akcay, S., Atapour-Abarghouei, A., and Breckon, T.P. (2018). GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training. arXiv, 0672."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sahoo, D., Pham, Q., Lu, J., and Hoi, S.C. (2018). Online Deep Learning: Learning Deep Neural Networks on the Fly. arXiv.","DOI":"10.24963\/ijcai.2018\/369"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sun, C., Shrivastava, A., Singh, S., and Gupta, A. (2017). Revisiting Unreasonable Effectiveness of Data in Deep Learning Era. arXiv, 2968.","DOI":"10.1109\/ICCV.2017.97"},{"key":"ref_19","unstructured":"Shen, Z., Liu, J., He, Y., Zhang, X., Xu, R., Yu, H., and Cui, P. Towards Out-Of-Distribution Generalization: A Survey. arXiv 2021. arXiv.2108.1, 3624."},{"key":"ref_20","unstructured":"D\u2019Amour, A., Heller, K., Moldovan, D., Adlam, B., Alipanahi, B., Beutel, A., Chen, C., Deaton, J., Eisenstein, J., and Hoffman, M.D. (2020). Underspecification Presents Challenges for Credibility in Modern Machine Learning. arXiv, 3395."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI","volume":"58","author":"Bennetot","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.neucom.2017.04.070","article-title":"Unsupervised real-time anomaly detection for streaming data","volume":"262","author":"Ahmad","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zou, Y., Shi, Y., Wang, Y., Shu, Y., Yuan, Q., and Tian, Y. (2018, January 23\u201327). Hierarchical Temporal Memory Enhanced One-Shot Distance Learning for Action Recognition. Proceedings of the 2018 IEEE International Conference on Multimedia and Expo (ICME), San Diego, CA, USA.","DOI":"10.1109\/ICME.2018.8486447"},{"key":"ref_24","unstructured":"McDougall, D. (2023, January 09). 2019. Available online: https:\/\/github.com\/htm-community\/htm.core\/issues\/259#issuecomment-533333336."},{"key":"ref_25","unstructured":"Daylidyonok, I., Frolenkova, A., and Panov, A.I. (2019). Biologically Inspired Cognitive Architectures 2018, Springer International Publishing."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hebb, D. (2005). The Organization of Behavior: A Neuropsychological Theory, Taylor & Francis.","DOI":"10.4324\/9781410612403"},{"key":"ref_27","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. ORB: An efficient alternative to SIFT or SURF. Proceedings of the International Conference on Computer Vision (ICCV), Barcelona, Spain."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Oh, S., Hoogs, A., Perera, A., Cuntoor, N., Chen, C.C., Lee, J.T., Mukherjee, S., Aggarwal, J.K., Lee, H., and Davis, L. (2011, January 20\u201325). A large-scale benchmark dataset for event recognition in surveillance video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995586"},{"key":"ref_29","unstructured":"Heiserman, S. (2023, January 09). 2022. Available online: https:\/\/discourse.numenta.org\/t\/htm-core-am-i-getting-prediction-density-correctly\/9299."},{"key":"ref_30","unstructured":"Iegorov, O. (2023, January 09). My Analysis On Why Temporal Memory Prediction Doesn\u2019T Work On Sequential Data; 2017. Available online: https:\/\/discourse.numenta.org\/t\/my-analysis-on-why-temporal-memory-prediction-doesnt-work-on-sequential-data\/3141."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kirillov, A., Wu, Y., He, K., and Girshick, R. (2019). PointRend: Image Segmentati on as Rendering. arXiv, 8193.","DOI":"10.1109\/CVPR42600.2020.00982"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Web Conference, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_34","unstructured":"Olafenwa, A. (2023, January 09). Available online: https:\/\/vixra.org\/pdf\/2101.0122v1.pdf."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/2087\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:33:13Z","timestamp":1760121193000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/2087"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,13]]},"references-count":34,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23042087"],"URL":"https:\/\/doi.org\/10.3390\/s23042087","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,13]]}}}