{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T07:44:16Z","timestamp":1771055056057,"version":"3.50.1"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,12,6]],"date-time":"2024-12-06T00:00:00Z","timestamp":1733443200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,12,6]],"date-time":"2024-12-06T00:00:00Z","timestamp":1733443200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100008899","name":"University of South Carolina","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008899","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Pattern Anal Applic"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>This paper presents a Spatial-Temporal Graph Convolutional Network-based Pedestrians\u2019 behaviors Anomaly Detection system (STGCN-PAD) for grade crossings. The behaviors of pedestrians are represented in a structured manner by skeleton trajectories that are generated using a pose estimation model. The ST-GCN components are sequentially applied to capture the spatial dependencies between skeleton key points within a single video frame and the temporal relationships for each of them. Based on these features, the system reconstructs input trajectories with a constant sliding window size, and the reconstruction error is used to distinguish abnormal behaviors from those normal. To accelerate the processing of extracted multi-dimensional feature maps, an MLP-Mixer model-based reconstruction network is developed as an alternative to the traditional convolution neural network. Only trajectories of normal walking behavior are included for model training. Anomalies, such as lingering and squatting activities, can be identified as outliers by observing the magnitude of reconstruction errors. The case studies demonstrate the salient feasibility and efficiency of the proposed system, which achieves at least comparable performance (approximately 88% in the AUC evaluation metric) with several state-of-the-art approaches while using the MLP-Mixer model accelerates model inference by 10\u00d7 relative to our previous effort (Song et al. in Appl Intell 53:21676\u201321691, 2023).<\/jats:p>","DOI":"10.1007\/s10044-024-01382-w","type":"journal-article","created":{"date-parts":[[2024,12,6]],"date-time":"2024-12-06T17:49:40Z","timestamp":1733507380000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Stgcn-pad: a spatial-temporal graph convolutional network for detecting abnormal pedestrian motion patterns at grade crossings"],"prefix":"10.1007","volume":"28","author":[{"given":"Ge","family":"Song","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Qian","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yi","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,12,6]]},"reference":[{"issue":"19","key":"1382_CR1","doi-asserted-by":"publisher","first-page":"21676","DOI":"10.1007\/s10489-023-04639-9","volume":"53","author":"G Song","year":"2023","unstructured":"Song G, Qian Y, Wang Y (2023) Analysis of abnormal pedestrian behaviors at grade crossings based on semi-supervised generative adversarial networks. Appl Intell 53(19):21676\u201391","journal-title":"Appl Intell"},{"key":"1382_CR2","unstructured":"Administration FR. Highway\/Rail Grade Crossing Incident Dashboards. https:\/\/railroads.dot.gov\/accident-and-incident-reporting\/highwayrail-grade-crossing-incidents\/incidents-summary"},{"issue":"1","key":"1382_CR3","doi-asserted-by":"publisher","first-page":"3475","DOI":"10.1109\/TCE.2024.3353530","volume":"70","author":"H Gao","year":"2024","unstructured":"Gao H, Yu X, Xu Y, Kim JY, Wang Y (2024) Monoli: Precise monocular 3d object detection for next-generation consumer electronics for autonomous electric vehicles. IEEE Trans Consum Electron 70(1):3475\u20133486","journal-title":"IEEE Trans Consum Electron"},{"key":"1382_CR4","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/TVT.2024.3372940","volume":"7","author":"H Gao","year":"2024","unstructured":"Gao H, Shao J, Iqbal M, Wang Y, Xiang Z (2024) Cfpc: The curbed fake point collector to pseudo-lidar-based 3d object detection for autonomous vehicles. IEEE Trans Veh Technol 7:4. https:\/\/doi.org\/10.1109\/TVT.2024.3372940","journal-title":"IEEE Trans Veh Technol"},{"key":"1382_CR5","doi-asserted-by":"crossref","unstructured":"Bau D, Zhou B, Khosla A, Oliva A, Torralba A (2017) Network dissection: Quantifying interpretability of deep visual representations. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 6541\u20136549","DOI":"10.1109\/CVPR.2017.354"},{"issue":"1","key":"1382_CR6","first-page":"307","volume":"9","author":"K Singh","year":"2012","unstructured":"Singh K, Upadhyaya S (2012) Outlier detection: applications and techniques. Int J Comput Sci Issues (IJCSI) 9(1):307","journal-title":"Int J Comput Sci Issues (IJCSI)"},{"key":"1382_CR7","doi-asserted-by":"crossref","unstructured":"Sabokrou M, Khalooei M, Fathy M, Adeli E (2018) Adversarially learned one-class classifier for novelty detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3379\u20133388","DOI":"10.1109\/CVPR.2018.00356"},{"key":"1382_CR8","doi-asserted-by":"crossref","unstructured":"Martinez J, Black MJ, Romero J (2017) On human motion prediction using recurrent neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2891\u20132900","DOI":"10.1109\/CVPR.2017.497"},{"key":"1382_CR9","doi-asserted-by":"crossref","unstructured":"Piergiovanni A, Ryoo MS (2019) Representation flow for action recognition. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 9945\u20139953","DOI":"10.1109\/CVPR.2019.01018"},{"key":"1382_CR10","doi-asserted-by":"crossref","unstructured":"Fernando B, Gavves E, Oramas JM, Ghodrati A, Tuytelaars T (2015) Modeling video evolution for action recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 5378\u20135387","DOI":"10.1109\/CVPR.2015.7299176"},{"key":"1382_CR11","doi-asserted-by":"crossref","unstructured":"Liu G, Tang J, Tian Y, Wang J (2021) Graph neural network for credit card fraud detection. In: 2021 International Conference on Cyber-Physical Social Intelligence (ICCSI). IEEE, pp 1\u20136","DOI":"10.1109\/ICCSI53130.2021.9736204"},{"key":"1382_CR12","unstructured":"Wu L, Sun P, Hong R, Fu Y, Wang X, Wang M (2018) Socialgcn: An efficient graph convolutional network based model for social recommendation. arXiv preprint arXiv:1811.02815"},{"key":"1382_CR13","doi-asserted-by":"crossref","unstructured":"Guo S, Lin Y, Feng N, Song C, Wan H (2019) Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp 922\u2013929","DOI":"10.1609\/aaai.v33i01.3301922"},{"key":"1382_CR14","doi-asserted-by":"crossref","unstructured":"Yan S, Xiong Y, Lin D (2018) Spatial temporal graph convolutional networks for skeleton-based action recognition. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32","DOI":"10.1609\/aaai.v32i1.12328"},{"key":"1382_CR15","unstructured":"Chalapathy R, Chawla S (2019) Deep learning for anomaly detection: a survey. arXiv preprint arXiv:1901.03407"},{"issue":"9","key":"1382_CR16","doi-asserted-by":"publisher","first-page":"4321","DOI":"10.1109\/TIP.2017.2713048","volume":"26","author":"W Lu","year":"2017","unstructured":"Lu W, Cheng Y, Xiao C, Chang S, Huang S, Liang B, Huang T (2017) Unsupervised sequential outlier detection with deep architectures. IEEE Trans Image Process 26(9):4321\u20134330","journal-title":"IEEE Trans Image Process"},{"key":"1382_CR17","doi-asserted-by":"publisher","first-page":"6440","DOI":"10.1109\/TIP.2022.3211476","volume":"31","author":"N Huyan","year":"2022","unstructured":"Huyan N, Quan D, Zhang X, Liang X, Chanussot J, Jiao L (2022) Unsupervised outlier detection using memory and contrastive learning. IEEE Trans Image Process 31:6440\u20136454","journal-title":"IEEE Trans Image Process"},{"key":"1382_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.117921","volume":"207","author":"W Jiang","year":"2022","unstructured":"Jiang W, Luo J (2022) Graph neural network for traffic forecasting: a survey. Expert Syst Appl 207:117921","journal-title":"Expert Syst Appl"},{"key":"1382_CR19","doi-asserted-by":"crossref","unstructured":"Cheng K, Zhang Y, He X, Chen W, Cheng J, Lu H (2020) Skeleton-based action recognition with shift graph convolutional network. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 183\u2013192","DOI":"10.1109\/CVPR42600.2020.00026"},{"key":"1382_CR20","doi-asserted-by":"crossref","unstructured":"Yang K, Ding X, Chen W (2019) Attention-based generative graph convolutional network for skeleton-based human action recognition. In: Proceedings of the 3rd International Conference on Video and Image Processing, pp 1\u20136","DOI":"10.1145\/3376067.3376076"},{"issue":"1","key":"1382_CR21","doi-asserted-by":"publisher","first-page":"891","DOI":"10.1007\/s40747-022-00836-0","volume":"9","author":"X Li","year":"2023","unstructured":"Li X, Ma S, Shan L, Liu S, Chai S, Li X (2023) Gran: graph recurrent attention network for pedestrian orientation classification. Complex Intell Syst 9(1):891\u2013908","journal-title":"Complex Intell Syst"},{"key":"1382_CR22","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2023.109633","volume":"142","author":"X Zhang","year":"2023","unstructured":"Zhang X, Angeloudis P, Demiris Y (2023) Dual-branch spatio-temporal graph neural networks for pedestrian trajectory prediction. Pattern Recognit 142:109633","journal-title":"Pattern Recognit"},{"issue":"3","key":"1382_CR23","doi-asserted-by":"publisher","first-page":"611","DOI":"10.3390\/electronics12030611","volume":"12","author":"BI Sighencea","year":"2023","unstructured":"Sighencea BI, Stanciu IR, C\u0103leanu CD (2023) D-stgcn: Dynamic pedestrian trajectory prediction using spatio-temporal graph convolutional networks. Electronics 12(3):611","journal-title":"Electronics"},{"issue":"4","key":"1382_CR24","first-page":"341","volume":"20","author":"Z Bi","year":"2024","unstructured":"Bi Z, Sun S, Zhang W, Shan M (2024) Click-through rate prediction model based on graph networks and feature squeeze-and-excitation mechanism. Int J Web Inf Syst 20(4):341\u2013357","journal-title":"Int J Web Inf Syst"},{"issue":"4","key":"1382_CR25","first-page":"436","volume":"20","author":"Y Li","year":"2024","unstructured":"Li Y, Xie Z, Cao B, Lou H (2024) Graph structure estimation neural network-based service classification. Int J Web Inf Syst 20(4):436\u2013451","journal-title":"Int J Web Inf Syst"},{"key":"1382_CR26","first-page":"24261","volume":"34","author":"IO Tolstikhin","year":"2021","unstructured":"Tolstikhin IO, Houlsby N, Kolesnikov A, Beyer L, Zhai X, Unterthiner T, Yung J, Steiner A, Keysers D, Uszkoreit J et al (2021) Mlp-mixer: An all-mlp architecture for vision. Adv Neural Inf Process Syst 34:24261\u201324272","journal-title":"Adv Neural Inf Process Syst"},{"key":"1382_CR27","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2021.103404","volume":"73","author":"B Huang","year":"2022","unstructured":"Huang B, Chen W, Lin C-L, Juang C-F, Wang J (2022) Mlp-bp: A novel framework for cuffless blood pressure measurement with PPG and ECG signals based on mlp-mixer neural networks. Biomed Signal Process Control 73:103404","journal-title":"Biomed Signal Process Control"},{"key":"1382_CR28","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.109792","volume":"258","author":"H Zhang","year":"2022","unstructured":"Zhang H, Dong Z, Li B, He S (2022) Multi-scale mlp-mixer for image classification. Knowl-Based Syst 258:109792","journal-title":"Knowl-Based Syst"},{"key":"1382_CR29","doi-asserted-by":"crossref","unstructured":"Fusco F, Pascual D, Staar P (2022) pnlp-mixer: an efficient all-mlp architecture for language. arXiv preprint arXiv:2202.04350","DOI":"10.18653\/v1\/2023.acl-industry.6"},{"issue":"1","key":"1382_CR30","first-page":"18","volume":"36","author":"W Li","year":"2013","unstructured":"Li W, Mahadevan V, Vasconcelos N (2013) Anomaly detection and localization in crowded scenes. IEEE Trans Pattern Anal Mach Intell 36(1):18\u201332","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"1382_CR31","doi-asserted-by":"crossref","unstructured":"Luo W, Liu W, Gao S (2017) A revisit of sparse coding based anomaly detection in stacked rnn framework. In: Proceedings of the IEEE International Conference on Computer Vision, pp 341\u2013349","DOI":"10.1109\/ICCV.2017.45"},{"key":"1382_CR32","doi-asserted-by":"crossref","unstructured":"Cao Z, Simon T, Wei S-E, Sheikh Y (2017) Realtime multi-person 2d pose estimation using part affinity fields. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 7291\u20137299","DOI":"10.1109\/CVPR.2017.143"},{"key":"1382_CR33","doi-asserted-by":"crossref","unstructured":"Fang H-S, Li J, Tang H, Xu C, Zhu H, Xiu Y, Li Y-L, Lu C (2022) Alphapose: Whole-body regional multi-person pose estimation and tracking in real-time. IEEE Transactions on Pattern Analysis and Machine Intelligence","DOI":"10.1109\/TPAMI.2022.3222784"},{"key":"1382_CR34","doi-asserted-by":"crossref","unstructured":"Andriluka M, Pishchulin L, Gehler P, Schiele B (2014) 2d human pose estimation: New benchmark and state of the art analysis. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3686\u20133693","DOI":"10.1109\/CVPR.2014.471"},{"key":"1382_CR35","doi-asserted-by":"crossref","unstructured":"Fang H-S, Xie S, Tai Y-W, Lu C (2017) Rmpe: Regional multi-person pose estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp 2334\u20132343","DOI":"10.1109\/ICCV.2017.256"},{"key":"1382_CR36","unstructured":"MSCOCO Keypoint Challenge 2016 (2016) http:\/\/mscoco.org\/dataset\/keypoints-challenge2016"},{"key":"1382_CR37","unstructured":"Niepert M, Ahmed M, Kutzkov K (2016) Learning convolutional neural networks for graphs. In: International Conference on Machine Learning. PMLR, pp 2014\u20132023"},{"key":"1382_CR38","unstructured":"Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907"},{"key":"1382_CR39","doi-asserted-by":"crossref","unstructured":"Park H, Noh J, Ham B (2020) Learning memory-guided normality for anomaly detection. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 14372\u201314381","DOI":"10.1109\/CVPR42600.2020.01438"},{"key":"1382_CR40","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2021.108213","volume":"122","author":"Y Chang","year":"2022","unstructured":"Chang Y, Tu Z, Xie W, Luo B, Zhang S, Sui H, Yuan J (2022) Video anomaly detection with spatio-temporal dissociation. Pattern Recognit 122:108213","journal-title":"Pattern Recognit"},{"issue":"4","key":"1382_CR41","doi-asserted-by":"publisher","first-page":"1481","DOI":"10.1007\/s00530-022-00915-9","volume":"28","author":"W Pang","year":"2022","unstructured":"Pang W, He Q, Li Y (2022) Predicting skeleton trajectories using a skeleton-transformer for video anomaly detection. Multimed Syst 28(4):1481\u20131494","journal-title":"Multimed Syst"},{"key":"1382_CR42","doi-asserted-by":"publisher","first-page":"36712","DOI":"10.1109\/ACCESS.2024.3374383","volume":"12","author":"S Hong","year":"2024","unstructured":"Hong S, Ahn S, Jo Y, Park S (2024) Making anomalies more anomalous: video anomaly detection using a novel generator and destroyer. IEEE Access 12:36712\u201336726","journal-title":"IEEE Access"},{"issue":"24","key":"1382_CR43","doi-asserted-by":"publisher","first-page":"22099","DOI":"10.1007\/s00521-022-07660-0","volume":"34","author":"Z Jiang","year":"2022","unstructured":"Jiang Z, Song G, Qian Y, Wang Y (2022) A deep learning framework for detecting and localizing abnormal pedestrian behaviors at grade crossings. Neural Comput Appl 34(24):22099\u201322113","journal-title":"Neural Comput Appl"},{"key":"1382_CR44","doi-asserted-by":"crossref","unstructured":"Song G, Qian Y, Wang Y (2023) A deep generative adversarial network (gan)-enabled abnormal pedestrian behavior detection at grade crossings. In: SoutheastCon 2023. IEEE, pp 677\u2013684","DOI":"10.1109\/SoutheastCon51012.2023.10114963"}],"container-title":["Pattern Analysis and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10044-024-01382-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10044-024-01382-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10044-024-01382-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,11]],"date-time":"2025-02-11T20:11:34Z","timestamp":1739304694000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10044-024-01382-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,6]]},"references-count":44,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["1382"],"URL":"https:\/\/doi.org\/10.1007\/s10044-024-01382-w","relation":{},"ISSN":["1433-7541","1433-755X"],"issn-type":[{"value":"1433-7541","type":"print"},{"value":"1433-755X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,6]]},"assertion":[{"value":"22 July 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 November 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 December 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}],"article-number":"2"}}