{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,6]],"date-time":"2025-12-06T16:48:58Z","timestamp":1765039738985,"version":"build-2065373602"},"reference-count":53,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2024,2,14]],"date-time":"2024-02-14T00:00:00Z","timestamp":1707868800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Huawei International Co. Limited","award":["KJYFKT2022002"],"award-info":[{"award-number":["KJYFKT2022002"]}]},{"name":"Second Construction Company Ltd. of China Construction Second Bureau","award":["KJYFKT2022002"],"award-info":[{"award-number":["KJYFKT2022002"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Computer vision (CV)-based recognition approaches have accelerated the automation of safety and progress monitoring on construction sites. However, limited studies have explored its application in process-based quality control of construction works, especially for concealed work. In this study, a framework is developed to facilitate process-based quality control utilizing Spatial\u2013Temporal Graph Convolutional Networks (ST-GCNs). To test this model experimentally, we used an on-site collected plastering work video dataset to recognize construction activities. An ST-GCN model was constructed to identify the four primary activities in plastering works, which attained 99.48% accuracy on the validation set. Then, the ST-GCN model was employed to recognize the activities of three extra videos, which represented a process with four activities in the correct order, a process without the activity of fiberglass mesh covering, and a process with four activities but in the wrong order, respectively. The results indicated that activity order could be clearly withdrawn from the activity recognition result of the model. Hence, it was convenient to judge whether key activities were missing or in the wrong order. This study has identified a promising framework that has the potential to the development of active, real-time, process-based quality control at construction sites.<\/jats:p>","DOI":"10.3390\/s24041220","type":"journal-article","created":{"date-parts":[[2024,2,14]],"date-time":"2024-02-14T11:18:46Z","timestamp":1707909526000},"page":"1220","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Skeleton-Based Activity Recognition for Process-Based Quality Control of Concealed Work via Spatial\u2013Temporal Graph Convolutional Networks"],"prefix":"10.3390","volume":"24","author":[{"given":"Lei","family":"Xiao","sequence":"first","affiliation":[{"name":"Department of Building and Real Estate, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xincong","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Civil and Environmental Engineering, Harbin Institute of Technology, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tian","family":"Peng","sequence":"additional","affiliation":[{"name":"Technology Department, The Second Construction Company Ltd. of China Construction Second Bureau, Shenzhen 518000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3187-9041","authenticated-orcid":false,"given":"Heng","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Building and Real Estate, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Runhao","family":"Guo","sequence":"additional","affiliation":[{"name":"Department of Building and Real Estate, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,2,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"04019031","DOI":"10.1061\/(ASCE)CP.1943-5487.0000847","article-title":"Real-time image localisation and registration with BIM using perspective alignment for indoor monitoring of construction","volume":"33","author":"Asadi","year":"2019","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"03120002","DOI":"10.1061\/(ASCE)CO.1943-7862.0001843","article-title":"Automated methods for activity recognition of construction workers and equipment: State-of-the-art review","volume":"146","author":"Sherafat","year":"2020","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.autcon.2016.08.015","article-title":"Smartphone-based construction workers\u2019 activity recognition and classification","volume":"71","author":"Akhavian","year":"2016","journal-title":"Autom. Constr."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"104104","DOI":"10.1016\/j.autcon.2021.104104","article-title":"Sound-based multiple-equipment activity recognition using convolutional neural networks","volume":"135","author":"Sherafat","year":"2022","journal-title":"Autom. Constr."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"103361","DOI":"10.1016\/j.autcon.2020.103361","article-title":"Activity identification in modular construction using audio signals and machine learning","volume":"119","author":"Rashid","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3090343","DOI":"10.1155\/2017\/3090343","article-title":"A review on human activity recognition using vision-based method","volume":"2017","author":"Zhang","year":"2017","journal-title":"J. Healthc. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1061\/(ASCE)CP.1943-5487.0000279","article-title":"Vision-based detection of unsafe actions of a construction worker: Case study of ladder climbing","volume":"27","author":"Han","year":"2013","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.autcon.2017.11.002","article-title":"A deep hybrid learning model to detect unsafe behavior: Integrating convolution neural networks and long short-term memory","volume":"86","author":"Ding","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"103126","DOI":"10.1016\/j.autcon.2020.103126","article-title":"Effective inertial sensor quantity and locations on a body for deep learning-based worker\u2019s motion recognition","volume":"113","author":"Kim","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"103448","DOI":"10.1016\/j.compind.2021.103448","article-title":"Utilising safety rule correlation for mobile scaffolds monitoring leveraging deep convolution neural networks","volume":"129","author":"Khan","year":"2021","journal-title":"Comput. Ind."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1813","DOI":"10.1108\/ECAM-12-2019-0732","article-title":"Dynamic safety prewarning mechanism of human\u2013machine\u2013environment using computer vision","volume":"27","author":"Xu","year":"2020","journal-title":"Eng. Constr. Archit. Manag."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1108\/ECAM-06-2019-0325","article-title":"Pro-active warning system for the crossroads at construction sites based on computer vision","volume":"27","author":"Zhu","year":"2020","journal-title":"Eng. Constr. Archit. Manag."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"04021171","DOI":"10.1061\/(ASCE)CO.1943-7862.0002200","article-title":"Dynamic fall risk assessment framework for construction workers based on dynamic Bayesian network and computer vision","volume":"147","author":"Piao","year":"2021","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"144","DOI":"10.3389\/fbuil.2019.00144","article-title":"Automated activity identification for construction equipment using motion data from articulated members","volume":"5","author":"Rashid","year":"2020","journal-title":"Front. Built Environ."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"103138","DOI":"10.1016\/j.autcon.2020.103138","article-title":"Construction activity recognition with convolutional recurrent networks","volume":"113","author":"Slaton","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"04019095","DOI":"10.1061\/(ASCE)CO.1943-7862.0001744","article-title":"Automatic indoor construction process monitoring for tiles based on BIM and computer vision","volume":"146","author":"Deng","year":"2020","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"100087","DOI":"10.1016\/j.dibe.2022.100087","article-title":"Digital technology for quality management in construction: A review and future research directions","volume":"12","author":"Luo","year":"2022","journal-title":"Dev. Built Environ."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Yan, S., Xiong, Y., and Lin, D. (2018, January 2\u20137). Spatial temporal graph convolutional networks for skeleton-based action recognition. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12328"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, M., Chen, S., Chen, X., Zhang, Y., Wang, Y., and Tian, Q. (2019, January 16\u201320). Actional-structural graph convolutional networks for skeleton-based action recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00371"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Gao, X., Hu, W., Tang, J., Liu, J., and Guo, Z. (2019, January 21\u201325). Optimised skeleton-based action recognition via sparsified graph regression. Proceedings of the 27th ACM International Conference on Multimedia, Nice, France.","DOI":"10.1145\/3343031.3351170"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Shi, L., Zhang, Y., Cheng, J., and Lu, H. (2019, January 16\u201320). Two-stream adaptive graph convolutional networks for skeleton-based action recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01230"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"110989","DOI":"10.1016\/j.enbuild.2021.110989","article-title":"Real-time surveillance-video-based personalised thermal comfort recognition","volume":"244","author":"Duan","year":"2021","journal-title":"Energy Build."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.aei.2015.02.001","article-title":"Computer vision techniques for construction safety and health monitoring","volume":"29","author":"Seo","year":"2015","journal-title":"Adv. Eng. Inform."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3383","DOI":"10.1007\/s11831-020-09504-3","article-title":"Computer vision techniques in construction: A critical review","volume":"28","author":"Xu","year":"2021","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"103940","DOI":"10.1016\/j.autcon.2021.103940","article-title":"Computer vision applications in construction: Current state, opportunities & challenges","volume":"132","author":"Paneru","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"104658","DOI":"10.1016\/j.ssci.2020.104658","article-title":"A critical review of vision-based occupational health and safety monitoring of construction site workers","volume":"126","author":"Zhang","year":"2020","journal-title":"Saf. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"105130","DOI":"10.1016\/j.ssci.2020.105130","article-title":"Computer vision technologies for safety science and management in construction: A critical review and future research directions","volume":"135","author":"Guo","year":"2021","journal-title":"Saf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"100980","DOI":"10.1016\/j.aei.2019.100980","article-title":"Computer vision for behaviour-based safety in construction: A review and future directions","volume":"43","author":"Fang","year":"2020","journal-title":"Adv. Eng. Inform."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"104245","DOI":"10.1016\/j.autcon.2022.104245","article-title":"Computer vision-based construction progress monitoring","volume":"138","author":"Reja","year":"2022","journal-title":"Autom. Constr."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.autcon.2016.06.016","article-title":"Data acquisition technologies for construction progress tracking","volume":"70","author":"Omar","year":"2016","journal-title":"Autom. Constr."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.aei.2018.05.005","article-title":"A review of 3D reconstruction techniques in civil engineering and their applications","volume":"37","author":"Ma","year":"2018","journal-title":"Adv. Eng. Inform."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"103705","DOI":"10.1016\/j.autcon.2021.103705","article-title":"Computer vision-based interior construction progress monitoring: A literature review and future research directions","volume":"127","author":"Ekanayake","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"103210","DOI":"10.1016\/j.autcon.2020.103210","article-title":"Improving progress monitoring by fusing point clouds, semantic data and computer vision","volume":"116","author":"Braun","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"103121","DOI":"10.1016\/j.autcon.2020.103121","article-title":"Multi-camera vision-based productivity monitoring of earthmoving operations","volume":"112","author":"Kim","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.autcon.2018.04.002","article-title":"Analysing context and productivity of tunnel earthmoving processes using imaging and simulation","volume":"92","author":"Kim","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"103045","DOI":"10.1016\/j.autcon.2019.103045","article-title":"Automated excavators activity recognition and productivity analysis from construction site surveillance videos","volume":"110","author":"Chen","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Maalek, R., Lichti, D.D., and Ruwanpura, J.Y. (2019). Automatic Recognition of Common Structural Elements from Point Clouds for Automated Progress Monitoring and Dimensional Quality Control in Reinforced Concrete Construction. Remote Sens., 11.","DOI":"10.3390\/rs11091102"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"106800","DOI":"10.1016\/j.cemconres.2022.106800","article-title":"A roadmap for quality control of hardening and hardened printed concrete","volume":"157","author":"Mechtcherine","year":"2022","journal-title":"Cem. Concr. Res."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.compind.2018.03.030","article-title":"Automated vision system for quality inspection of slate slabs","volume":"99","author":"Iglesias","year":"2018","journal-title":"Comput. Ind."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Chai, Y.T., and Wang, T.-K. (2022). Evaluation and decision-making framework for concrete surface quality based on computer vision and ontology. Eng. Constr. Archit. Manag., ahead-of-print.","DOI":"10.1108\/ECAM-01-2022-0064"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1111\/mice.12419","article-title":"Capturing and understanding workers\u2019 activities in far-field surveillance videos with deep action recognition and Bayesian nonparametric learning","volume":"34","author":"Luo","year":"2019","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.autcon.2003.08.010","article-title":"A process-based quality management information system","volume":"13","author":"Chin","year":"2004","journal-title":"Autom. Constr."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.autcon.2012.06.006","article-title":"Ontology-based semantic modeling of regulation constraint for automated construction quality compliance checking","volume":"28","author":"Zhong","year":"2012","journal-title":"Autom. Constr."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"103219","DOI":"10.1016\/j.cviu.2021.103219","article-title":"Skeleton-based action recognition via spatial and temporal transformer networks","volume":"208","author":"Plizzari","year":"2021","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_45","unstructured":"Du, Y., Wang, W., and Wang, L. (2015, January 7\u201312). Hierarchical recurrent neural network for skeleton based action recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_46","first-page":"1","article-title":"Two-stream convolutional networks for action recognition in videos","volume":"27","author":"Simonyan","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.autcon.2013.05.001","article-title":"A vision-based motion capture and recognition framework for behavior-based safety management","volume":"35","author":"Han","year":"2013","journal-title":"Autom. Constr."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1016\/j.aei.2012.02.011","article-title":"Real-time construction worker posture analysis for ergonomics training","volume":"26","author":"Ray","year":"2012","journal-title":"Adv. Eng. Inform."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"04018042","DOI":"10.1061\/(ASCE)CO.1943-7862.0001497","article-title":"Image-and-Skeleton-Based Parameterized Approach to Real-Time Identification of Construction Workers\u2019 Unsafe Behaviors","volume":"144","author":"Guo","year":"2018","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Cao, Z., Simon, T., Wei, S.E., and Sheikh, Y. (2017, January 21\u201326). Realtime multi-person 2d pose estimation using part affinity fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"103016","DOI":"10.1016\/j.autcon.2019.103016","article-title":"Full body pose estimation of construction equipment using computer vision and deep learning techniques","volume":"110","author":"Luo","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_52","first-page":"1323","article-title":"A competency-based training guide model for labourers in construction","volume":"23","author":"Manoharan","year":"2021","journal-title":"Int. J. Constr. Manag."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"103352","DOI":"10.1016\/j.jobe.2021.103352","article-title":"Action recognition of construction workers under occlusion","volume":"45","author":"Li","year":"2022","journal-title":"J. Build. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/4\/1220\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:59:48Z","timestamp":1760104788000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/4\/1220"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,14]]},"references-count":53,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["s24041220"],"URL":"https:\/\/doi.org\/10.3390\/s24041220","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,2,14]]}}}