{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:21:37Z","timestamp":1776082897461,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,13]],"date-time":"2023-01-13T00:00:00Z","timestamp":1673568000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Institute of Information &amp; Communications Technology Planning &amp; Evaluation (IITP) grant funded by the Korea government (MSIT)","award":["2022-0-00074"],"award-info":[{"award-number":["2022-0-00074"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this study, we used image recognition technology to explore different ways to improve the safety of construction workers. Three object recognition scenarios were designed for safety at a construction site, and a corresponding object recognition model was developed for each scenario. The first object recognition model checks whether there are construction workers at the site. The second object recognition model assesses the risk of falling (falling off a structure or falling down) when working at an elevated position. The third object recognition model determines whether the workers are appropriately wearing safety helmets and vests. These three models were newly created using the image data collected from the construction sites and synthetic image data collected from the virtual environment based on transfer learning. In particular, we verified an artificial intelligence model based on a virtual environment in this study. Thus, simulating and performing tests on worker falls and fall injuries, which are difficult to re-enact by humans, are efficient algorithm verification methods. The verification and synthesis data acquisition method based on a virtual environment is one of the main contributions of this study. This paper describes the overall application development approach, including the structure and method used to collect the construction site image data, structure of the training image dataset, image dataset augmentation method, and the artificial intelligence backbone model applied for transfer learning.<\/jats:p>","DOI":"10.3390\/s23020944","type":"journal-article","created":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T05:30:07Z","timestamp":1673847007000},"page":"944","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":63,"title":["Construction Site Safety Management: A Computer Vision and Deep Learning Approach"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7664-6025","authenticated-orcid":false,"given":"Jaekyu","family":"Lee","sequence":"first","affiliation":[{"name":"Energy IT Convergence Research Center, Korea Electronics Technology Institute, Seongnam-si 13509, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3011-8750","authenticated-orcid":false,"given":"Sangyub","family":"Lee","sequence":"additional","affiliation":[{"name":"Energy IT Convergence Research Center, Korea Electronics Technology Institute, Seongnam-si 13509, Republic of Korea"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1061\/(ASCE)0733-9364(2002)128:3(203)","article-title":"Construction site safety roles","volume":"128","author":"Toole","year":"2002","journal-title":"J. Constr. Eng. Manage"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.24840\/2184-0954_004.001_0001","article-title":"IoT-based safety monitoring from the perspective of construction site workers","volume":"4","author":"Haikio","year":"2020","journal-title":"Int. J. Occup. Environ. Saf."},{"key":"ref_3","unstructured":"Fang, W., Love, P.E., Ding, L., Xu, S., Kong, T., and Li, H. (IEEE Trans. Eng. Manag., 2021). Computer Vision and Deep Learning to Manage Safety in Construction: Matching Images of Unsafe Behavior and Semantic Rules, IEEE Trans. Eng. Manag., early access."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"103085","DOI":"10.1016\/j.autcon.2020.103085","article-title":"Deep learning for site safety: Real-time detection of personal protective equipment","volume":"112","author":"Nath","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/j.aap.2015.09.024","article-title":"A big-data-based platform of workers\u2019 behavior: Observations from the field","volume":"93","author":"Guo","year":"2016","journal-title":"Accid. Anal. Prev."},{"key":"ref_6","unstructured":"Azhar, S., and Behringer, A. (2013, January 10\u201313). A BIM-based approach for communicating and implementing a construction site safety plan. Proceedings of the 49th ASC Annual International Conference, San Luis Obispo, CA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.aei.2015.02.001","article-title":"Computer vision techniques for construction safety and health monitoring","volume":"29","author":"Seo","year":"2015","journal-title":"Adv. Eng. Inf."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1061\/(ASCE)0733-9364(2008)134:5(320)","article-title":"Vision system for tower cranes","volume":"134","author":"Shapira","year":"2008","journal-title":"J. Constr. Eng. Manage."},{"key":"ref_9","unstructured":"Awalgaonkar, N.M., Zheng, H., and Gurciullo, C.S. (2020). DEEVA: A deep learning and IoT based computer vision system to address safety and security of production sites in energy industry. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1145\/4078.4081","article-title":"Three-dimensional object recognition","volume":"17","author":"Besl","year":"1985","journal-title":"ACM Comput. Surv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.1007\/s00371-013-0886-1","article-title":"Computer vision-based object recognition for the visually impaired in an indoors environment: A survey","volume":"30","author":"Jafri","year":"2014","journal-title":"Vis. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"103036","DOI":"10.1016\/j.jobe.2021.103036","article-title":"Combining computer vision with semantic reasoning for on-site construction safety management","volume":"42","author":"Wu","year":"2021","journal-title":"J. Build. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Moohialdin, A., Lamari, F., Marc, M., and Trigunarsyah, B. (2021). A Real-Time Computer Vision System for Workers\u2019 PPE and Posture Detection in Actual Construction Site Environment, EASEC16 Springer.","DOI":"10.1007\/978-981-15-8079-6_199"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"103013","DOI":"10.1016\/j.autcon.2019.103013","article-title":"Computer vision applications in construction safety assurance","volume":"110","author":"Fang","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chen, S., and Demachi, K. (2020). A vision-based approach for ensuring proper use of personal protective equipment (PPE) in decommissioning of Fukushima Daiichi Nuclear Power Station. Appl. Sci., 10.","DOI":"10.3390\/app10155129"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/j.promfg.2020.04.017","article-title":"PPE compliance detection using artificial intelligence in learning factories","volume":"45","author":"Balakreshnan","year":"2020","journal-title":"Procedia Manuf."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"136","DOI":"10.3389\/fbuil.2020.00136","article-title":"Detection of personal protective equipment (PPE) compliance on construction site using computer vision based deep learning techniques","volume":"6","author":"Delhi","year":"2020","journal-title":"Front. Built Environ."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"104658","DOI":"10.1016\/j.ssci.2020.104658","article-title":"A critical review of vision-based occupational health and safety monitoring of construction site workers","volume":"126","author":"Zhang","year":"2020","journal-title":"Saf. Sci."},{"key":"ref_19","first-page":"11","article-title":"Image Recognition Based Autonomous Driving: A Deep Learning Approach","volume":"10","author":"Tahir","year":"2020","journal-title":"Int. J. Eng. Manuf."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"15","DOI":"10.5815\/ijigsp.2022.01.02","article-title":"Combining Multi-Feature Regions for Fine-Grained Image Recognition","volume":"14","author":"Fayou","year":"2022","journal-title":"Int. J. Image Graph. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"12","DOI":"10.5815\/ijigsp.2021.06.02","article-title":"Image Recognition Using Machine Learning with the Aid of MLR","volume":"13","author":"Tania","year":"2021","journal-title":"Int. J. Image Graph. Signal Process."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Torrey, L., and Shavlik, J. (2010). Transfer learning. Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, IGI Global.","DOI":"10.4018\/978-1-60566-766-9.ch011"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2009","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_27","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_28","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_29","unstructured":"Bradski, G., and Kaehler, A. (2008). Learning OpenCV: Computer vision with the OpenCV library, O\u2019Reilly Media, Inc."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., and Zitnick, C.L. (2014). Microsoft COCO: Common objects in context. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/S0031-3203(99)00055-2","article-title":"Adaptive document image binarization","volume":"33","author":"Sauvola","year":"2000","journal-title":"Pattern Recognit."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1109\/83.217222","article-title":"Morphological grayscale reconstruction in image analysis: Applications and efficient algorithms","volume":"2","author":"Vincent","year":"1993","journal-title":"IEEE Trans. Image Process."},{"key":"ref_33","first-page":"33","article-title":"Pyramid methods in image processing","volume":"29","author":"Adelson","year":"1984","journal-title":"RCA Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1109\/30.754419","article-title":"Image enhancement based on equal area dualistic sub-image histogram equalization method","volume":"45","author":"Wang","year":"1999","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2259","DOI":"10.1016\/S0031-3203(00)00149-7","article-title":"Color image segmentation: Advances and prospects","volume":"34","author":"Cheng","year":"2001","journal-title":"Pattern Recognit."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Ketkar, N. (2017). Introduction to Keras. Deep Learning with Python, Manning Publications.","DOI":"10.1007\/978-1-4842-2766-4"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The pascal visual object classes (VOC) challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vision"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Andriluka, M., Pishchulin, L., Gehler, P., and Schiele, B. (2014, January 23\u201328). 2D human pose estimation: New benchmark and state of the art analysis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.471"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"G\u00fcler, R.A., Neverova, N., and Kokkinos, I. (2018, January 18\u201323). Densepose: Dense human pose estimation in the wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00762"},{"key":"ref_40","unstructured":"ONVIF (2022, November 02). ONVIF\u2122 Core Specification, Version 2.2. Available online: http:\/\/www.onvif.org\/specs\/DocMap.html."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/944\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:05:30Z","timestamp":1760119530000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/944"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,13]]},"references-count":40,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23020944"],"URL":"https:\/\/doi.org\/10.3390\/s23020944","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,13]]}}}