{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,11]],"date-time":"2026-02-11T13:18:32Z","timestamp":1770815912310,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,6,30]],"date-time":"2021-06-30T00:00:00Z","timestamp":1625011200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["300102259503"],"award-info":[{"award-number":["300102259503"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Excavation is one of the broadest activities in the construction industry, often affected by safety and productivity. To address these problems, it is necessary for construction sites to automatically monitor the poses of excavator manipulators in real time. Based on computer vision (CV) technology, an approach, through a monocular camera and marker, was proposed to estimate the pose parameters (including orientation and position) of the excavator manipulator. To simulate the pose estimation process, a measurement system was established with a common camera and marker. Through comprehensive experiments and error analysis, this approach showed that the maximum detectable depth of the system is greater than 11 m, the orientation error is less than 8.5\u00b0, and the position error is less than 22 mm. A prototype of the system that proved the feasibility of the proposed method was tested. Furthermore, this study provides an alternative CV technology for monitoring construction machines.<\/jats:p>","DOI":"10.3390\/s21134478","type":"journal-article","created":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T02:44:39Z","timestamp":1625107479000},"page":"4478","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Pose Estimation of Excavator Manipulator Based on Monocular Vision Marker System"],"prefix":"10.3390","volume":"21","author":[{"given":"Jiangying","family":"Zhao","sequence":"first","affiliation":[{"name":"National Engineering Laboratory for Highway Maintenance Equipment, Chang\u2019an University, Xi\u2019an 710064, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongbiao","family":"Hu","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Highway Maintenance Equipment, Chang\u2019an University, Xi\u2019an 710064, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingrui","family":"Tian","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Highway Maintenance Equipment, Chang\u2019an University, Xi\u2019an 710064, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,30]]},"reference":[{"key":"ref_1","unstructured":"BLS (2021, January 11). Labor Productivity and Costs, Available online: https:\/\/www.bls.gov\/lpc\/construction.htm."},{"key":"ref_2","unstructured":"MOHURD (2020, November 21). Announcement of the General Office of the Ministry of Housing and Urban-Rural Development on the Production Safety Accidents of Housing and Municipal Engineering in 2019, Available online: http:\/\/www.mohurd.gov.cn\/wjfb\/202006\/t20200624_246031.html."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.autcon.2015.07.022","article-title":"The future of construction automation: Technological disruption and the upcoming ubiquity of robotics","volume":"59","author":"Bock","year":"2015","journal-title":"Autom. Constr."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.aei.2015.02.001","article-title":"Computer vision techniques for construction safety and health monitoring","volume":"29","author":"Seo","year":"2015","journal-title":"Adv. Eng. Inform."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liang, C.-J., Kamat, V.R., and Menassa, C.M. (2018, January 2\u20134). Real-time construction site layout and equipment monitoring. Proceedings of the Construction Research Congress 2018, New Orleans, LA, USA.","DOI":"10.1061\/9780784481264.007"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1061\/(ASCE)CP.1943-5487.0000115","article-title":"Automated trajectory and path planning analysis based on ultra wideband data","volume":"26","author":"Cheng","year":"2012","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.autcon.2012.09.004","article-title":"Automatic spatio-temporal analysis of construction site equipment operations using GPS data","volume":"29","author":"Pradhananga","year":"2013","journal-title":"Autom. Constr."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Mathur, N., Aria, S.S., Adams, T., Ahn, C.R., and Lee, S. (2015, January 21\u201323). Automated cycle time measurement and analysis of excavator\u2019s loading operation using smart phone-embedded IMU sensors. Proceedings of the Computing in Civil Engineering 2015, Austin, TX, USA.","DOI":"10.1061\/9780784479247.027"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1061\/(ASCE)0887-3801(2007)21:4(238)","article-title":"Using hue, saturation, and value color space for hydraulic excavator idle time analysis","volume":"21","author":"Zou","year":"2007","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/j.autcon.2012.03.003","article-title":"Part based model and spatial\u2013temporal reasoning to recognize hydraulic excavators in construction images and videos","volume":"24","author":"McCabe","year":"2012","journal-title":"Autom. Constr."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1061\/(ASCE)CO.1943-7862.0000652","article-title":"Server-customer interaction tracker: Computer vision\u2013based system to estimate dirt-loading cycles","volume":"139","author":"Dickinson","year":"2013","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yuan, C., and Cai, H. (2014, January 23\u201325). Key nodes modeling for object detection and location on construction site using color-depth cameras. Proceedings of the Computing in Civil and Building Engineering, Orlando, FL, USA.","DOI":"10.1061\/9780784413616.091"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"04016038","DOI":"10.1061\/(ASCE)CP.1943-5487.0000602","article-title":"Vision-based excavator detection and tracking using hybrid kinematic shapes and key nodes","volume":"31","author":"Yuan","year":"2017","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.autcon.2017.06.023","article-title":"Skeleton estimation of excavator by detecting its parts","volume":"82","author":"Soltani","year":"2017","journal-title":"Autom. Constr."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.autcon.2015.10.002","article-title":"Automated annotation for visual recognition of construction resources using synthetic images","volume":"62","author":"Soltani","year":"2016","journal-title":"Autom. Constr."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xu, J., Yoon, H.-S., Lee, J.Y., and Kim, S. (2016). Estimation of excavator manipulator position using neural network-based vision system. SAE Tech. Pap.","DOI":"10.4271\/2016-01-8122"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.autcon.2018.11.022","article-title":"Vision-based estimation of excavator manipulator pose for automated grading control","volume":"98","author":"Xu","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.autcon.2019.04.004","article-title":"A vision-based marker-less pose estimation system for articulated construction robots","volume":"104","author":"Liang","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liang, C.-J., Lundeen, K.M., McGee, W., Menassa, C.C., Lee, S., and Kamat, V.R. (2018, January 20\u201325). Stacked Hourglass Networks for Markerless Pose Estimation of Articulated Construction Robots. Proceedings of the 35th International Symposium on Automation and Robotics in Construction (ISARC), Berlin, Germany.","DOI":"10.22260\/ISARC2018\/0120"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liang, C.-J., Lundeen, K.M., McGee, W., Menassa, C.C., Lee, S., and Kamat, V.R. (2019, January 17\u201319). Fast dataset collection approach for articulated equipment pose estimation. Proceedings of the Computing in Civil Engineering 2019, Atlanta, GA, USA.","DOI":"10.1061\/9780784482438.019"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"04020052","DOI":"10.1061\/(ASCE)CP.1943-5487.0000937","article-title":"Synthesizing Pose Sequences from 3D Assets for Vision-Based Activity Analysis","volume":"35","author":"Calderon","year":"2021","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"979","DOI":"10.1111\/mice.12541","article-title":"A sematic and prior-knowledge-aided monocular localization method for construction-related entities","volume":"35","author":"Fang","year":"2020","journal-title":"Comput. Aided Civ. Infrastruct. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Luo, H., Wang, M., Wong, P.K.-Y., Tang, J., and Cheng, J.C.P. (2020, January 18\u201320). Vision-Based Pose Forecasting of Construction Equipment for Monitoring Construction Site Safety. Proceedings of the 18th International Conference on Computing in Civil and Building Engineering (ICCCBE 2020), S\u00e3o Paulo, Brazil.","DOI":"10.1007\/978-3-030-51295-8_78"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"103016","DOI":"10.1016\/j.autcon.2019.103016","article-title":"Full body pose estimation of construction equipment using computer vision and deep learning techniques","volume":"110","author":"Luo","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"103444","DOI":"10.1016\/j.autcon.2020.103444","article-title":"Construction machine pose prediction considering historical motions and activity attributes using gated recurrent unit (GRU)","volume":"121","author":"Luo","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_26","first-page":"213","article-title":"Feasibility of in-plane articulation monitoring of excavator arm using planar marker tracking","volume":"20","author":"Feng","year":"2015","journal-title":"J. Inf. Technol. Constr."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Olson, E. (2011, January 9\u201313). AprilTag: A robust and flexible visual fiducial system. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5979561"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lundeen, K.M., Dong, S., Fredricks, N., Akula, M., and Kamat, V.R. (2015, January 15\u201318). Electromechanical development of a low cost end effector pose estimation system for articulated excavators. Proceedings of the 32nd International Symposium on Automation and Robotics in Construction and Mining (ISARC 2015), Oulu, Finland.","DOI":"10.22260\/ISARC2015\/0081"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.autcon.2016.02.003","article-title":"Optical marker-based end effector pose estimation for articulated excavators","volume":"65","author":"Lundeen","year":"2016","journal-title":"Autom. Constr."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Feng, C., Dong, S., Lundeen, K.M., Xiao, Y., and Kamat, V.R. (2015, January 15\u201318). Vision-based articulated machine pose estimation for excavation monitoring and guidance. Proceedings of the 32nd International Symposium on Automation and Robotics in Construction and Mining (ISARC 2015), Oulu, Finland.","DOI":"10.22260\/ISARC2015\/0029"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.autcon.2018.09.004","article-title":"Camera marker networks for articulated machine pose estimation","volume":"96","author":"Feng","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","unstructured":"Fiala, M. (2005, January 20\u201325). ARTag, a fiducial marker system using digital techniques. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_34","unstructured":"Atcheson, B., Heide, F., and Heidrich, W. (2010, January 15\u201317). Caltag: High precision fiducial markers for camera calibration. Proceedings of the 15th International Workshop on Vision, Modeling and Visualization (VMV 2010), Siegen, Germany."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Sagitov, A., Shabalina, K., Sabirova, L., Li, H., and Magid, E. (2017, January 26\u201328). ARTag, AprilTag and CALTag fiducial marker systems: Comparison in a presence of partial marker occlusion and rotation. Proceedings of the 14th International Conference on Informatics in Control, Automation and Robotics (ICINCO 2017), Madrid, Spain.","DOI":"10.5220\/0006478901820191"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2004). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1109\/TPAMI.2003.1217599","article-title":"Complete solution classification for the perspective-three-point problem","volume":"25","author":"Gao","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"EPnP: An accurate O(n) solution to the pnp problem","volume":"81","author":"Lepetit","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2387","DOI":"10.1109\/TPAMI.2013.36","article-title":"Exhaustive linearization for robust camera pose and focal length estimation","volume":"35","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Triggs, B., McLauchlan, P., Hartley, R., and Fitzgibbon, A. (1999, January 21\u201322). Bundle adjustment\u2014A modern synthesis. Proceedings of the International Workshop on Vision Algorithms (IWVA 1999), Corfu, Greece.","DOI":"10.1007\/3-540-44480-7_21"},{"key":"ref_41","unstructured":"K\u00fcmmerle, R., Grisetti, G., Strasdat, H., Konolige, K., and Burgard, W. (2011, January 9\u201313). G2o: A general framework for graph optimization. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4478\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:23:44Z","timestamp":1760163824000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4478"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,30]]},"references-count":41,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["s21134478"],"URL":"https:\/\/doi.org\/10.3390\/s21134478","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,30]]}}}