{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T12:57:51Z","timestamp":1783688271408,"version":"3.55.0"},"reference-count":42,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2022,10,9]],"date-time":"2022-10-09T00:00:00Z","timestamp":1665273600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"US National Science Foundation (NSF)","award":["CMMI-927475"],"award-info":[{"award-number":["CMMI-927475"]}]},{"name":"US National Science Foundation (NSF)","award":["CMMI-1160937"],"award-info":[{"award-number":["CMMI-1160937"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The visibility available to an equipment operator on a dynamic construction site can often be blocked by various obstacles such as materials, temporary or permanent facilities, other equipment, and workers. Equipment monitoring in real-time digital twins can thus play a crucial role in accident prevention. This paper develops a scalable technical approach and presents a prototype application framework for transmitting real world sensor data to update 3D equipment models inside a graphical digital twin for concurrent visualization of a monitored construction operation. The developed framework and workflow can be extended to visualize any construction operation, as it occurs, inside a dynamic 3D world simply by outfitting the real equipment with appropriate sensors and connecting them to their virtual counterparts. The implemented proof-of-concept interface is described in the context of a real-time 3D digital twin for assisting excavator operators prevent unintended strikes with underground utilities. Experiments to validate the proposed technical approach by simulating the real-time motion of a backhoe loader\u2019s articulated arm using orientation sensors installed on its boom, stick, and bucket are described. The experimental results characterize the scope and potential reasons for spatio-temporal discrepancies that can occur between a monitored real operation and its replicated digital twin. The effect of an operator warning mechanism based on preset safety thresholds is also investigated and described.<\/jats:p>","DOI":"10.3390\/s22197635","type":"journal-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T05:12:21Z","timestamp":1665378741000},"page":"7635","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital Twins"],"prefix":"10.3390","volume":"22","author":[{"given":"Sanat A.","family":"Talmaki","sequence":"first","affiliation":[{"name":"Department of Civil and Environmental Engineering, University of Michigan, Ann Arbor, MI 48109-2125, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0788-5588","authenticated-orcid":false,"given":"Vineet R.","family":"Kamat","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, University of Michigan, Ann Arbor, MI 48109-2125, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,9]]},"reference":[{"key":"ref_1","unstructured":"Mine Safety and Health Administration (2012, October 14). Mining Equipment Camera Installation Tips for Best Results. MSHA Accident Prevention Program, Available online: http:\/\/www.msha.gov\/Accident_Prevention\/newtechnologies\/initiatives\/cameras\/installtips.htm."},{"key":"ref_2","unstructured":"Castro-Lacoutere, D., Irizarry, J., and Arboleda, C.A. (2007, January 6\u20138). Ultra wideband positioning system and method for safety improvement in building construction sites. Proceedings of the American Society of Civil Engineers Construction Research Congress, Grand Bahama Island, The Bahamas."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Lu, M., and Liang, X. (2012, January 17\u201320). Real-Time 3D Positioning and Visualization of Articulated Construction Equipment. Proceedings of the International Conference on Computing in Civil Engineering, Clearwater Beach, FL, USA.","DOI":"10.1061\/9780784412343.0025"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1016\/j.autcon.2005.07.008","article-title":"Teleoperation of construction machines with haptic information for underwater applications","volume":"15","author":"Hirabayashi","year":"2006","journal-title":"Autom. Constr."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1016\/j.autcon.2009.12.012","article-title":"Automating the blind spot measurement of construction equipment","volume":"19","author":"Teizer","year":"2010","journal-title":"Autom. Constr."},{"key":"ref_6","first-page":"247","article-title":"Earthmoving equipment automation: A review of technical advances and future outlook","volume":"22","author":"Azar","year":"2017","journal-title":"J. Inf. Technol. Constr. (ITcon)"},{"key":"ref_7","unstructured":"Brammer, B. (2012, October 14). Dubuque Company Pays $5000 for Violating \u2018One Call\u2019 Law, Available online: http:\/\/www.iowaattorneygeneral.gov\/protecting_environment\/2006\/dubuque_company.html."},{"key":"ref_8","unstructured":"Hanley, R. (2011, June 17). Newark airport is closed as crew cuts power lines.  New York Times, 10 January 1995. Available online: http:\/\/www.nytimes.com\/1995\/01\/10\/nyregion\/newark-airport-is-closed-as-crew-cuts-power-lines.html?pagewanted=2."},{"key":"ref_9","unstructured":"Wilder, F. (2011, October 31). The Fire Down Below. Texas Observer, 2 December 2010. Available online: http:\/\/www.texasobserver.org\/cover-story\/the-fire-down-below."},{"key":"ref_10","unstructured":"WRAL Archives (2011, June 17). Who\u2019s to Blame for Cary Gas Line Rupture?. Available online: http:\/\/www.wral.com\/news\/local\/story\/1916911\/."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/j.autcon.2012.03.003","article-title":"Part based model and spatial\u2013temporal reasoning to recognize hydraulic excavators in construction images and videos","volume":"24","author":"Azar","year":"2012","journal-title":"Autom. Constr."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1016\/j.autcon.2006.03.003","article-title":"Research in automated measurement of project performance indicators","volume":"16","author":"Navon","year":"2007","journal-title":"Autom. Constr."},{"key":"ref_13","unstructured":"Glink, I. (2012, October 14). Backyard digging poses unseen hazards. CBS News, 15 September 2012. Available online: http:\/\/www.cbsnews.com\/8301-505145_162-57507838\/backyard-digging-poses-unseen-hazards."},{"key":"ref_14","unstructured":"PHMSA (2012, October 14). Pipeline Incidents and Mileage Reports\u2014Serious Incidents, Available online: http:\/\/primis.phmsa.dot.gov\/comm\/reports\/safety\/PSI.html."},{"key":"ref_15","unstructured":"BLS, Bureau of Labor Statistics (2022, March 29). Census of Fatal Occupational Injuries (CFOI). 2009\u20132018, Available online: www.bls.gov\/iif\/oshcfoi1.htm."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1061\/(ASCE)0887-3801(2001)15:4(329)","article-title":"Visualizing simulated construction operations in 3D","volume":"15","author":"Kamat","year":"2001","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Huber, D., Herman, H., Kelly, A., Rander, P., and Warner, R. (2009, January 3\u20134). Real-time Photorealistic Visualization of 3D Environments for Enhanced Teleoperation of Vehicles. Proceedings of the 2nd International Conference on 3D Digital Imaging and Modeling, Kyoto, Japan.","DOI":"10.1109\/ICCVW.2009.5457431"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/S0198-9715(00)00025-9","article-title":"Integrating GIS, GPS and GSM technologies for the effective management of ambulances","volume":"25","author":"Derekenaris","year":"2001","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1016\/S0097-8493(96)00040-4","article-title":"A mobile vehicle on-board computing and communication system","volume":"20","author":"Sterzbach","year":"1996","journal-title":"Comput. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/S0198-9715(00)00027-2","article-title":"Examples of vehicle location systems using CORBA-based distributed real-time GPS data and services","volume":"25","author":"Nogueras","year":"2001","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.autcon.2019.04.004","article-title":"A vision-based marker-less pose estimation system for articulated construction robots","volume":"104","author":"Liang","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1061\/(ASCE)CP.1943-5487.0000172","article-title":"Crane Pose Estimation Using UWB Real-Time Location System","volume":"26","author":"Zhang","year":"2012","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1016\/j.autcon.2010.02.009","article-title":"Autonomous pro-active realtime construction worker and equipment operator proximity safety alert system","volume":"19","author":"Teizer","year":"2010","journal-title":"Autom. Constr."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s10514-006-9003-x","article-title":"NIST research in autonomous construction","volume":"22","author":"Lytle","year":"2007","journal-title":"Auton. Robot."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Oloufa, A., Ikeda, M., and Hiroshi, O. (2002, January 23\u201325). GPS-Based wireless collision detection of construction equipment. Proceedings of the 19th International Symposium on Automation and Robotics in Construction (ISARC), Washington, DC, USA.","DOI":"10.22260\/ISARC2002\/0072"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1016\/S0926-5805(99)00008-4","article-title":"Global Positioning System Aided Autonomous Construction Plant Control and Guidance","volume":"8","author":"Roberts","year":"1999","journal-title":"Autom. Constr."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/S0926-5805(99)00058-8","article-title":"High-Precision Application of GPS in the Field of Real-Time Equipment Positioning","volume":"9","author":"Peyret","year":"2000","journal-title":"Autom. Constr."},{"key":"ref_28","unstructured":"Leica Geosystems (2012, October 04). Leica iCON Grade 42\u2014Intelligent Grading Systems. Available online: http:\/\/www.leica-geosystems.com\/en\/Leica-iCON-grade-42_70038.htm."},{"key":"ref_29","unstructured":"(2012, October 04). Trimble GCS900. Grade Control System\u2014The Connected Machine. Available online: http:\/\/www.trimble.com\/construction\/heavy-civil\/machine-control\/grade-control\/."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liang, C.J., Lundeen, K.M., McGee, W., Menassa, C.C., Lee, S., and Kamat, V.R. (2018, January 20\u201325). Stacked hourglass networks for markerless pose estimation of articulated construction robots. Proceedings of the 35th International Symposium on Automation and Robotics in Construction, Berlin, Germany.","DOI":"10.22260\/ISARC2018\/0120"},{"key":"ref_31","unstructured":"Steffen, M.A., Will, J.D., and Murakami, N. (2007, January 17\u201320). Use of Virtual Reality for Teleoperation of Autonomous Vehicles. Proceedings of the American Society of Agricultural and Biological Engineers Biological Sensorics Conference, Summer 2007, Minneapolis, MN, USA. Available online: http:\/\/gem.valpo.edu\/~svl\/research\/pubs\/useofvertualreality.pdf."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/s41693-022-00068-1","article-title":"Real-time state synchronization between physical construction robots and process-level digital twins","volume":"6","author":"Liang","year":"2022","journal-title":"Constr. Robot."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Liang, C.J., McGee, W., Menassa, C., and Kamat, V. (2020, January 27\u201328). Bi-directional communication bridge for state synchronization between digital twin simulations and physical construction robots. Proceedings of the International Symposium on Automation and Robotics in Construction (IAARC), Kitakyushu, Japan.","DOI":"10.22260\/ISARC2020\/0205"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Wang, X., Liang, C.J., Menassa, C., and Kamat, V. (2020, January 27\u201328). Real-time process-level digital twin for collaborative human-robot construction work. Proceedings of the International Symposium on Automation and Robotics in Construction (IAARC), Kitakyushu, Japan.","DOI":"10.22260\/ISARC2020\/0212"},{"key":"ref_35","unstructured":"Beggs, J.S. (1983). Kinematics, Taylor & Francis."},{"key":"ref_36","unstructured":"Garg, A., and Kamat, V.R. (2012, January 1\u20132). Virtual Prototyping for Robotic Fabrication of Rebar Cages in Manufactured Concrete Construction. Proceedings of the 2012 CONVR Conference, Taipei, Taiwan."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1016\/S0097-8493(01)00099-1","article-title":"Lessons from Scene Graphs: Using Scene Graphs to Teach Hierarchical Modeling","volume":"25","author":"Cunningham","year":"2001","journal-title":"Comput. Graph."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1111\/1467-8667.00272","article-title":"Scene Graph and Frame Update Algorithms for Smooth and Scalable 3D Visualization of Simulated Construction Operations","volume":"17","author":"Kamat","year":"2002","journal-title":"J. Comput. -Aided Civ. Infrastruct. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"04014001","DOI":"10.1061\/(ASCE)CP.1943-5487.0000269","article-title":"Real-Time Hybrid Virtuality for Prevention of Excavation Related Utility Strikes","volume":"28","author":"Talmaki","year":"2014","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_40","unstructured":"Caterpillar (2012, October 14). Caterpillar 430E\/430 EIT Backhoe Loader. Available online: http:\/\/www.cat.com\/cda\/layout?m=308397&x=7."},{"key":"ref_41","unstructured":"XSens (2012, October 14). XSens MTw\u2014Wireless Motion Tracker. Available online: http:\/\/www.xsens.com\/images\/stories\/products\/PDF_Brochures\/mtw%20leaflet.pdf."},{"key":"ref_42","unstructured":"Landberg, L. (2012, October 14). Lasers\/GPS Enhance Machine Control. Available online: http:\/\/www.constructionequipment.com\/lasersgps-enhance-machine-control."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7635\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:48:26Z","timestamp":1760143706000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7635"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,9]]},"references-count":42,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22197635"],"URL":"https:\/\/doi.org\/10.3390\/s22197635","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,9]]}}}