{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T14:55:31Z","timestamp":1761490531932,"version":"3.41.2"},"reference-count":22,"publisher":"ASME International","issue":"3","content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,9,1]]},"abstract":"<jats:p>Modern color and depth (RGB-D) sensing systems are capable of reconstructing convincing virtual representations of real world environments. These virtual reconstructions can be used as the foundation for virtual reality (VR) and augmented reality environments due to their high-quality visualizations. However, a main limitation of modern virtual reconstruction methods is the time it takes to incorporate new data and update the virtual reconstruction. This delay prevents the reconstruction from accurately rendering dynamic objects or portions of the environment (like an engineer performing an inspection of a machinery or laboratory space). The authors propose a multisensor method to dynamically capture objects in an indoor environment. The method automatically aligns the sensors using modern image homography techniques, leverages graphics processing units (GPUs) to process the large number of independent RGB-D data points, and renders them in real time. Incorporating and aligning multiple sensors allows a larger area to be captured from multiple angles, providing a more complete virtual representation of the physical space. Performing processing on GPU's leverages the large number of processing cores available to minimize the delay between data capture and rendering. A case study using commodity RGB-D sensors, computing hardware, and standard transmission control protocol internet connections is presented to demonstrate the viability of the proposed method.<\/jats:p>","DOI":"10.1115\/1.4039472","type":"journal-article","created":{"date-parts":[[2018,3,20]],"date-time":"2018-03-20T22:31:17Z","timestamp":1521585077000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":7,"title":["Dynamic Rendering of Remote Indoor Environments Using Real-Time Point Cloud Data"],"prefix":"10.1115","volume":"18","author":[{"given":"Kevin","family":"Lesniak","sequence":"first","affiliation":[{"name":"Industrial and Manufacturing Engineering, The Pennsylvania State University, University Park, PA 16802 e-mail:"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Conrad S.","family":"Tucker","sequence":"additional","affiliation":[{"name":"Engineering Design, Industrial and Manufacturing Engineering, The Pennsylvania State University, University Park, PA 16802 e-mail:"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"33","published-online":{"date-parts":[[2018,6,12]]},"reference":[{"issue":"1","key":"2019100602303737800_bib1","doi-asserted-by":"publisher","first-page":"27","DOI":"10.3758\/BF03200563","article-title":"How the Eye Measures Reality and Virtual Reality","volume":"29","year":"1997","journal-title":"Behav. Res. Methods, Instrum., Comput."},{"issue":"7","key":"2019100602303737800_bib2","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1109\/MC.2007.257","article-title":"Virtual Reality: How Much Immersion is Enough?","volume":"40","year":"2007","journal-title":"Computer"},{"issue":"4","key":"2019100602303737800_bib3","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1162\/1054746041944830","article-title":"Why Presence Occurs: Evolutionary Psychology, Media Equation, and Presence","volume":"13","year":"2004","journal-title":"Presence: Teleoperators Virtual Environ."},{"issue":"3","key":"2019100602303737800_bib4","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1109\/JSTSP.2014.2381153","article-title":"Fast, Automated, Scalable Generation of Textured 3D Models of Indoor Environments","volume":"9","year":"2015","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"2019100602303737800_bib5","doi-asserted-by":"crossref","unstructured":"Hamzeh, O., and Elnagar, A., 2015, \u201cA Kinect-Based Indoor Mobile Robot Localization,\u201d Tenth International Symposium on Mechatronics and Its Applications (ISMA), Sharjah, United Arab Emirates, Dec. 8\u201310, pp. 1\u20136.10.1109\/ISMA.2015.7373469","DOI":"10.1109\/ISMA.2015.7373469"},{"key":"2019100602303737800_bib6","doi-asserted-by":"crossref","unstructured":"Newcombe, R. A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A., Kohi, P., Shotton, J., Hodges, S., and Fitzgibbon, A., 2011, \u201cKinectFusion: Real-Time Dense Surface Mapping and Tracking,\u201d Tenth IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland, Oct. 26\u201329, pp. 127\u2013136.10.1109\/ISMAR.2011.6092378","DOI":"10.1109\/ISMAR.2011.6092378"},{"year":"2011","key":"2019100602303737800_bib7","article-title":"Kinect Fusion Explorer-WPF C# Sample"},{"issue":"3","key":"2019100602303737800_bib8","doi-asserted-by":"publisher","first-page":"031010","DOI":"10.1115\/1.4035001","article-title":"Immersive Distributed Design Through Real-Time Capture, Translation, and Rendering of Three-Dimensional Mesh Data","volume":"17","year":"2016","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"year":"2016","key":"2019100602303737800_bib9","article-title":"Oculus Rift|Oculus"},{"year":"2016","key":"2019100602303737800_bib10","article-title":"United States Speedtest Market Report"},{"key":"2019100602303737800_bib11","doi-asserted-by":"crossref","unstructured":"Yang, R. S., Chan, Y. H., Gong, R., Nguyen, M., Strozzi, A. G., Delmas, P., Gimel'farb, G., and Ababou, R., 2013, \u201cMulti-Kinect Scene Reconstruction: Calibration and Depth Inconsistencies,\u201d 28th International Conference on Image and Vision Computing New Zealand (IVCNZ), Wellington, New Zealand, Nov. 27\u201329, pp. 47\u201352.10.1109\/IVCNZ.2013.6726991","DOI":"10.1109\/IVCNZ.2013.6726991"},{"key":"2019100602303737800_bib12","doi-asserted-by":"crossref","unstructured":"Asteriadis, S., Chatzitofis, A., Zarpalas, D., Alexiadis, D. S., and Daras, P., 2013, \u201cEstimating Human Motion From Multiple Kinect Sensors,\u201d Sixth International Conference on Computer Vision\/Computer Graphics Collaboration Techniques and Applications (MIRAGE), Berlin, June 6\u20137, Paper No. 3.10.1145\/2466715.2466727","DOI":"10.1145\/2466715.2466727"},{"key":"2019100602303737800_bib13","unstructured":"Harris, C., and Stephens, M., 1988, \u201cA Combined Corner and Edge Detector,\u201d Alvey Vision Conference, Manchester, UK, Aug. 31\u2013Sept. 2, Paper No. 50.http:\/\/citeseer.ist.psu.edu\/viewdoc\/download;jsessionid=8475C77EC4C2AD0EDC7C61C14D189E33?doi=10.1.1.231.1604&rep=rep1&type=pdf"},{"article-title":"Homography Estimation","volume-title":"Master's thesis","year":"2009","key":"2019100602303737800_bib14"},{"year":"2014","key":"2019100602303737800_bib15","article-title":"Accord.NET Framework"},{"issue":"10","key":"2019100602303737800_bib16","doi-asserted-by":"publisher","first-page":"1958","DOI":"10.1017\/S0263574716000631","article-title":"3D-Point-Cloud Registration and Real-World Dynamic Modelling-Based Virtual Environment Building Method for Teleoperation","volume":"35","year":"2017","journal-title":"Robotica"},{"key":"2019100602303737800_bib17","doi-asserted-by":"crossref","unstructured":"Kim, S., and Park, J., 2017, \u201cRobust Haptic Exploration of Remote Environments Represented by Streamed Point Cloud Data,\u201d IEEE World Haptics Conference (WHC), Munich, Germany, June 6\u20139, pp. 358\u2013363.10.1109\/WHC.2017.7989928","DOI":"10.1109\/WHC.2017.7989928"},{"key":"2019100602303737800_bib18","doi-asserted-by":"crossref","unstructured":"Su, P.-C., Xu, W., Shen, J., and Cheung, S. S., 2017, \u201cReal-Time Rendering of Physical Scene on Virtual Curved Mirror With RGB-D Camera Networks,\u201d IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Hong Kong, China, July 10\u201314, pp. 79\u201384.10.1109\/ICMEW.2017.8026256","DOI":"10.1109\/ICMEW.2017.8026256"},{"issue":"1","key":"2019100602303737800_bib19","doi-asserted-by":"publisher","first-page":"011003","DOI":"10.1115\/1.4034324","article-title":"Poisson Mesh Reconstruction for Accurate Object Tracking With Low-Fidelity Point Clouds","volume":"17","year":"2016","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"year":"2014","key":"2019100602303737800_bib20","article-title":"What is Unreal Engine 4"},{"issue":"2","key":"2019100602303737800_bib21","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.displa.2007.09.005","article-title":"Virtual Reality Induced Symptoms and Effects (VRISE): Comparison of Head Mounted Display (HMD), Desktop and Projection Display Systems","volume":"29","year":"2008","journal-title":"Displays"},{"year":"2010","key":"2019100602303737800_bib22","article-title":"GZipStream Class (System.IO.Compression)"}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/doi\/10.1115\/1.4039472\/5997190\/jcise_018_03_031006.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/doi\/10.1115\/1.4039472\/5997190\/jcise_018_03_031006.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,10,6]],"date-time":"2019-10-06T06:30:55Z","timestamp":1570343455000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/doi\/10.1115\/1.4039472\/367946\/Dynamic-Rendering-of-Remote-Indoor-Environments"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,12]]},"references-count":22,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018,9,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4039472","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"type":"print","value":"1530-9827"},{"type":"electronic","value":"1944-7078"}],"subject":[],"published":{"date-parts":[[2018,6,12]]},"article-number":"031006"}}