{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:57:40Z","timestamp":1760241460036,"version":"build-2065373602"},"reference-count":40,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2018,3,28]],"date-time":"2018-03-28T00:00:00Z","timestamp":1522195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005073","name":"Agency for Defense Development","doi-asserted-by":"publisher","award":["#UD150017ID"],"award-info":[{"award-number":["#UD150017ID"]}],"id":[{"id":"10.13039\/501100005073","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Nowadays, unmanned ground vehicles (UGVs) are widely used for many applications. UGVs have sensors including multi-channel laser sensors, two-dimensional (2D) cameras, Global Positioning System receivers, and inertial measurement units (GPS\u2013IMU). Multi-channel laser sensors and 2D cameras are installed to collect information regarding the environment surrounding the vehicle. Moreover, the GPS\u2013IMU system is used to determine the position, acceleration, and velocity of the vehicle. This paper proposes a fast and effective method for modeling nonground scenes using multiple types of sensor data captured through a remote-controlled robot. The multi-channel laser sensor returns a point cloud in each frame. We separated the point clouds into ground and nonground areas before modeling the three-dimensional (3D) scenes. The ground part was used to create a dynamic triangular mesh based on the height map and vehicle position. The modeling of nonground parts in dynamic environments including moving objects is more challenging than modeling of ground parts. In the first step, we applied our object segmentation algorithm to divide nonground points into separate objects. Next, an object tracking algorithm was implemented to detect dynamic objects. Subsequently, nonground objects other than large dynamic ones, such as cars, were separated into two groups: surface objects and non-surface objects. We employed colored particles to model the non-surface objects. To model the surface and large dynamic objects, we used two dynamic projection panels to generate 3D meshes. In addition, we applied two processes to optimize the modeling result. First, we removed any trace of the moving objects, and collected the points on the dynamic objects in previous frames. Next, these points were merged with the nonground points in the current frame. We also applied slide window and near point projection techniques to fill the holes in the meshes. Finally, we applied texture mapping using 2D images captured using three cameras installed in the front of the robot. The results of the experiments prove that our nonground modeling method can be used to model photorealistic and real-time 3D scenes around a remote-controlled robot.<\/jats:p>","DOI":"10.3390\/sym10040083","type":"journal-article","created":{"date-parts":[[2018,3,29]],"date-time":"2018-03-29T05:26:37Z","timestamp":1522301197000},"page":"83","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Multimedia System for Real-Time Photorealistic Nonground Modeling of 3D Dynamic Environment for Remote Control System"],"prefix":"10.3390","volume":"10","author":[{"given":"Phuong","family":"Chu","sequence":"first","affiliation":[{"name":"Department of Multimedia Engineering, Dongguk University-Seoul, 30, Pildongro-1-gil, Jung-gu, Seoul 04620, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0243-2491","authenticated-orcid":false,"given":"Seoungjae","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Multimedia Engineering, Dongguk University-Seoul, 30, Pildongro-1-gil, Jung-gu, Seoul 04620, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sungdae","family":"Sim","sequence":"additional","affiliation":[{"name":"2nd R&D Institute, Agency for Defense Development, P.O. Box 35, Yuseong-gu, Daejeon 34186, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kiho","family":"Kwak","sequence":"additional","affiliation":[{"name":"2nd R&D Institute, Agency for Defense Development, P.O. Box 35, Yuseong-gu, Daejeon 34186, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2219-0848","authenticated-orcid":false,"given":"Kyungeun","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Multimedia Engineering, Dongguk University-Seoul, 30, Pildongro-1-gil, Jung-gu, Seoul 04620, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,3,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lim, J.B., Gil, J.M., and Yu, H.C. (2018). A Distributed Snapshot Protocol for Efficient Artificial Intelligence Computation in Cloud Computing Environments. Symmetry, 10.","DOI":"10.3390\/sym10010030"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lim, J.B., Yu, H.C., and Gil, J.M. (2017). An Efficient and Energy-Aware Cloud Consolidation Algorithm for Multimedia Big Data Applications. Symmetry, 9.","DOI":"10.3390\/sym9090184"},{"key":"ref_3","first-page":"1","article-title":"Powering IoT Devices: A Novel Design and Analysis Technique","volume":"7","author":"Maity","year":"2016","journal-title":"J. Converg."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1186\/s13673-017-0120-7","article-title":"A 3D localisation method in indoor environments for virtual reality applications","volume":"7","author":"Song","year":"2017","journal-title":"Hum. Cent. Comput. Inf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1023\/A:1011295826834","article-title":"Vehicle Teleoperation Interfaces","volume":"11","author":"Fong","year":"2001","journal-title":"Auton. Robots"},{"key":"ref_6","unstructured":"Kogut, G., Blackburn, M., and Everett, H.R. (2003, January 9\u201312). Using Video Sensor Networks to Command and Control Unmanned Ground Vehicles. Proceedings of the AUVSI Unmanned Systems in International Security 2003 (USIS 03), London, UK."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1109\/MRA.2009.932521","article-title":"Mobile robots in mine rescue and recovery","volume":"16","author":"Murphy","year":"2009","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/s40648-017-0073-7","article-title":"Unitization for portability of emergency response surveillance robot system: Experiences and lessons learned from the deployment of the JAEA-3 emergency response robot at the Fukushima Daiichi Nuclear Power Plants","volume":"4","author":"Kawatsuma","year":"2017","journal-title":"ROBOMECH J."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Song, W., Cho, S., Cho, K., Um, K., Won, C.S., and Sim, S. (2014). Traversable Ground Surface Segmentation and Modeling for Real-Time Mobile Mapping. Int. J. Distrib. Sens. Netw., 10.","DOI":"10.1155\/2014\/795851"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chu, P., Cho, S., Fong, S., Park, Y., and Cho, K. (2017). 3D reconstruction framework for multiple remote Robots on cloud system. Symmetry, 9.","DOI":"10.3390\/sym9040055"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3459","DOI":"10.1007\/s11042-013-1669-4","article-title":"Real-time terrain reconstruction using 3D flag map for point clouds","volume":"74","author":"Song","year":"2015","journal-title":"Multimed. Tools Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1177\/0278364910383724","article-title":"Real-Time Photorealistic Virtualized Reality Interface For Remote Mobile Robot Control","volume":"30","author":"Kelly","year":"2011","journal-title":"Int. J. Robot. Res."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., and Stuetzle, W. (1992, January 27\u201331). Surface reconstruction from unorganized points. Proceedings of the ACM SIGGRAPH 1992, Chicago, IL, USA.","DOI":"10.1145\/133994.134011"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1111\/1467-8659.00439","article-title":"Surface reconstruction based on lower dimensional localized Delaunay triangulation","volume":"19","author":"Gopi","year":"2000","journal-title":"Comput. Graph. Forum"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1111\/j.1467-8659.2008.01211.x","article-title":"GPU local triangulation an interpolating surface reconstruction algorithm","volume":"27","author":"Butchart","year":"2008","journal-title":"Comput. Graph. Forum"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cao, T., Nanjappa, A., Gao, M., and Tan, T. (2014, January 14\u201316). A GPU-accelerated algorithm for 3D Delaunay triangulation. Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, San Francisco, CA, USA.","DOI":"10.1145\/2556700.2556710"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Moosmann, F., Pink, O., and Stiller, C. (2009, January 3\u20135). Segmentation of 3D LiDAR Data in non-flat Urban Environments using a Local Convexity Criterion. Proceedings of the IEEE Intelligent Vehicles Symposium, Xi\u2019an, China.","DOI":"10.1109\/IVS.2009.5164280"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hern\u00e1ndez, J., and Marcotegui, B. (2009, January 20\u201322). Point Cloud Segmentation towards Urban Ground Modeling. Proceedings of the 2009 Joint Urban Remote Sensing Event, Shanghai, China.","DOI":"10.1109\/URS.2009.5137562"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Himmelsbach, M., Hundelshausen, F.V., and Wuensche, H. (2010, January 21\u201324). Fast segmentation of 3d point clouds for ground vehicles. Proceedings of the IEEE Intelligent Vehicles Symposium, San Diego, CA, USA.","DOI":"10.1109\/IVS.2010.5548059"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Douillard, B., Underwood, J., Kuntz, N., Vlaskine, V., Quadros, A., Morton, P., and Frenkel, A. (2011, January 9\u201313). On the Segmentation of 3D LiDAR Point Clouds. Proceedings of the IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5979818"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bogoslavskyi, I., and Stachniss, C. (2016, January 9\u201314). Fast range image-based segmentation of sparse 3d laser scans for online operation. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759050"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1109\/TAC.1978.1101790","article-title":"Tracking Methods in a Multi target Environment","volume":"23","year":"1978","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_23","unstructured":"Shalom, Y.B., and Li, X.R. (1995). Multitarget Multisensor Tracking: Principles and Techniques, YBS Publishing."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1109\/9.1299","article-title":"The Interacting Multiple Model Algorithm for Systems with Markovian Switching Coefficients","volume":"33","author":"Blom","year":"1988","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_25","unstructured":"Blackman, S., and Popoli, R. (1999). Design and Analysis of Modem Tracking Systems, Artech House Publishing."},{"key":"ref_26","unstructured":"Wang, C.C., Thorpe, C., and Suppe, A. (2003, January 9\u201311). LADAR-based detection and tracking of moving objects from a ground vehicle at high speeds. Proceedings of the IEEE International Conference on Intelligent Vehicles Symposium, Columbus, OH, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"126","DOI":"10.3182\/20130626-3-AU-2035.00058","article-title":"Multiple Vehicle-like Target Tracking Based on the Velodyne LiDAR","volume":"45","author":"Zhang","year":"2013","journal-title":"IFAC Process. Vol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hwang, S., Kim, N., Cho, Y., Lee, S., and Kweon, I. (2016, January 19\u201322). Fast Multiple Objects Detection and Tracking Fusing Color Camera and 3D LiDAR for Intelligent Vehicles. Proceedings of the International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Xi\u2019an, China.","DOI":"10.1109\/URAI.2016.7625744"},{"key":"ref_29","unstructured":"Monteiro, G., Premebida, C., Peixoto, P., and Nunes, U. (2006, January 9\u201313). Tracking and classification of dynamic obstacles using laser range finder and vision. Proceedings of the International Conference on Intelligent Robots and Systems, Beijing, China."},{"key":"ref_30","unstructured":"Mahlisch, M., Schweiger, R., Ritter, W., and Dietmayer, K. (2006, January 13\u201315). Sensorfusion using spatio-temporal aligned video and LiDAR for improved vehicle detection. Proceedings of the 2006 IEEE Conference on Intelligent Vehicles Symposium, Tokyo, Japan."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Spinello, L., and Siegwart, R. (2008, January 19\u201323). Human detection using multimodal and multidimensional features. Proceedings of the IEEE International Conference on Robotics and Automation, Pasadena, CA, USA.","DOI":"10.1109\/ROBOT.2008.4543708"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1002\/rob.20312","article-title":"LiDAR and vision-based pedestrian detection system","volume":"26","author":"Premebida","year":"2009","journal-title":"J. Field Robot."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1109\/THMS.2013.2283945","article-title":"Person Tracking in Large Public Spaces Using 3-D Range Sensors","volume":"43","author":"Brscic","year":"2013","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Cesic, J., Markovic, I., Juric-Kavelj, S., and Petrovic, I. (2014, January 1\u20133). Detection and Tracking of Dynamic Objects using 3D Laser Range Sensor on a Mobile Platform. Proceedings of the 11th International Conference on Informatics in Control, Automation and Robotics (ICINCO), Vienna, Austria.","DOI":"10.5220\/0005057601100119"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ye, Y., Fu, L., and Li, B. (2016, January 1\u20134). Object Detection and Tracking Using Multi-layer Laser for Autonomous Urban Driving. Proceedings of the 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, Brazil.","DOI":"10.1109\/ITSC.2016.7795564"},{"key":"ref_36","first-page":"491","article-title":"A Fast Ground Segmentation Method for 3D Point Cloud","volume":"13","author":"Chu","year":"2017","journal-title":"J. Inf. Process. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Chu, P.M., Cho, S., Park, Y.W., and Cho, K. (2017, January 16\u201318). Fast point cloud segmentation based on flood-fill algorithm. Proceedings of the 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2017), Daegu, Korea.","DOI":"10.1109\/MFI.2017.8170397"},{"key":"ref_38","unstructured":"Chu, P.M., Cho, S., Nguyen, H.T., Huang, K., Park, Y.W., and Cho, K. (2018). Ubiquitous Multimedia System for Fast Object Segmentation and Tracking Using a Multi-channel Laser Sensor. Cluster Comput., in press."},{"key":"ref_39","first-page":"1","article-title":"Convergent application for trace elimination of dynamic objects from accumulated LiDAR point clouds","volume":"2017","author":"Chu","year":"2017","journal-title":"Multimed. Tools Appl."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Sim, S., Sock, J., and Kwak, K. (2016). Indirect Correspondence-Based Robust Extrinsic Calibration of LiDAR and Camera. Sensors, 16.","DOI":"10.3390\/s16060933"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/10\/4\/83\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:58:52Z","timestamp":1760194732000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/10\/4\/83"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,28]]},"references-count":40,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2018,4]]}},"alternative-id":["sym10040083"],"URL":"https:\/\/doi.org\/10.3390\/sym10040083","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2018,3,28]]}}}