{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:34:45Z","timestamp":1760236485827,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2021,12,5]],"date-time":"2021-12-05T00:00:00Z","timestamp":1638662400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2019YFC0605102"],"award-info":[{"award-number":["2019YFC0605102"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Geospatial three-dimensional (3D) raster data have been widely used for simple representations and analysis, such as geological models, spatio-temporal satellite data, hyperspectral images, and climate data. With the increasing requirements of resolution and accuracy, the amount of geospatial 3D raster data has grown exponentially. In recent years, the processing of large raster data using Hadoop has gained popularity. However, data uploaded to Hadoop are randomly distributed onto datanodes without consideration of the spatial characteristics. As a result, the direct processing of geospatial 3D raster data produces a massive network data exchange among the datanodes and degrades the performance of the cluster. To address this problem, we propose an efficient group-based replica placement policy for large-scale geospatial 3D raster data, aiming to optimize the locations of the replicas in the cluster to reduce the network overhead. An overlapped group scheme was designed for three replicas of each file. The data in each group were placed in the same datanode, and different colocation patterns for three replicas were implemented to further reduce the communication between groups. The experimental results show that our approach significantly reduces the network overhead during data acquisition for 3D raster data in the Hadoop cluster, and maintains the Hadoop replica placement requirements.<\/jats:p>","DOI":"10.3390\/s21238132","type":"journal-article","created":{"date-parts":[[2021,12,6]],"date-time":"2021-12-06T03:10:38Z","timestamp":1638760238000},"page":"8132","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["An Efficient Group-Based Replica Placement Policy for Large-Scale Geospatial 3D Raster Data on Hadoop"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3611-0319","authenticated-orcid":false,"given":"Zhipeng","family":"Liu","sequence":"first","affiliation":[{"name":"School of Geography and Information Engineering, China University of Geosciences, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weihua","family":"Hua","sequence":"additional","affiliation":[{"name":"School of Geography and Information Engineering, China University of Geosciences, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0045-9642","authenticated-orcid":false,"given":"Xiuguo","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Geography and Information Engineering, China University of Geosciences, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong","family":"Liang","sequence":"additional","affiliation":[{"name":"School of Geography and Information Engineering, China University of Geosciences, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yabo","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Geography and Information Engineering, China University of Geosciences, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manxing","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Geography and Information Engineering, China University of Geosciences, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,5]]},"reference":[{"key":"ref_1","unstructured":"Zlatanova, S., Nourian, P., Goncalves, R., and Vo, A.V. (2016, January 21). Towards 3D Raster GIS: On Developing a Raster Engine for Spatial DBMS. Proceedings of the ISPRS WG IV\/2 Workshop, Novosibirsk, Russia."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Nguyen-Gia, T.-A., Dao, M.-S., and Mai-Van, C. (2017, January 24\u201325). A Comparative Survey of 3D GIS Models. Proceedings of the 2017 4th NAFOSTED Conference on Information and Computer Science, Hanoi, Vietnam.","DOI":"10.1109\/NAFOSTED.2017.8108051"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MGRS.2018.2890023","article-title":"Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art","volume":"7","author":"Ghamisi","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2207","DOI":"10.1109\/JPROC.2016.2598228","article-title":"Big Data for Remote Sensing: Challenges and Opportunities","volume":"104","author":"Chi","year":"2016","journal-title":"Proc. IEEE"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1007\/s10586-015-0512-2","article-title":"Geographical Information System Parallelization for Spatial Big Data Processing: A Review","volume":"19","author":"Zhao","year":"2016","journal-title":"Cluster Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.isprsjprs.2015.10.012","article-title":"Geospatial Big Data Handling Theory and Methods: A Review and Research Challenges","volume":"115","author":"Li","year":"2016","journal-title":"ISPRS J. Photogram"},{"key":"ref_7","unstructured":"Apache (2021, September 20). Apache Hadoop. Available online: http:\/\/hadoop.apache.org."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1145\/1517463.1517471","article-title":"PRPL: An Open-Source General-Purpose Parallel Raster Processing Programming Library","volume":"1","author":"Guan","year":"2009","journal-title":"SIGSPATIAL Spec."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2127","DOI":"10.1080\/13658816.2014.911300","article-title":"A Strategy for Raster-Based Geocomputation under Different Parallel Computing Platforms","volume":"28","author":"Qin","year":"2014","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/JSTARS.2016.2547020","article-title":"In-Memory Parallel Processing of Massive Remotely Sensed Data Using an Apache Spark on Hadoop YARN Model","volume":"10","author":"Huang","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4610","DOI":"10.1109\/JSTARS.2015.2424683","article-title":"Real-Time Big Data Analytical Architecture for Remote Sensing Application","volume":"8","author":"Rathore","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yang, M., Song, W., and Mei, H. (2017). Efficient Retrieval of Massive Ocean Remote Sensing Images via a Cloud-Based Mean-Shift Algorithm. Sensors, 17.","DOI":"10.3390\/s17071693"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Fan, J., Yan, J., Ma, Y., and Wang, L. (2018). Big Data Integration in Remote Sensing across a Distributed Metadata-Based Spatial Infrastructure. Remote Sens., 10.","DOI":"10.3390\/rs10010007"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, J., Ye, Z., and Zheng, K. (2021). A Parallel Computing Approach to Spatial Neighboring Analysis of Large Amounts of Terrain Data Using Spark. Sensors, 21.","DOI":"10.3390\/s21020365"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Eldawy, A., Mokbel, M.F., Alharthi, S., Alzaidy, A., Tarek, K., and Ghani, S. (2015, January 13\u201317). SHAHED: A MapReduce-Based System for Querying and Visualizing Spatio-Temporal Satellite Data. Proceedings of the 2015 IEEE 31st ICDE, Seoul, Korea.","DOI":"10.1109\/ICDE.2015.7113427"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1080\/13658816.2015.1131830","article-title":"A Spatiotemporal Indexing Approach for Efficient Processing of Big Array-Based Climate Data with MapReduce","volume":"31","author":"Li","year":"2016","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1080\/17538947.2018.1523957","article-title":"A Hierarchical Indexing Strategy for Optimizing Apache Spark with HDFS to Efficiently Query Big Geospatial Raster Data","volume":"13","author":"Hu","year":"2020","journal-title":"Int. J. Digit. Earth"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1002\/spe.2425","article-title":"XHAMI\u2014Extended HDFS and MapReduce Interface for Big Data Image Processing Applications in Cloud Computing Environments","volume":"47","author":"Kune","year":"2017","journal-title":"Softw. Pract. Exper."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.14778\/2536222.2536227","article-title":"Hadoop GIS: A High Performance Spatial Data Warehousing System over Mapreduce","volume":"6","author":"Aji","year":"2013","journal-title":"Proc. VLDB Endow."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Eldawy, A., and Mokbel, M.F. (2015, January 13\u201317). SpatialHadoop: A MapReduce Framework for Spatial Data. Proceedings of the 2015 IEEE 31st ICDE, Seoul, Korea.","DOI":"10.1109\/ICDE.2015.7113382"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1007\/s10707-018-0325-6","article-title":"ST-Hadoop: A MapReduce Framework for Spatio-Temporal Data","volume":"22","author":"Alarabi","year":"2018","journal-title":"Geoinformatica"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/j.future.2018.10.034","article-title":"An Integrated GIS Platform Architecture for Spatiotemporal Big Data","volume":"94","author":"Wang","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1145\/2934664","article-title":"Apache Spark: A Unified Engine for Big Data Processing","volume":"59","author":"Zaharia","year":"2016","journal-title":"Commun. ACM"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/s10707-018-0330-9","article-title":"Spatial Data Management in Apache Spark: The GeoSpark Perspective and Beyond","volume":"23","author":"Yu","year":"2019","journal-title":"Geoinformatica"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Huang, Z., Chen, Y., Wan, L., and Peng, X. (2017). GeoSpark SQL: An Effective Framework Enabling Spatial Queries on Spark. ISPRS Int. Geo-Inf., 6.","DOI":"10.3390\/ijgi6090285"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.compenvurbsys.2016.12.003","article-title":"A High Performance Query Analytical Framework for Supporting Data-Intensive Climate Studies. Comput. Environ","volume":"62","author":"Li","year":"2017","journal-title":"Urban Syst."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liang, Y., Vo, H., Kong, J., and Wang, F. (2017, January 7\u201310). ISPEED: An Efficient In-Memory Based Spatial Query System for Large-Scale 3D Data with Complex Structures. Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, Redondo Beach, CA, USA.","DOI":"10.1145\/3139958.3139961"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"52452","DOI":"10.1109\/ACCESS.2020.2979597","article-title":"An Efficient Access Model of Massive Spatiotemporal Vehicle Trajectory Data in Smart City","volume":"8","author":"Zhou","year":"2020","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/s10619-015-7173-2","article-title":"Performance Analysis of Data Intensive Cloud Systems Based on Data Management and Replication: A Survey","volume":"34","author":"Malik","year":"2016","journal-title":"Distrib. Parallel Dat."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Wang, W., Meng, D., Yang, X., Zhang, S., Li, J., and Guan, G. (2012, January 1\u20134). A Data Locality Optimization Algorithm for Large-Scale Data Processing in Hadoop. Proceedings of 2012 IEEE Symposium on Computers and Communications (ISCC), Cappadocia, Turkey.","DOI":"10.1109\/ISCC.2012.6249372"},{"key":"ref_31","unstructured":"Eltabakh, M.Y., Tian, Y., \u00d6zcan, F., Gemulla, R., Krettek, A., and McPherson, J. (September, January 29). CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop. Proceedings of the 37th International Conference on Very Large Data Bases (PVLDB), Seattle, WA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Fahmy, M.M., Elghandour, I., and Nagi, M. (2016, January 6\u20139). CoS-HDFS: Co-Locating Geo-Distributed Spatial Data in Hadoop Distributed File System. Proceedings of the 2016 IEEE\/ACM 3rd International Conference on Big Data Computing Applications and Technologies (BDCAT), Shanghai, China.","DOI":"10.1145\/3006299.3006314"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/23\/8132\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:39:55Z","timestamp":1760168395000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/23\/8132"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,5]]},"references-count":32,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["s21238132"],"URL":"https:\/\/doi.org\/10.3390\/s21238132","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,12,5]]}}}