{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,22]],"date-time":"2026-06-22T22:58:00Z","timestamp":1782169080795,"version":"3.54.5"},"reference-count":47,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,2,12]],"date-time":"2020-02-12T00:00:00Z","timestamp":1581465600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Strategic Priority Research Program of Chinese Academy of Sciences, Project title: CASEarth","award":["XDA19080103"],"award-info":[{"award-number":["XDA19080103"]}]},{"name":"National Key Research and Development Project","award":["2018YFC1504201D"],"award-info":[{"award-number":["2018YFC1504201D"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Mass remote sensing data management and processing is currently one of the most important topics. In this study, we introduce ScienceEarth, a cluster-based data processing framework. The aim of ScienceEarth is to store, manage, and process large-scale remote sensing data in a cloud-based cluster-computing environment. The platform consists of the following three main parts: ScienceGeoData, ScienceGeoIndex, and ScienceGeoSpark. ScienceGeoData stores and manages remote sensing data. ScienceGeoIndex is an index and query system, a spatial index based on quad-tree and Hilbert curve which is combined for heterogeneous tiled remote sensing data that makes efficient data retrieval in ScienceGeoData. ScienceGeoSpark is an easy-to-use computing framework in which we use Apache Spark as the analytics engine for big remote sensing data processing. The result of tests proves that ScienceEarth can efficiently store, retrieve, and process remote sensing data. The results reveal ScienceEarth has the potential and capabilities of efficient big remote sensing data processing.<\/jats:p>","DOI":"10.3390\/rs12040607","type":"journal-article","created":{"date-parts":[[2020,2,20]],"date-time":"2020-02-20T03:20:03Z","timestamp":1582168803000},"page":"607","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":55,"title":["ScienceEarth: A Big Data Platform for Remote Sensing Data Processing"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5452-9941","authenticated-orcid":false,"given":"Chen","family":"Xu","sequence":"first","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0618-0984","authenticated-orcid":false,"given":"Xiaoping","family":"Du","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenzhen","family":"Yan","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiangtao","family":"Fan","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1907","DOI":"10.1109\/JPROC.2012.2190811","article-title":"Very High-resolution remote sensing: Challenges and opportunities point of view","volume":"100","author":"Benediktsson","year":"2012","journal-title":"Proc. IEEE"},{"key":"ref_2","first-page":"67","article-title":"Inversion of the Fraction of Absorbed Photosynthetically Active Radiation (FPAR) from FY-3C MERSI Data","volume":"12","author":"Data","year":"2020","journal-title":"Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6929","DOI":"10.3390\/rs6086929","article-title":"A non-stationary 1981\u20132012 AVHRR NDVI3g time series","volume":"6","author":"Pinzon","year":"2014","journal-title":"Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ansper, A., and Alikas, K. (2019). Retrieval of chlorophyll a from Sentinel-2 MSI data for the European Union water framework directive reporting purposes. Remote Sens., 11.","DOI":"10.3390\/rs11010064"},{"key":"ref_5","first-page":"777","article-title":"A Review: Remote Sensing Sensors","volume":"17","author":"Drahansky","year":"2016","journal-title":"IntechOpen"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/JSTARS.2011.2106332","article-title":"Foreword to the Special Issue on Human Settlements: A Global Remote Sensing Challenge","volume":"4","author":"Gamba","year":"2011","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1360\/N972014-00907","article-title":"Processing of earth observation big data: Challenges and countermeasures","volume":"60","author":"He","year":"2015","journal-title":"Kexue Tongbao Chin. Sci. Bull."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.rse.2015.12.029","article-title":"UAVs as remote sensing platform in glaciology: Present applications and future prospects","volume":"175","author":"Bhardwaj","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_9","first-page":"215","article-title":"New research methods for vegetation information extraction based on visible light remote sensing images from an unmanned aerial vehicle (UAV)","volume":"78","author":"Zhang","year":"2019","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1260","DOI":"10.2112\/JCOASTRES-D-15-00005.1","article-title":"Coastal and Environmental Remote Sensing from Unmanned Aerial Vehicles: An Overview","volume":"315","author":"Klemas","year":"2015","journal-title":"J. Coast. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1002\/gea.20312","article-title":"High-resolution remote sensing and GIS techniques for geobase data supporting archaeological surveys: A case study of ancient doliche, southeast Turkey","volume":"25","author":"Prinz","year":"2010","journal-title":"Geoarchaeology"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5066","DOI":"10.1007\/s11434-014-0645-3","article-title":"Scientific big data and Digital Earth","volume":"59","author":"Guo","year":"2014","journal-title":"Chin. Sci. Bull."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1497","DOI":"10.1109\/TPDS.2014.2322362","article-title":"A parallel file system with application-aware data layout policies for massive remote sensing image processing in digital earth","volume":"26","author":"Wang","year":"2015","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Oliveira, S.F., F\u00fcrlinger, K., and Kranzlm\u00fcller, D. (2012, January 25\u201327). Trends in computation, communication and storage and the consequences for data-intensive science. Proceedings of the 2012 IEEE 14th International Conference on High Performance Computing and Communication & 2012 IEEE 9th International Conference on Embedded Software and Systems, Liverpool, UK.","DOI":"10.1109\/HPCC.2012.83"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.asoc.2017.11.045","article-title":"Computational intelligence in optical remote sensing image processing","volume":"64","author":"Zhong","year":"2018","journal-title":"Appl. Soft Comput. J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1016\/j.ins.2019.06.048","article-title":"RDMA-driven MongoDB: An approach of RDMA enhanced NoSQL paradigm for large-Scale data processing","volume":"502","author":"Huang","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, C., and Yang, W. (2014, January 11\u201314). The distributed storage strategy research of remote sensing image based on Mongo DB. Proceedings of the 2014 3rd International Workshop on Earth Observation and Remote Sensing Applications (EORSA), Changsha, China.","DOI":"10.1109\/EORSA.2014.6927858"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Liu, X., Han, J., Zhong, Y., Han, C., and He, X. (September, January 31). Implementing WebGIS on Hadoop: A case study of improving small file I\/O performance on HDFS. Proceedings of the 2009 IEEE International Conference on Cluster Computing and Workshops, New Orleans, Louisiana.","DOI":"10.1109\/CLUSTR.2009.5289196"},{"key":"ref_19","unstructured":"Lin, F.C., Chung, L.K., Ku, W.Y., Chu, L.R., and Chou, T.Y. (2013, January 25\u201328). The framework of cloud computing platform for massive remote sensing images. Proceedings of the 2013 IEEE 27th International Conference on Advanced Information Networking and Applications (AINA), Barcelona, Spain."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Xiao, Z., and Liu, Y. (2011, January 24\u201326). Remote sensing image database based on NOSQL database. Proceedings of the 2011 19th International Conference on Geoinformatics, Shanghai, China.","DOI":"10.1109\/GeoInformatics.2011.5980724"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.cag.2015.08.005","article-title":"A Survey of Digital Earth","volume":"53","author":"Alderson","year":"2015","journal-title":"Comput. Graph."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fan, J., Yan, J., Ma, Y., and Wang, L. (2018). Big data integration in remote sensing across a distributed metadata-based spatial infrastructure. Remote Sens., 10.","DOI":"10.3390\/rs10010007"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.pmcj.2013.07.001","article-title":"Indexing spatial data in cloud data managements","volume":"15","author":"Wei","year":"2014","journal-title":"Pervasive Mob. Comput."},{"key":"ref_24","first-page":"81830C","article-title":"High-performance computing in remote sensing image compression","volume":"8183","author":"Lin","year":"2011","journal-title":"High. Perform. Comput. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1154","DOI":"10.1016\/j.future.2017.02.044","article-title":"A cloud-based remote sensing data production system","volume":"86","author":"Yan","year":"2018","journal-title":"Futur. Gener. Comput. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1109\/TPDS.2008.105","article-title":"The design of OpenMP tasks","volume":"20","author":"Copty","year":"2009","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1145\/1327452.1327492","article-title":"MapReduce: Simplified data processing on large clusters","volume":"51","author":"Dean","year":"2008","journal-title":"Commun. ACM"},{"key":"ref_28","unstructured":"Lv, Z., Hu, Y., Zhong, H., Wu, J., Li, B., and Zhao, H. (2020, February 11). Parallel K-Means Clustering of Remote Sensing images Based on Mapreduce. Available online: https:\/\/www.researchgate.net\/publication\/220774985_Parallel_K-Means_Clustering_of_Remote_Sensing_Images_Based_on_MapReduce."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/j.future.2016.06.009","article-title":"pipsCloud: High performance cloud computing for remote sensing big data management and processing","volume":"78","author":"Wang","year":"2018","journal-title":"Futur. Gener. Comput. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.rse.2017.06.031","article-title":"Google Earth Engine: Planetary-scale geospatial analysis for everyone","volume":"202","author":"Gorelick","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MGRS.2013.2244672","article-title":"Hyperspectral remote sensing data analysis and future challenges","volume":"1","author":"Plaza","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_32","first-page":"38","article-title":"OpenStack: Toward an Open-source Solution for Cloud Computing","volume":"55","author":"Sefraoui","year":"2012","journal-title":"Int. J. Comput. Appl."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1109\/MITP.2009.40","article-title":"The case for cloud computing","volume":"11","author":"Grossman","year":"2009","journal-title":"IT Prof."},{"key":"ref_34","unstructured":"Borthakur, D. (2020, February 11). HDFS Architecture Guide. Available online: https:\/\/hadoop.apache.org\/docs\/current\/hadoop-project-dist\/hadoop-hdfs\/HdfsDesign.html."},{"key":"ref_35","unstructured":"Vora, M.N. (2011, January 24\u201326). Hadoop-HBase for large-scale data. Proceedings of the 2011 International Conference on Computer Science and Network Technology, Harbin, China."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhang, J., You, S., and Gruenwald, L. (2011, January 23\u201328). Parallel quadtree coding of large-scale raster geospatial data on GPGPUs. Proceedings of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, Gosier, Guadeloupe, France.","DOI":"10.1145\/2093973.2094047"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.procs.2018.03.071","article-title":"An improved distributed storage and query for remote sensing data","volume":"129","author":"Jing","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_38","unstructured":"Vavilapalli, V., and Murthy, A. (2020, February 11). Apache Hadoop Yarn: Yet Another Resource Negotiator Big Data Resources Scheduling. Available online: https:\/\/www.cse.ust.hk\/~weiwa\/teaching\/Fall15-COMP6611B\/reading_list\/YARN.pdf."},{"key":"ref_39","first-page":"95","article-title":"Spark: Cluster computing with working sets","volume":"10","author":"Zaharia","year":"2010","journal-title":"HotCloud"},{"key":"ref_40","first-page":"1","article-title":"MLlib: Machine learning in Apache Spark","volume":"17","author":"Meng","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1007\/s40596-017-0796-z","article-title":"Spark SQL Relational Data Processing in Spark","volume":"41","author":"Qin","year":"2017","journal-title":"Acad. Psychiatry"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhang, Y., and Liu, D. (2012, January 11\u201313). Improving the efficiency of storing for small files in hdfs. Proceedings of the Computer Science & Service System (CSSS), Nanjing, China.","DOI":"10.1109\/CSSS.2012.556"},{"key":"ref_43","first-page":"1759","article-title":"A novel approach in improving I\/O performance of small meteorological files on HDFS","volume":"117","author":"Xue","year":"2012","journal-title":"Appl. Mech. Mater."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Yang, X., Yin, Y., Jin, H., and Sun, X.H. (2014, January 22\u201326). SCALER: Scalable parallel file write in HDFS. Proceedings of the 2014 IEEE International Conference on Cluster Computing (CLUSTER), Madrid, Spain.","DOI":"10.1109\/CLUSTER.2014.6968736"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Chebotko, A., Abraham, J., Brazier, P., Piazza, A., Kashlev, A., and Lu, S. (July, January 28). Storing, indexing and querying large provenance data sets as RDF graphs in apache HBase. Proceedings of the Services (SERVICES), 2013 IEEE Ninth World Congress on Services, Santa Clara, CA, USA.","DOI":"10.1109\/SERVICES.2013.32"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Azqueta-Alzuaz, A., Patino-Martinez, M., Brondino, I., and Jimenez-Peris, R. (2017, January 14\u201317). Massive data load on distributed database systems over HBase. Proceedings of the 2017 17th IEEE\/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), Madrid, Spain.","DOI":"10.1109\/CCGRID.2017.124"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"105194","DOI":"10.1016\/j.compag.2019.105194","article-title":"Mapping soybean planting area in midwest Brazil with remotely sensed images and phenology-based algorithm using the Google Earth Engine platform","volume":"169","author":"Rossi","year":"2020","journal-title":"Comput. Electron. Agric."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/4\/607\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T08:57:02Z","timestamp":1760173022000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/4\/607"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,12]]},"references-count":47,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["rs12040607"],"URL":"https:\/\/doi.org\/10.3390\/rs12040607","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,12]]}}}