{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T20:38:06Z","timestamp":1775248686437,"version":"3.50.1"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,3,31]],"date-time":"2019-03-31T00:00:00Z","timestamp":1553990400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Spatial Algorithms Syst."],"published-print":{"date-parts":[[2019,3,31]]},"abstract":"<jats:p>Effective processing of extremely large volumes of spatial data has led to many organizations employing distributed processing frameworks. Apache Spark is one such open source framework that is enjoying widespread adoption. Within this data space, it is important to note that most of the observational data (i.e., data collected by sensors, either moving or stationary) has a temporal component or timestamp. To perform advanced analytics and gain insights, the temporal component becomes equally important as the spatial and attribute components. In this article, we detail several variants of a spatial join operation that addresses both spatial, temporal, and attribute-based joins. Our spatial join technique differs from other approaches in that it combines spatial, temporal, and attribute predicates in the join operator. In addition, our spatio-temporal join algorithm and implementation differs from others in that it runs in commercial off-the-shelf (COTS) application. The users of this functionality are assumed to be GIS analysts with little if any knowledge of the implementation details of spatio-temporal joins or distributed processing. They are comfortable using simple tools that do not provide the ability to tweak the configuration of the algorithm or processing environment. The spatio-temporal join algorithm behind the tool must always succeed, regardless of input data parameters (e.g., it can be highly irregularly distributed, contain large numbers of coincident points, it can be extremely large, etc.). These factors combine to place additional requirements on the algorithm that are uncommonly found in the traditional research environment. Our spatio-temporal join algorithm was shipped as part of the GeoAnalytics Server [12], part of the ArcGIS Enterprise platform from version 10.5 onward.<\/jats:p>","DOI":"10.1145\/3325135","type":"journal-article","created":{"date-parts":[[2019,6,27]],"date-time":"2019-06-27T12:54:24Z","timestamp":1561640064000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["Distributed Spatial and Spatio-Temporal Join on Apache Spark"],"prefix":"10.1145","volume":"5","author":[{"given":"Randall T.","family":"Whitman","sequence":"first","affiliation":[{"name":"Esri, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bryan G.","family":"Marsh","sequence":"additional","affiliation":[{"name":"Esri, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael B.","family":"Park","sequence":"additional","affiliation":[{"name":"Esri, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Erik G.","family":"Hoel","sequence":"additional","affiliation":[{"name":"Esri, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,6,27]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 4th International Symposium on Advances in Spatial Databases (SSD\u201995)","author":"Abel David J.","year":"1892"},{"key":"e_1_2_1_2_1","volume-title":"Retrieved","year":"2012"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2666310.2666365"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536227"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the VLDB Workshop on Biomedical Data Management and Graph Online Querying (DMAH\u201915)","volume":"9579","author":"Baig Furqan","year":"2015"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3139958.3140019"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/645481.655583"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/846219.847395"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.3390\/ijgi6040096"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 2015 IEEE 31st International Conference on Data Engineering (ICDE\u201915)","volume":"1363","author":"Eldawy Ahmed"},{"key":"e_1_2_1_11_1","volume-title":"Retrieved","year":"2013"},{"key":"e_1_2_1_12_1","volume-title":"Retrieved","year":"2016"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining (KDD\u201996)","author":"Ester Martin","year":"1996"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00288933"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 2013 IEEE International Conference on Big Data. 291--299","author":"Fox A."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/358728.358741"},{"key":"e_1_2_1_17_1","volume-title":"Retrieved","year":"2017"},{"key":"e_1_2_1_18_1","unstructured":"Lars George. 2011. HBase: The Definitive Guide (1st ed.). O\u2019Reilly Media Inc.  Lars George. 2011. HBase: The Definitive Guide (1st ed.). O\u2019Reilly Media Inc."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/602259.602266"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 17th Conference on Database Systems for Business, Technology, and the Web (BTW\u201917)","author":"Hagedorn Stefan","year":"2017"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-002-0067-8"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPP.1994.82"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1206049.1206056"},{"key":"e_1_2_1_24_1","volume-title":"For Real. Retrieved","author":"Kornacker M.","year":"2018"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the International Studies Association Annual Conference","author":"Leetaru Kalev","year":"2013"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/503099.503101"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/15886.15908"},{"key":"e_1_2_1_28_1","unstructured":"Gustavo Niemeyer. 2008. Geohash. Retrieved June 6 2018 from https:\/\/en.wikipedia.org\/wiki\/Geohash.  Gustavo Niemeyer. 2008. Geohash. Retrieved June 6 2018 from https:\/\/en.wikipedia.org\/wiki\/Geohash."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/348.318586"},{"key":"e_1_2_1_30_1","volume-title":"Retrieved","year":"2004"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/0020-0190(82)90027-8"},{"key":"e_1_2_1_32_1","unstructured":"GDELT Project. 2014. The GDELT Project. Retrieved May 3 2018 from https:\/\/www.gdeltproject.org\/.  GDELT Project. 2014. The GDELT Project. Retrieved May 3 2018 from https:\/\/www.gdeltproject.org\/."},{"key":"e_1_2_1_33_1","volume-title":"Retrieved","author":"Raad Mansour","year":"2013"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 13th International Conference on Very Large Data Bases (VLDB\u201987)","author":"Sellis Timos K.","year":"1987"},{"key":"e_1_2_1_35_1","volume-title":"Magellan: Geospatial Analytics on Spark. Retrieved","author":"Sriharsha R.","year":"2015"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007310"},{"key":"e_1_2_1_37_1","unstructured":"New York City Taxi and Limousine Commission. 2016. TLC Trip Record Data. Retrieved May 3 2018 from http:\/\/www.nyc.gov\/html\/tlc\/html\/about\/trip_record_data.shtml.  New York City Taxi and Limousine Commission. 2016. TLC Trip Record Data. Retrieved May 3 2018 from http:\/\/www.nyc.gov\/html\/tlc\/html\/about\/trip_record_data.shtml."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/348.318590"},{"key":"e_1_2_1_39_1","volume-title":"Hadoop: The Definitive Guide","author":"White Tom","year":"2009","edition":"1"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2666310.2666387"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3139958.3139963"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2915237"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDEW.2015.7129541"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2820783.2820860"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing (HotCloud\u201910)","author":"Zaharia Matei","year":"2010"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Renyi Liu Feng Zhang Zhenhong Du Jingwei Zhou and Xinyue Ye. 2016. A new design of high-performance large-scale GIS computing at a finer spatial granularity: A case study of spatial join with spark for sustainability. Sustainability (2071-1050) 8 9 (2016).  Renyi Liu Feng Zhang Zhenhong Du Jingwei Zhou and Xinyue Ye. 2016. A new design of high-performance large-scale GIS computing at a finer spatial granularity: A case study of spatial join with spark for sustainability. Sustainability (2071-1050) 8 9 (2016).","DOI":"10.3390\/su8090926"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the IEEE International Conference on Cluster Computing (CLUSTER\u201909)","author":"Zhang S."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPSW.2012.245"}],"container-title":["ACM Transactions on Spatial Algorithms and Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3325135","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3325135","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:54:16Z","timestamp":1750204456000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3325135"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,31]]},"references-count":48,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,3,31]]}},"alternative-id":["10.1145\/3325135"],"URL":"https:\/\/doi.org\/10.1145\/3325135","relation":{},"ISSN":["2374-0353","2374-0361"],"issn-type":[{"value":"2374-0353","type":"print"},{"value":"2374-0361","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,31]]},"assertion":[{"value":"2018-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-06-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}