{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T15:40:17Z","timestamp":1783784417747,"version":"3.55.0"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2025,2,10]],"date-time":"2025-02-10T00:00:00Z","timestamp":1739145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["OAC-2104023, OAC-2311875, OAC-2311876, OAC-2311878, OAC-2344717"],"award-info":[{"award-number":["OAC-2104023, OAC-2311875, OAC-2311876, OAC-2311878, OAC-2344717"]}]},{"name":"U.S. Department of Energy, Office of Science, Advanced Scientific Computing Research","award":["DE-AC02-06CH11357"],"award-info":[{"award-number":["DE-AC02-06CH11357"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2025,2,10]]},"abstract":"<jats:p>Many scientific applications opt for particles instead of meshes as their basic primitives to model complex systems composed of billions of discrete entities. Such applications span a diverse array of scientific domains, including molecular dynamics, cosmology, computational fluid dynamics, and geology. The scale of the particles in those scientific applications increases substantially thanks to the ever-increasing computational power in high-performance computing (HPC) platforms. However, the actual gains from such increases are often undercut by obstacles in data management systems related to data storage, transfer, and processing. Lossy compression has been widely recognized as a promising solution to enhance scientific data management systems regarding such challenges, although most existing compression solutions are tailored for Cartesian grids and thus have sub-optimal results on discrete particle data. In this paper, we introduce LCP, an innovative lossy compressor designed for particle datasets, offering superior compression quality and higher speed than existing compression solutions. Specifically, our contribution is threefold. (1) We propose LCP-S, an error-bound aware block-wise spatial compressor to efficiently reduce particle data size while satisfying the pre-defined error criteria. This approach is universally applicable to particle data across various domains, eliminating the need for reliance on specific application domain characteristics. (2) We develop LCP, a hybrid compression solution for multi-frame particle data, featuring dynamic method selection and parameter optimization. It aims to maximize compression effectiveness while preserving data quality as much as possible by utilizing both spatial and temporal domains. (3) We evaluate our solution alongside eight state-of-the-art alternatives on eight real-world particle datasets from seven distinct domains. The results demonstrate that our solution achieves up to 104% improvement in compression ratios and up to 593% increase in speed compared to the second-best option, under the same error criteria.<\/jats:p>","DOI":"10.1145\/3709700","type":"journal-article","created":{"date-parts":[[2025,2,11]],"date-time":"2025-02-11T15:45:06Z","timestamp":1739288706000},"page":"1-27","source":"Crossref","is-referenced-by-count":6,"title":["LCP: Enhancing Scientific Data Management with\n                    <u>L<\/u>\n                    ossy\n                    <u>C<\/u>\n                    ompression for\n                    <u>P<\/u>\n                    articles"],"prefix":"10.1145","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-3318-8059","authenticated-orcid":false,"given":"Longtao","family":"Zhang","sequence":"first","affiliation":[{"name":"Florida State University, Tallahassee, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5141-9815","authenticated-orcid":false,"given":"Ruoyu","family":"Li","sequence":"additional","affiliation":[{"name":"Florida State University, Tallahassee, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-6285-7271","authenticated-orcid":false,"given":"Congrong","family":"Ren","sequence":"additional","affiliation":[{"name":"The Ohio State University, Columbus, Ohio, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7339-5256","authenticated-orcid":false,"given":"Sheng","family":"Di","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, Illinois, USA, &amp; The University of Chicago, Chicago, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0177-502X","authenticated-orcid":false,"given":"Jinyang","family":"Liu","sequence":"additional","affiliation":[{"name":"University of Houston, Houston, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5092-3987","authenticated-orcid":false,"given":"Jiajun","family":"Huang","sequence":"additional","affiliation":[{"name":"University of California Riverside, Riverside, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1464-729X","authenticated-orcid":false,"given":"Robert","family":"Underwood","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, Illinois, USA, &amp; The University of Chicago, Chicago, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2192-3843","authenticated-orcid":false,"given":"Pascal","family":"Grosset","sequence":"additional","affiliation":[{"name":"Los Alamos National Laboratory, Los Alamos, New Mexico, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5422-4497","authenticated-orcid":false,"given":"Dingwen","family":"Tao","sequence":"additional","affiliation":[{"name":"Indiana University, Bloomington, Indiana, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0630-1600","authenticated-orcid":false,"given":"Xin","family":"Liang","sequence":"additional","affiliation":[{"name":"University of Kentucky, Lexington, Kentucky, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7776-1834","authenticated-orcid":false,"given":"Hanqi","family":"Guo","sequence":"additional","affiliation":[{"name":"The Ohio State University, Columbus, Ohio, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7890-3934","authenticated-orcid":false,"given":"Franck","family":"Cappello","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, Illinois, USA, &amp; The University of Chicago, Chicago, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5328-3962","authenticated-orcid":false,"given":"Kai","family":"Zhao","sequence":"additional","affiliation":[{"name":"Florida State University, Tallahassee, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,2,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132758"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3231935"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007279"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","unstructured":"Timothy J. Boerner Stephen Deems Thomas R. Furlani Shelley L. Knuth and John Towns. 2023. ACCESS: Advancing Innovation: NSF's Advanced Cyberinfrastructure Coordination Ecosystem: Services & Support. In Practice and Experience in Advanced Research Computing 2023: Computing for the Common Good (Portland OR USA) (PEARC '23). Association for Computing Machinery New York NY USA 173--176. https:\/\/doi.org\/10.1145\/3569951.3597559","DOI":"10.1145\/3569951.3597559"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094342018762036"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-005-0163-7"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2593673"},{"key":"e_1_2_1_8_1","first-page":"2","article-title":"A Demonstration of SciDB","volume":"2","author":"P. Cudre-Mauroux","year":"2009","unstructured":"P. Cudre-Mauroux et al. 2009. A Demonstration of SciDB: A Science-Oriented DBMS. Proc. VLDB Endow., Vol. 2, 2 (Aug. 2009), 1534--1537.","journal-title":"A Science-Oriented DBMS. Proc. VLDB Endow."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318221"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687645"},{"key":"e_1_2_1_11_1","unstructured":"YiiP equilibrium dataset. 2024. https:\/\/www.mdanalysis.org\/MDAnalysisData\/yiip_equilibrium.html\/. Online."},{"key":"e_1_2_1_12_1","volume-title":"EXAALT: MOLECULAR DYNAMICS AT EXASCALE FOR MATERIALS SCIENCE. https:\/\/www.exascaleproject.org\/research-project\/exaalt\/. Online.","author":"EXAALT","year":"2021","unstructured":"EXAALT project. 2021. EXAALT: MOLECULAR DYNAMICS AT EXASCALE FOR MATERIALS SCIENCE. https:\/\/www.exascaleproject.org\/research-project\/exaalt\/. Online."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE51399.2021.00066"},{"key":"e_1_2_1_14_1","unstructured":"Lustre file system. [n. d.]. http:\/\/lustre.org\/. Online."},{"key":"e_1_2_1_15_1","unstructured":"FZ Lossy Compression Framework. 2024. https:\/\/szcompressor.org\/next.szcompressor.github.io\/. Online."},{"key":"e_1_2_1_16_1","unstructured":"Google Draco. 2024. https:\/\/google.github.io\/draco. Online."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1107499.1107503"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3015569"},{"key":"e_1_2_1_19_1","unstructured":"HDF5. 2024. HDF5. https:\/\/www.hdfgroup.org\/solutions\/hdf5\/. Online."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/LDAV53230.2021.00011"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465273"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/jcc.24405"},{"key":"e_1_2_1_23_1","unstructured":"IBM General Parallel File System. 2024. https:\/\/www.ibm.com\/docs\/en\/gpfs. Online."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.14778\/3236187.3236215"},{"key":"e_1_2_1_25_1","volume-title":"Scalable Model-Based Management of Correlated Dimensional Time Series in ModelarDB. In 2021 IEEE 37th International Conference on Data Engineering (ICDE). 1380--1391","author":"Jensen Soren Kejser","year":"2021","unstructured":"Soren Kejser Jensen, Torben Bach Pedersen, and Christian Thomsen. 2021. Scalable Model-Based Management of Correlated Dimensional Time Series in ModelarDB. In 2021 IEEE 37th International Conference on Data Engineering (ICDE). 1380--1391."},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Pu Jiao Sheng Di Hanqi Guo Kai Zhao Jiannan Tian Dingwen Tao Xin Liang and Franck Cappello. 2023. Toward Quantity-of-Interest Preserving Lossy Compression for Scientific Data. In nternational Conference on Very Large Data Bases (VLDB).","DOI":"10.14778\/3574245.3574255"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/3571885.3571966"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.14778\/3402755.3402799"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-42057-3_4"},{"key":"e_1_2_1_30_1","unstructured":"Sandia National Laboratories. 2021. Lennard-Jones liquid benchmark on LAMMPS. https:\/\/lammps.sandia.gov\/bench.html#lj. Online."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2003.1260811"},{"key":"e_1_2_1_32_1","volume-title":"Optimizing Lossy Compression with Adjacent Snapshots for N-body Simulation Data. In 2018 IEEE International Conference on Big Data (Big Data). 428--437","author":"Li Sihuan","year":"2018","unstructured":"Sihuan Li, Sheng Di, Xin Liang, Zizhong Chen, and Franck Cappello. 2018a. Optimizing Lossy Compression with Adjacent Snapshots for N-body Simulation Data. In 2018 IEEE International Conference on Big Data (Big Data). 428--437."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS54959.2023.00104"},{"key":"e_1_2_1_34_1","volume-title":"Deep Representation Learning for Trajectory Similarity Computation. In 2018 IEEE 34th International Conference on Data Engineering (ICDE). 617--628","author":"Li Xiucheng","year":"2018","unstructured":"Xiucheng Li, Kaiqi Zhao, Gao Cong, Christian S. Jensen, and Wei Wei. 2018b. Deep Representation Learning for Trajectory Similarity Computation. In 2018 IEEE 34th International Conference on Data Engineering (ICDE). 617--628."},{"key":"e_1_2_1_35_1","volume-title":"Error-Controlled Lossy Compression Optimized for High Compression Ratios of Scientific Datasets. 2018 IEEE International Conference on Big Data (Big Data)","author":"Liang Xin","year":"2018","unstructured":"Xin Liang, Sheng Di, Dingwen Tao, Sihuan Li, Shaomeng Li, Hanqi Guo, Z. Chen, and F. Cappello. 2018. Error-Controlled Lossy Compression Optimized for High Compression Ratios of Scientific Datasets. 2018 IEEE International Conference on Big Data (Big Data) (2018), 438--447."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2021.3092201"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Xin Liang Kai Zhao Sheng Di Sihuan Li Robert Underwood Ali M Gok Jiannan Tian Junjing Deng Jon C Calhoun Dingwen Tao et al. 2022b. SZ3: A modular framework for composing prediction-based error-bounded lossy compressors. https:\/\/arxiv.org\/abs\/2111.02925. IEEE Transactions on Big Data (2022). Online.","DOI":"10.1109\/TBDATA.2022.3201176"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346458"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/Cluster48925.2021.00034"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the VLDB Endowment","volume":"8","author":"Long Cheng","year":"2014","unstructured":"Cheng Long, Raymond Wong, and H.V. Jagadish. 2014. Trajectory simplification: On minimizing the directionbased error. Proceedings of the VLDB Endowment, Vol. 8 (01 2014), 49--60."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1002\/jcc.23495"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939856"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1021\/ct050285b"},{"key":"e_1_2_1_44_1","unstructured":"MPEG G-PCC. 2024. https:\/\/github.com\/MPEGGroup\/mpeg-pcc-tmc13. Online."},{"key":"e_1_2_1_45_1","unstructured":"MPEG V-PCC. 2024. https:\/\/github.com\/MPEGGroup\/mpeg-pcc-tmc2. Online."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0010-4655(00)00083-7"},{"key":"e_1_2_1_47_1","first-page":"12","article-title":"Gorilla: A Fast, Scalable, in-Memory Time Series Database","volume":"8","author":"Tuomas Pelkonen","year":"2015","unstructured":"Tuomas Pelkonen et al. 2015. Gorilla: A Fast, Scalable, in-Memory Time Series Database. Proc. VLDB Endow., Vol. 8, 12 (Aug. 2015), 1816--1827.","journal-title":"Proc. VLDB Endow."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1006\/jcph.1995.1039"},{"key":"e_1_2_1_49_1","unstructured":"HACC Outer Rim simulation dataset. 2024. https:\/\/cosmology.alcf.anl.gov\/outerrim\/. Online."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2221191"},{"key":"e_1_2_1_51_1","unstructured":"Purdue Anvil supercomputer. 2024. https:\/\/www.rcac.purdue.edu\/anvil. Online."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2017.8257962"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.5555\/2588198"},{"key":"e_1_2_1_54_1","unstructured":"The Stanford bunny. 2024. https:\/\/graphics.stanford.edu\/data\/3Dscanrep\/. Online."},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Jiannan Tian Sheng Di Xiaodong Yu Cody Rivera Kai Zhao Sian Jin Yunhe Feng Xin Liang Dingwen Tao and Franck Cappello. 2021. Optimizing Error-Bounded Lossy Compression for Scientific Data on GPUs. https:\/\/arxiv.org\/abs\/2105.12912. Online.","DOI":"10.1109\/Cluster48925.2021.00047"},{"key":"e_1_2_1_56_1","unstructured":"USGS 3D Elevation Program. 2024. https:\/\/www.usgs.gov\/3d-elevation-program. Online."},{"key":"e_1_2_1_57_1","unstructured":"USGS 3DEP S3 dataset. 2024. https:\/\/www.usgs.gov\/news\/technical-announcement\/usgs-3dep-lidar-point-cloud-now-available-amazon-public-dataset\/. Online."},{"key":"e_1_2_1_58_1","unstructured":"WarpX. 2024. https:\/\/ecp-warpx.github.io\/\/. Online."},{"key":"e_1_2_1_59_1","doi-asserted-by":"crossref","unstructured":"Xinyang Yu et al. 2020. Two-Level Data Compression using Machine Learning in Time Series Database. In 36th IEEE International Conference on Data Engineering. 1333--1344.","DOI":"10.1109\/ICDE48307.2020.00119"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE51399.2021.00145"},{"key":"e_1_2_1_61_1","volume-title":"SDRBench: Scientific Data Reduction Benchmark for Lossy Compressors. In 2020 IEEE International Conference on Big Data (Big Data). 2716--2724","author":"Zhao Kai","year":"2020","unstructured":"Kai Zhao, Sheng Di, Xin Liang, Sihuan Li, Dingwen Tao, Julie Bessac, Zizhong Chen, and Franck Cappello. 2020. SDRBench: Scientific Data Reduction Benchmark for Lossy Compressors. In 2020 IEEE International Conference on Big Data (Big Data). 2716--2724."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE53745.2022.00007"},{"key":"e_1_2_1_63_1","unstructured":"Zstandard. 2021. Zstandard - Real-time data compression algorithm. https:\/\/github.com\/facebook\/zstd\/releases. Online."}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3709700","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3709700","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T18:18:09Z","timestamp":1774981089000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3709700"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,10]]},"references-count":63,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,2,10]]}},"alternative-id":["10.1145\/3709700"],"URL":"https:\/\/doi.org\/10.1145\/3709700","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,10]]}}}