{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:16:45Z","timestamp":1750220205084,"version":"3.41.0"},"reference-count":17,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2022,6,14]],"date-time":"2022-06-14T00:00:00Z","timestamp":1655164800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGOPS Oper. Syst. Rev."],"published-print":{"date-parts":[[2022,6,14]]},"abstract":"<jats:p>While compression can provide significant storage and cost savings, its use within HPC applications is often only of secondary concern. This is in part due to the inflexibility of existing approaches where a single compression algorithm has to be used throughout the whole application but also because insights into the behaviour of the algorithms within the context of individual applications are missing.<\/jats:p>","DOI":"10.1145\/3544497.3544508","type":"journal-article","created":{"date-parts":[[2022,6,15]],"date-time":"2022-06-15T10:06:57Z","timestamp":1655287617000},"page":"62-69","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Data-Aware Compression for HPC using Machine Learning"],"prefix":"10.1145","volume":"56","author":[{"given":"Julius","family":"Plehn","sequence":"first","affiliation":[{"name":"Universit\u00e4t Hamburg Hamburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anna","family":"Fuchs","sequence":"additional","affiliation":[{"name":"Universit\u00e4t Hamburg Hamburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Kuhn","sequence":"additional","affiliation":[{"name":"Otto von Guericke University Magdeburg Magdeburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jakob","family":"L\u00fcttgau","sequence":"additional","affiliation":[{"name":"University of Tennessee Knoxville Knoxville, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Ludwig","sequence":"additional","affiliation":[{"name":"Deutsches Klimarechenzentrum GmbH Hamburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,6,14]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Cyan4973. 2020. LZ4 - Extremely fast compression. https:\/\/github. com\/lz4\/lz4  Cyan4973. 2020. LZ4 - Extremely fast compression. https:\/\/github. com\/lz4\/lz4"},{"key":"e_1_2_1_2_1","unstructured":"Anna Fuchs. 2019. Enhanced Adaptive Compression in Lustre. https: \/\/wiki.lustre.org\/Enhanced_Adaptive_Compression_in_Lustre  Anna Fuchs. 2019. Enhanced Adaptive Compression in Lustre. https: \/\/wiki.lustre.org\/Enhanced_Adaptive_Compression_in_Lustre"},{"key":"e_1_2_1_3_1","volume-title":"OpenSFS Survey","author":"Roelofs Gailly Greg","year":"2021","unstructured":"Jean-loup Gailly Greg Roelofs and Mark Adler . 2022. OpenSFS Survey March 2021 Results. https:\/\/wiki.opensfs.org\/images\/2\/20\/OpenSFS_ Survey _Results_March_2021.pdf Jean-loup Gailly Greg Roelofs and Mark Adler. 2022. OpenSFS Survey March 2021 Results. https:\/\/wiki.opensfs.org\/images\/2\/20\/OpenSFS_ Survey_Results_March_2021.pdf"},{"key":"e_1_2_1_4_1","unstructured":"Jean-loup Gailly Greg Roelofs and Mark Adler. 2022. zlib Technical Details. https:\/\/zlib.net\/zlib_tech.html  Jean-loup Gailly Greg Roelofs and Mark Adler. 2022. zlib Technical Details. https:\/\/zlib.net\/zlib_tech.html"},{"key":"e_1_2_1_5_1","unstructured":"The HDF Group. 2018. Release of HDF5--1.10.2 - Newsletter #160. https:\/\/www.hdfgroup.org\/2018\/03\/release-of-hdf5--1--10--2- newsletter-160\/  The HDF Group. 2018. Release of HDF5--1.10.2 - Newsletter #160. https:\/\/www.hdfgroup.org\/2018\/03\/release-of-hdf5--1--10--2- newsletter-160\/"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2019.2893940"},{"key":"e_1_2_1_7_1","volume-title":"So Nakagawa, and Tadashi Imanishi.","author":"Kryukov Kirill","year":"2019","unstructured":"Kirill Kryukov , Mahoko Takahashi Ueda , So Nakagawa, and Tadashi Imanishi. 2019 . Sequence Compression Benchmark (SCB) database - a comprehensive evaluation of reference-free compressors for FASTAformatted sequences. bioRxiv (2019). https:\/\/doi.org\/10.1101\/642553 arXiv:https:\/\/www.biorxiv.org\/content\/early\/2019\/12\/27\/642553.full.pdf 10.1101\/642553 Kirill Kryukov, Mahoko Takahashi Ueda, So Nakagawa, and Tadashi Imanishi. 2019. Sequence Compression Benchmark (SCB) database - a comprehensive evaluation of reference-free compressors for FASTAformatted sequences. bioRxiv (2019). https:\/\/doi.org\/10.1101\/642553 arXiv:https:\/\/www.biorxiv.org\/content\/early\/2019\/12\/27\/642553.full.pdf"},{"key":"e_1_2_1_8_1","volume-title":"Improving Energy Efficiency of Scientific Data Compression with Decision Trees. In ENERGY 2020: The Tenth International Conference on Smart Grids, Green Communications and IT Energy-aware Technologies","author":"Kuhn Michael","year":"2020","unstructured":"Michael Kuhn , Julius Plehn , Yevhen Alforov , and Thomas Ludwig . 2020 . Improving Energy Efficiency of Scientific Data Compression with Decision Trees. In ENERGY 2020: The Tenth International Conference on Smart Grids, Green Communications and IT Energy-aware Technologies ( Lisbon, Portugal). IARIA XPS Press, 17--23. https:\/\/www.thinkmind. org\/index.php?view=article&articleid=energy_ 2020_1_40_30038 Michael Kuhn, Julius Plehn, Yevhen Alforov, and Thomas Ludwig. 2020. Improving Energy Efficiency of Scientific Data Compression with Decision Trees. In ENERGY 2020: The Tenth International Conference on Smart Grids, Green Communications and IT Energy-aware Technologies (Lisbon, Portugal). IARIA XPS Press, 17--23. https:\/\/www.thinkmind. org\/index.php?view=article&articleid=energy_2020_1_40_30038"},{"key":"e_1_2_1_9_1","unstructured":"na. 2019. netCDF4 Version 1.6.0. https:\/\/unidata.github.io\/netcdf4- python\/  na. 2019. netCDF4 Version 1.6.0. https:\/\/unidata.github.io\/netcdf4- python\/"},{"key":"e_1_2_1_10_1","unstructured":"na. na. IBM Spectrum Scale File compression. https:\/\/www.ibm.com\/ docs\/en\/spectrum-scale\/5.1.0?topic=systems-file-compression  na. na. IBM Spectrum Scale File compression. https:\/\/www.ibm.com\/ docs\/en\/spectrum-scale\/5.1.0?topic=systems-file-compression"},{"key":"e_1_2_1_11_1","unstructured":"Uli Plechschmidt. 2020. It's lonely at the top: Lustre continues to dominate top 100 fastest supercomputers. https:\/\/community.hpe.com\/t5\/Advantage-EX\/It-s-lonely-atthe- top-Lustre-continues-to-dominate-top-100\/ba-p\/7109668  Uli Plechschmidt. 2020. It's lonely at the top: Lustre continues to dominate top 100 fastest supercomputers. https:\/\/community.hpe.com\/t5\/Advantage-EX\/It-s-lonely-atthe- top-Lustre-continues-to-dominate-top-100\/ba-p\/7109668"},{"key":"e_1_2_1_12_1","volume-title":"Characterization of data compression across CPU platforms and accelerators. Concurrency and Computation: Practice and Experience n\/a, n\/a","author":"Promberger Laura","year":"2021","unstructured":"Laura Promberger , Rainer Schwemmer , and Holger Fr\u00f6ning . 2021. Characterization of data compression across CPU platforms and accelerators. Concurrency and Computation: Practice and Experience n\/a, n\/a ( 2021 ), e6465. https:\/\/doi.org\/10.1002\/cpe.6465 arXiv:https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cpe.6465 10.1002\/cpe.6465 Laura Promberger, Rainer Schwemmer, and Holger Fr\u00f6ning. 2021. Characterization of data compression across CPU platforms and accelerators. Concurrency and Computation: Practice and Experience n\/a, n\/a (2021), e6465. https:\/\/doi.org\/10.1002\/cpe.6465 arXiv:https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cpe.6465"},{"key":"e_1_2_1_13_1","volume-title":"EPJ Web Conf. 245 (2020","author":"Paul Brian","year":"2020","unstructured":"Shadura, Oksana, Bockelman, Brian Paul , Canal, Philippe, Piparo, Danilo, and Zhang, Zhe. 2020 . ROOT I\/O compression improvements for HEP analysis . EPJ Web Conf. 245 (2020 ), 02017. https: \/\/doi.org\/10.1051\/epjconf\/202024502017 10.1051\/epjconf Shadura, Oksana, Bockelman, Brian Paul, Canal, Philippe, Piparo, Danilo, and Zhang, Zhe. 2020. ROOT I\/O compression improvements for HEP analysis. EPJ Web Conf. 245 (2020), 02017. https: \/\/doi.org\/10.1051\/epjconf\/202024502017"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData52589.2021.9671876"},{"key":"e_1_2_1_15_1","unstructured":"Chip Turner Yann Collet. 2016. Smaller and faster data compression with Zstandard. https:\/\/engineering.fb.com\/2016\/08\/31\/core-data\/ smaller-and-faster-data-compression-with-zstandard\/  Chip Turner Yann Collet. 2016. Smaller and faster data compression with Zstandard. https:\/\/engineering.fb.com\/2016\/08\/31\/core-data\/ smaller-and-faster-data-compression-with-zstandard\/"},{"key":"e_1_2_1_16_1","volume-title":"Adaptive lossy compression of climate model data based on hierarchical tensor with Adaptive-HGFDR (v1.0). (06","author":"Yu Zhaoyuan","year":"2020","unstructured":"Zhaoyuan Yu , Zhengfang Zhang , Dongshuang Li , Wen Luo , Yuan Liu , Uzair Bhatti , and Linwang Yuan . 2020. Adaptive lossy compression of climate model data based on hierarchical tensor with Adaptive-HGFDR (v1.0). (06 2020 ). https:\/\/doi.org\/10.5194\/gmd-2020--124 10.5194\/gmd-2020--124 Zhaoyuan Yu, Zhengfang Zhang, Dongshuang Li, Wen Luo, Yuan Liu, Uzair Bhatti, and Linwang Yuan. 2020. Adaptive lossy compression of climate model data based on hierarchical tensor with Adaptive-HGFDR (v1.0). (06 2020). https:\/\/doi.org\/10.5194\/gmd-2020--124"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369583.3392688"}],"container-title":["ACM SIGOPS Operating Systems Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3544497.3544508","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3544497.3544508","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:54Z","timestamp":1750186974000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3544497.3544508"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,14]]},"references-count":17,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,6,14]]}},"alternative-id":["10.1145\/3544497.3544508"],"URL":"https:\/\/doi.org\/10.1145\/3544497.3544508","relation":{},"ISSN":["0163-5980"],"issn-type":[{"type":"print","value":"0163-5980"}],"subject":[],"published":{"date-parts":[[2022,6,14]]},"assertion":[{"value":"2022-06-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}