{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T01:26:49Z","timestamp":1778635609900,"version":"3.51.4"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,6,15]],"date-time":"2023-06-15T00:00:00Z","timestamp":1686787200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Math. Softw."],"published-print":{"date-parts":[[2023,6,30]]},"abstract":"<jats:p>We present ATC, a C++ library for advanced Tucker-based lossy compression of dense multidimensional numerical data in a shared-memory parallel setting, based on the sequentially truncated higher-order singular value decomposition (ST-HOSVD) and bit plane truncation. Several techniques are proposed to improve speed, memory usage, error control and compression rate. First, a hybrid truncation scheme is described which combines Tucker rank truncation and TTHRESH quantization. We derive a novel expression to approximate the error of truncated Tucker decompositions in the case of core and factor perturbations. We parallelize the quantization and encoding scheme and adjust this phase to improve error control. Implementation aspects are described, such as an ST-HOSVD procedure using only a single transposition. We also discuss several usability features of ATC, including the presence of multiple interfaces, extensive data type support, and integrated downsampling of the decompressed data. Numerical results show that ATC maintains state-of-the-art Tucker compression rates while providing average speed-up factors of 2.2 to 3.5 and halving memory usage. Our compressor provides precise error control, deviating only 1.4% from the requested error on average. Finally, ATC often achieves higher compression than non-Tucker-based compressors in the high-error domain.<\/jats:p>","DOI":"10.1145\/3585514","type":"journal-article","created":{"date-parts":[[2023,3,1]],"date-time":"2023-03-01T12:04:13Z","timestamp":1677672253000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Algorithm\u00a01036: ATC, An Advanced Tucker Compression Library for Multidimensional Data"],"prefix":"10.1145","volume":"49","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2846-9199","authenticated-orcid":false,"given":"Wouter","family":"Baert","sequence":"first","affiliation":[{"name":"KU Leuven, Belgium"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5692-4163","authenticated-orcid":false,"given":"Nick","family":"Vannieuwenhoven","sequence":"additional","affiliation":[{"name":"KU Leuven, Belgium"}]}],"member":"320","published-online":{"date-parts":[[2023,6,15]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/T-C.1974.223784"},{"key":"e_1_3_2_3_2","unstructured":"Alliance for Open Media. [n.d.]. AV1 Features. Retrieved March 12 2023 from https:\/\/aomedia.org\/av1-features\/."},{"key":"e_1_3_2_4_2","unstructured":"AVIRIS. [n.d.]. Free Data. Retrieved March 12 2023 from https:\/\/aviris.jpl.nasa.gov\/data\/free_data.html."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3378445"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2904063"},{"key":"e_1_3_2_7_2","first-page":"1","article-title":"Lossy volume compression using Tucker truncation and thresholding","author":"Ballester-Ripoll R.","year":"2015","unstructured":"R. Ballester-Ripoll and R. Pajarola. 2015. Lossy volume compression using Tucker truncation and thresholding. The Visual Computer (2015), 1\u201314.","journal-title":"The Visual Computer"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/567806.567807"},{"key":"e_1_3_2_9_2","unstructured":"CCITT. 1992. Information Technology - Digital Compression and Coding of Continuous-Tone Still Images - Requirements and Guidelines. Retrieved March 12 2023 from https:\/\/www.w3.org\/Graphics\/JPEG\/itu-t81.pdf."},{"key":"e_1_3_2_10_2","unstructured":"U.S. National Center for Atmospheric Research. [n.d.]. Hurricane Isabel WRF Model Data Visualization. Retrieved March 12 2023 from https:\/\/www.earthsystemgrid.org\/dataset\/isabeldata.html."},{"key":"e_1_3_2_11_2","volume-title":"The Electrical Engineering Handbook","author":"Chen W.","year":"2004","unstructured":"W. Chen. 2004. The Electrical Engineering Handbook. Elsevier, 906."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1117\/12.2238495"},{"key":"e_1_3_2_13_2","unstructured":"Y. Collet and C. Turner. 2016. Smaller and faster data compression with Zstandard. Retrieved March 12 2023 from https:\/\/engineering.fb.com\/2016\/08\/31\/core-data\/smaller-and-faster-data-compression-with-zstandard\/."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","unstructured":"Gokhan Danabasoglu. 2019. NCAR CESM2 model output prepared for CMIP6 LUMIP deforest-globe. Earth System Grid Federation. 10.22033\/ESGF\/CMIP6.7574","DOI":"10.22033\/ESGF\/CMIP6.7574"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1137\/S0895479896305696"},{"key":"e_1_3_2_16_2","unstructured":"J. Duda. 2009. Asymmetric numeral systems. (2009). arxiv:0902.0271"},{"issue":"1","key":"e_1_3_2_17_2","article-title":"State of the art and future trends in data reduction for high-performance computing","volume":"7","author":"Duwe K.","year":"2020","unstructured":"K. Duwe, J. L\u00fcttgau, G. Mania, J. Squar, A. Fuchs, M. Kuhn, E. Betke, and T. Ludwig. 2020. State of the art and future trends in data reduction for high-performance computing. Supercomputing Frontiers and Innovations 7, 1 (2020). https:\/\/superfri.org\/superfri\/article\/view\/303.","journal-title":"Supercomputing Frontiers and Innovations"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02288367"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1137\/19M128689X"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2004.840301"},{"key":"e_1_3_2_21_2","unstructured":"J. Gailly and M. Adler. [n.d.]. zlib. Retrieved March 12 2023 from http:\/\/zlib.net\/."},{"key":"e_1_3_2_22_2","unstructured":"Google. [n.d.]. Draco 3D Graphics Compression. Retrieved March 12 2023 from https:\/\/google.github.io\/draco\/."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1137\/090764189"},{"key":"e_1_3_2_24_2","unstructured":"Turbulence Database Group. [n.d.]. Johns Hopkins Turbulence Database. Retrieved March 12 2023 from http:\/\/turbulence.pha.jhu.edu\/newcutout.aspx."},{"key":"e_1_3_2_25_2","unstructured":"G. Guennebaud B. Jacob et\u00a0al. [n.d.]. Eigen. Retrieved March 12 2023 from http:\/\/eigen.tuxfamily.org."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02837279"},{"key":"e_1_3_2_27_2","unstructured":"JPEG. 2021. JPEG White Paper: JPEG XL Image Coding System. Retrieved March 12 2023 from http:\/\/ds.jpeg.org\/whitepapers\/jpeg-xl-whitepaper.pdf."},{"key":"e_1_3_2_28_2","unstructured":"B. Kerautret. [n.d.]. TC18-3D Images. Retrieved March 12 2023 from http:\/\/tc18.org\/3D_images.html."},{"key":"e_1_3_2_29_2","unstructured":"G. Kindlmann and A. Alexander. [n.d.]. Diffusion tensor MRI datasets. Retrieved March 12 2023 from http:\/\/www.sci.utah.edu\/gk\/DTI-data\/."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1137\/07070111X"},{"issue":"2","key":"e_1_3_2_31_2","article-title":"Toward a practical perceptual video quality metric","volume":"6","author":"Li Z.","year":"2016","unstructured":"Z. Li, A. Aaron, I. Katsavounidis, A. Moorthy, and M. Manohara. 2016. Toward a practical perceptual video quality metric. The Netflix Tech Blog 6, 2 (2016).","journal-title":"The Netflix Tech Blog"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2018.8622520"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346458"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2006.143"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1137\/19M1284579"},{"key":"e_1_3_2_36_2","unstructured":"MultiCoreWare. [n.d.]. x265. Retrieved March 12 2023 from https:\/\/www.x265.org\/."},{"key":"e_1_3_2_37_2","unstructured":"OpenMP ARB. [n.d.]. OpenMP. Retrieved March 12 2023 from https:\/\/www.openmp.org."},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1137\/090752286"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2915921"},{"key":"e_1_3_2_40_2","unstructured":"V. Prus. [n.d.]. Chapter 31. Boost.Program_options. Retrieved March 12 2023 from https:\/\/www.boost.org\/doc\/libs\/1_75_0\/doc\/html\/program_options.html."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1147\/rd.203.0198"},{"key":"e_1_3_2_42_2","volume-title":"Data Compression: The Complete Reference (4. aufl. ed.)","author":"Salomon D.","year":"2007","unstructured":"D. Salomon. 2007. Data Compression: The Complete Reference (4. aufl. ed.). Springer Verlag London Limited, London."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2015.67"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/584091.584093"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3091966.3091968"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.214"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12102"},{"key":"e_1_3_2_48_2","unstructured":"FFmpeg team. [n.d.]. FFmpeg. Retrieved March 12 2023 from https:\/\/ffmpeg.org\/."},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02289464"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1137\/110836067"},{"key":"e_1_3_2_51_2","volume-title":"HEVC\/H.265 Video Codecs Comparison","author":"Vatolin D.","year":"2016","unstructured":"D. Vatolin, D. Kulikov, M. Erofeev, S. Dolganov, and S. Zvezdakov. 2016. HEVC\/H.265 Video Codecs Comparison. Technical Report. Retrieved March 12, 2023 from http:\/\/compression.ru\/video\/codec_comparison\/hevc_2016\/MSU_HEVC_comparison_2016_free.pdf."},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2003.815165"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE51399.2021.00145"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3369583.3392688"}],"container-title":["ACM Transactions on Mathematical Software"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3585514","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3585514","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:08Z","timestamp":1750178768000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3585514"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,15]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6,30]]}},"alternative-id":["10.1145\/3585514"],"URL":"https:\/\/doi.org\/10.1145\/3585514","relation":{},"ISSN":["0098-3500","1557-7295"],"issn-type":[{"value":"0098-3500","type":"print"},{"value":"1557-7295","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,15]]},"assertion":[{"value":"2022-05-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-14","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}