{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:16:11Z","timestamp":1760145371886,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T00:00:00Z","timestamp":1721174400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["101016577","RTC2019-007159-5"],"award-info":[{"award-number":["101016577","RTC2019-007159-5"]}]},{"name":"Spanish Ministry of Science and Innovation","award":["101016577","RTC2019-007159-5"],"award-info":[{"award-number":["101016577","RTC2019-007159-5"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>GPUs are commonly used to accelerate the execution of applications in domains such as deep learning. Deep learning applications are applied to an increasing variety of scenarios, with edge computing being one of them. However, edge devices present severe computing power and energy limitations. In this context, the use of remote GPU virtualization solutions is an efficient way to address these concerns. Nevertheless, the limited network bandwidth might be an issue. This limitation can be alleviated by leveraging on-the-fly compression within the communication layer of remote GPU virtualization solutions. In this way, data exchanged with the remote GPU is transparently compressed before being transmitted, thus increasing network bandwidth in practice. In this paper, we present the implementation of a parallel compression pipeline designed to be used within remote GPU virtualization solutions. A thorough performance analysis shows that network bandwidth can be increased by a factor of up to 2\u00d7.<\/jats:p>","DOI":"10.3390\/s24144649","type":"journal-article","created":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T16:35:58Z","timestamp":1721234158000},"page":"4649","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Parallel Compression Pipeline for Improving GPU Virtualization Data Transfers"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3805-4584","authenticated-orcid":false,"given":"Cristian","family":"Pe\u00f1aranda","sequence":"first","affiliation":[{"name":"Departamento de Inform\u00e1tica de Sistemas y Computadores, Universitat Polit\u00e8cnica de Val\u00e8ncia, 46022 Valencia, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7871-9152","authenticated-orcid":false,"given":"Carlos","family":"Rea\u00f1o","sequence":"additional","affiliation":[{"name":"Departament d\u2019Inform\u00e0tica, Escola T\u00e8cnica Superior d\u2019Enginyeria (ETSE-UV), Universitat de Val\u00e8ncia, 46010 Valencia, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6435-1200","authenticated-orcid":false,"given":"Federico","family":"Silla","sequence":"additional","affiliation":[{"name":"Departamento de Inform\u00e1tica de Sistemas y Computadores, Universitat Polit\u00e8cnica de Val\u00e8ncia, 46022 Valencia, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Papadokostaki, K., Mastorakis, G., Panagiotakis, S., Mavromoustakis, C.X., Dobre, C., and Batalla, J.M. (2017). Handling Big Data in the Era of Internet of Things (IoT). Advances in Mobile Cloud Computing and Big Data in the 5G Era, Springer.","DOI":"10.1007\/978-3-319-45145-9_1"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1645","DOI":"10.1016\/j.future.2013.01.010","article-title":"Internet of Things (IoT): A Vision, Architectural Elements, and Future Directions","volume":"29","author":"Gubbi","year":"2013","journal-title":"Future Gener. Comput. Syst. (FGCS)"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1109\/MC.2017.9","article-title":"The Emergence of Edge Computing","volume":"50","author":"Satyanarayanan","year":"2017","journal-title":"Computer"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Capra, M., Peloso, R., Masera, G., Ruo Roch, M., and Martina, M. (2019). Edge Computing: A Survey on the Hardware Requirements in the Internet of Things World. Future Internet, 11.","DOI":"10.3390\/fi11040100"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.future.2022.12.038","article-title":"Using Remote GPU Virtualization Techniques to Enhance Edge Computing Devices","volume":"142","author":"Cecilia","year":"2023","journal-title":"Future Gener. Comput. Syst. (FGCS)"},{"key":"ref_6","unstructured":"NVIDIA Corporation (2024, July 15). CUDA (Compute Unified Device Architecture). Available online: https:\/\/developer.nvidia.com\/cuda-toolkit."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Giunta, G., Montella, R., Agrillo, G., and Coviello, G. (3, January 31). A GPGPU Transparent Virtualization Component for High Performance Computing Clouds. Proceedings of the Euro-Par 2010-Parallel Processing: 16th International Euro-Par Conference, Ischia, Italy.","DOI":"10.1007\/978-3-642-15277-1_37"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"e4072","DOI":"10.1002\/cpe.4072","article-title":"On the Benefits of the Remote GPU Virtualization Mechanism: The rCUDA Case","volume":"29","author":"Silla","year":"2017","journal-title":"Concurr. Comput. Pract. Exp. (CCPE)"},{"key":"ref_9","unstructured":"Duranton, M., De Bosschere, K., Gamrat, C., Maebe, J., Munk, H., and Zendra, O. (2017). The HiPEAC Vision 2017, HiPEAC High-Performance Embedded Architecture and Compilation."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1301","DOI":"10.1016\/j.fusengdes.2007.06.014","article-title":"Real-Time Lossless Data Compression Techniques for Long-Pulse Operation","volume":"82","author":"Vega","year":"2007","journal-title":"Fusion Eng. Des."},{"key":"ref_11","unstructured":"Hansson, E., and Karlsson, S. (2024, July 15). Lossless Message Compression. 2013. Dissertation. Available online: https:\/\/urn.kb.se\/resolve?urn=urn:nbn:se:mdh:diva-21434."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1109\/LCOMM.2014.011214.132319","article-title":"An Efficient and Robust Data Compression Algorithm in Wireless Sensor Networks","volume":"18","author":"Liang","year":"2014","journal-title":"IEEE Commun. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1398","DOI":"10.1109\/TR.2020.2972567","article-title":"Highly Reliable and Low-Complexity Image Compression Scheme Using Neighborhood Correlation Sequence Algorithm in WSN","volume":"69","author":"Uthayakumar","year":"2020","journal-title":"IEEE Trans. Reliab."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Welton, B., Kimpe, D., Cope, J., Patrick, C.M., Iskra, K., and Ross, R. (2011, January 26\u201330). Improving i\/o Forwarding Throughput With Data Compression. Proceedings of the 2011 IEEE International Conference on Cluster Computing (Cluster), Austin, TX, USA.","DOI":"10.1109\/CLUSTER.2011.80"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"866","DOI":"10.1108\/AEAT-06-2015-0152","article-title":"Unlimited and Protected Memory for Flight Data Recorders","volume":"88","author":"Wiseman","year":"2016","journal-title":"Aircr. Eng. Aerosp. Technol. (AEAT)"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Routray, S.K., Javali, A., Sharmila, K., Semunigus, W., Pappa, M., and Ghosh, A.D. (2020, January 3\u20135). Lossless Compression Techniques for Low Bandwidth Networks. Proceedings of the 2020 3rd International Conference on Intelligent Sustainable Systems (ICISS), Thoothukudi, India.","DOI":"10.1109\/ICISS49785.2020.9315936"},{"key":"ref_17","unstructured":"Hu, N. Network Aware Data Transmission with Compression. Proceedings of the Selected Papers from the Proceedings of the Fourth Student Symposium on Computer Systems (SOCS-4), Pittsburgh, PA, USA, 6 October 2001."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/TPDS.2006.3","article-title":"Adaptive On-the-Fly Compression","volume":"17","author":"Krintz","year":"2005","journal-title":"IEEE Trans. Parallel Distrib. Syst. (TPDS)"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Peterson, P.A., and Reiher, P.L. (2016, January 27\u201330). Datacomp: Locally Independent Adaptive Compression for Real-World Systems. Proceedings of the 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS), Nara, Japan.","DOI":"10.1109\/ICDCS.2016.106"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.1109\/TII.2020.2981382","article-title":"Adaptive Multivariate Data Compression in Smart Metering Internet of Things","volume":"17","author":"Chowdhury","year":"2020","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"37105","DOI":"10.1109\/ACCESS.2020.2975929","article-title":"Low-Overhead Compressibility Prediction for High-Performance Lossless Data Compression","volume":"8","author":"Kim","year":"2020","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pe\u00f1aranda, C., Rea\u00f1o, C., and Silla, F. (2022, January 5\u20137). Smash: A Compression Benchmark with AI Datasets from Remote GPU Virtualization Systems. Proceedings of the International Conference on Hybrid Artificial Intelligence Systems (HAIS), Salamanca, Spain.","DOI":"10.1007\/978-3-031-15471-3_21"},{"key":"ref_23","first-page":"e7328","article-title":"Exploring the Use of Data Compression for Accelerating Machine Learning in the Edge with Remote Virtual Graphics Processing Units","volume":"35","author":"Silla","year":"2022","journal-title":"Concurr. Comput. Pract. Exp. (CCPE)"},{"key":"ref_24","unstructured":"Google (2024, July 15). Snappy\u2014A Fast Compressor\/Decompressor. Available online: https:\/\/github.com\/google\/snappy."},{"key":"ref_25","unstructured":"Google (2024, July 15). Gipfeli, a High-Speed Compression Library. Available online: https:\/\/github.com\/google\/gipfeli."},{"key":"ref_26","unstructured":"LZ4 (2022, October 25). Lz4 Website. Available online: https:\/\/lz4.github.io\/lz4\/."},{"key":"ref_27","unstructured":"Oberhumer, M.F. (2022, October 25). Lzo Website. Available online: http:\/\/www.oberhumer.com\/opensource\/lzo\/."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"119847","DOI":"10.1016\/j.ins.2023.119847","article-title":"AFC: An adaptive lossless floating-point compression algorithm in time series database","volume":"654","author":"Chen","year":"2024","journal-title":"Inf. Sci."},{"key":"ref_29","unstructured":"Gao, R., Li, Z., Tan, G., and Li, X. (May, January 27). BeeZip: Towards An Organized and Scalable Architecture for Data Compression. Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, La Jolla, CA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Afroozeh, A., Felius, L., and Boncz, P. (2024, January 10). Accelerating GPU Data Processing using FastLanes Compression. Proceedings of the 20th International Workshop on Data Management on New Hardware, Santiago, Chile.","DOI":"10.1145\/3662010.3663450"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Jaranilla, C., and Choi, J. (2023). Requirements and Trade-Offs of Compression Techniques in Key\u2013Value Stores: A Survey. Electronics, 12.","DOI":"10.3390\/electronics12204280"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Gao, C., Xu, X., Yang, Z., Lin, L., and Li, J. (2023). QZRAM: A Transparent Kernel Memory Compression System Design for Memory-Intensive Applications with QAT Accelerator Integration. Appl. Sci., 13.","DOI":"10.3390\/app131810526"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Karandikar, S., Udipi, A.N., Choi, J., Whangbo, J., Zhao, J., Kanev, S., Lim, E., Alakuijala, J., Madduri, V., and Shao, Y.S. (2023, January 17\u201321). CDPU: Co-designing compression and decompression processing units for hyperscale systems. Proceedings of the 50th Annual International Symposium on Computer Architecture, Orlando, FL, USA.","DOI":"10.1145\/3579371.3589074"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/14\/4649\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:18:37Z","timestamp":1760109517000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/14\/4649"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,17]]},"references-count":33,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["s24144649"],"URL":"https:\/\/doi.org\/10.3390\/s24144649","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,7,17]]}}}