{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T19:11:09Z","timestamp":1772910669136,"version":"3.50.1"},"reference-count":30,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,2,22]],"date-time":"2024-02-22T00:00:00Z","timestamp":1708560000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["U22A2027, 61832020, 61821003"],"award-info":[{"award-number":["U22A2027, 61832020, 61821003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Technol."],"published-print":{"date-parts":[[2024,2,29]]},"abstract":"<jats:p>Consistent Hashing (CH) algorithms are widely adopted in networks and distributed systems for their ability to achieve load balancing and minimize disruptions. However, the rise of the Internet of Things (IoT) has introduced new challenges for existing CH algorithms, characterized by high memory usage and update overhead. This article presents DxHash, a novel CH algorithm based on repeated pseudo-random number generation. DxHash offers significant benefits, including a remarkably low memory footprint, high lookup throughput, and minimal update overhead. Additionally, we introduce a weighted variant of DxHash, enabling adaptable weight adjustments to handle heterogeneous load distribution. Through extensive evaluation, we demonstrate that DxHash outperforms AnchorHash, a state-of-the-art CH algorithm, in terms of the reduction of up to 98.4% in memory footprint and comparable performance in lookup and update.<\/jats:p>","DOI":"10.1145\/3631708","type":"journal-article","created":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T18:32:27Z","timestamp":1699036347000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["DxHash: A Memory-saving Consistent Hashing Algorithm"],"prefix":"10.1145","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9965-0852","authenticated-orcid":false,"given":"Chao","family":"Dong","sequence":"first","affiliation":[{"name":"WNLO, Key Laboratory of Information Storage System, Engineering Research Center of Data Storage Systems and Technology (School of Computer Science &amp; Technology, Huazhong University of Science &amp; Technology), Ministry of Education of China, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2791-4158","authenticated-orcid":false,"given":"Fang","family":"Wang","sequence":"additional","affiliation":[{"name":"WNLO, Key Laboratory of Information Storage System, Engineering Research Center of Data Storage Systems and Technology (School of Computer Science &amp; Technology, Huazhong University of Science &amp; Technology), Ministry of Education of China, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4674-6006","authenticated-orcid":false,"given":"Dan","family":"Feng","sequence":"additional","affiliation":[{"name":"WNLO, Key Laboratory of Information Storage System, Engineering Research Center of Data Storage Systems and Technology (School of Computer Science &amp; Technology, Huazhong University of Science &amp; Technology), Ministry of Education of China, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,2,22]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/2632296"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/1041680.1041681"},{"key":"e_1_3_2_4_2","article-title":"Multi-probe consistent hashing","author":"Appleton Ben","year":"2015","unstructured":"Ben Appleton and Michael O\u2019Reilly. 2015. Multi-probe consistent hashing. arXiv preprint arXiv:1505.00062 (2015).","journal-title":"arXiv preprint arXiv:1505.00062"},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","unstructured":"Elaine B. Barker William C. Barker William E. Burr W. Timothy Polk and Miles E. Smid. 2007. SP 800-57. Recommendation for Key Management Part 1: General (Revised) Technical Report National Institute of Standards & Technology Gaithersburg MD.","DOI":"10.6028\/NIST.SP.800-57p1r2007"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3297858.3304022"},{"key":"e_1_3_2_7_2","unstructured":"Cisco. 2020. Cisco Annual Internet Report (2018\u20132023) White Paper. https:\/\/www.cisco.com\/c\/en\/us\/solutions\/collateral\/executive-perspectives\/annual-internet-report\/white-paper-c11-741490.pdf"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/1323293.1294281"},{"key":"e_1_3_2_9_2","first-page":"523","volume-title":"13th USENIX Symposium on Networked Systems Design and Implementation (NSDI\u201916)","author":"Eisenbud Daniel E.","year":"2016","unstructured":"Daniel E. Eisenbud, Cheng Yi, Carlo Contavalli, Cody Smith, Roman Kononov, Eric Mann-Hielscher, Ardas Cilingiroglu, Bin Cheyney, Wentao Shang, and Jinnah Dylan Hosein. 2016. Maglev: A fast and reliable software network load balancer. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI\u201916). USENIX Association, Santa Clara, CA, 523\u2013535. https:\/\/www.usenix.org\/conference\/nsdi16\/technical-sessions\/presentation\/eisenbud"},{"key":"e_1_3_2_10_2","first-page":"559","volume-title":"Intelligence Science and Big Data Engineering. Big Data and Machine Learning Techniques","author":"Fu Xiang","year":"2015","unstructured":"Xiang Fu, Can Peng, and Weihong Han. 2015. A consistent hashing based data redistribution algorithm. In Intelligence Science and Big Data Engineering. Big Data and Machine Learning Techniques, Xiaofei He, Xinbo Gao, Yanning Zhang, Zhi-Hua Zhou, Zhi-Yong Liu, Baochuan Fu, Fuyuan Hu, and Zhancheng Zhang (Eds.). Springer International Publishing, Cham, 559\u2013566."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/CloudCom.2017.49"},{"key":"e_1_3_2_12_2","volume-title":"USENIX Workshop on Hot Topics in Edge Computing (HotEdge\u201918)","author":"Gupta Harshit","year":"2018","unstructured":"Harshit Gupta, Zhuangdi Xu, and Umakishore Ramachandran. 2018. DataFog: Towards a holistic data management platform for the IoT age at the network edge. In USENIX Workshop on Hot Topics in Edge Computing (HotEdge\u201918). USENIX Association, Boston, MA. https:\/\/www.usenix.org\/conference\/hotedge18\/presentation\/gupta"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/258533.258660"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1389-1286(99)00055-9"},{"key":"e_1_3_2_15_2","first-page":"1360","volume-title":"Proceedings of the 22nd International Joint Conference on Artificial Intelligence, Volume 2 (IJCAI\u201911)","author":"Kumar Shaishav","year":"2011","unstructured":"Shaishav Kumar and Raghavendra Udupa. 2011. Learning hash functions for cross-view similarity search. In Proceedings of the 22nd International Joint Conference on Artificial Intelligence, Volume 2 (IJCAI\u201911). AAAI Press, 1360\u20131365."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/1773912.1773922"},{"key":"e_1_3_2_17_2","unstructured":"John Lamping and Eric Veach. 2014. A Fast Minimal Memory Consistent Hash Algorithm. (2014). arxiv:cs.DS\/1406.2294"},{"key":"e_1_3_2_18_2","first-page":"143","volume-title":"17th USENIX Conference on File and Storage Technologies (FAST\u201919)","author":"Liu Zaoxing","year":"2019","unstructured":"Zaoxing Liu, Zhihao Bai, Zhenming Liu, Xiaozhou Li, Changhoon Kim, Vladimir Braverman, Xin Jin, and Ion Stoica. 2019. DistCache: Provable load balancing for large-scale storage systems with distributed caching. In 17th USENIX Conference on File and Storage Technologies (FAST\u201919). USENIX Association, Boston, MA, 143\u2013157. https:\/\/www.usenix.org\/conference\/fast19\/presentation\/liu"},{"key":"e_1_3_2_19_2","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/3-540-45748-8_5","volume-title":"International Workshop on Peer-to-peer Systems","author":"Maymounkov Petar","year":"2002","unstructured":"Petar Maymounkov and David Mazieres. 2002. Kademlia: A peer-to-peer information system based on the xor metric. In International Workshop on Peer-to-peer Systems. Springer, 53\u201365."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2020.3039547"},{"key":"e_1_3_2_21_2","unstructured":"Satoshi Nakamoto. 2008. Bitcoin: A peer-to-peer electronic cash system. https:\/\/bitcoin.org\/bitcoin.pdf"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2021.3058963"},{"issue":"4","key":"e_1_3_2_23_2","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/0167-7152(83)90025-1","article-title":"A generalized geometric distribution and some of its properties","volume":"1","author":"Philippou Andreas N.","year":"1983","unstructured":"Andreas N. Philippou, Costas Georghiou, and George N. Philippou. 1983. A generalized geometric distribution and some of its properties. Statistics & Probability Letters 1, 4 (1983), 171\u2013175.","journal-title":"Statistics & Probability Letters"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3412852"},{"key":"e_1_3_2_25_2","first-page":"1","volume-title":"2008 IEEE Hot Chips 20 Symposium (HCS\u201908)","author":"Singhal Ronak","year":"2008","unstructured":"Ronak Singhal. 2008. Inside Intel\u00ae core microarchitecture (nehalem). In 2008 IEEE Hot Chips 20 Symposium (HCS\u201908). IEEE, 1\u201325."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2002.808407"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/90.663936"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2007.893881"},{"key":"e_1_3_2_29_2","first-page":"293","article-title":"Spectral hashing","author":"Weiss Yair","year":"2009","unstructured":"Yair Weiss, Antonio Torralba, and Rob Fergus. 2009. Spectral hashing. In Proceedings of the 2009 Conference on Computer Vision and Pattern Recognition, 293\u2013300.","journal-title":"Proceedings of the 2009 Conference on Computer Vision and Pattern Recognition"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.14778\/3311880.3311881"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2015.7218384"}],"container-title":["ACM Transactions on Internet Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631708","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3631708","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:35:43Z","timestamp":1750178143000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631708"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,22]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,2,29]]}},"alternative-id":["10.1145\/3631708"],"URL":"https:\/\/doi.org\/10.1145\/3631708","relation":{},"ISSN":["1533-5399","1557-6051"],"issn-type":[{"value":"1533-5399","type":"print"},{"value":"1557-6051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,22]]},"assertion":[{"value":"2023-03-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-27","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}