{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:32:56Z","timestamp":1760149976129,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T00:00:00Z","timestamp":1696896000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["2021YFA0715202","KQTD20170810150821146"],"award-info":[{"award-number":["2021YFA0715202","KQTD20170810150821146"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shenzhen Science and Technology Program","award":["2021YFA0715202","KQTD20170810150821146"],"award-info":[{"award-number":["2021YFA0715202","KQTD20170810150821146"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Distributed hypothesis testing (DHT) has emerged as a significant research area, but the information-theoretic optimality of coding strategies is often typically hard to address. This paper studies the DHT problems under the type-based setting, which is requested from the popular federated learning methods. Specifically, two communication models are considered: (i) DHT problem over noiseless channels, where each node observes i.i.d. samples and sends a one-dimensional statistic of observed samples to the decision center for decision making; and (ii) DHT problem over AWGN channels, where the distributed nodes are restricted to transmit functions of the empirical distributions of the observed data sequences due to practical computational constraints. For both of these problems, we present the optimal error exponent by providing both the achievability and converse results. In addition, we offer corresponding coding strategies and decision rules. Our results not only offer coding guidance for distributed systems, but also have the potential to be applied to more complex problems, enhancing the understanding and application of DHT in various domains.<\/jats:p>","DOI":"10.3390\/e25101434","type":"journal-article","created":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T06:14:04Z","timestamp":1696918444000},"page":"1434","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["On the Optimal Error Exponent of Type-Based Distributed Hypothesis Testing"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8242-8737","authenticated-orcid":false,"given":"Xinyi","family":"Tong","sequence":"first","affiliation":[{"name":"Tsinghua\u2013Berkeley Shenzhen Institute, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4178-0934","authenticated-orcid":false,"given":"Xiangxiang","family":"Xu","sequence":"additional","affiliation":[{"name":"Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2827-4022","authenticated-orcid":false,"given":"Shao-Lun","family":"Huang","sequence":"additional","affiliation":[{"name":"Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2300","DOI":"10.1109\/18.720540","article-title":"Statistical inference under multiterminal data compression","volume":"44","author":"Han","year":"1998","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1109\/TIT.1986.1057194","article-title":"Hypothesis testing with communication constraints","volume":"32","author":"Ahlswede","year":"1986","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/18.42171","article-title":"Exponential-type error probabilities for multiterminal hypothesis testing","volume":"35","author":"Han","year":"1989","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1109\/18.32118","article-title":"Statistical inference under multiterminal rate restrictions: A differential geometric approach","volume":"35","author":"Amari","year":"1989","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4923","DOI":"10.1109\/TIT.2017.2778252","article-title":"Neyman\u2013Pearson test for zero-rate multiterminal hypothesis testing","volume":"64","author":"Watanabe","year":"2017","journal-title":"IEEE Trans. Inf. Theory"},{"unstructured":"Shimokawa, H., Han, T.S., and Amari, S. (July, January 27). Error bound of hypothesis testing with data compression. Proceedings of the 1994 IEEE International Symposium on Information Theory, Trondheim, Norway.","key":"ref_6"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1109\/JSAIT.2022.3157797","article-title":"On Distributed Learning with Constant Communication Bits","volume":"3","author":"Xu","year":"2022","journal-title":"IEEE J. Sel. Areas Inf. Theory"},{"doi-asserted-by":"crossref","unstructured":"Sreekumar, S., and G\u00fcnd\u00fcz, D. (2020, January 21\u201326). Strong Converse for Testing Against Independence over a Noisy channel. Proceedings of the 2020 IEEE International Symposium on Information Theory (ISIT), Los Angeles, CA, USA.","key":"ref_8","DOI":"10.1109\/ISIT44484.2020.9174170"},{"unstructured":"McMahan, B., Moore, E., Ramage, D., Hampson, S., and Arcas, B.A.Y. (2017, January 20\u201322). Communication-Efficient Learning of Deep Networks from Decentralized Data. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA.","key":"ref_9"},{"unstructured":"Vapnik, V. (1991, January 2\u20135). Principles of Risk Minimization for Learning Theory. Proceedings of the 4th International Conference on Neural Information Processing Systems, San Francisco, CA, USA.","key":"ref_10"},{"key":"ref_11","first-page":"2949","article-title":"Multimodal learning with deep boltzmann machines","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing), Wiley-Interscience.","key":"ref_12"},{"unstructured":"Huang, S.L., Makur, A., Wornell, G.W., and Zheng, L. (2019). On universal features for high-dimensional learning and inference. arXiv.","key":"ref_13"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1109\/TIT.1987.1057383","article-title":"Hypothesis testing with multiterminal data compression","volume":"33","author":"Han","year":"1987","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.ins.2015.01.007","article-title":"Distributed learning for random vector functional-link networks","volume":"301","author":"Scardapane","year":"2015","journal-title":"Inf. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.neucom.2012.12.055","article-title":"Distributed machine learning in networks by consensus","volume":"124","author":"Georgopoulos","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1109\/TAC.1985.1103988","article-title":"On the complexity of decentralized decision making and detection problems","volume":"30","author":"Tsitsiklis","year":"1985","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1007\/BF02551407","article-title":"Decentralized detection by a large number of sensors","volume":"1","author":"Tsitsiklis","year":"1988","journal-title":"Math. Control. Signals Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1109\/TAES.1981.309178","article-title":"Detection with distributed sensors","volume":"AES-17","author":"Tenney","year":"1981","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1109\/18.119685","article-title":"Multiterminal detection with zero-rate data compression","volume":"38","author":"Shalaby","year":"1992","journal-title":"IEEE Trans. Inf. Theory"},{"doi-asserted-by":"crossref","unstructured":"Zhao, W., and Lai, L. (2015, January 14\u201319). Distributed testing with zero-rate compression. Proceedings of the 2015 IEEE International Symposium on Information Theory (ISIT), Hong Kong, China.","key":"ref_21","DOI":"10.1109\/ISIT.2015.7282965"},{"doi-asserted-by":"crossref","unstructured":"Sreekumar, S., and G\u00fcnd\u00fcz, D. (2017, January 25\u201330). Distributed hypothesis testing over noisy channels. Proceedings of the 2017 IEEE International Symposium on Information Theory (ISIT), Aachen, Germany.","key":"ref_22","DOI":"10.1109\/ISIT.2017.8006675"},{"doi-asserted-by":"crossref","unstructured":"Zaidi, A. (2020, January 21\u201326). Hypothesis Testing Against Independence Under Gaussian Noise. Proceedings of the 2020 IEEE International Symposium on Information Theory (ISIT), Los Angeles, CA, USA.","key":"ref_23","DOI":"10.1109\/ISIT44484.2020.9173936"},{"unstructured":"Salehkalaibar, S., and Wigger, M.A. (2018, January 21\u201323). Distributed hypothesis testing over a noisy channel. Proceedings of the International Zurich Seminar on Information and Communication (IZS 2018), Zurich, Switzerland.","key":"ref_24"},{"doi-asserted-by":"crossref","unstructured":"Weinberger, N., Kochman, Y., and Wigger, M. (2019, January 7\u201312). Exponent trade-off for hypothesis testing over noisy channels. Proceedings of the 2019 IEEE International Symposium on Information Theory (ISIT), Paris, France.","key":"ref_25","DOI":"10.1109\/ISIT.2019.8849485"},{"doi-asserted-by":"crossref","unstructured":"Boyd, S., and Vandenberghe, L. (2004). Convex Optimization, Cambridge University Press.","key":"ref_26","DOI":"10.1017\/CBO9780511804441"},{"doi-asserted-by":"crossref","unstructured":"Csisz\u00e1r, I., and Shields, P.C. (2004). Information Theory and Statistics: A Tutorial, Now Publishers Inc.","key":"ref_27","DOI":"10.1561\/9781933019543"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2505","DOI":"10.1109\/18.720546","article-title":"The method of types [information theory]","volume":"44","year":"1998","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/JSAIT.2020.2981538","article-title":"An information-theoretic approach to unsupervised feature selection for high-dimensional data","volume":"1","author":"Huang","year":"2020","journal-title":"IEEE J. Sel. Areas Inf. Theory"},{"doi-asserted-by":"crossref","unstructured":"Horn, R.A., and Johnson, C.R. (2012). Matrix Analysis, Cambridge University Press.","key":"ref_30","DOI":"10.1017\/CBO9781139020411"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1063\/1.4822863","article-title":"Concrete mathematics: A foundation for computer science","volume":"3","author":"Graham","year":"1989","journal-title":"Comput. Phys."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1090\/S0025-5718-1976-0421040-7","article-title":"Rational Chebyshev approximations for the inverse of the error function","volume":"30","author":"Blair","year":"1976","journal-title":"Math. Comput."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/10\/1434\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:04:17Z","timestamp":1760130257000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/10\/1434"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,10]]},"references-count":32,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["e25101434"],"URL":"https:\/\/doi.org\/10.3390\/e25101434","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2023,10,10]]}}}