{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T13:16:03Z","timestamp":1774876563949,"version":"3.50.1"},"reference-count":31,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T00:00:00Z","timestamp":1774828800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003246","name":"NWO\n\t\t\t\t\t\t\t\t\t\t\t\t\t              https:\/\/ror.org\/04jsz6e67","doi-asserted-by":"publisher","award":["CS.001"],"award-info":[{"award-number":["CS.001"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Dutch Groeifonds project Quantum Delta NL KAT-2"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>We develop an approximation method for the differential entropy h(X) of a q-component Gaussian mixture in Rn. We provide two examples of approximations using our method denoted by h\u00afC,mTaylor(X) and h\u00afCPolyfit(X). We show that h\u00afC,mTaylor(X) provides an easy-to-compute lower bound to h(X), while h\u00afCPolyfit(X) provides an accurate and efficient approximation to h(X). h\u00afCPolyfit(X) is more accurate than known bounds and is conjectured to be much more resilient than other approximations in high dimensions.<\/jats:p>","DOI":"10.3390\/e28040381","type":"journal-article","created":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T12:11:59Z","timestamp":1774872719000},"page":"381","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Numerical Evaluation of Gaussian Mixture Entropy"],"prefix":"10.3390","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8311-6161","authenticated-orcid":false,"given":"Basheer","family":"Joudeh","sequence":"first","affiliation":[{"name":"Department of Computer Science and Mathematics, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1409-4127","authenticated-orcid":false,"given":"Boris","family":"\u0160kori\u0107","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Mathematics, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,30]]},"reference":[{"key":"ref_1","first-page":"6840","article-title":"Denoising diffusion probabilistic models","volume":"33","author":"Ho","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_2","unstructured":"Wu, Y., Chen, M., Li, Z., Wang, M., and Wei, Y. (2024). Theoretical insights for diffusion guidance: A case study for Gaussian mixture models. arXiv."},{"key":"ref_3","first-page":"25598","article-title":"Gaussian mixture solvers for diffusion models","volume":"36","author":"Guo","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sulam, J., Romano, Y., and Elad, M. (2016). Gaussian mixture diffusion. Proceedings of the 2016 IEEE International Conference on the Science of Electrical Engineering (ICSEE), IEEE.","DOI":"10.1109\/ICSEE.2016.7806173"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"194110","DOI":"10.1063\/1.5025058","article-title":"A path integral methodology for obtaining thermodynamic properties of nonadiabatic systems using Gaussian mixture distributions","volume":"148","author":"Raymond","year":"2018","journal-title":"J. Chem. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Turan, N., B\u00f6ck, B., Chan, K.J., Fesl, B., Burmeister, F., Joham, M., Fettweis, G., and Utschick, W. (2024). Wireless channel prediction via Gaussian mixture models. arXiv.","DOI":"10.1109\/WSA61681.2024.10512246"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"53583","DOI":"10.1109\/ACCESS.2018.2871514","article-title":"Physical layer authentication enhancement using a Gaussian mixture model","volume":"6","author":"Qiu","year":"2018","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1109\/TCCN.2023.3342409","article-title":"Gaussian mixture model based anomaly detection for defense against Byzantine attack in cooperative spectrum sensing","volume":"10","author":"Parmar","year":"2023","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2705","DOI":"10.1093\/bioinformatics\/btq498","article-title":"Model-based clustering of microarray expression data via latent Gaussian mixture models","volume":"26","author":"McNicholas","year":"2010","journal-title":"Bioinformatics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1093\/bioinformatics\/18.2.287","article-title":"Inference of a genetic network by a combined approach of cluster analysis and graphical Gaussian modeling","volume":"18","author":"Toh","year":"2002","journal-title":"Bioinformatics"},{"key":"ref_11","unstructured":"Zhu, H., Guo, R., Shen, J., Liu, J., Liu, C., Xue, X.X., Zhang, L., and Mao, S. (2024). The local dark matter kinematic substructure based on LAMOST K giants. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Turner, W., Martini, P., Kara\u00e7ayl\u0131, N.G., Aguilar, J., Ahlen, S., Brooks, D., Claybaugh, T., de la Macorra, A., Dey, A., and Doel, P. (2024). New measurements of the Lyman-\u03b1 forest continuum and effective optical depth with LyCAN and DESI Y1 data. arXiv.","DOI":"10.3847\/1538-4357\/ad8239"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1147\/rd.53.0183","article-title":"Irreversibility and heat generation in the computing process","volume":"5","author":"Landauer","year":"1961","journal-title":"IBM J. Res. Dev."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"7645","DOI":"10.1016\/j.ifacol.2017.08.1162","article-title":"Beating Landauer\u2019s bound by memory erasure using time-multiplexed potentials","volume":"50","author":"Talukdar","year":"2017","journal-title":"IFAC\u2014PapersOnLine"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"068403","DOI":"10.1103\/PhysRevLett.134.068403","article-title":"Excitation-inhibition balance controls information encoding in neural populations","volume":"134","author":"Barzon","year":"2025","journal-title":"Phys. Rev. Lett."},{"key":"ref_16","unstructured":"Nolan, O., Stevens, T.S.W., van Nierop, W.L., and van Sloun, R. (2025). Active diffusion subsampling. arXiv."},{"key":"ref_17","unstructured":"Nielsen, F., and Nock, R. (2016). A series of maximum entropy upper bounds of the differential entropy. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Michalowicz, J.V., Nichols, J.M., and Bucholtz, F. (2008). Calculation of differential entropy for a mixed Gaussian distribution. Entropy, 10.","DOI":"10.3390\/entropy-e10030200"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"IV-317","DOI":"10.1109\/ICASSP.2007.366913","article-title":"Approximating the Kullback\u2013Leibler divergence between Gaussian mixture models","volume":"Volume 4","author":"Hershey","year":"2007","journal-title":"Proceedings of the 2007 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Goldberger, J., Gordon, S., and Greenspan, H. (2003). An efficient image similarity measure based on approximations of KL-divergence between two Gaussian mixtures. Proceedings of the Ninth IEEE International Conference on Computer Vision, IEEE.","DOI":"10.1109\/ICCV.2003.1238387"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Huber, M.F., Bailey, T., Durrant-Whyte, H., and Hanebeck, U.D. (2008). On entropy approximation for Gaussian mixture random vectors. Proceedings of the 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, IEEE.","DOI":"10.1109\/MFI.2008.4648062"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2123","DOI":"10.1109\/TIT.2022.3140661","article-title":"The differential entropy of mixtures: New bounds and applications","volume":"68","author":"Melbourne","year":"2022","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1109\/T-C.1974.224051","article-title":"A projection pursuit algorithm for exploratory data analysis","volume":"C-23","author":"Friedman","year":"1974","journal-title":"IEEE Trans. Comput."},{"key":"ref_24","unstructured":"Tukey, P.A., and Tukey, J.W. (1981). Data-driven view selection, agglomeration, and sharpening. Interpreting Multivariate Data, Wiley."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/2981662","article-title":"What is projection pursuit?","volume":"150","author":"Jones","year":"1987","journal-title":"J. R. Stat. Soc. Ser. A (Gen.)"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1016\/j.spl.2015.01.018","article-title":"Vector-valued skewness for model-based clustering","volume":"99","author":"Loperfido","year":"2015","journal-title":"Stat. Probab. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1007\/s11634-018-0336-z","article-title":"Finite mixtures, projection pursuit and tensor rank: A triangulation","volume":"13","author":"Loperfido","year":"2019","journal-title":"Adv. Data Anal. Classif."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1903","DOI":"10.1162\/0899766054323026","article-title":"Edgeworth approximation of multivariate differential entropy","volume":"17","year":"2005","journal-title":"Neural Comput."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/S0167-7152(00)00055-9","article-title":"The kurtosis coefficient and the linear discriminant function","volume":"49","author":"Prieto","year":"2000","journal-title":"Stat. Probab. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1198\/004017001316975899","article-title":"Multivariate outlier detection and robust covariance matrix estimation","volume":"43","author":"Prieto","year":"2001","journal-title":"Technometrics"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1433","DOI":"10.1198\/016214501753382345","article-title":"Cluster identification using projections","volume":"96","author":"Prieto","year":"2001","journal-title":"J. Am. Stat. Assoc."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/4\/381\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T12:15:02Z","timestamp":1774872902000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/4\/381"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,30]]},"references-count":31,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,4]]}},"alternative-id":["e28040381"],"URL":"https:\/\/doi.org\/10.3390\/e28040381","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,30]]}}}