{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:03:08Z","timestamp":1760241788732,"version":"build-2065373602"},"reference-count":22,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2018,8,30]],"date-time":"2018-08-30T00:00:00Z","timestamp":1535587200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The maximum entropy principle introduced by Jaynes proposes that a data distribution should maximize the entropy subject to constraints imposed by the available knowledge. Jaynes provided a solution for the case when constraints were imposed on the expected value of a set of scalar functions of the data. These expected values are typically moments of the distribution. This paper describes how the method of maximum entropy PDF projection can be used to generalize the maximum entropy principle to constraints on the joint distribution of this set of functions.<\/jats:p>","DOI":"10.3390\/e20090650","type":"journal-article","created":{"date-parts":[[2018,8,30]],"date-time":"2018-08-30T10:30:06Z","timestamp":1535625006000},"page":"650","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Beyond Moments: Extending the Maximum Entropy Principle to Feature Distribution Constraints"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3739-6104","authenticated-orcid":false,"given":"Paul M.","family":"Baggenstoss","sequence":"first","affiliation":[{"name":"Fraunhofer FKIE, Wachtberg 53343, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1103\/PhysRev.106.620","article-title":"Information Theory and Statistical Mechanics I","volume":"106","author":"Jaynes","year":"1957","journal-title":"Phys. Rev."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1042","DOI":"10.1109\/21.44019","article-title":"The Generalized maximum Entropy Principle","volume":"19","author":"Kesavan","year":"1989","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"063101","DOI":"10.1088\/0953-8984\/22\/6\/063101","article-title":"Applications of the principle of maximum entropy: From physics to ecology","volume":"22","author":"Banavar","year":"2010","journal-title":"J. Phys. Condens. Matter"},{"unstructured":"Holmes, D.E. (2018). Entropy, Special Issue on Maximum Entropy and Its Application, MDPI.","key":"ref_4"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e00596","DOI":"10.1016\/j.heliyon.2018.e00596","article-title":"An introduction to the maximum entropy approach and its application to inference problems in biology","volume":"4","author":"Martino","year":"2018","journal-title":"Heliyon"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1215","DOI":"10.1109\/5.237532","article-title":"Signal Modeling Techniques in Speech Recognition","volume":"81","author":"Picone","year":"1993","journal-title":"Proce. IEEE"},{"doi-asserted-by":"crossref","unstructured":"Baggenstoss, P.M. (2017). Maximum entropy PDF projection: A review. AIP Conf. Proc.","key":"ref_7","DOI":"10.1063\/1.4985362"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2815","DOI":"10.1109\/TSP.2015.2419189","article-title":"Maximum Entropy PDF Design Using Feature Density Constraints: Applications in Signal Processing","volume":"63","author":"Baggenstoss","year":"2015","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2455","DOI":"10.1109\/TSP.2017.2659645","article-title":"Uniform Manifold Sampling (UMS): Sampling the Maximum Entropy PDF","volume":"65","author":"Baggenstoss","year":"2017","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1109\/TSP.2002.808109","article-title":"The PDF Projection Theorem and the Class-Specific method","volume":"51","author":"Baggenstoss","year":"2003","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2240","DOI":"10.1109\/78.950780","article-title":"Multidimensional probability density function approximations for detection, classification, and model order selection","volume":"49","author":"Kay","year":"2001","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1109\/MAES.2004.1263230","article-title":"The Class-Specific Classifier: Avoiding the Curse of Dimensionality (Tutorial)","volume":"19","author":"Baggenstoss","year":"2004","journal-title":"IEEE Aerosp. Electron. Syst. Mag. Spec. Tutor. Add."},{"doi-asserted-by":"crossref","unstructured":"Baggenstoss, P.M. (Septemper, January 28). Evaluating the RBM Without Integration Using PDF Projection. Proceedings of the EUSIPCO 2017, Kos, Greece.","key":"ref_13","DOI":"10.23919\/EUSIPCO.2017.8081323"},{"doi-asserted-by":"crossref","unstructured":"Nuttall, A.H. (2000). Saddlepoint Approximation and First-Order Correction Term to The Joint Probability Density Function of M Quadratic and Linear Forms in K Gaussian Random Variables With Arbitrary Means and Covariances, US Naval Undersea Warfare Center. NUWC Technical Report 11262.","key":"ref_14","DOI":"10.21236\/ADA389100"},{"doi-asserted-by":"crossref","unstructured":"Nuttall, A.H. (2002). Joint Probability Density Function of Selected Order Statistics And the Sum of the Remaining Random Variables, US Naval Undersea Warfare Center. NUWC Technical Report 11345.","key":"ref_15","DOI":"10.21236\/ADA399298"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3428","DOI":"10.1109\/78.806092","article-title":"Class-Specific Features in Classification","volume":"47","author":"Baggenstoss","year":"1999","journal-title":"IEEE Trans. Signal Process."},{"doi-asserted-by":"crossref","unstructured":"Baggenstoss, P.M. (2014, January 11\u201314). Optimal Detection and Classification of Diverse Short-Duration Signals. Proceedings of the International Conference on Cloud Engineering, Boston, MA, USA.","key":"ref_17","DOI":"10.1109\/IC2E.2014.96"},{"doi-asserted-by":"crossref","unstructured":"Baggenstoss, P.M. (September, January 31). Class-specific model mixtures for the classification of time-series. Proceedings of the 2015 23rd European Signal Processing Conference (EUSIPCO), Nice, France.","key":"ref_18","DOI":"10.1109\/EUSIPCO.2015.7362803"},{"key":"ref_19","first-page":"1937","article-title":"Class-Specific Model Mixtures for the Classification of Acoustic Time-Series","volume":"52","author":"Baggenstoss","year":"2016","journal-title":"IEEE Trans. AES"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"5165","DOI":"10.1109\/TSP.2010.2052458","article-title":"A multi-resolution hidden Markov model using class-specific features","volume":"58","author":"Baggenstoss","year":"2010","journal-title":"IEEE Trans. Signal Process."},{"doi-asserted-by":"crossref","unstructured":"Baggenstoss, P.M. (2018, January 3\u20137). Acoustic Event Classification using Multi-resolution HMM. Proceedings of the European Signal Processing Conference (EUSIPCO) 2018, Rome, Italy.","key":"ref_21","DOI":"10.23919\/EUSIPCO.2018.8553131"},{"doi-asserted-by":"crossref","unstructured":"Baggenstoss, P.M. (2018). On the Duality Between Belief Networks and Feed-Forward Neural Networks. IEEE Trans. Neural Netw. Learn. Syst., 1\u201311.","key":"ref_22","DOI":"10.1109\/TNNLS.2018.2836662"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/9\/650\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:22:08Z","timestamp":1760196128000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/9\/650"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,30]]},"references-count":22,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2018,9]]}},"alternative-id":["e20090650"],"URL":"https:\/\/doi.org\/10.3390\/e20090650","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2018,8,30]]}}}