{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T14:36:49Z","timestamp":1787323009822,"version":"build-2736575974"},"reference-count":36,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Discrete Math."],"published-print":{"date-parts":[[2015,1]]},"abstract":"<jats:p>We derive relations between theoretical properties of restricted Boltzmann machines (RBMs), popular machine learning models which form the building blocks of deep learning models, and several natural notions from discrete mathematics and convex geometry. We give implications and equivalences relating RBM-representable probability distributions, perfectly reconstructible inputs, Hamming modes, zonotopes and zonosets, point configurations in hyperplane arrangements, linear threshold codes, and multicovering numbers of hypercubes. As a motivating application, we prove results on the relative representational power of mixtures of product distributions and products of mixtures of pairs of product distributions (RBMs) that formally justify widely held intuitions about distributed representations. In particular, we show that a mixture of products requiring an exponentially larger number of parameters is needed to represent the probability distributions which can be obtained as products of mixtures.<\/jats:p>","DOI":"10.1137\/140957081","type":"journal-article","created":{"date-parts":[[2015,2,10]],"date-time":"2015-02-10T11:20:54Z","timestamp":1423567254000},"page":"321-347","source":"Crossref","is-referenced-by-count":12,"title":["When Does a Mixture of Products Contain a Product of Mixtures?"],"prefix":"10.1137","volume":"29","author":[{"given":"Guido F.","family":"Mont\u00fafar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Morton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2015,2,10]]},"reference":[{"key":"atypb1","first-page":"517","volume":"42","author":"Ay N.","year":"2006","journal-title":"Kybernetika"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1561\/2200000006"},{"key":"atypb3","doi-asserted-by":"crossref","unstructured":"A. Bjo\u0308rner, M. Las Vergnas, B. Sturmfels, N. White, and G. M. Ziegler,\n                      Oriented Matroids\n                      , Encyclopedia Math. Appl. 46, Cambridge University Press, Cambridge, UK, 1999.","DOI":"10.1017\/CBO9780511586507"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1090\/S1056-3911-10-00537-0"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1109\/PGEC.1965.264137"},{"key":"atypb6","first-page":"135","author":"Cueto M. A.","year":"2010","journal-title":"RI"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsc.2010.06.011"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpaa.2007.05.022"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1016\/j.dam.2008.05.023"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1090\/S0002-9939-1970-0248147-8"},{"key":"atypb11","first-page":"43","author":"Gawrilow E.","year":"2000","journal-title":"Birkha\u0308user"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1214\/009053606000000263"},{"key":"atypb13","doi-asserted-by":"crossref","unstructured":"G. E. Hinton,\n                      Products of experts\n                      , in Proceedings of the 9th International Conference on Artificial Neural Networks (ICANN), Vol. 1, 1999, pp. 1-6.","DOI":"10.1049\/cp:19991075"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1162\/089976602760128018"},{"key":"atypb15","first-page":"189","volume":"45","author":"Kahle T.","year":"2009","journal-title":"Kybernetika"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1145\/1008328.1008329"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2008.04-07-510"},{"key":"atypb18","first-page":"23","volume":"49","author":"Montu\u0301far G.","year":"2013","journal-title":"Kybernetika"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1162\/NECO_a_00113"},{"key":"atypb20","unstructured":"G. Montu\u0301far and J. Morton,\n                      Discrete restricted Boltzmann machines\n                      , in International Conference on Learning Representations 2013 (ICLR 2013), Scottsdale, AZ, 2013."},{"key":"atypb21","unstructured":"G. Montu\u0301far and J. Morton,\n                      Dimension of Hidden-Visible Products of Exponential Families\n                      , unpublished manuscript, 2014."},{"key":"atypb22","unstructured":"G. Montu\u0301far, J. Rauh, and N. Ay,\n                      Expressive power and approximation errors of restricted Boltzmann machines\n                      , in Advances in Neural Information Processing Systems 24 (NIPS 24), 2011, pp. 415-423."},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1109\/T-C.1970.223046"},{"key":"atypb24","unstructured":"OEIS, The On-Line Encyclopedia of Integer Sequences,\n                      A000609 Number of Threshold Functions of $n$ or Fewer Variables\n                      , http:\/\/oeis.org\/A000609, 2010."},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1109\/72.857765"},{"key":"atypb26","doi-asserted-by":"crossref","unstructured":"P. Orlik and H. Terao,\n                      Arrangements of Hyperplanes\n                      , Springer-Verlag, 1992.","DOI":"10.1007\/978-3-662-02772-1"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijar.2011.01.013"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1214\/009053605000000417"},{"key":"atypb29","first-page":"211","author":"Saks M. E.","year":"1993","journal-title":"New York"},{"key":"atypb30","doi-asserted-by":"crossref","unstructured":"L. Schla\u0308fli,\n                      Theorie der vielfachen Kontinuita\u0308t\n                      , Cornell University Library Historical Math Monographs, George & Company, 1901.","DOI":"10.1007\/978-3-0348-5118-3_2"},{"key":"atypb31","doi-asserted-by":"crossref","unstructured":"L. Schla\u0308fli,\n                      Gesammelte mathematische Abhandlungen\n                      , Vol. 2, Birkha\u0308user, 1953.","DOI":"10.1007\/978-3-0348-4117-7"},{"key":"atypb32","first-page":"389","author":"Stanley R.","year":"2007","journal-title":"RI"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1006\/aama.2000.0701"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1109\/PGEC.1965.264136"},{"key":"atypb35","doi-asserted-by":"crossref","unstructured":"G. M. Ziegler,\n                      Lectures on Polytopes\n                      , Grad. Texts in Math., Springer-Verlag, 1995.","DOI":"10.1007\/978-1-4613-8431-1"},{"key":"atypb37","first-page":"512","volume":"39","author":"Zuev Y. A.","year":"1989","journal-title":"Soviet Math. Dokl."}],"container-title":["SIAM Journal on Discrete Mathematics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/140957081","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T13:37:01Z","timestamp":1787319421000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/140957081"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,1]]},"references-count":36,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2015,1]]}},"alternative-id":["10.1137\/140957081"],"URL":"https:\/\/doi.org\/10.1137\/140957081","relation":{},"ISSN":["0895-4801","1095-7146"],"issn-type":[{"value":"0895-4801","type":"print"},{"value":"1095-7146","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,1]]}}}