{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,31]],"date-time":"2026-01-31T01:51:06Z","timestamp":1769824266049,"version":"3.49.0"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,2,10]],"date-time":"2021-02-10T00:00:00Z","timestamp":1612915200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Science and Technology Development Fund of Macao S.A.R","award":["0015\/2019\/AKP"],"award-info":[{"award-number":["0015\/2019\/AKP"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61806192"],"award-info":[{"award-number":["61806192"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shenzhen Discipline Construction Project for Urban Computing and Data Intelligence"},{"name":"National Key R8D Program of China","award":["2019YFB2102100 and 2018YFB1402600"],"award-info":[{"award-number":["2019YFB2102100 and 2018YFB1402600"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2021,4,30]]},"abstract":"<jats:p>\n            Stochastic Gradient Langevin Dynamics (SGLD) have been widely used for Bayesian sampling from certain probability distributions, incorporating derivatives of the log-posterior. With the derivative evaluation of the log-posterior distribution, SGLD methods generate samples from the distribution through performing as a thermostats dynamics that traverses over gradient flows of the log-posterior with certainly controllable perturbation. Even when the density is not known, existing solutions still can first learn the kernel density models from the given datasets, then produce new samples using the SGLD over the kernel density derivatives. In this work, instead of exploring new samples from kernel spaces, a novel SGLD sampler, namely,\n            <jats:italic>Randomized Measurement Langevin Dynamics<\/jats:italic>\n            (RMLD) is proposed to sample the high-dimensional sparse representations from the spectral domain of a given dataset.\n          <\/jats:p>\n          <jats:p>Specifically, given a random measurement matrix for sparse coding, RMLD first derives a novel likelihood evaluator of the probability distribution from the loss function of LASSO, then samples from the high-dimensional distribution using stochastic Langevin dynamics with derivatives of the logarithm likelihood and Metropolis\u2013Hastings sampling. In addition, new samples in low-dimensional measuring spaces can be regenerated using the sampled high-dimensional vectors and the measurement matrix. The algorithm analysis shows that RMLD indeed projects a given dataset into a high-dimensional Gaussian distribution with Laplacian prior, then draw new sparse representation from the dataset through performing SGLD over the distribution. Extensive experiments have been conducted to evaluate the proposed algorithm using real-world datasets. The performance comparisons on three real-world applications demonstrate the superior performance of RMLD beyond baseline methods.<\/jats:p>","DOI":"10.1145\/3427585","type":"journal-article","created":{"date-parts":[[2021,2,10]],"date-time":"2021-02-10T18:27:49Z","timestamp":1612981669000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Sampling Sparse Representations with Randomized Measurement Langevin Dynamics"],"prefix":"10.1145","volume":"15","author":[{"given":"Kafeng","family":"Wang","sequence":"first","affiliation":[{"name":"Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, and University of Chinese Academy of Sciences, Shenzhen, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haoyi","family":"Xiong","sequence":"additional","affiliation":[{"name":"Baidu Inc., Haidian, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiang","family":"Bian","sequence":"additional","affiliation":[{"name":"University of Central Florida, Orlando, FL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhanxing","family":"Zhu","sequence":"additional","affiliation":[{"name":"Peking University, Haidian, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qian","family":"Gao","sequence":"additional","affiliation":[{"name":"Baidu Inc., Haidian, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhishan","family":"Guo","sequence":"additional","affiliation":[{"name":"University of Central Florida, Orlando, FL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng-Zhong","family":"Xu","sequence":"additional","affiliation":[{"name":"University of Macau, Taipa, Macau, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Huan","sequence":"additional","affiliation":[{"name":"StylingAI Inc., Haidian, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dejing","family":"Dou","sequence":"additional","affiliation":[{"name":"Baidu Inc., Haidian, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,2,10]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783373"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML'12)","author":"Ahn Sungjin","year":"2012"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1020281327116"},{"key":"e_1_2_1_4_1","volume-title":"Data augmentation generative adversarial networks. arXiv preprint arXiv:1711.04340","author":"Antoniou Antreas","year":"2017"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00199-004-0514-4"},{"key":"e_1_2_1_6_1","volume-title":"Roux","author":"Bengio Yoshua","year":"2006"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2011.2146090"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2005.862083"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2018.2872675"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2012.2201167"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the International Conference on Machine Learning. 1683--1691","author":"Chen Tianqi","year":"2014"},{"key":"e_1_2_1_12_1","volume-title":"How to train a GAN? Tips and tricks to make GANs work","author":"Chintala Soumith","year":"2017"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2017.7966217"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2006.871582"},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","unstructured":"David L. Donoho. 2006. For most large underdetermined systems of linear equations the minimal norm solution is also the sparsest solution. Communications on Pure and Applied Mathematics: A Journal Issued by the Courant Institute of Mathematical Sciences 59 6 (2006) 797--829.  David L. Donoho. 2006. For most large underdetermined systems of linear equations the minimal norm solution is also the sparsest solution. Communications on Pure and Applied Mathematics: A Journal Issued by the Courant Institute of Mathematical Sciences 59 6 (2006) 797--829.","DOI":"10.1002\/cpa.20132"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2005.860430"},{"key":"e_1_2_1_17_1","first-page":"3084","article-title":"Learning deep generative models with doubly stochastic gradient MCMC","volume":"29","author":"Du Chao","year":"2018","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_2_1_18_1","unstructured":"Raaz Dwivedi Yuansi Chen Martin J. Wainwright and Bin Yu. 2018. Log-concave sampling: Metropolis-Hastings algorithms are fast! In Proceedings of the Conference on Learning Theory. PMLR 793--797.  Raaz Dwivedi Yuansi Chen Martin J. Wainwright and Bin Yu. 2018. Log-concave sampling: Metropolis-Hastings algorithms are fast! In Proceedings of the Conference on Learning Theory. PMLR 793--797."},{"key":"e_1_2_1_19_1","volume-title":"International Conference on Machine Learning. 1015--1024","author":"Filippone Maurizio","year":"2015"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems. 2672--2680","author":"Goodfellow Ian","year":"2014"},{"key":"e_1_2_1_21_1","volume-title":"Courville","author":"Gulrajani Ishaan","year":"2017"},{"key":"e_1_2_1_22_1","volume-title":"International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=Hy6GHpkCW.","author":"Ha David","year":"2018"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/57.1.97"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2007.914345"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2018.2868835"},{"key":"e_1_2_1_26_1","unstructured":"Yann LeCun Corinna Cortes and C. J. Burges. 2010. MNIST handwritten digit database. AT8T Labs. Retrieved from http:\/\/yann.lecun.com\/exdb\/mnist. 2 (2010).  Yann LeCun Corinna Cortes and C. J. Burges. 2010. MNIST handwritten digit database. AT8T Labs. Retrieved from http:\/\/yann.lecun.com\/exdb\/mnist. 2 (2010)."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 13th AAAI Conference on Artificial Intelligence. AAAI Press, 1788--1794","author":"Li Chunyuan","year":"2016"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2017.2757140"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2013.2245914"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems. 2917--2925","author":"Ma Yi-An","year":"2015"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 24th International Joint Conference on Artificial Intelligence. 543--552","author":"Maclaurin Dougal"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the International Conference on Machine Learning. 354--363","author":"Mandt Stephan","year":"2016"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3208015"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68445-1_53"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1137\/0330046"},{"key":"e_1_2_1_36_1","volume-title":"Advanced Lectures on Machine Learning","author":"Rasmussen Carl Edward"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972764.53"},{"key":"e_1_2_1_38_1","first-page":"5847","article-title":"On GANs and GMMs","volume":"31","author":"Richardson Eitan","year":"2018","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_39_1","volume-title":"Advances in Neural Information Processing Systems 29","author":"Salimans Tim"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1162\/NECO_a_00835"},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the 18th International Conference on Artificial Intelligence and Statistics. 809--818","author":"Sasaki Hiroaki","year":"2015"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-71249-9_24"},{"key":"e_1_2_1_43_1","volume-title":"Multivariate Density Estimation: Theory, Practice, and Visualization","author":"Scott David W."},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems. 955--963","author":"Strathmann Heiko","year":"2015"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2014.2361052"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1996.tb02080.x"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2007.909108"},{"key":"e_1_2_1_49_1","volume-title":"Bandwidth selection in kernel density estimation: A review","author":"Turlach Berwin A."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.788640"},{"key":"e_1_2_1_51_1","volume-title":"Machine Learning and Knowledge Discovery in Databases, Ulf Brefeld, Elisa Fromont, Andreas Hotho, Arno Knobbe, Marloes Maathuis, and C\u00e9line Robardet (Eds.)","author":"Wan Ruosi"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the 28th International Conference on Machine Learning (ICML\u201911)","author":"Welling Max"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2017.2782711"},{"key":"e_1_2_1_54_1","volume-title":"Fashion-mnist: A novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747","author":"Xiao Han","year":"2017"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2017.62"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2018\/401"},{"key":"e_1_2_1_57_1","volume-title":"SpHMC: Spectral Hamiltonian Monte Carlo. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence.","author":"Xiong Haoyi"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3007195"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2014.2361026"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/3304889.3305080"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2012.2230406"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3427585","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3427585","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:40Z","timestamp":1750195480000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3427585"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,10]]},"references-count":60,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,4,30]]}},"alternative-id":["10.1145\/3427585"],"URL":"https:\/\/doi.org\/10.1145\/3427585","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,10]]},"assertion":[{"value":"2019-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-02-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}