{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T07:42:36Z","timestamp":1723016556011},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,8]]},"abstract":"<jats:p>Recently, the Stochastic Particle Optimization Sampling (SPOS) method is proposed to solve the particle-collapsing pitfall of deterministic Particle Variational Inference methods by ultilizing the stochastic Overdamped Langevin dynamics to enhance exploration. In this paper, we propose an accelerated particle optimization sampling method called Stochastic Hamiltonian Particle Optimization Sampling (SHPOS). Compared to the first-order dynamics used in SPOS, SHPOS adopts an augmented second-order dynamics, which involves an extra momentum term to achieve acceleration. We establish a non-asymptotic convergence analysis for SHPOS, and show that it enjoys a faster convergence rate than SPOS. Besides, we also propose a variance-reduced stochastic gradient variant of SHPOS for tasks with large-scale datasets and complex models. Experiments on both synthetic and real data validate our theory and demonstrate the superiority of SHPOS over the state-of-the-art.<\/jats:p>","DOI":"10.24963\/ijcai.2021\/372","type":"proceedings-article","created":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T11:00:49Z","timestamp":1628679649000},"page":"2701-2707","source":"Crossref","is-referenced-by-count":0,"title":["SHPOS: A Theoretical Guaranteed Accelerated Particle Optimization Sampling Method"],"prefix":"10.24963","author":[{"given":"Zhijian","family":"Li","sequence":"first","affiliation":[{"name":"Information Science and Electronic Engineering, Zhejiang University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chao","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University"},{"name":"Alibaba-Zhejiang University Joint Research Institute of Frontier Technologies"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui","family":"Qian","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University"},{"name":"Alibaba-Zhejiang University Joint Research Institute of Frontier Technologies"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xin","family":"Du","sequence":"additional","affiliation":[{"name":"Information Science and Electronic Engineering, Zhejiang University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lingwei","family":"Peng","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"10584","event":{"number":"30","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"acronym":"IJCAI-2021","name":"Thirtieth International Joint Conference on Artificial Intelligence {IJCAI-21}","start":{"date-parts":[[2021,8,19]]},"theme":"Artificial Intelligence","location":"Montreal, Canada","end":{"date-parts":[[2021,8,27]]}},"container-title":["Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T11:02:53Z","timestamp":1628679773000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2021\/372"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2021,8]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2021\/372","relation":{},"subject":[],"published":{"date-parts":[[2021,8]]}}}