{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T00:52:00Z","timestamp":1760403120664,"version":"build-2065373602"},"reference-count":44,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T00:00:00Z","timestamp":1641945600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["JP25120010, JP15KK0010,JP17H02923, JP19H04125, JP21H03509"],"award-info":[{"award-number":["JP25120010, JP15KK0010,JP17H02923, JP19H04125, JP21H03509"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJCR1755, JPMJCR1861, JPMJCR1914"],"award-info":[{"award-number":["JPMJCR1755, JPMJCR1861, JPMJCR1914"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Extracting latent nonlinear dynamics from observed time-series data is important for understanding a dynamic system against the background of the observed data. A state space model is a probabilistic graphical model for time-series data, which describes the probabilistic dependence between latent variables at subsequent times and between latent variables and observations. Since, in many situations, the values of the parameters in the state space model are unknown, estimating the parameters from observations is an important task. The particle marginal Metropolis\u2013Hastings (PMMH) method is a method for estimating the marginal posterior distribution of parameters obtained by marginalization over the distribution of latent variables in the state space model. Although, in principle, we can estimate the marginal posterior distribution of parameters by iterating this method infinitely, the estimated result depends on the initial values for a finite number of times in practice. In this paper, we propose a replica exchange particle marginal Metropolis\u2013Hastings (REPMMH) method as a method to improve this problem by combining the PMMH method with the replica exchange method. By using the proposed method, we simultaneously realize a global search at a high temperature and a local fine search at a low temperature. We evaluate the proposed method using simulated data obtained from the Izhikevich neuron model and L\u00e9vy-driven stochastic volatility model, and we show that the proposed REPMMH method improves the problem of the initial value dependence in the PMMH method, and realizes efficient sampling of parameters in the state space models compared with existing methods.<\/jats:p>","DOI":"10.3390\/e24010115","type":"journal-article","created":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T09:10:36Z","timestamp":1641978636000},"page":"115","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Estimating Distributions of Parameters in Nonlinear State Space Models with Replica Exchange Particle Marginal Metropolis\u2013Hastings Method"],"prefix":"10.3390","volume":"24","author":[{"given":"Hiroaki","family":"Inoue","sequence":"first","affiliation":[{"name":"Graduate School of Engineering, Kobe University, 1-1 Rokkodai-cho, Nada-ku, Kobe 657-8501, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1153-1758","authenticated-orcid":false,"given":"Koji","family":"Hukushima","sequence":"additional","affiliation":[{"name":"Graduate School of Arts and Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-ku, Tokyo 153-8902, Japan"},{"name":"Komaba Institute for Science, The University of Tokyo, 3-8-1 Komaba, Meguro-ku, Tokyo 153-8902, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4011-0055","authenticated-orcid":false,"given":"Toshiaki","family":"Omori","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Kobe University, 1-1 Rokkodai-cho, Nada-ku, Kobe 657-8501, Japan"},{"name":"Organization for Advanced and Integrated Research, Kobe University, 1-1 Rokkodai-cho, Nada-ku, Kobe 657-8501, Japan"},{"name":"Center for Mathematical and Data Sciences, Kobe University, 1-1 Rokkodai-cho, Nada-ku, Kobe 657-8501, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2123","DOI":"10.1016\/S1474-6670(17)66194-9","article-title":"A new spline algorithm for non-linear filtering of discrete time systems","volume":"11","author":"Netto","year":"1978","journal-title":"IFAC Proc. Vol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1023\/A:1008935410038","article-title":"On sequential Monte Carlo sampling methods for Bayesian filtering","volume":"10","author":"Doucet","year":"2000","journal-title":"Stat. Comput."},{"key":"ref_3","unstructured":"Ghahramani, Z., and Hinton, G.E. (1996). The EM Algorithm for Mixtures of Factor Analyzers, Department of Computer Science, University of Toronto. Technical Report CRG-TR-96-1."},{"key":"ref_4","first-page":"1203","article-title":"A self-organizing state-space model","volume":"93","author":"Kitagawa","year":"1998","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"016206","DOI":"10.1103\/PhysRevE.65.016206","article-title":"Fast Bayesian reconstruction of chaotic dynamical systems via extended Kalman filtering","volume":"65","author":"Meyer","year":"2001","journal-title":"Phys. Rev. E"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Doucet, A., De Freitas, N., and Gordon, N. (2001). An introduction to sequential Monte Carlo methods. Sequential Monte Carlo Methods in Practice, Springer.","DOI":"10.1007\/978-1-4757-3437-9"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1016\/S0169-2070(01)00110-8","article-title":"A state space framework for automatic forecasting using exponential smoothing methods","volume":"18","author":"Hyndman","year":"2002","journal-title":"Int. J. Forecast."},{"key":"ref_8","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1016\/j.bpj.2008.08.005","article-title":"Spike inference from calcium imaging using sequential Monte Carlo methods","volume":"97","author":"Vogelstein","year":"2009","journal-title":"Biophys. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3691","DOI":"10.1152\/jn.01073.2009","article-title":"Fast nonnegative deconvolution for spike train inference from population calcium imaging","volume":"104","author":"Vogelstein","year":"2010","journal-title":"J. Neurophysiol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"124801","DOI":"10.1143\/JPSJ.79.124801","article-title":"Estimation of intracellular calcium ion concentration by nonlinear state space modeling and expectation-maximization algorithm for parameter estimation","volume":"79","author":"Tsunoda","year":"2010","journal-title":"J. Phys. Soc. Jpn."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1111\/j.1467-9868.2009.00736.x","article-title":"Particle Markov chain Monte Carlo methods","volume":"72","author":"Andrieu","year":"2010","journal-title":"J. R. Stat. Soc. B"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"065006","DOI":"10.1088\/1741-2560\/8\/6\/065006","article-title":"A sequential Monte Carlo approach to estimate biophysical neural models from spikes","volume":"8","author":"Meng","year":"2011","journal-title":"J. Neural Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10827-011-0371-7","article-title":"Inferring synaptic inputs given a noisy voltage trace via sequential Monte Carlo methods","volume":"33","author":"Paninski","year":"2012","journal-title":"J. Comput. Neurosci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1016\/j.ijforecast.2016.11.008","article-title":"Forecasting compositional time series: A state space approach","volume":"33","author":"Snyder","year":"2017","journal-title":"Int. J. Forecast."},{"key":"ref_16","unstructured":"Lindsten, F., Sch\u00f6n, T.B., and Jordan., M.I. (2012, January 3\u20138). Ancestor sampling for particle Gibbs. Proceedings of the Advances in Neural Information Processing Systems, Stateline, NV, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.3182\/20120711-3-BE-2027.00296","article-title":"Parallel implementation of particle MCMC methods on a GPU","volume":"45","author":"Henriksen","year":"2012","journal-title":"IFAC Proc. Vol."},{"key":"ref_18","unstructured":"Frigola, R., Lindsten, F., Sch\u00f6n, T.B., and Rasmussen, C.E. (2013, January 5\u201310). Bayesian inference and learning in Gaussian process state-space models with particle MCMC. Proceedings of the Advances in Neural Information Processing Systems, Stateline, NV, USA."},{"key":"ref_19","first-page":"2145","article-title":"Particle Gibbs with ancestor sampling","volume":"15","author":"Lindsten","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"033305","DOI":"10.1103\/PhysRevE.94.033305","article-title":"Bayesian inversion analysis of nonlinear dynamics in surface heterogeneous reactions","volume":"94","author":"Omori","year":"2016","journal-title":"Phys. Rev. E"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"084802","DOI":"10.7566\/JPSJ.86.084802","article-title":"Belief propagation for probabilistic slow feature analysis","volume":"86","author":"Omori","year":"2017","journal-title":"J. Phys. Soc. Jpn."},{"key":"ref_22","unstructured":"Rangapuram, S.S., Seeger, M.W., Gasthaus, J., Stella, L., Wang, Y., and Januschowski, T. (2018, January 2\u20138). Deep state space models for time series forecasting. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, P., Yang, M., Peng, Y., Zhu, J., Ju, R., and Yin, Q. (2019). Sensor control in anti-submarine warfare\u2014A digital twin and random finite sets based approach. Entropy, 21.","DOI":"10.3390\/e21080767"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"104801","DOI":"10.7566\/JPSJ.89.104801","article-title":"Replica exchange particle-Gibbs method with ancestor sampling","volume":"89","author":"Inoue","year":"2020","journal-title":"J. Phys. Soc. Jpn."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Shapovalova, Y. (2021). \u201cExact\u201d and approximate methods for Bayesian inference: Stochastic volatility case study. Entropy, 23.","DOI":"10.3390\/e23040466"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gregory, P. (2005). Bayesian Logical Data Analysis for the Physical Sciences, Cambridge University Press.","DOI":"10.1017\/CBO9780511791277"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Doucet, A., De Freitas, N., and Gordon, N. (2001). Sequential Monte Carlo methods for optimal filtering. Sequential Monte Carlo Methods in Practice, Springer.","DOI":"10.1007\/978-1-4757-3437-9"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1214\/aos\/1176346060","article-title":"On the convergence properties of the EM algorithm","volume":"11","author":"Wu","year":"1983","journal-title":"Annal. Stat."},{"key":"ref_29","unstructured":"McLachlan, G.J., and Krishnan, T. (1996). The EM Algorithm and Extensions, Wiley."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1109\/TPAMI.1984.4767596","article-title":"Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images","volume":"6","author":"Geman","year":"1984","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.1063\/1.1699114","article-title":"Equation of state calculations by fast computing machines","volume":"21","author":"Metropolis","year":"1953","journal-title":"J. Chem. Phys."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1093\/biomet\/57.1.97","article-title":"Monte Carlo sampling methods using Markov chains and their applications","volume":"57","author":"Hastings","year":"1970","journal-title":"Biometrika"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1007\/s11634-020-00401-y","article-title":"ParticleMDI: Particle Monte Carlo methods for the cluster analysis of multiple datasets with applications to cancer subtype identification","volume":"14","author":"Cunningham","year":"2020","journal-title":"Adv. Data Anal. Classif."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1093\/bioinformatics\/btaa867","article-title":"Particle Gibbs sampling for Bayesian phylogenetic inference","volume":"37","author":"Wang","year":"2021","journal-title":"Bioinformatics"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1089\/cmb.2015.0072","article-title":"Bayesian inference for duplication\u2013mutation with complementarity network models","volume":"22","author":"Jasra","year":"2015","journal-title":"J. Comput. Biol."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Du, D., Hu, Z., and Du, Y. (2019, January 22\u201326). Model Identification and Physical Exercise Control using Nonlinear Heart Rate Model and Particle Filter. Proceedings of the 2019 IEEE 15th International Conference on Automation Science and Engineering, Vancouver, BC, Canada.","DOI":"10.1109\/COASE.2019.8843217"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Osmundsen, K.K., Kleppe, T.S., Liesenfeld, R., and Oglend, A. (2021). Estimating the Competitive Storage Model with Stochastic Trends in Commodity Prices. Econometrics, 9.","DOI":"10.3390\/econometrics9040040"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1604","DOI":"10.1143\/JPSJ.65.1604","article-title":"Exchange Monte Carlo method and application to spin glass simulations","volume":"65","author":"Hukushima","year":"1996","journal-title":"J. Phys. Soc. Jpn."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1016\/j.cpc.2015.07.007","article-title":"Designed-walk replica-exchange method for simulations of complex systems","volume":"196","author":"Urano","year":"2015","journal-title":"Comput. Phys. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.neunet.2019.05.004","article-title":"Connecting PM and MAP in Bayesian spectral deconvolution by extending exchange Monte Carlo method and using multiple data sets","volume":"118","author":"Motonaka","year":"2019","journal-title":"Neural Netw."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1569","DOI":"10.1109\/TNN.2003.820440","article-title":"Simple model of spiking neurons","volume":"14","author":"Izhikevich","year":"2003","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1109\/TNN.2004.832719","article-title":"Which model to use for cortical spiking neurons?","volume":"15","author":"Izhikevich","year":"2004","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1111\/1467-9868.00282","article-title":"Non-Gaussian Ornstein\u2013Uhlenbeck-based models and some of their uses in financial economics","volume":"63","author":"Shephard","year":"2001","journal-title":"J. R. Stat. Soc. B"},{"key":"ref_44","first-page":"1","article-title":"Normal modified stable processes","volume":"65","author":"Shephard","year":"2001","journal-title":"Theor. Probab. Math. Stat."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/115\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:14:47Z","timestamp":1760364887000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/115"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,12]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["e24010115"],"URL":"https:\/\/doi.org\/10.3390\/e24010115","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,1,12]]}}}