{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T03:02:59Z","timestamp":1777777379756,"version":"3.51.4"},"reference-count":128,"publisher":"Emerald","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2013,6,26]]},"abstract":"<jats:p>A bivariate Markov process comprises a pair of random processes which are jointly Markov. One of the two processes in that pair is observable while the other plays the role of an underlying process. We are interested in three classes of bivariate Markov processes. In the first and major class of interest, the underlying and observable processes are continuous-time with finite alphabet; in the second class, they are discrete-time with finite alphabet; and in the third class, the underlying process is continuous-time with uncountably infinite alphabet, and the observable process is continuous-time with countably or uncountably infinite alphabet. We refer to processes in the first two classes as bivariate Markov chains. Important examples of continuoustime bivariate Markov chains include the Markov modulated Poisson process, and the batch Markovian arrival process. A hidden Markov model with finite alphabet is an example of a discrete-time bivariate Markov chain. In the third class we have diffusion processes observed in Brownian motion, and diffusion processes modulating the rate of a Poisson process. Bivariate Markov processes play central roles in the theory and applications of estimation, control, queuing, biomedical engineering, and reliability. We review properties of bivariate Markov processes, recursive estimation of their statistics, and recursive and iterative parameter estimation.<\/jats:p>","DOI":"10.1561\/2000000043","type":"journal-article","created":{"date-parts":[[2013,6,26]],"date-time":"2013-06-26T04:34:27Z","timestamp":1372221267000},"page":"1-95","source":"Crossref","is-referenced-by-count":21,"title":["Bivariate Markov Processes and Their Estimation"],"prefix":"10.1108","volume":"6","author":[{"given":"Yariv","family":"Ephraim","sequence":"first","affiliation":[{"name":"George Mason University , 4400 University Drive, Fairfax, VA 22030 ,","place":["USA"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian L.","family":"Mark","sequence":"additional","affiliation":[{"name":"George Mason University , 4400 University Drive, Fairfax, VA 22030 ,","place":["USA"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","published-online":{"date-parts":[[2013,6,26]]},"reference":[{"key":"2026040901314949100_ref001","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1214\/aoms\/1177704594","article-title":"Estimating the infinitesimal generator of a continuous time, finite state Markov process","volume":"33","author":"Albert","year":"1962","journal-title":"Ann. Math. Stat"},{"key":"2026040901314949100_ref002","volume-title":"Applied Probability and Queues","author":"Asmussen","year":"2003"},{"issue":"4","key":"2026040901314949100_ref003","first-page":"419","article-title":"Fitting phase-type distributions via the EM algorithm","volume":"23","author":"Asmussen","year":"1996","journal-title":"Scand. J. Stat"},{"key":"2026040901314949100_ref004","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-76896-0","volume-title":"Fundamentals of Stochastic Filtering","author":"Bain","year":"2009"},{"key":"2026040901314949100_ref005","doi-asserted-by":"crossref","first-page":"919","DOI":"10.2307\/1427898","article-title":"Continuous-time Markov chains in a random environment, with applications to ion channel modelling","volume":"26","author":"Ball","year":"1994","journal-title":"Adv. Appl. Probab"},{"issue":"3","key":"2026040901314949100_ref006","doi-asserted-by":"crossref","first-page":"518","DOI":"10.2307\/3214762","article-title":"Lumpability and marginalisability for continuous time Markov chains","volume":"30","author":"Ball","year":"1993","journal-title":"J. Appl. Prob"},{"key":"2026040901314949100_ref007","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/0025-5564(92)90023-P","article-title":"Stochastic models for ion channels: Introduction and bibliography","volume":"112","author":"Ball","year":"1992","journal-title":"Math. Biosci"},{"issue":"1285","key":"2026040901314949100_ref008","first-page":"385","article-title":"Ion-channel gating mechanisms: model identification and parameter estimation from single channel recordings","volume":"236","author":"Ball","year":"1989","journal-title":"Proceedings of the Royal Society of London. Series B, Biological Sciences"},{"key":"2026040901314949100_ref009","volume-title":"Semi-Markov Chains and Hidden Semi-Markov Models Towards Applications","author":"Barbu","year":"2008"},{"issue":"1","key":"2026040901314949100_ref010","first-page":"1","article-title":"An inequality and associated maximization technique in statistical estimation of probabilistic functions of Markov processes","volume":"3","author":"Baum","year":"1972","journal-title":"Inequalities"},{"key":"2026040901314949100_ref011","doi-asserted-by":"crossref","first-page":"1554","DOI":"10.1214\/aoms\/1177699147","article-title":"Statistical inference for probabilistic functions of finite state Markov chains","volume":"37","author":"Baum","year":"1966","journal-title":"Ann. Math. Statist"},{"key":"2026040901314949100_ref012","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1214\/aoms\/1177697196","article-title":"A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains","volume":"41","author":"Baum","year":"1970","journal-title":"Ann. Math. Statist"},{"issue":"4","key":"2026040901314949100_ref013","doi-asserted-by":"crossref","first-page":"1614","DOI":"10.1214\/aos\/1024691255","article-title":"Asymptotic normality of the maximum-likelihood estimator for general hidden Markov models","volume":"26","author":"Bickel","year":"1998","journal-title":"Ann. of Statist,"},{"key":"2026040901314949100_ref014","volume-title":"Convergence of Probability Measures","author":"Billingsley","year":"1968"},{"key":"2026040901314949100_ref015","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611971286","volume-title":"Probability","author":"Breiman","year":"1992"},{"key":"2026040901314949100_ref016","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4684-9477-8","volume-title":"Point Processes and Queues: Martingale Dynamics","author":"Br\u00e9maud","year":"1981"},{"issue":"1\u20134","key":"2026040901314949100_ref017","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1023\/A:1020981005544","article-title":"An EM algorithm for batch Markovian arrival processes and its comparison to a simpler estimation procedure","volume":"112","author":"Breuer","year":"2002","journal-title":"Ann. Oper. Res"},{"key":"2026040901314949100_ref018","volume-title":"Mathematics of Evolution and Phylogeny,","author":"Bryant","year":"2007"},{"issue":"2","key":"2026040901314949100_ref019","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1093\/biomet\/65.2.273","article-title":"Asymptotic behaviour of classification maximum likelihood estimates","volume":"65","author":"Bryant","year":"1978","journal-title":"Biometrika,"},{"key":"2026040901314949100_ref020","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.physd.2006.08.015","article-title":"A survey of numerical methods for nonlinear filtering problems","volume":"230","author":"Budhiraja","year":"2007","journal-title":"Physica D,"},{"key":"2026040901314949100_ref021","doi-asserted-by":"crossref","DOI":"10.1007\/0-387-28982-8","volume-title":"Inference in Hidden Markov Models","author":"Capp\u00e9","year":"2005"},{"key":"2026040901314949100_ref022","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.peva.2009.09.003","article-title":"Trace data characterization and fitting for Markov modeling","volume":"67","author":"Casale","year":"2010","journal-title":"Performance Evaluation,"},{"key":"2026040901314949100_ref023","doi-asserted-by":"crossref","first-page":"1867","DOI":"10.1016\/S0165-1889(00)00012-9","article-title":"Analytic derivatives of the matrix exponential for estimation of linear continuous-time models","volume":"25","author":"Chen","year":"2001","journal-title":"Journal of Economic Dynamics & Control,"},{"key":"2026040901314949100_ref024","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1098\/rstb.1991.0122","article-title":"Adaptive processing techniques based on hidden Markov models for characterizing very small channel currents buried in noise and deterministic interference","volume":"334","author":"Chung","year":"1991","journal-title":"Phil. Trans. R. Soc. Lond. B"},{"issue":"7","key":"2026040901314949100_ref025","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1287\/mnsc.21.7.727","article-title":"Markov renewal theory: A survey","volume":"21","author":"\u00c7inlar","year":"1975","journal-title":"Management Science,"},{"key":"2026040901314949100_ref026","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1007\/978-94-011-7577-7_41","volume-title":"Communication Systems and Random Processes Theory,","author":"Clark","year":"1978"},{"issue":"1098","key":"2026040901314949100_ref027","first-page":"1","article-title":"On the stochastic properties of bursts of single ion channel openings and of clusters of bursts","volume":"300","author":"Colquhoun","year":"1982","journal-title":"Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences"},{"issue":"2","key":"2026040901314949100_ref028","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1111\/j.2517-6161.1955.tb00188.x","article-title":"Some statistical methods connected with series of events","volume":"17","author":"Cox","year":"1955","journal-title":"Journal of the Royal Statistical Society,"},{"key":"2026040901314949100_ref029","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/0304-4149(86)90018-9","article-title":"Parameter estimation of partially observed continuous time stochastic processes via the EM algorithm","volume":"23","author":"Dembo","year":"1986","journal-title":"Stochastic Processes and their Applications,"},{"key":"2026040901314949100_ref030","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the EM algorithm","volume":"39","author":"Dempster","year":"1977","journal-title":"J. Royal Stat. Soc. B"},{"key":"2026040901314949100_ref031","volume-title":"Stochastic Processes","author":"Doob","year":"1990"},{"key":"2026040901314949100_ref032","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1214\/10-AOS834","article-title":"Consistency of the maximum likelihood estimator for general hidden Markov models","volume":"39","author":"Douc","year":"2011","journal-title":"Ann. Statist"},{"key":"2026040901314949100_ref033","doi-asserted-by":"crossref","first-page":"2254","DOI":"10.1214\/009053604000000021","article-title":"Asymptotic properties of the maximum likelihood estimator in autoregressive models with Markov regime","volume":"32","author":"Douc","year":"2004","journal-title":"Ann. Statist"},{"key":"2026040901314949100_ref034","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/S0019-9958(68)90795-X","article-title":"Evaluation of likelihood functions","volume":"13","author":"Duncan","year":"1968","journal-title":"Information and Control"},{"issue":"8","key":"2026040901314949100_ref035","first-page":"1","article-title":"Zur theorie der markoffschen ketten","volume":"A.2","author":"Elfving","year":"1937","journal-title":"Acta Social Science Fennicaen"},{"key":"2026040901314949100_ref036","volume-title":"Hidden Markov Models: Estimation and Control","author":"Elliott"},{"issue":"3","key":"2026040901314949100_ref037","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1080\/15326349.2012.699750","article-title":"Explicit forward recursive estimators for Markov modulated Markov processes","volume":"28","author":"Ephraim","year":"2012","journal-title":"Stoch. Models"},{"key":"2026040901314949100_ref038","volume-title":"Conference on Information Sciences and Systems (CISS)","author":"Ephraim","year":"2012"},{"issue":"1","key":"2026040901314949100_ref039","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1080\/15326349.2013.750534","article-title":"Consistency of maximum likelihood parameter estimation for bivariate Markov chains","volume":"29","author":"Ephraim","year":"2013","journal-title":"Stoch. Models"},{"key":"2026040901314949100_ref040","doi-asserted-by":"crossref","first-page":"1518","DOI":"10.1109\/TIT.2002.1003838","article-title":"Hidden Markov processes","volume":"48","author":"Ephraim","year":"2002","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2026040901314949100_ref041","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1109\/TSP.2008.2007919","article-title":"An EM algorithm for Markov modulated Markov processes","volume":"57","author":"Ephraim","year":"2009","journal-title":"IEEE Trans. Signal Process"},{"key":"2026040901314949100_ref042","volume-title":"Proc. of the Symposium on the Applications of Hidden Markov Models to Text and Speech","author":"Ferguson","year":"1980"},{"key":"2026040901314949100_ref043","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/0166-5316(93)90035-S","article-title":"The Markov-modulated Poisson process (MMPP) cookbook","volume":"18","author":"Fischer","year":"1992","journal-title":"Perform. Eval"},{"issue":"1","key":"2026040901314949100_ref044","doi-asserted-by":"crossref","first-page":"208","DOI":"10.2307\/3214130","article-title":"On aggregated Markov processes","volume":"23","author":"Fredkin","year":"1986","journal-title":"J. Appl. Prob"},{"issue":"2","key":"2026040901314949100_ref045","doi-asserted-by":"crossref","first-page":"427","DOI":"10.2307\/2532301","article-title":"Bayesian restoration of single-channel patch clamp recordings","volume":"48","author":"Fredkin","year":"1992","journal-title":"Biometrics"},{"issue":"1325","key":"2026040901314949100_ref046","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1098\/rspb.1992.0094","article-title":"Maximum likelihood estimation and identification from single-channel recordings","volume":"249","author":"Fredkin","year":"1992","journal-title":"Proc. Royal. Soc. London B"},{"key":"2026040901314949100_ref047","unstructured":"[47]\n          \n            \n              R.\n              Frey\n            , T.Schmidt, and L.Xu, \u201cOn Galerkin approximations for the Zakai equation with diffusive and point process observations,\u201d Preprint available at http:\/\/www.math.uni-leipzig.de\/^frey\/publications-frey.html. Also in arXiv:1303.0975, 2011."},{"issue":"4","key":"2026040901314949100_ref048","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1089\/cmb.2004.11.727","article-title":"Markov-modulated Markov processes and the covarion process of molecular evolution","volume":"11","author":"Galtier","year":"2004","journal-title":"J. Computational Biology"},{"issue":"5","key":"2026040901314949100_ref049","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1109\/MCOM.2007.358851","article-title":"Dynamic spectrum access in the time domain: Modeling and exploiting white space","volume":"45","author":"Geirhofer","year":"2007","journal-title":"IEEE Communications Magazine"},{"key":"2026040901314949100_ref050","first-page":"415","article-title":"A Galerkin approximation for the Zakai equation","volume":"59","author":"Germani","year":"1984","journal-title":"Lecture Notes in Control and Information Sciences"},{"key":"2026040901314949100_ref051","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198572237.001.0001","author":"Grimmett","year":"2001","journal-title":"Probability and Random Processes"},{"key":"2026040901314949100_ref052","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1109\/49.68448","article-title":"Characterizing the variability of arrival processes with indexes of dispersion","volume":"9","author":"Gusella","year":"1991","journal-title":"IEEE J. Selected Areas Comm"},{"key":"2026040901314949100_ref053","doi-asserted-by":"crossref","first-page":"1683","DOI":"10.1109\/18.104334","article-title":"Recursive estimation in mixture models with Markov regime","volume":"37","author":"Holst","year":"1991","journal-title":"IEEE Trans. Inform. Theory"},{"issue":"5","key":"2026040901314949100_ref054","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1111\/j.1467-9892.1994.tb00206.x","article-title":"Recursive estimation in switching autoregressive with a Markov regime","volume":"15","author":"Holst","year":"1994","journal-title":"J. Time Ser. Anal"},{"key":"2026040901314949100_ref055","volume-title":"Matrix Analysis","author":"Horn","year":"2013"},{"key":"2026040901314949100_ref056","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1109\/18.119690","article-title":"Identifiability of Hidden Markov information sources and their minimum degrees of freedom","volume":"38","author":"Ito","year":"1992","journal-title":"IEEE Trans. on Inform. Theory"},{"key":"2026040901314949100_ref057","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1109\/18.485727","article-title":"Time discretization of continuous-time filters and smoothers for HMM parameter estimation","volume":"42","author":"James","year":"1996","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2026040901314949100_ref058","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1007\/BF00531768","article-title":"The imbedding problem for finite Markov Chains","volume":"1","author":"Kingman","year":"1962","journal-title":"Zeitschrift fur Wahrscheinlichkeitstheorie"},{"key":"2026040901314949100_ref059","volume-title":"Introduction to Stochastic Calculus with Applications","author":"Klebaner","year":"2006"},{"key":"2026040901314949100_ref060","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/S0166-5316(03)00067-1","article-title":"Modeling IP traffic using the batch Markovian arrival process","volume":"54","author":"Klemm","year":"2003","journal-title":"Performance Evaluation"},{"issue":"1","key":"2026040901314949100_ref061","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1214\/aop\/1176991887","article-title":"Unique characterization of conditional distributions in nonlinear filtering","volume":"16","author":"Kurtz","year":"1988","journal-title":"The Annals of Probability"},{"issue":"2","key":"2026040901314949100_ref062","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/0022-0396(67)90023-X","article-title":"Dynamical equations for optimal nonlinear filtering","volume":"3","author":"Kushner","year":"1967","journal-title":"Journal of Differential Equations"},{"key":"2026040901314949100_ref063","volume-title":"The Theory of Matrices","author":"Lancaster","year":"1985"},{"key":"2026040901314949100_ref064","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1239\/jap\/1032192850","article-title":"A canonical representation for aggregated Markov processes","volume":"35","author":"Larget","year":"1998","journal-title":"J. Appl. Prob"},{"key":"2026040901314949100_ref065","doi-asserted-by":"crossref","DOI":"10.1137\/1.9780898719734","volume-title":"Introduction to Matrix Analytic Methods in Stochastic Modeling","author":"Latouche","year":"1999"},{"key":"2026040901314949100_ref066","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/0304-4149(92)90141-C","article-title":"Maximum likelihood estimation for hidden Markov models","volume":"40","author":"Leroux","year":"1992","journal-title":"Stochastic Processes and Their Applications"},{"key":"2026040901314949100_ref067","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/S0885-2308(86)80009-2","article-title":"Continuously variable duration hidden Markov models for automatic speech recognition","volume":"1","author":"Levinson","year":"1986","journal-title":"Computer, Speech and Language"},{"key":"2026040901314949100_ref068","article-title":"Recursive parameter estimation for bivariate Markov chains","author":"Li"},{"issue":"11","key":"2026040901314949100_ref069","doi-asserted-by":"crossref","first-page":"2812","DOI":"10.1109\/26.481232","article-title":"Recursive estimation of parameters in Markov- modulated Poisson processes","volume":"43","author":"Lindgren","year":"1995","journal-title":"IEEE Trans. Commun"},{"key":"2026040901314949100_ref070","volume-title":"Statistics of Random Processes, Part I","author":"Liptser","year":"2001"},{"issue":"1","key":"2026040901314949100_ref071","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/15326349108807174","article-title":"New results on the single server queue with a batch Markovian arrival process","volume":"7","author":"Lucantoni","year":"1991","journal-title":"Stochastic Models"},{"key":"2026040901314949100_ref072","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1007\/BFb0013859","volume-title":"Models and techniques for Performance Evaluation of Computer and Communications Systems","author":"Lucantoni","year":"1993"},{"key":"2026040901314949100_ref073","volume-title":"Linear and Nonlinear Programming","author":"Luenberger","year":"1984"},{"key":"2026040901314949100_ref074","first-page":"371","article-title":"A deterministic discretisation-step upper bound for state estimation via Clark transformations","volume":"4","author":"Malcolm","year":"2004","journal-title":"Journal of Applied Mathematics and Stochastic Analysis"},{"key":"2026040901314949100_ref075","article-title":"Explicit forward recursive estimators for continuous-time bivariate Markov chains","author":"Mark"},{"key":"2026040901314949100_ref076","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1016\/j.csda.2012.07.017","article-title":"An EM algorithm for continuous-time bivariate Markov chains","volume":"57","author":"Mark","year":"2013","journal-title":"Computational Statistics and Data Analysis"},{"issue":"5","key":"2026040901314949100_ref077","doi-asserted-by":"crossref","first-page":"2505","DOI":"10.1109\/TWC.2009.080190","article-title":"Estimation of maximum interference-free transmit power level for opportunistic spectrum access","volume":"8","author":"Mark","year":"2009","journal-title":"IEEE Trans. on Wireless Communications"},{"key":"2026040901314949100_ref078","author":"Meier","year":"1984"},{"key":"2026040901314949100_ref079","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1137\/S00361445024180","article-title":"Nineteen dubious ways to compute the exponential of a matrix, twenty five years later","volume":"45","author":"Moler","year":"2003","journal-title":"SIAM Review"},{"key":"2026040901314949100_ref080","author":"Mortensen","year":"1966"},{"key":"2026040901314949100_ref081","doi-asserted-by":"crossref","first-page":"764","DOI":"10.2307\/3213143","article-title":"A versatile Markovian point process","volume":"16","author":"Neuts","year":"1979","journal-title":"J. Appl. Prob"},{"key":"2026040901314949100_ref082","volume-title":"Matrix-Geometric Solutions in Stochastic Models","author":"Neuts","year":"1981"},{"key":"2026040901314949100_ref083","author":"Nguyen"},{"key":"2026040901314949100_ref084","volume-title":"Conference on Information Sciences and Systems (CISS)","author":"Nguyen","year":"2011"},{"issue":"1","key":"2026040901314949100_ref085","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1137\/050632634","article-title":"The mathematics of phylogenomics","volume":"49","author":"Pachter","year":"2007","journal-title":"SIAM Review"},{"key":"2026040901314949100_ref086","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1214\/aoms\/1177697807","article-title":"Probabilistic functions of finite state Markov chains","volume":"40","author":"Petrie","year":"1969","journal-title":"Ann. Math. Statist"},{"key":"2026040901314949100_ref087","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1098\/rspb.1997.0054","article-title":"Maximum likelihood estimation of aggregated Markov processes","volume":"264","author":"Qin","year":"1997","journal-title":"Proc. Royal Society Lond. B"},{"issue":"2","key":"2026040901314949100_ref088","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1002\/env.3170060207","article-title":"Statistical analysis on Markov-modulated Poisson processes","volume":"6","author":"Ramesh","year":"1995","journal-title":"Environmetrics"},{"issue":"1","key":"2026040901314949100_ref089","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/TSP.2007.906743","article-title":"An EM algorithm for ion-channel current estimation","volume":"56","author":"Roberts","year":"2008","journal-title":"IEEE Trans. Sig. Proc"},{"key":"2026040901314949100_ref090","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1109\/LSP.2006.871709","article-title":"On Ryd\u00e9n\u2019s EM algorithm for estimating MMPPs","volume":"13","author":"Roberts","year":"2006","journal-title":"IEEE Sig. Proc. Let"},{"key":"2026040901314949100_ref091","author":"Rossiter","year":"1989"},{"key":"2026040901314949100_ref092","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1016\/0022-247X(73)90003-6","article-title":"State estimation for partially observed Markov chains","volume":"44","author":"Rudemo","year":"1973","journal-title":"J. Math. Analysis and Applications"},{"issue":"4","key":"2026040901314949100_ref093","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1080\/15326349408807323","article-title":"Parameter estimation for Markov modulated Poisson processes","volume":"10","author":"Ryd\u00e9n","year":"1994","journal-title":"Commun. Statist. Stoch. Models"},{"key":"2026040901314949100_ref094","first-page":"295","article-title":"Consistent and asymptotically normal parameter estimates for Markov modulated Poisson processes","volume":"22","author":"Ryd\u00e9n","year":"1995","journal-title":"Scand. J. Statist"},{"key":"2026040901314949100_ref095","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1016\/0167-9473(95)00025-9","article-title":"An EM algorithm for estimation in Markov-modulated Poisson processes","volume":"21","author":"Ryd\u00e9n","year":"1996","journal-title":"Computational Statistics and Data Analysis"},{"key":"2026040901314949100_ref096","doi-asserted-by":"crossref","first-page":"640","DOI":"10.2307\/3215346","article-title":"On identifiability and order of continuous-time aggregated Markov chains, Markov-modulated Poisson processes, and phase-type distributions","volume":"33","author":"Ryd\u00e9n","year":"1996","journal-title":"J. Appl. Prob"},{"key":"2026040901314949100_ref097","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/S0304-4149(96)00114-7","article-title":"On recursive estimation for hidden Markov models","volume":"66","author":"Ryd\u00e9n","year":"1997","journal-title":"Stochastic Processes and their Applications"},{"key":"2026040901314949100_ref098","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/BF02742868","article-title":"Asymptotically efficient recursive estimation for incomplete data models using the observed information","volume":"47","author":"Ryd\u00e9n","year":"1998","journal-title":"Metrika"},{"key":"2026040901314949100_ref099","first-page":"92","article-title":"Hidden Markov modelling for network communication channels","author":"Salamatian","year":"2001","journal-title":"Proc. ACM Sigmetrics"},{"key":"2026040901314949100_ref100","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1109\/TIT.1975.1055359","article-title":"The modeling of randomly modulated jump processes","volume":"21","author":"Segall","year":"1975","journal-title":"IEEE Trans. Inform. Theory"},{"issue":"2","key":"2026040901314949100_ref101","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1109\/TIT.1975.1055360","article-title":"Nonlinear filtering with counting observations","volume":"IT-21","author":"Segall","year":"1975","journal-title":"IEEE Trans. Inform. Theory"},{"issue":"1","key":"2026040901314949100_ref102","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1086\/226269","article-title":"The representation of social processes by Markov models","volume":"82","author":"Singer","year":"1976","journal-title":"The American Journal of Sociology"},{"issue":"1","key":"2026040901314949100_ref103","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1109\/TIT.1972.1054756","article-title":"Filtering and detection for doubly stochastic Poisson processes","volume":"IT-18","author":"Snyder","year":"1972","journal-title":"IEEE Trans. Information Theory"},{"key":"2026040901314949100_ref104","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4612-3166-0","volume-title":"Random Point Processes in Time and Space","author":"Snyder","year":"1991"},{"issue":"8","key":"2026040901314949100_ref105","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1109\/97.774870","article-title":"Online estimation of hidden Markov models","volume":"6","author":"Stiller","year":"1999","journal-title":"IEEE Sig. Proc. Let"},{"issue":"1","key":"2026040901314949100_ref106","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/JSTSP.2010.2080661","article-title":"Sequence detection algorithms for PHY-layer sensing in dynamic spectrum access networks","volume":"5","author":"Sun","year":"2011","journal-title":"IEEE Journal on Selected Topics in Signal Processing"},{"issue":"5","key":"2026040901314949100_ref107","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1109\/TPAMI.1984.4767581","article-title":"Comments on \u2018Application of the conditional population- mixture model to image segmentation\u2019","volume":"PAMI-6","author":"Titterington","year":"1984","journal-title":"IEEE Trans. Pattern Analysis and, Machine Intelligence"},{"issue":"2","key":"2026040901314949100_ref108","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1111\/j.2517-6161.1984.tb01296.x","article-title":"Recursive parameter estimation using incomplete data","volume":"46","author":"Titterington","year":"1984","journal-title":"J. R. Statist. Soc. B"},{"key":"2026040901314949100_ref109","volume-title":"An Introduction to Stochastic Processes and Their Applications","author":"Todorovic","year":"1994"},{"key":"2026040901314949100_ref110","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1109\/TAC.1978.1101743","article-title":"Computing integrals involving the matrix exponential","volume":"23","author":"Van Loan","year":"1978","journal-title":"IEEE Trans. Automat. Control"},{"issue":"3","key":"2026040901314949100_ref111","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1137\/0132045","article-title":"Filtering, prediction and smoothing for counting process observations, a martingale approach","volume":"32","author":"van Schuppen","year":"1977","journal-title":"SIAM J. Appl. Math"},{"key":"2026040901314949100_ref112","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1109\/TAC.1970.1099409","article-title":"Derivative operations on matrices","volume":"AC-15","author":"Vetter","year":"1970","journal-title":"IEEE Trans. Automatic Control"},{"key":"2026040901314949100_ref113","doi-asserted-by":"crossref","first-page":"2001","DOI":"10.1016\/j.spl.2006.05.017","article-title":"Almost sure convergence of Titterington\u2019s recursive estimator for mixture models","volume":"76","author":"Wang","year":"2006","journal-title":"Statistics & Probability Letters"},{"key":"2026040901314949100_ref114","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/S0166-5316(02)00122-0","article-title":"Continuous-time hidden Markov models for network performance evaluation","volume":"49","author":"Wei","year":"2002","journal-title":"Performance Evaluation"},{"issue":"9","key":"2026040901314949100_ref115","doi-asserted-by":"crossref","first-page":"1652","DOI":"10.1109\/29.60089","article-title":"Sequential algorithms for parameter estimation based on the Kullback-Leibler information measure","volume":"38","author":"Weinstein","year":"1990","journal-title":"IEEE Trans. Acoustic., Speech and Signal Processing"},{"issue":"4","key":"2026040901314949100_ref116","article-title":"Hidden Markov models and the Baum-Welch algorithm","volume":"53","author":"Welch","year":"2003","journal-title":"IEEE Information Theory Society Newsletter"},{"key":"2026040901314949100_ref117","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1109\/LSP.2008.2007619","article-title":"On recursive MMPP parameter estimation","volume":"15","author":"Willy","year":"2008","journal-title":"IEEE Sig. Proc. Let"},{"issue":"4","key":"2026040901314949100_ref118","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1080\/15326349.2010.519673","article-title":"Recursions for the MMPP score vector and observed information matrix","volume":"26","author":"Willy","year":"2010","journal-title":"Stoch. Models"},{"key":"2026040901314949100_ref119","volume-title":"Stochastic Modeling and the Theory of Queues","author":"Wolff","year":"1989"},{"key":"2026040901314949100_ref120","volume-title":"Stochastic Processes in Engineering Systems","author":"Wong","year":"1984"},{"key":"2026040901314949100_ref121","first-page":"347","article-title":"Some applications of stochastic differential equations to optimal non-linear filtering","volume":"2","author":"Wonham","year":"1965","journal-title":"SIAM J. Contr., Series A"},{"issue":"1","key":"2026040901314949100_ref122","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1214\/aos\/1176346060","article-title":"On the convergence properties of the EM algorithm","volume":"11","author":"Wu","year":"1983","journal-title":"Ann. Statist"},{"key":"2026040901314949100_ref123","first-page":"725","article-title":"Filtering of jump processes","volume":"31","author":"Yashin","year":"1970","journal-title":"Automat. Remote Control"},{"key":"2026040901314949100_ref124","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.artint.2009.11.011","article-title":"Hidden semi-Markov models","volume":"174","author":"Yu","year":"2010","journal-title":"Artificial Intelligence"},{"key":"2026040901314949100_ref125","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1007\/BF00536382","article-title":"On the optimal filtering of diffusion processes","volume":"11","author":"Zakai","year":"1969","journal-title":"Z. Wahrsch Verw. Gebiete"},{"key":"2026040901314949100_ref126","author":"Zakai","year":"1983"},{"key":"2026040901314949100_ref127","article-title":"The optimal filtering of Markov jump processes in additive white noise","author":"Zakai","year":"2009"},{"key":"2026040901314949100_ref128","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1109\/18.9793","article-title":"Exact filters for the estimation of the number of transitions of finite-state continuous-time Markov processes","volume":"34","author":"Zeitouni","year":"1988","journal-title":"IEEE Trans. Inform. Theory"}],"container-title":["Foundations and Trends\u00ae in Signal Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/ftsig\/article-pdf\/6\/1\/1\/11100967\/2000000043en.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.emerald.com\/ftsig\/article-pdf\/6\/1\/1\/11100967\/2000000043en.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T18:55:25Z","timestamp":1777488925000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/ftsig\/article\/6\/1\/1\/1330619\/Bivariate-Markov-Processes-and-Their-Estimation"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,6,26]]},"references-count":128,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,6,26]]}},"URL":"https:\/\/doi.org\/10.1561\/2000000043","relation":{},"ISSN":["1932-8346","1932-8354"],"issn-type":[{"value":"1932-8346","type":"print"},{"value":"1932-8354","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,6,26]]}}}