{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T12:54:19Z","timestamp":1782910459450,"version":"3.54.5"},"reference-count":28,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,3,21]],"date-time":"2023-03-21T00:00:00Z","timestamp":1679356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"French Government Agency ASSOCIATION NATIONALE RECHERCHE TECHNOLOGIES (ANRT)"},{"name":"CIFRE (\u201cConventions industrielles de formation par la recherch\u00e9\u201d) scholarship"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Practitioners have used hidden Markov models (HMMs) in different problems for about sixty years. Moreover, conditional random fields (CRFs) are an alternative to HMMs and appear in the literature as different and somewhat concurrent models. We propose two contributions: First, we show that the basic linear-chain CRFs (LC-CRFs), considered as different from HMMs, are in fact equivalent to HMMs in the sense that for each LC-CRF there exists an HMM\u2014that we specify\u2014whose posterior distribution is identical to the given LC-CRF. Second, we show that it is possible to reformulate the generative Bayesian classifiers maximum posterior mode (MPM) and maximum a posteriori (MAP), used in HMMs, as discriminative ones. The last point is of importance in many fields, especially in natural language processing (NLP), as it shows that in some situations dropping HMMs in favor of CRFs is not necessary.<\/jats:p>","DOI":"10.3390\/a16030173","type":"journal-article","created":{"date-parts":[[2023,3,22]],"date-time":"2023-03-22T06:00:01Z","timestamp":1679464801000},"page":"173","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Equivalence between LC-CRF and HMM, and Discriminative Computing of HMM-Based MPM and MAP"],"prefix":"10.3390","volume":"16","author":[{"given":"Elie","family":"Azeraf","sequence":"first","affiliation":[{"name":"Watson Department, IBM GSB France, avenue de l\u2019Europe,92270 Bois-Colombes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emmanuel","family":"Monfrini","sequence":"additional","affiliation":[{"name":"SAMOVAR, Telecom SudParis, Institut Polytechnique de Paris, 91120 Palaiseau, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wojciech","family":"Pieczynski","sequence":"additional","affiliation":[{"name":"SAMOVAR, Telecom SudParis, Institut Polytechnique de Paris, 91120 Palaiseau, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,21]]},"reference":[{"key":"ref_1","unstructured":"Stratonovich, R.L. (1965). Non-Linear Transformations of Stochastic Processes, Pergamon Press."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1554","DOI":"10.1214\/aoms\/1177699147","article-title":"Statistical Inference for Probabilistic Functions of Finite state Markov Chains","volume":"37","author":"Baum","year":"1966","journal-title":"Ann. Math. Stat."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MASSP.1986.1165342","article-title":"An Introduction to Hidden Markov Models","volume":"3","author":"Rabiner","year":"1986","journal-title":"IEEE ASSP Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1518","DOI":"10.1109\/TIT.2002.1003838","article-title":"Hidden Markov Processes","volume":"48","author":"Ephraim","year":"2002","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Capp\u00e9, O., Moulines, E., and Ryden, T. (2005). Inference in Hidden Markov Models, Springer.","DOI":"10.1007\/0-387-28982-8"},{"key":"ref_6","unstructured":"Lafferty, J., McCallum, A., and Pereira, F.C. (July, January 28). Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. Proceedings of the International Conference on Machine Learning, Williamstown, MA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1561\/2200000013","article-title":"An Introduction to Conditional Random Fields","volume":"4","author":"Sutton","year":"2012","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_8","unstructured":"Jurafsky, D., and Martin, J.H. (2014). Speech and Language Processing, Prentice Hall."},{"key":"ref_9","first-page":"841","article-title":"On Discriminative vs. Generative Classifiers: A Comparison of Logistic Regression and Naive Bayes","volume":"14","author":"Ng","year":"2001","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"He, H., Liu, Z., Jiao, R., and Yan, G. (2019). A Novel Nonintrusive Load Monitoring Approach based on Linear-Chain Conditional Random Fields. Energies, 12.","DOI":"10.3390\/en12091797"},{"key":"ref_11","first-page":"639","article-title":"Virtual Rehabilitation Using Sequential Learning Algorithms","volume":"9","author":"Condori","year":"2018","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.compchemeng.2017.12.017","article-title":"A Novel Approach to Process Operating Mode Diagnosis using Conditional Random Fields in the Presence of Missing Data","volume":"111","author":"Fang","year":"2018","journal-title":"Comput. Chem. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"026020","DOI":"10.1088\/1741-2560\/9\/2\/026020","article-title":"A Latent Discriminative model-based Approach for Classification of Imaginary Motor tasks from EEG data","volume":"9","author":"Saa","year":"2012","journal-title":"J. Neural Eng."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Azeraf, E., Monfrini, E., and Pieczynski, W. (2022, January 3\u20135). On Equivalence between Linear-Chain Conditional Random Fields and Hidden Markov Chains. Proceedings of the International Conference on Agents and Artificial Intelligence, Virtual.","DOI":"10.5220\/0010897400003116"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Liliana, D.Y., and Basaruddin, C. (2017, January 22\u201323). A Review on Conditional Random Fields as a Sequential Classifier in Machine Learning. Proceedings of the International Conference on Electrical Engineering and Computer Science (ICECOS), Palembang, Indonesia.","DOI":"10.1109\/ICECOS.2017.8167121"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ayogu, I.I., Adetunmbi, A.O., Ojokoh, B.A., and Oluwadare, S.A. (2017, January 29\u201331). A Comparative Study of Hidden Markov Model and Conditional Random Fields on a Yor\u00f9ba Part-of-Speech Tagging task. Proceedings of the IEEE International Conference on Computing Networking and Informatics (ICCNI), Lagos, Nigeria.","DOI":"10.1109\/ICCNI.2017.8123784"},{"key":"ref_17","first-page":"591","article-title":"Maximum Entropy Markov Models for Information Extraction and Segmentation","volume":"17","author":"McCallum","year":"2000","journal-title":"ICML"},{"key":"ref_18","first-page":"S5195","article-title":"Named Entity Recognition based on Conditional Random Fields","volume":"22","author":"Song","year":"2019","journal-title":"Clust. Comput. J. Netw. Softw. Tools Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.1109\/TASL.2010.2082532","article-title":"Equivalence of Generative and Log-Linear Models","volume":"19","author":"Heigold","year":"2010","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_20","unstructured":"Azeraf, E., Monfrini, E., Vignon, E., and Pieczynski, W. (2020). Hidden Markov Chains, Entropic Forward-Backward, and Part-Of-Speech Tagging. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1214\/aoms\/1177697196","article-title":"A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains","volume":"41","author":"Baum","year":"1970","journal-title":"Ann. Math. Stat."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1109\/TIT.1967.1054010","article-title":"Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm","volume":"13","author":"Viterbi","year":"1967","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1109\/TPAMI.2003.1195998","article-title":"Pairwise Markov Chains","volume":"25","author":"Pieczynski","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1848","DOI":"10.1109\/TPAMI.2007.1124","article-title":"Hidden Conditional Random Fields","volume":"29","author":"Quattoni","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","unstructured":"Pieczynski, W., Hulard, C., and Veit, T. (2002, January 22\u201327). Triplet Markov Chains in hidden signal restoration. Proceedings of the SPIE\u2019s International Symposium on Remote Sensing, Crete, Greece."},{"key":"ref_26","unstructured":"Sarawagi, S., and Cohen, W. (2004). Semi-Markov conditional random fields for information extraction. Adv. Neural Inf. Process. Syst., 17."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.artint.2009.11.011","article-title":"Hidden semi-Markov models","volume":"174","author":"Yu","year":"2010","journal-title":"Artif. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Li, H., Derrode, S., and Pieczynski, W. (2019). Adaptive on-line lower limb locomotion activity recognition of healthy individuals using semi-Markov model and single wearable inertial sensor. Sensors, 19.","DOI":"10.3390\/s19194242"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/3\/173\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:59:54Z","timestamp":1760122794000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/3\/173"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,21]]},"references-count":28,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["a16030173"],"URL":"https:\/\/doi.org\/10.3390\/a16030173","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,21]]}}}