{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T14:53:25Z","timestamp":1776783205450,"version":"3.51.2"},"reference-count":65,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,4,2]],"date-time":"2021-04-02T00:00:00Z","timestamp":1617321600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, we propose a novel hybrid discriminative learning approach based on shifted-scaled Dirichlet mixture model (SSDMM) and Support Vector Machines (SVMs) to address some challenging problems of medical data categorization and recognition. The main goal is to capture accurately the intrinsic nature of biomedical images by considering the desirable properties of both generative and discriminative models. To achieve this objective, we propose to derive new data-based SVM kernels generated from the developed mixture model SSDMM. The proposed approach includes the following steps: the extraction of robust local descriptors, the learning of the developed mixture model via the expectation\u2013maximization (EM) algorithm, and finally the building of three SVM kernels for data categorization and classification. The potential of the implemented framework is illustrated through two challenging problems that concern the categorization of retinal images into normal or diabetic cases and the recognition of lung diseases in chest X-rays (CXR) images. The obtained results demonstrate the merits of our hybrid approach as compared to other methods.<\/jats:p>","DOI":"10.3390\/s21072450","type":"journal-article","created":{"date-parts":[[2021,4,2]],"date-time":"2021-04-02T04:13:51Z","timestamp":1617336831000},"page":"2450","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Discriminative Learning Approach Based on Flexible Mixture Model for Medical Data Categorization and Recognition"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2166-8168","authenticated-orcid":false,"given":"Fahd","family":"Alharithi","sequence":"first","affiliation":[{"name":"College of Computers and Information Technology, Taif University, Taif, P.O. Box 11099, Taif 21944, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ahmed","family":"Almulihi","sequence":"additional","affiliation":[{"name":"College of Computers and Information Technology, Taif University, Taif, P.O. Box 11099, Taif 21944, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6638-7039","authenticated-orcid":false,"given":"Sami","family":"Bourouis","sequence":"additional","affiliation":[{"name":"College of Computers and Information Technology, Taif University, Taif, P.O. Box 11099, Taif 21944, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1585-2962","authenticated-orcid":false,"given":"Roobaea","family":"Alroobaea","sequence":"additional","affiliation":[{"name":"College of Computers and Information Technology, Taif University, Taif, P.O. Box 11099, Taif 21944, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7224-7940","authenticated-orcid":false,"given":"Nizar","family":"Bouguila","sequence":"additional","affiliation":[{"name":"The Concordia Institute for Information Systems Engineering (CIISE), Concordia University, Montreal, QC H3G 1T7, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Razzak, M.I., Naz, S., and Zaib, A. (2018). Deep learning for medical image processing: Overview, challenges and future. Classification in BioApps, Springer.","DOI":"10.1007\/978-3-319-65981-7_12"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"9375","DOI":"10.1109\/ACCESS.2017.2788044","article-title":"Deep Learning Applications in Medical Image Analysis","volume":"6","author":"Ker","year":"2018","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.media.2016.06.032","article-title":"Machine learning approaches in medical image analysis: From detection to diagnosis","volume":"33","year":"2016","journal-title":"Med. Image Anal."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1109\/MSP.2010.936730","article-title":"Machine Learning in Medical Imaging","volume":"27","author":"Wernick","year":"2010","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1002\/ima.22391","article-title":"Bayesian inference framework for bounded generalized Gaussian-based mixture model and its application to biomedical images classification","volume":"30","author":"Alroobaea","year":"2020","journal-title":"Int. J. Imaging Syst. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.neunet.2018.12.008","article-title":"Learning a discriminant graph-based embedding with feature selection for image categorization","volume":"111","author":"Zhu","year":"2019","journal-title":"Neural Netw."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"102655","DOI":"10.1016\/j.jvcir.2019.102655","article-title":"Scene categorization towards urban tunnel traffic by image quality assessment","volume":"65","author":"Zhou","year":"2019","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1016\/j.neucom.2018.08.086","article-title":"Visual content-based web page categorization with deep transfer learning and metric learning","volume":"338","author":"Arrieta","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1109\/ACCESS.2018.2886315","article-title":"Deriving Probabilistic SVM Kernels From Flexible Statistical Mixture Models and its Application to Retinal Images Classification","volume":"7","author":"Bourouis","year":"2019","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"18669","DOI":"10.1007\/s11042-018-7116-9","article-title":"Unsupervised learning of finite full covariance multivariate generalized Gaussian mixture models for human activity recognition","volume":"78","author":"Najar","year":"2019","journal-title":"Multim. Tools Appl."},{"key":"ref_11","unstructured":"McLachlan, G.J., and Peel, D. (2004). Finite Mixture Models, John Wiley & Sons."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Khan, A.M., El-Daly, H., and Rajpoot, N.M. (2012, January 11\u201315). A Gamma-Gaussian mixture model for detection of mitotic cells in breast cancer histopathology images. Proceedings of the 21st International Conference on Pattern Recognition, ICPR 2012, Tsukuba, Japan.","DOI":"10.4103\/2153-3539.112696"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"5809","DOI":"10.1007\/s11042-020-09809-2","article-title":"Color object segmentation and tracking using flexible statistical model and level-set","volume":"80","author":"Bourouis","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"10611","DOI":"10.1007\/s00500-019-04567-2","article-title":"A new hybrid discriminative\/generative model using the full-covariance multivariate generalized Gaussian mixture models","volume":"24","author":"Najar","year":"2020","journal-title":"Soft Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.engappai.2015.03.016","article-title":"Expectation propagation learning of a Dirichlet process mixture of Beta-Liouville distributions for proportional data clustering","volume":"43","author":"Fan","year":"2015","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Oboh, B.S., and Bouguila, N. (2017, January 22\u201325). Unsupervised learning of finite mixtures using scaled dirichlet distribution and its application to software modules categorization. Proceedings of the IEEE International Conference on Industrial Technology, ICIT, Toronto, ON, Canada.","DOI":"10.1109\/ICIT.2017.7915513"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"5799","DOI":"10.1007\/s00500-018-3244-4","article-title":"Bayesian inference by reversible jump MCMC for clustering based on finite generalized inverted Dirichlet mixtures","volume":"23","author":"Bourouis","year":"2019","journal-title":"Soft Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"979","DOI":"10.1007\/s00500-014-1557-5","article-title":"Variational learning of hierarchical infinite generalized Dirichlet mixture models and applications","volume":"20","author":"Fan","year":"2016","journal-title":"Soft Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2329","DOI":"10.1016\/j.eswa.2013.09.030","article-title":"Bayesian learning of finite generalized inverted Dirichlet mixtures: Application to object classification and forgery detection","volume":"41","author":"Bourouis","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Alsuroji, R., Zamzami, N., and Bouguila, N. (2018, January 17\u201320). Model selection and estimation of a finite shifted-scaled dirichlet mixture model. Proceedings of the 17th IEEE International Conference on Machine Learning and Applications, ICMLA 2018, Orlando, FL, USA.","DOI":"10.1109\/ICMLA.2018.00112"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bourouis, S., Alharbi, A., and Bouguila, N. (2021). Bayesian Learning of Shifted-Scaled Dirichlet Mixture Models and Its Application to Early COVID-19 Detection in Chest X-ray Images. J. Imaging, 7.","DOI":"10.3390\/jimaging7010007"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1008928315401","article-title":"Finding overlapping components with MML","volume":"10","author":"Baxter","year":"2000","journal-title":"Stat. Comput."},{"key":"ref_23","unstructured":"Kearns, M.J., Solla, S.A., and Cohn, D.A. (December, January 30). Exploiting generative models in discriminative classifiers. Proceedings of the Advances in Neural Information Processing Systems 11, NIPS Conference, Denver, CO, USA."},{"key":"ref_24","unstructured":"Thrun, S., Saul, L.K., and Sch\u00f6lkopf, B. (2003, January 8\u201313). A Kullback-Leibler divergence based kernel for SVM classification in multimedia applications. Proceedings of the Advances in Neural Information Processing Systems 16 Neural Information Processing Systems, NIPS, Vancouver, BC, Canada."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jebara, T., and Kondor, R. (2003). Bhattacharyya and expected likelihood kernels. Learning Theory and Kernel Machines. In Proceedings of the 16th Annual Conference on Learning Theory (COLT), Graz, Austria, 9\u201312 July 2020, Springer.","DOI":"10.1007\/978-3-540-45167-9_6"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Monti, G.S., Mateu i Figueras, G., Pawlowsky-Glahn, V., and Egozcue, J.J. (2011, January 10\u201313). The shifted-scaled Dirichlet distribution in the simplex. Proceedings of the 4th International Workshop on Compositional Data Analysis, Girona, Spain.","DOI":"10.1002\/9781119976462.ch10"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the EM algorithm","volume":"39","author":"Dempster","year":"1977","journal-title":"J. R. Stat. Soc. Ser. Methodol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1111\/j.2517-6161.1987.tb01695.x","article-title":"Estimation and inference by compact coding","volume":"49","author":"Wallace","year":"1987","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1869","DOI":"10.1016\/j.eswa.2011.08.063","article-title":"Positive vectors clustering using inverted Dirichlet finite mixture models","volume":"39","author":"Bdiri","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_30","unstructured":"Vapnik, V.N., and Vapnik, V. (1998). Statistical Learning Theory, Wiley."},{"key":"ref_31","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1109\/LSP.2006.870086","article-title":"Support vector machines using GMM supervectors for speaker verification","volume":"13","author":"Campbell","year":"2006","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_33","unstructured":"Chan, A.B., Vasconcelos, N., and Moreno, P.J. (2004). A family of Probabilistic Kernels Based on Information Divergence, Statistical Visual Computing Laboratory. Tech. Rep. SVCL-TR-2004-1."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"105948","DOI":"10.1016\/j.ijantimicag.2020.105948","article-title":"Review of the 2019 Novel Coronavirus (COVID-19) based on current evidence","volume":"55","author":"Wang","year":"2020","journal-title":"Int. J. Antimicrob. Agents"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"13727","DOI":"10.1109\/ACCESS.2021.3051758","article-title":"A Competitive Generalized Gamma Mixture Model for Medical Image Diagnosis","volume":"9","author":"Bourouis","year":"2021","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"100391","DOI":"10.1016\/j.imu.2020.100391","article-title":"Hybrid deep learning for detecting lung diseases from X-ray images","volume":"20","author":"Bharati","year":"2020","journal-title":"Inform. Med. Unlocked"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"138277","DOI":"10.1016\/j.scitotenv.2020.138277","article-title":"COVID-19: A promising cure for the global panic","volume":"725","author":"Vellingiri","year":"2020","journal-title":"Sci. Total Environ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.clinimag.2020.04.001","article-title":"Portable chest X-ray in coronavirus disease-19 (COVID-19): A pictorial review","volume":"64","author":"Jacobi","year":"2020","journal-title":"Clin. Imaging"},{"key":"ref_39","unstructured":"Cohen, J.P., Morrison, P., and Dao, L. (2020). COVID-19 image data collection. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Cohen, J.P., Morrison, P., Dao, L., Roth, K., Duong, T.Q., and Ghassemi, M. (2020). COVID-19 Image Data Collection: Prospective Predictions Are the Future. arXiv.","DOI":"10.59275\/j.melba.2020-48g7"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","article-title":"Textural Features for Image Classification","volume":"3","author":"Haralick","year":"1973","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Sallay, H., Bourouis, S., and Bouguila, N. (2021). Online Learning of Finite and Infinite Gamma Mixture Models for COVID-19 Detection in Medical Images. Computers, 10.","DOI":"10.3390\/computers10010006"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1016\/j.compmedimag.2008.07.006","article-title":"Content-based medical image classification using a new hierarchical merging scheme","volume":"32","author":"Pourghassem","year":"2008","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Taylor, R., and Batey, D. (2006). Handbook of Retinal Screening in Diabetes, Wiley Online Library.","DOI":"10.1002\/0470028858"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"e339","DOI":"10.1016\/S2214-109X(13)70113-X","article-title":"Causes of vision loss worldwide, 1990\u20132010: A systematic analysis","volume":"1","author":"Bourne","year":"2013","journal-title":"Lancet Glob. Health"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Scanlon, P.H., Sallam, A., and Van Wijngaarden, P. (2017). A Practical Manual of Diabetic Retinopathy Management, John Wiley & Sons.","DOI":"10.1002\/9781119058984"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Bandello, F., Zarbin, M.A., Lattanzio, R., and Zucchiatti, I. (2016). Clinical Strategies in the Management of Diabetic Retinopathy, Springer.","DOI":"10.1159\/isbn.978-3-318-06042-3"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1007\/s10916-008-9154-8","article-title":"Application of higher order spectra for the identification of diabetes retinopathy stages","volume":"32","author":"Acharya","year":"2008","journal-title":"J. Med. Syst."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2402","DOI":"10.1001\/jama.2016.17216","article-title":"Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs","volume":"316","author":"Gulshan","year":"2016","journal-title":"J. Am. Med. Assoc. JAMA"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1109\/TMI.2009.2037146","article-title":"Multiscale AM-FM methods for diabetic retinopathy lesion detection","volume":"29","author":"Agurto","year":"2010","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2237","DOI":"10.1016\/j.patcog.2009.12.017","article-title":"Detection of microaneurysms using multi-scale correlation coefficients","volume":"43","author":"Zhang","year":"2010","journal-title":"Pattern Recognit."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1230","DOI":"10.1109\/TMI.2008.920619","article-title":"Optimal wavelet transform for the detection of microaneurysms in retina photographs","volume":"27","author":"Quellec","year":"2008","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1720","DOI":"10.1109\/TBME.2012.2193126","article-title":"An ensemble-based system for microaneurysm detection and diabetic retinopathy grading","volume":"59","author":"Antal","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"101936","DOI":"10.1016\/j.artmed.2020.101936","article-title":"Coarse-to-fine classification for diabetic retinopathy grading using convolutional neural network","volume":"108","author":"Wu","year":"2020","journal-title":"Artif. Intell. Med."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1016\/j.compmedimag.2008.08.009","article-title":"Automatic detection of diabetic retinopathy exudates from non-dilated retinal images using mathematical morphology methods","volume":"32","author":"Sopharak","year":"2008","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1186\/s12859-018-2277-0","article-title":"Predicting diabetic retinopathy and identifying interpretable biomedical features using machine learning algorithms","volume":"19","author":"Tsao","year":"2018","journal-title":"BMC Bioinform."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"2538","DOI":"10.1109\/TBME.2012.2205687","article-title":"An ensemble classification-based approach applied to retinal blood vessel segmentation","volume":"59","author":"Fraz","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.irbm.2013.01.010","article-title":"TeleOphta: Machine learning and image processing methods for teleophthalmology","volume":"34","author":"Cazuguel","year":"2013","journal-title":"IRBM"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1109\/TMI.2004.825627","article-title":"Ridge-based vessel segmentation in color images of the retina","volume":"23","author":"Staal","year":"2004","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"7385","DOI":"10.1088\/0031-9155\/52\/24\/012","article-title":"Automated detection of exudates for diabetic retinopathy screening","volume":"52","author":"Fleming","year":"2007","journal-title":"Phys. Med. Biol."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Garcia, M., Hornero, R., Sanchez, C.I., L\u00f3pez, M.I., and D\u00edez, A. (2007, January 22\u201326). Feature extraction and selection for the automatic detection of hard exudates in retinal images. Proceedings of the 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France.","DOI":"10.1109\/IEMBS.2007.4353456"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Li, H., and Chutatape, O. (2003, January 13\u201316). A model-based approach for automated feature extraction in fundus images. Proceedings of the Ninth IEEE International Conference on Computer Vision, Nice, France.","DOI":"10.1109\/ICCV.2003.1238371"},{"key":"ref_64","unstructured":"Wang, H., Hsu, W., Goh, K.G., and Lee, M.L. (2000, January 15). An effective approach to detect lesions in color retinal images. Proceedings of the Computer Vision and Pattern Recognition, Hilton Head, SC, USA."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Colomer, A., Igual, J., and Naranjo, V. (2020). Detection of Early Signs of Diabetic Retinopathy Based on Textural and Morphological Information in Fundus Images. Sensors, 20.","DOI":"10.3390\/s20041005"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/7\/2450\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:10:58Z","timestamp":1760364658000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/7\/2450"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,2]]},"references-count":65,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["s21072450"],"URL":"https:\/\/doi.org\/10.3390\/s21072450","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,2]]}}}