{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T16:04:41Z","timestamp":1778256281366,"version":"3.51.4"},"reference-count":44,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2024,5,11]],"date-time":"2024-05-11T00:00:00Z","timestamp":1715385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ono Acoustics Research Grant"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Cervical auscultation is a simple, noninvasive method for diagnosing dysphagia, although the reliability of the method largely depends on the subjectivity and experience of the evaluator. Recently developed methods for the automatic detection of swallowing sounds facilitate a rough automatic diagnosis of dysphagia, although a reliable method of detection specialized in the peculiar feature patterns of swallowing sounds in actual clinical conditions has not been established. We investigated a novel approach for automatically detecting swallowing sounds by a method wherein basic statistics and dynamic features were extracted based on acoustic features: Mel Frequency Cepstral Coefficients and Mel Frequency Magnitude Coefficients, and an ensemble learning model combining Support Vector Machine and Multi-Layer Perceptron were applied. The evaluation of the effectiveness of the proposed method, based on a swallowing-sounds database synchronized to a video fluorographic swallowing study compiled from 74 advanced-age patients with dysphagia, demonstrated an outstanding performance. It achieved an F1-micro average of approximately 0.92 and an accuracy of 95.20%. The method, proven effective in the current clinical recording database, suggests a significant advancement in the objectivity of cervical auscultation. However, validating its efficacy in other databases is crucial for confirming its broad applicability and potential impact.<\/jats:p>","DOI":"10.3390\/s24103057","type":"journal-article","created":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T11:18:17Z","timestamp":1715599097000},"page":"3057","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Novel Approach Combining Shallow Learning and Ensemble Learning for the Automated Detection of Swallowing Sounds in a Clinical Database"],"prefix":"10.3390","volume":"24","author":[{"given":"Satoru","family":"Kimura","sequence":"first","affiliation":[{"name":"Division of Science and Technology, Graduate School of Sciences and Technology for Innovations, Tokushima University, Tokushima 770-8506, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7676-972X","authenticated-orcid":false,"given":"Takahiro","family":"Emoto","sequence":"additional","affiliation":[{"name":"Division of Science and Technology, Industrial and Social Science, Graduate School of Technology, Tokushima University, Tokushima 770-8506, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1472-059X","authenticated-orcid":false,"given":"Yoshitaka","family":"Suzuki","sequence":"additional","affiliation":[{"name":"Department of Stomatognathic Function and Occlusal Reconstruction, Graduate School of Biomedical Sciences, Tokushima University, Tokushima 770-8504, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mizuki","family":"Shinkai","sequence":"additional","affiliation":[{"name":"Department of Stomatognathic Function and Occlusal Reconstruction, Graduate School of Biomedical Sciences, Tokushima University, Tokushima 770-8504, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Akari","family":"Shibagaki","sequence":"additional","affiliation":[{"name":"Department of Stomatognathic Function and Occlusal Reconstruction, Graduate School of Biomedical Sciences, Tokushima University, Tokushima 770-8504, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fumio","family":"Shichijo","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, Suzue Hospital, Tokushima 770-0028, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,11]]},"reference":[{"key":"ref_1","first-page":"119","article-title":"Approaching Oropharyngeal Dysphagia","volume":"96","author":"Serra","year":"2004","journal-title":"Rev. Esp. Enferm. Dig."},{"key":"ref_2","first-page":"784","article-title":"Dysphagia in the Elderly","volume":"9","author":"Aslam","year":"2013","journal-title":"Gastroenterol. Hepatol."},{"key":"ref_3","first-page":"287","article-title":"Dysphagia in the Elderly: Management and Nutritional Considerations","volume":"7","author":"Sura","year":"2012","journal-title":"Clin. Interv. Aging"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"769","DOI":"10.1016\/j.otc.2018.03.006","article-title":"Dysphagia in the Older Patient","volume":"51","author":"Nawaz","year":"2018","journal-title":"Otolaryngol. Clin. N. Am."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1007\/s00455-013-9490-9","article-title":"Bedside Screening to Detect Oropharyngeal Dysphagia in Patients with Neurological Disorders: An Updated Systematic Review","volume":"29","author":"Kertscher","year":"2014","journal-title":"Dysphagia"},{"key":"ref_6","first-page":"529","article-title":"Physiology of Swallowing","volume":"36","author":"Walton","year":"2018","journal-title":"Surgery"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1007\/s00455-018-9885-8","article-title":"Screening for Dysphagia in Adult Patients with Stroke: Assessing the Accuracy of Informal Detection","volume":"33","author":"Sherman","year":"2018","journal-title":"Dysphagia"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2002","DOI":"10.1002\/lary.26419","article-title":"Accuracy of Endoscopic and Videofluoroscopic Evaluations of Swallowing for Oropharyngeal Dysphagia","volume":"127","author":"Bastidas","year":"2017","journal-title":"Laryngoscope"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"395","DOI":"10.14639\/0392-100X-829","article-title":"Comparison Between Videofluoroscopy, Fiberoptic Endoscopy and Scintigraphy for Diagnosis of Oro-Pharyngeal Dysphagia","volume":"36","author":"Fattori","year":"2016","journal-title":"Acta Otorhinolaryngol. Ital."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1097\/00005537-199703000-00023","article-title":"Evaluation of Swallowing Safety with Fiberoptic Endoscope: Comparison with Videofluoroscopic Technique","volume":"107","author":"Wu","year":"1997","journal-title":"Laryngoscope"},{"key":"ref_11","first-page":"31","article-title":"Screening Tests in Evaluating Swallowing Function","volume":"54","author":"Horiguchi","year":"2011","journal-title":"JMAJ"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1620\/tjem.220.41","article-title":"The Risk of Penetration or Aspiration During Videofluoroscopic Examination of Swallowing Varies Depending on Food Types","volume":"220","author":"Ozaki","year":"2010","journal-title":"Tohoku J. Exp. Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1016\/j.radi.2022.12.007","article-title":"The Use of Videofluoroscopy (VFS) and Fibreoptic Endoscopic Evaluation of Swallowing (FEES) in the Investigation of Oropharyngeal Dysphagia in Stroke Patients: A Narrative Review","volume":"29","author":"Helliwell","year":"2023","journal-title":"Radiography"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1111\/j.1365-2842.2011.02286.x","article-title":"Videoendoscopic Assessment of Swallowing Function to Predict the Future Incidence of Pneumonia of the Elderly","volume":"39","author":"Takahashi","year":"2012","journal-title":"J. Oral Rehabil."},{"key":"ref_15","first-page":"231","article-title":"Reliability and Validity of Cervical Auscultation: A Controlled Comparison Using Videofluoroscopy","volume":"19","author":"Leslie","year":"2004","journal-title":"Dysphagia"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1007\/s00455-007-9078-3","article-title":"Reliability and Validity of Cervical Auscultation","volume":"22","author":"Borr","year":"2007","journal-title":"Dysphagia"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1177\/0269215515576779","article-title":"The Reliability and Validity of Cervical Auscultation in the Diagnosis of Dysphagia: A Systematic Review","volume":"30","author":"Lagarde","year":"2016","journal-title":"Clin. Rehabil."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Dudik, J.M., Kurosu, A., Coyle, J.L., and Sejdi\u0107, E. (2018). Dysphagia and Its Effects on Swallowing Sounds and Vibrations in Adults. Biomed. Eng. OnLine, 17.","DOI":"10.1186\/s12938-018-0501-9"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1007\/BF00262760","article-title":"Methodology for Detecting Swallowing Sounds","volume":"9","author":"Takahashi","year":"1994","journal-title":"Dysphagia"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"984","DOI":"10.1007\/s00455-020-10225-9","article-title":"Automatic Detection and Analysis of Swallowing Sounds in Healthy Subjects and in Patients with Pharyngolaryngeal Cancer","volume":"36","author":"Rayneau","year":"2021","journal-title":"Dysphagia"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.1007\/s00455-022-10410-y","article-title":"Using an Automated Speech Recognition Approach to Differentiate Between Normal and Aspirating Swallowing Sounds Recorded from Digital Cervical Auscultation in Children","volume":"37","author":"Frakking","year":"2022","journal-title":"Dysphagia"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1261","DOI":"10.1007\/s11517-012-0958-9","article-title":"Detection of Swallows with Silent Aspiration Using Swallowing and Breath Sound Analysis","volume":"50","author":"Buchel","year":"2012","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.irbm.2018.10.009","article-title":"Swallowing Sound Recognition at Home Using GMM","volume":"39","author":"Khlaifi","year":"2018","journal-title":"IRBM"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kuramoto, N., Ichimura, K., Jayatilake, D., Shimokakimoto, T., Hidaka, K., and Suzuki, K. (2020, January 20\u201324). Deep Learning-Based Swallowing Monitor for Realtime Detection of Swallow Duration. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada.","DOI":"10.1109\/EMBC44109.2020.9176721"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"8704","DOI":"10.1038\/s41598-020-65492-1","article-title":"Non-invasive Identification of Swallows via Deep Learning in High Resolution Cervical Auscultation Recordings","volume":"10","author":"Khalifa","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Suzuki, T., Ogata, J., Tsunakawa, T., Nishida, M., and Nishimura, M. (2018, January 12\u201315). Bottleneck Feature-Mediated DNN-Based Feature Mapping for Throat Microphone Speech Recognition. Proceedings of the 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Honolulu, HI, USA.","DOI":"10.23919\/APSIPA.2018.8659450"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1007\/s11517-016-1561-2","article-title":"A Noninvasive Swallowing Measurement System Using a Combination of Respiratory Flow, Swallowing Sound, and Laryngeal Motion","volume":"55","author":"Yagi","year":"2017","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.cmpb.2017.03.009","article-title":"A Comparison Between Swallowing Sounds and Vibrations in Patients with Dysphagia","volume":"144","author":"Movahedi","year":"2017","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1007\/PL00009548","article-title":"The Physiologic Cause of Swallowing Sounds: Answers from Heart Sounds and Vocal Tract Acoustics","volume":"13","author":"Cichero","year":"1998","journal-title":"Dysphagia"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"108046","DOI":"10.1016\/j.apacoust.2021.108046","article-title":"Improved Speech Emotion Recognition with Mel Frequency Magnitude Coefficient","volume":"179","author":"Ancilin","year":"2021","journal-title":"Appl. Acoust."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kerkeni, L., Serrestou, Y., Mbarki, M., Raoof, K., Mahjoub, M.A., and Cleder, C. (2019). Automatic Speech Emotion Recognition Using Machine Learning, IntechOpen.","DOI":"10.5772\/intechopen.84856"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3155","DOI":"10.1007\/s11760-023-02537-8","article-title":"Machine Learning Approach for Detecting COVID-19 from Speech Signal Using Mel Frequency Magnitude Coefficient","volume":"17","author":"Nayak","year":"2023","journal-title":"Signal Image Video Process."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"117496","DOI":"10.1016\/j.eswa.2022.117496","article-title":"Dysphagia Diagnosis System with Integrated Speech Analysis from Throat Vibration","volume":"204","author":"Zhao","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_34","unstructured":"Ribeiro, V.H.A., and Reynoso-Meza, G. (2020). Ensemble Learning Toolbox: Easily Building Custom Ensembles in MATLAB, MathWorks. Version 1.0.0."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Chicco, D., and Jurman, G. (2020). The Advantages of the Matthews Correlation Coefficient (MCC) over F1 Score and Accuracy in Binary Classification Evaluation. BMC Genom., 21.","DOI":"10.1186\/s12864-019-6413-7"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Nakamura, A., Saito, T., Ikeda, D., Ohta, K., Mineno, H., and Nishimura, M. (2021). Automatic Detection of Chewing and Swallowing. Sensors, 21.","DOI":"10.3390\/s21103378"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/TBME.2009.2033037","article-title":"Automatic Detection of Swallowing Events by Acoustical Means for Applications of Monitoring of Ingestive Behavior","volume":"57","author":"Sazonov","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2900310","DOI":"10.1109\/JTEHM.2015.2500562","article-title":"Smartphone-Based Real-Time Assessment of Swallowing Ability from the Swallowing Sound","volume":"3","author":"Jayatilake","year":"2015","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Honda, T., Baba, T., Fujimoto, K., Goto, T., Nagao, K., Harada, M., Honda, E., and Ichikawa, T. (2016). Characterization of Swallowing Sound: Preliminary Investigation of Normal Subjects. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0168187"},{"key":"ref_40","first-page":"331","article-title":"Cervical Auscultation","volume":"28","author":"Ohyado","year":"2013","journal-title":"Jpn. J. Gerodontol."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Miyagi, S., Sugiyama, S., Kozawa, K., Moritani, S., Sakamoto, S.I., and Sakai, O. (2020). Classifying Dysphagic Swallowing Sounds with Support Vector Machines. Healthcare, 8.","DOI":"10.3390\/healthcare8020103"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1002\/cre2.531","article-title":"Real-Time Assessment of Swallowing Sound Using an Electronic Stethoscope and an Artificial Intelligence System","volume":"8","author":"Suzuki","year":"2022","journal-title":"Clin. Exp. Dent. Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1007\/s00455-014-9547-4","article-title":"Automated Acoustic Analysis in Detection of Spontaneous Swallows in Parkinson\u2019s Disease","volume":"29","author":"Golabbakhsh","year":"2014","journal-title":"Dysphagia"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Santoso, L.F., Baqai, F., Gwozdz, M., Lange, J., Rosenberger, M.G., Sulzer, J., and Paydarfar, D. (2019, January 23\u201327). Applying Machine Learning Algorithms for Automatic Detection of Swallowing from Sound. Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany.","DOI":"10.1109\/EMBC.2019.8857937"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/10\/3057\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:44:19Z","timestamp":1760107459000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/10\/3057"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,11]]},"references-count":44,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["s24103057"],"URL":"https:\/\/doi.org\/10.3390\/s24103057","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,11]]}}}