{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T21:45:05Z","timestamp":1772142305757,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,2,2]],"date-time":"2022-02-02T00:00:00Z","timestamp":1643760000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003329","name":"Ministry of Economy, Industry and Competitiveness","doi-asserted-by":"publisher","award":["TIN2017-84553-C2-2-R"],"award-info":[{"award-number":["TIN2017-84553-C2-2-R"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ministerio de Ciencia e Innovacion","award":["PID2020-113614RB-C22"],"award-info":[{"award-number":["PID2020-113614RB-C22"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The term \u201cbulbar involvement\u201d is employed in ALS to refer to deterioration of motor neurons within the corticobulbar area of the brainstem, which results in speech and swallowing dysfunctions. One of the primary symptoms is a deterioration of the voice. Early detection is crucial for improving the quality of life and lifespan of ALS patients suffering from bulbar involvement. The main objective, and the principal contribution, of this research, was to design a new methodology, based on the phonatory-subsystem and time-frequency characteristics for detecting bulbar involvement automatically. This study focused on providing a set of 50 phonatory-subsystem and time-frequency features to detect this deficiency in males and females through the utterance of the five Spanish vowels. Multivariant Analysis of Variance was then used to select the statistically significant features, and the most common supervised classifications models were analyzed. A set of statistically significant features was obtained for males and females to capture this dysfunction. To date, the accuracy obtained (98.01% for females and 96.10% for males employing a random forest) outperformed the models in the literature. Adding time-frequency features to more classical phonatory-subsystem features increases the prediction capabilities of the machine-learning models for detecting bulbar involvement. Studying men and women separately gives greater success. The proposed method can be deployed in any kind of recording device (i.e., smartphone).<\/jats:p>","DOI":"10.3390\/s22031137","type":"journal-article","created":{"date-parts":[[2022,2,6]],"date-time":"2022-02-06T20:40:18Z","timestamp":1644180018000},"page":"1137","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Detecting Bulbar Involvement in Patients with Amyotrophic Lateral Sclerosis Based on Phonatory and Time-Frequency Features"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3999-5549","authenticated-orcid":false,"given":"Alberto","family":"Tena","sequence":"first","affiliation":[{"name":"CIMNE, Building C1, North Campus, UPC, Gran Capit\u00e0, 08034 Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7586-0652","authenticated-orcid":false,"given":"Francesc","family":"Clari\u00e0","sequence":"additional","affiliation":[{"name":"Department of Computer Science & INSPIRES, University of Lleida, Jaume II 69, 25001 Lleida, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4830-9184","authenticated-orcid":false,"given":"Francesc","family":"Solsona","sequence":"additional","affiliation":[{"name":"Department of Computer Science & INSPIRES, University of Lleida, Jaume II 69, 25001 Lleida, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5146-6183","authenticated-orcid":false,"given":"M\u00f2nica","family":"Povedano","sequence":"additional","affiliation":[{"name":"Neurology Department, Hospital Universitari de Bellvitge, L\u2019Hospitalet de Llobregat, 08907 Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"942","DOI":"10.1016\/S0140-6736(10)61156-7","article-title":"Amyotrophic lateral sclerosis","volume":"377","author":"Kiernan","year":"2011","journal-title":"Lancet"},{"key":"ref_2","first-page":"4","article-title":"Dysarthria in amyotrophic lateral sclerosis: A review","volume":"11","author":"Tomik","year":"2010","journal-title":"Amyotroph. Lateral Scler. Off. Publ. World Fed. Neurol. Res. Group Mot. Neuron Dis."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"887","DOI":"10.1044\/2016_JSLHR-S-15-0238","article-title":"Speech Movement Measures as Markers of Bulbar Disease in Amyotrophic Lateral Sclerosis","volume":"59","author":"Shellikeri","year":"2016","journal-title":"J. Speech Lang. Heart Res. JSLHR"},{"key":"ref_4","first-page":"1","article-title":"Vowel-Specific Intelligibility and Acoustic Patterns in Individuals With Dysarthria Secondary to Amyotrophic Lateral Sclerosis","volume":"62","author":"Lee","year":"2019","journal-title":"J. Speech Lang. Heart Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"ORL-479\u2013ORL-484","DOI":"10.1177\/019459987808600319","article-title":"The Otolaryngologic Presentation of Amyotrophic Lateral Sclerosis","volume":"86","author":"Carpenter","year":"1978","journal-title":"Otolaryngology"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e21331","DOI":"10.2196\/21331","article-title":"Detection of Bulbar Involvement in Patients With Amyotrophic Lateral Sclerosis by Machine Learning Voice Analysis: Diagnostic Decision Support Development Study","volume":"9","author":"Tena","year":"2021","journal-title":"JMIR Med. Inform."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/S0892-1997(97)80081-1","article-title":"Acoustic analysis of voice in individuals with amyotrophic lateral sclerosis and perceptually normal vocal quality","volume":"11","author":"Silbergleit","year":"1997","journal-title":"J. Voice"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, J., Kothalkar, P.V., and Heitzman, D. (2016, January 8\u201312). Towards Automatic Detection of Amyotrophic Lateral Sclerosis from Speech Acoustic and Articulatory Samples. Proceedings of the InterSpeech, San Francisco, CA, USA.","DOI":"10.21437\/Interspeech.2016-1542"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.otorri.2017.12.002","article-title":"Multi-disciplinary clinical protocol for the diagnosis of bulbar amyotrophic lateral sclerosis","volume":"70","author":"Chiaramonte","year":"2019","journal-title":"Acta Otorrinolaringol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1159\/000381956","article-title":"The Evaluation of Abnormal Voice Qualities in Patients with Amyotrophic Lateral Sclerosis","volume":"15","author":"Tomik","year":"2015","journal-title":"Neuro-Degener. Dis."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Horwitz-Martin, R.L., Horwitz-Martin, R.L., Quatieri, T.F., Lammert, A.C., Williamson, J.R., Yunusova, Y., Godoy, E., Mehta, D.D., and Green, J.R. (2016, January 8\u201312). Relation of automatically extracted formant trajectories with intelligibility loss and speaking rate decline in amyotrophic lateral sclerosis. Proceedings of the InterSpeech, San Francisco, CA, USA.","DOI":"10.21437\/Interspeech.2016-403"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Spangler, T., Vinodchandran, N.V., Samal, A., and Green, J.R. (2017, January 16\u201319). Fractal features for automatic detection of dysarthria. Proceedings of the 2017 IEEE EMBS International Conference on Biomedical Health Informatics (BHI), Orland, FL, USA.","DOI":"10.1109\/BHI.2017.7897299"},{"key":"ref_13","unstructured":"Suhas, B., Patel, D., Rao, N., Belur, Y., Reddy, P., Atchayaram, N., Yadav, R., Gope, D., and Ghosh, P.K. (2019, January 15\u201319). Comparison of Speech Tasks and Recording Devices for Voice Based Automatic Classification of Healthy Subjects and Patients with Amyotrophic Lateral Sclerosis. Proceedings of the Interspeech, Graz, Austria."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Melia, U., Vallverd\u00fa, M., Jospin, M., Jensen, E.W., Valencia, J.F., Clari\u00e1, F., Gambus, P.L., and Caminal, P. (2013, January 3\u20137). Prediction of nociceptive responses during sedation by time-frequency representation. Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan.","DOI":"10.1109\/EMBC.2013.6610059"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2530","DOI":"10.3390\/e16052530","article-title":"Measuring Instantaneous and Spectral Information Entropies by Shannon Entropy of Choi-Williams Distribution in the Context of Electroencephalography","volume":"16","author":"Melia","year":"2014","journal-title":"Entropy"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1088\/0967-3334\/29\/3\/010","article-title":"Heart rate variability analysis based on time-frequency representation and entropies in hypertrophic cardiomyopathy patients","volume":"29","author":"Claria","year":"2008","journal-title":"Physiol. Meas."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1327","DOI":"10.1088\/0967-3334\/32\/8\/021","article-title":"Characterization of the cerebral activity by time-frequency representation of evoked EEG potentials","volume":"32","author":"Riba","year":"2011","journal-title":"Physiol. Meas."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"103175","DOI":"10.1016\/j.bspc.2021.103175","article-title":"Automated detection of COVID-19 cough","volume":"71","author":"Tena","year":"2022","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"251","DOI":"10.12913\/22998624\/87028","article-title":"Advanced Time-Frequency Representation in Voice Signal Analysis","volume":"12","author":"Mika","year":"2018","journal-title":"Adv. Sci. Technol. Res. J."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.ymssp.2018.07.039","article-title":"Parameterised time-frequency analysis methods and their engineering applications: A review of recent advances","volume":"119","author":"Yang","year":"2019","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1016\/j.sigpro.2005.05.024","article-title":"Sparse audio representations using the MCLT","volume":"86","author":"Davies","year":"2006","journal-title":"Signal Process."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Makkonen, T., Ruottinen, H., Puhto, R., Helminen, M., and Palmiol, J. (2017). Speech deterioration in amyotrophic lateral sclerosis (ALS) after manifestation of bulbar symptoms: Speech deterioration in ALS. Int. J. Lang. Commun. Disord., 53.","DOI":"10.1111\/1460-6984.12357"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/S0022-510X(99)00213-0","article-title":"Acoustic analysis of dysarthria profile in ALS patients","volume":"169","author":"Tomik","year":"1999","journal-title":"J. Neurol. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Norel, R., Pietrowicz, M., Agurto, C., Rishoni, S., and Cecchi, G. (2018). Detection of Amyotrophic Lateral Sclerosis (ALS) via Acoustic Analysis. bioRxiv.","DOI":"10.1101\/383414"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"An, K., Kim, M., Teplansky, K., Green, J., Campbell, T., Yunusova, Y., Heitzman, D., and Wang, J. (2018, January 2\u20136). Automatic Early Detection of Amyotrophic Lateral Sclerosis from Intelligible Speech Using Convolutional Neural Networks. Proceedings of the Interspeech, Hyderabad, India.","DOI":"10.21437\/Interspeech.2018-2496"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gutz, S.E., Wang, J., Yunusova, Y., and Green, J.R. (2019, January 15\u201319). Early Identification of Speech Changes Due to Amyotrophic Lateral Sclerosis Using Machine Classification. Proceedings of the Interspeech, Graz, Austria.","DOI":"10.21437\/Interspeech.2019-2967"},{"key":"ref_27","unstructured":"(2022, January 27). Audacity Manual. Available online: https:\/\/manual.audacityteam.org."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3710","DOI":"10.1121\/1.3397477","article-title":"Updating signal typing in voice: Addition of type 4 signals","volume":"127","author":"Sprecher","year":"2010","journal-title":"J. Acoust. Soc. Am."},{"key":"ref_29","unstructured":"Boersma, P., and Weenink, D. (2019). Praat: Doing Phonetics by Computer, V6.1.01, University of Amsterdam. Technical Report."},{"key":"ref_30","unstructured":"MATLAB (2020). Version 9.9.0.1495850 (R2020b), The MathWorks Inc."},{"key":"ref_31","first-page":"35","article-title":"What are the time-frequency moments of a signal?","volume":"4474","author":"Loughlin","year":"2001","journal-title":"Proc. SPIE Int. Soc. Opt. Eng."},{"key":"ref_32","unstructured":"IBM Corp (2016). IBM SPSS Statistics for Windows, IBM Corp."},{"key":"ref_33","unstructured":"R Core Team (2019). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kuhn, M., and Johnson, K. (2013). Applied Predictive Modeling, Springer.","DOI":"10.1007\/978-1-4614-6849-3"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.aci.2018.08.003","article-title":"Classification assessment methods","volume":"17","author":"Tharwat","year":"2021","journal-title":"Appl. Comput. Inform."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Vashkevich, M., Petrovsky, A., and Rushkevich, Y. (2019, January 18\u201320). Bulbar ALS Detection Based on Analysis of Voice Perturbation and Vibrato. Proceedings of the 2019 Signal Processing: Algorithms, Architectures, Arrangements and Applications (SPA), Poznan, Poland.","DOI":"10.23919\/SPA.2019.8936657"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1080\/21678421.2017.1313868","article-title":"The evaluation of bulbar dysfunction in amyotrophic lateral sclerosis: Survey of clinical practice patterns in the United States","volume":"18","author":"Plowman","year":"2017","journal-title":"Amyotroph. Lateral Scler. Front. Degener."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v074.i11","article-title":"synthpop: Bespoke Creation of Synthetic Data in R","volume":"74","author":"Nowok","year":"2016","journal-title":"J. Stat. Softw."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/1137\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:12:54Z","timestamp":1760134374000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/1137"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,2]]},"references-count":38,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22031137"],"URL":"https:\/\/doi.org\/10.3390\/s22031137","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,2]]}}}