{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T07:32:12Z","timestamp":1776929532670,"version":"3.51.2"},"reference-count":99,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,6,17]],"date-time":"2022-06-17T00:00:00Z","timestamp":1655424000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Sciences and Engineering Research Council of Canada (NSERC)","award":["RGPIN-2016-04175"],"award-info":[{"award-number":["RGPIN-2016-04175"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Wearable devices are burgeoning, and applications across numerous verticals are emerging, including human performance monitoring, at-home patient monitoring, and health tracking, to name a few. Off-the-shelf wearables have been developed with focus on portability, usability, and low-cost. As such, when deployed in highly ecological settings, wearable data can be corrupted by artifacts and by missing data, thus severely hampering performance. In this technical note, we overview a signal processing representation called the modulation spectrum. The representation quantifies the rate-of-change of different spectral magnitude components and is shown to separate signal from noise, thus allowing for improved quality measurement, quality enhancement, and noise-robust feature extraction, as well as for disease characterization. We provide an overview of numerous applications developed by the authors over the last decade spanning different wearable modalities and list the results obtained from experimental results alongside comparisons with various state-of-the-art benchmark methods. Open-source software is showcased with the hope that new applications can be developed. We conclude with a discussion on possible future research directions, such as context awareness, signal compression, and improved input representations for deep learning algorithms.<\/jats:p>","DOI":"10.3390\/s22124579","type":"journal-article","created":{"date-parts":[[2022,6,19]],"date-time":"2022-06-19T21:19:26Z","timestamp":1655673566000},"page":"4579","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Modulation Spectral Signal Representation for Quality Measurement and Enhancement of Wearable Device Data: A Technical Note"],"prefix":"10.3390","volume":"22","author":[{"given":"Abhishek","family":"Tiwari","sequence":"first","affiliation":[{"name":"Institut National de la Recherche Scientifique, University of Quebec, Montr\u00e9al, QC H5A 1K6, Canada"},{"name":"Myant Inc., Toronto, ON M9W 1B6, Canada"}]},{"given":"Raymundo","family":"Cassani","sequence":"additional","affiliation":[{"name":"McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montr\u00e9al, QC H3A 2B4, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7191-4251","authenticated-orcid":false,"given":"Shruti","family":"Kshirsagar","sequence":"additional","affiliation":[{"name":"Institut National de la Recherche Scientifique, University of Quebec, Montr\u00e9al, QC H5A 1K6, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4659-7693","authenticated-orcid":false,"given":"Diana P.","family":"Tobon","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Universidad de Medell\u00edn, Medell\u00edn 050026, Colombia"}]},{"given":"Yi","family":"Zhu","sequence":"additional","affiliation":[{"name":"Institut National de la Recherche Scientifique, University of Quebec, Montr\u00e9al, QC H5A 1K6, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5739-2514","authenticated-orcid":false,"given":"Tiago H.","family":"Falk","sequence":"additional","affiliation":[{"name":"Institut National de la Recherche Scientifique, University of Quebec, Montr\u00e9al, QC H5A 1K6, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,17]]},"reference":[{"key":"ref_1","unstructured":"Markets And Markets (2021). Wearable Technology Market by Product, Type, Application, and Geography\u2014Global Forecast to 2026, Markets and Markets. Technical Report."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1038\/s41746-020-00363-7","article-title":"Assessment of physiological signs associated with COVID-19 measured using wearable devices","volume":"3","author":"Natarajan","year":"2020","journal-title":"NPJ Digit. Med."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"21640","DOI":"10.1038\/s41598-020-78355-6","article-title":"Feasibility of continuous fever monitoring using wearable devices","volume":"10","author":"Smarr","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bogu, G.K., and Snyder, M.P. (2021). Deep learning-based detection of COVID-19 using wearables data. MedRxiv.","DOI":"10.1101\/2021.01.08.21249474"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1016\/j.hrthm.2020.02.023","article-title":"Wearables in cardiology: Here to stay","volume":"17","author":"Dagher","year":"2020","journal-title":"Heart Rhythm"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.medengphy.2020.11.005","article-title":"Gait analysis in neurological populations: Progression in the use of wearables","volume":"87","author":"Celik","year":"2020","journal-title":"Med. Eng. Phys."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-021-87029-w","article-title":"A multimodal analysis of physical activity, sleep, and work shift in nurses with wearable sensor data","volume":"11","author":"Feng","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"e22006","DOI":"10.2196\/22006","article-title":"The use of wearables in clinical trials during cancer treatment: Systematic review","volume":"8","author":"Beauchamp","year":"2020","journal-title":"JMIR MHealth UHealth"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1037\/str0000137","article-title":"Integrating wearables in stress management interventions: Promising evidence from a randomized trial","volume":"27","author":"Smith","year":"2020","journal-title":"Int. J. Stress Manag."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41398-021-01445-0","article-title":"Personalized machine learning of depressed mood using wearables","volume":"11","author":"Shah","year":"2021","journal-title":"Transl. Psychiatry"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1109\/MWC.2017.1600423","article-title":"When smart wearables meet intelligent vehicles: Challenges and future directions","volume":"24","author":"Sun","year":"2017","journal-title":"IEEE Wirel. Commun."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1109\/TMC.2018.2837758","article-title":"Ptrack: Enhancing the applicability of pedestrian tracking with wearables","volume":"18","author":"Jiang","year":"2018","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Buruk, O., Salminen, M., Xi, N., Nummenmaa, T., and Hamari, J. (2021, January 8\u201313). Towards the Next Generation of Gaming Wearables. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445785"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Buruk, O., and Hamari, J. (2021, January 8\u201313). Towards the Next Generation of Extended Reality Wearables. Proceedings of the Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411763.3451697"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1109\/MMM.2017.2664019","article-title":"Revolutionizing wearables for 5G: 5G technologies: Recent developments and future perspectives for wearable devices and antennas","volume":"18","author":"Aun","year":"2017","journal-title":"IEEE Microw. Mag."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"03119007","DOI":"10.1061\/(ASCE)CO.1943-7862.0001708","article-title":"Wearable sensing technology applications in construction safety and health","volume":"145","author":"Ahn","year":"2019","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Svertoka, E., Rusu-Casandra, A., and Marghescu, I. (2020, January 18\u201320). State-of-the-Art of Industrial Wearables: A Systematic Review. Proceedings of the 2020 13th International Conference on Communications (COMM), Bucharest, Romania.","DOI":"10.1109\/COMM48946.2020.9141982"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"957","DOI":"10.3389\/fphys.2020.00957","article-title":"Ecological validation and reliability of hexoskin wearable body metrics tool in measuring pre-exercise and peak heart rate during shuttle run test in professional handball players","volume":"11","author":"Haddad","year":"2020","journal-title":"Front. Physiol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"e20738","DOI":"10.2196\/20738","article-title":"Factors Affecting the Quality of Person-Generated Wearable Device Data and Associated Challenges: Rapid Systematic Review","volume":"9","author":"Cho","year":"2021","journal-title":"JMIR MHealth UHealth"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Martinez, G.J., Mattingly, S.M., Mirjafari, S., Nepal, S.K., Campbell, A.T., Dey, A.K., and Striegel, A.D. (2020, January 23\u201327). On the quality of real-world wearable data in a longitudinal study of information workers. Proceedings of the 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), Austin, TX, USA.","DOI":"10.1109\/PerComWorkshops48775.2020.9156113"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bizzego, A., Gabrieli, G., Furlanello, C., and Esposito, G. (2020). Comparison of wearable and clinical devices for acquisition of peripheral nervous system signals. Sensors, 20.","DOI":"10.1101\/2020.10.27.356980"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10916-017-0796-2","article-title":"Effect of missing inter-beat interval data on heart rate variability analysis using wrist-worn wearables","volume":"41","author":"Baek","year":"2017","journal-title":"J. Med. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Barrios, L., Oldrati, P., Santini, S., and Lutterotti, A. (2019, January 20\u201323). Evaluating the accuracy of heart rate sensors based on photoplethysmography for in-the-wild analysis. Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare, Trento, Italy.","DOI":"10.1145\/3329189.3329215"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"094001","DOI":"10.1088\/1361-6579\/abaaf0","article-title":"Comparison of different modulations of photoplethysmography in extracting respiratory rate: From a physiological perspective","volume":"41","author":"Liu","year":"2020","journal-title":"Physiol. Meas."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Yang, S.Y., and Lin, Y.P. (2020, January 20\u201324). Validating a LEGO-Like EEG Headset for a Simultaneous Recording of Wet-and Dry-Electrode Systems During Treadmill Walking. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada.","DOI":"10.1109\/EMBC44109.2020.9176190"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"e18694","DOI":"10.2196\/18694","article-title":"Reliability and validity of commercially available wearable devices for measuring steps, energy expenditure, and heart rate: Systematic review","volume":"8","author":"Fuller","year":"2020","journal-title":"JMIR MHealth UHealth"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Daly, I., Pichiorri, F., Faller, J., Kaiser, V., Kreilinger, A., Scherer, R., and M\u00fcller-Putz, G. (September, January 28). What does clean EEG look like?. Proceedings of the 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, USA.","DOI":"10.1109\/EMBC.2012.6346834"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zaman, M.S., and Morshed, B.I. (2020, January 20\u201324). Estimating Reliability of Signal Quality of Physiological Data from Data Statistics Itself for Real-time Wearables. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada.","DOI":"10.1109\/EMBC44109.2020.9175317"},{"key":"ref_29","unstructured":"Behar, J., Oster, J., Li, Q., and Clifford, G. (2012). A single channel ECG quality metric. 2012 Computing in Cardiology, IEEE."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"193214","DOI":"10.1109\/ACCESS.2020.3033472","article-title":"Assessing the Quality of Wearable EEG Systems Using Functional Connectivity","volume":"8","author":"Mahdid","year":"2020","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1080\/24699322.2018.1560088","article-title":"A new modified wavelet-based ECG denoising","volume":"24","author":"Wang","year":"2019","journal-title":"Comput. Assist. Surg."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"S25","DOI":"10.1111\/epi.16527","article-title":"Signal quality and patient experience with wearable devices for epilepsy management","volume":"61","author":"Nasseri","year":"2020","journal-title":"Epilepsia"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1109\/JSEN.2011.2115236","article-title":"Automatic artifact rejection from multichannel scalp EEG by wavelet ICA","volume":"12","author":"Mammone","year":"2011","journal-title":"IEEE Sens. J."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2082","DOI":"10.4304\/jcp.9.9.2082-2090","article-title":"A Single-Channel ICA-R Method for Speech Signal Denoising combining EMD and Wavelet","volume":"9","author":"Qi","year":"2014","journal-title":"J. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1109\/TBME.2010.2099229","article-title":"An adaptive Kalman filter for ECG signal enhancement","volume":"58","author":"Vullings","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"341","DOI":"10.3389\/fnins.2021.611962","article-title":"Adaptive filtering for improved eeg-based mental workload assessment of ambulant users","volume":"15","author":"Rosanne","year":"2021","journal-title":"Front. Neurosci."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Arsene, C.T., Hankins, R., and Yin, H. (2019, January 2\u20136). Deep learning models for denoising ECG signals. Proceedings of the 2019 27th European Signal Processing Conference (EUSIPCO), Coruna, Spain.","DOI":"10.23919\/EUSIPCO.2019.8902833"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1109\/TCBB.2020.2976981","article-title":"A new ECG denoising framework using generative adversarial network","volume":"18","author":"Singh","year":"2020","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Michelsanti, D., Tan, Z.H., Zhang, S.X., Xu, Y., Yu, M., Yu, D., and Jensen, J. (2021). An overview of deep-learning-based audio-visual speech enhancement and separation. arXiv.","DOI":"10.1109\/TASLP.2021.3066303"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"e25415","DOI":"10.2196\/25415","article-title":"Assessing Electrocardiogram and Respiratory Signal Quality of a Wearable Device (SensEcho): Semisupervised Machine Learning-Based Validation Study","volume":"9","author":"Xu","year":"2021","journal-title":"JMIR MHealth UHealth"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.bspc.2016.09.005","article-title":"Trends in EEG-BCI for daily-life: Requirements for artifact removal","volume":"31","author":"Minguillon","year":"2017","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"97","DOI":"10.3389\/fnins.2018.00097","article-title":"The Harvard Automated Processing Pipeline for Electroencephalography (HAPPE): Standardized processing software for developmental and high-artifact data","volume":"12","author":"Wilkinson","year":"2018","journal-title":"Front. Neurosci."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1038\/s41591-020-0791-x","article-title":"Deep learning models for electrocardiograms are susceptible to adversarial attack","volume":"26","author":"Han","year":"2020","journal-title":"Nat. Med."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Cassani, R., and Falk, T.H. (2018). Spectrotemporal modeling of biomedical signals: Theoretical foundation and applications. Reference Module in Biomedical Sciences, Elsevier.","DOI":"10.1016\/B978-0-12-801238-3.99993-8"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1613","DOI":"10.1109\/TBME.2014.2355135","article-title":"MS-QI: A modulation spectrum-based ECG quality index for telehealth applications","volume":"63","author":"Tobon","year":"2014","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Cassani, R., Falk, T.H., Horai, A., and Gheorghe, L.A. (2019, January 27\u201330). Evaluating the measurement of driver heart and breathing rates from a sensor-equipped steering wheel using spectrotemporal signal processing. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zeland.","DOI":"10.1109\/ITSC.2019.8916959"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Tob\u00f3n, D.P., and Falk, T.H. (2015, January 3\u20136). Online ECG quality assessment for context-aware wireless body area networks. Proceedings of the 2015 IEEE 28th Canadian Conference on Electrical and Computer Engineering (CCECE), Halifax, NS, Canada.","DOI":"10.1109\/CCECE.2015.7129341"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2670","DOI":"10.1121\/1.409836","article-title":"Effect of reducing slow temporal modulations on speech reception","volume":"95","author":"Drullman","year":"1994","journal-title":"J. Acoust. Soc. Am."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Plomp, R., Houtgast, T., and Steeneken, H.J. (2020). The modulation transfer function in audition. Limits in Perception, CRC Press.","DOI":"10.1201\/9780367813819-7"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1766","DOI":"10.1109\/TASL.2010.2052247","article-title":"A non-intrusive quality and intelligibility measure of reverberant and dereverberated speech","volume":"18","author":"Falk","year":"2010","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1109\/TIM.2009.2024697","article-title":"Temporal dynamics for blind measurement of room acoustical parameters","volume":"59","author":"Falk","year":"2010","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Braun, S., Santos, J.F., Habets, E.A., and Falk, T.H. (2018, January 15\u201320). Dual-channel modulation energy metric for direct-to-reverberation ratio estimation. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8461421"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Santos, J.F., Senoussaoui, M., and Falk, T.H. (2014, January 8\u201311). An improved non-intrusive intelligibility metric for noisy and reverberant speech. Proceedings of the 2014 14th International Workshop on Acoustic Signal Enhancement (IWAENC), Juan-les-Pins, France.","DOI":"10.1109\/IWAENC.2014.6953337"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1016\/j.specom.2013.04.001","article-title":"Objective speech intelligibility measurement for cochlear implant users in complex listening environments","volume":"55","author":"Santos","year":"2013","journal-title":"Speech Commun."},{"key":"ref_55","unstructured":"Senoussaoui, M., Santos, J.F., and Falk, T.H. (2015). SRMR variants for improved blind room acoustics characterization. arXiv."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1109\/TASLP.2019.2912123","article-title":"Non-intrusive speech quality prediction using modulation energies and lstm-network","volume":"27","author":"Cauchi","year":"2019","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_57","unstructured":"Santos, J.F., Bouserhal, R., Voix, J., and Falk, T.H. (2016, January 29\u201331). Objective speech quality estimation of in-ear microphone speech. Proceedings of the 5th ISCA\/DEGA Workshop on Perceptual Quality of Systems (PQS 2016), Berlin, Germany."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13634-016-0306-6","article-title":"A summary of the REVERB challenge: State-of-the-art and remaining challenges in reverberant speech processing research","volume":"2016","author":"Kinoshita","year":"2016","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1681","DOI":"10.1109\/TASLP.2016.2577502","article-title":"Estimation of room acoustic parameters: The ACE challenge","volume":"24","author":"Eaton","year":"2016","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1109\/MSP.2014.2358871","article-title":"Objective quality and intelligibility prediction for users of assistive listening devices: Advantages and limitations of existing tools","volume":"32","author":"Falk","year":"2015","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_61","first-page":"421","article-title":"Adaptive spectro-temporal filtering for electrocardiogram signal enhancement","volume":"22","author":"Falk","year":"2016","journal-title":"IEEE J. Biomed. Health Informatics"},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Pan, J., and Tompkins, W.J. (1985). A real-time QRS detection algorithm. IEEE Transactions on Biomedical Engineering, IEEE.","DOI":"10.1109\/TBME.1985.325532"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Tiwari, A., Albuquerque, I., Parent, M., Gagnon, J.F., Lafond, D., Tremblay, S., and Falk, T.H. (2019, January 21\u201324). A Comparison of Two ECG Inter-beat Interval Measurement Methods for HRV-Based MentalWorkload Prediction of Ambulant Users. Proceedings of the CMBES Proceedings, Ottawa, ON, Canada.","DOI":"10.3390\/e21080783"},{"key":"ref_64","unstructured":"Hermansky, H., Wan, E.A., and Avendano, C. (1995, January 9\u201312). Speech enhancement based on temporal processing. Proceedings of the 1995 International Conference on Acoustics, Speech, and Signal Processing, Detroit, MI, USA."},{"key":"ref_65","unstructured":"Avendano, C., Hermansky, H., Vis, M., and Bayya, A. (October, January 30). Adaptive speech enhancement using frequency-specific SNR estimates. Proceedings of the IVTTA\u201996 Workshop on Interactive Voice Technology for Telecommunications Applications, Basking Ridge, NJ, USA."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1109\/89.326616","article-title":"RASTA processing of speech","volume":"2","author":"Hermansky","year":"1994","journal-title":"IEEE Trans. Speech Audio Process."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Falk, T.H., Stadler, S., Kleijn, W.B., and Chan, W.Y. (2007, January 27\u201331). Noise suppression based on extending a speech-dominated modulation band. Proceedings of the Eighth Annual Conference of the International Speech Communication Association, Antwerp, Belgium.","DOI":"10.21437\/Interspeech.2007-345"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Karimian-Azari, S., and Falk, T.H. (2017, January 15\u201318). Modulation spectrum based beamforming for speech enhancement. Proceedings of the 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, NY, USA.","DOI":"10.1109\/WASPAA.2017.8170001"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"101812","DOI":"10.1016\/j.bspc.2019.101812","article-title":"Improved motor imagery brain-computer interface performance via adaptive modulation filtering and two-stage classification","volume":"57","author":"Cassani","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_70","unstructured":"Cassani, R., Narayanan, S., and Falk, T.H. (2018, January 8\u201311). Respiration rate estimation from noisy electrocardiograms based on modulation spectral analysis. Proceedings of the CMBES Proceedings, Charlottetown, PEI, Canada."},{"key":"ref_71","unstructured":"Falk, T.H., Chan, W.Y., Sejdic, E., and Chau, T. (2010). Spectro-temporal analysis of auscultatory sounds. New Developments in Biomedical Engineering, IntechOpen."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JTEHM.2017.2767603","article-title":"Spectro-temporal electrocardiogram analysis for noise-robust heart rate and heart rate variability measurement","volume":"5","author":"Tobon","year":"2017","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/TASL.2009.2023679","article-title":"Modulation spectral features for robust far-field speaker identification","volume":"18","author":"Falk","year":"2009","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1109\/TAFFC.2018.2858255","article-title":"Feature pooling of modulation spectrum features for improved speech emotion recognition in the wild","volume":"12","author":"Avila","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Avila, A.R., Kshirsagar, S.R., Tiwari, A., Lafond, D., O\u2019Shaughnessy, D., and Falk, T.H. (2019, January 2\u20136). Speech-based stress classification based on modulation spectral features and convolutional neural networks. Proceedings of the 2019 27th European Signal Processing Conference (EUSIPCO), Coruna, Spain.","DOI":"10.23919\/EUSIPCO.2019.8903014"},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1109\/LSP.2013.2266860","article-title":"Whispered speech detection in noise using auditory-inspired modulation spectrum features","volume":"20","author":"Falk","year":"2013","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.specom.2018.07.005","article-title":"Fusion of bottleneck, spectral and modulation spectral features for improved speaker verification of neutral and whispered speech","volume":"102","author":"Falk","year":"2018","journal-title":"Speech Commun."},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Drouin-Picaro, A., Albuquerque, I., Gagnon, J.F., Lafond, D., and Falk, T.H. (2017, January 5\u20138). EEG coupling features: Towards mental workload measurement based on wearables. Proceedings of the 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, AB, USA.","DOI":"10.1109\/SMC.2017.8122573"},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Albuquerque, I., Rosanne, O., Gagnon, J.F., Tremblay, S., and Falk, T.H. (2019, January 20\u201323). Fusion of spectral and spectro-temporal EEG features for mental workload assessment under different levels of physical activity. Proceedings of the 2019 9th International IEEE\/EMBS Conference on Neural Engineering (NER), San Francisco, CA, USA.","DOI":"10.1109\/NER.2019.8717092"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"115","DOI":"10.3389\/fncom.2017.00115","article-title":"Electroencephalography amplitude modulation analysis for automated affective tagging of music video clips","volume":"11","author":"Clerico","year":"2018","journal-title":"Front. Comput. Neurosci."},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Trambaiolli, L.R., Cassani, R., and Falk, T.H. (2020, January 20\u201324). EEG spectro-temporal amplitude modulation as a measurement of cortical hemodynamics: An EEG-fNIRS study. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada.","DOI":"10.1109\/EMBC44109.2020.9175409"},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Trambaiolli, L., Cassani, R., Biazoli, C., Cravo, A., Sato, J., and Falk, T. (2018, January 7\u201310). Resting-awake EEG amplitude modulation can predict performance of an fNIRS-based neurofeedback task. Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan.","DOI":"10.1109\/SMC.2018.00199"},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1109\/JSEN.2020.3013996","article-title":"Improved gait speed calculation via modulation spectral analysis of noisy accelerometer data","volume":"21","author":"Tobon","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.gaitpost.2016.09.023","article-title":"Evaluation of the performance of accelerometer-based gait event detection algorithms in different real-world scenarios using the MAREA gait database","volume":"51","author":"Khandelwal","year":"2017","journal-title":"Gait Posture"},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Fraga, F.J., Falk, T.H., Kanda, P.A., and Anghinah, R. (2013). Characterizing Alzheimer\u2019s disease severity via resting-awake EEG amplitude modulation analysis. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0072240"},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"55","DOI":"10.3389\/fnagi.2014.00055","article-title":"The effects of automated artifact removal algorithms on electroencephalography-based Alzheimer\u2019s disease diagnosis","volume":"6","author":"Cassani","year":"2014","journal-title":"Front. Aging Neurosci."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.bspc.2016.12.009","article-title":"Towards automated electroencephalography-based Alzheimer\u2019s disease diagnosis using portable low-density devices","volume":"33","author":"Cassani","year":"2017","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_88","first-page":"1982","article-title":"Alzheimer\u2019s disease diagnosis and severity level detection based on electroencephalography modulation spectral \u201cpatch\u201d features","volume":"24","author":"Cassani","year":"2019","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Lopes, M.K.S., Cassani, R., and Falk, T.H. (2021, January 26\u201330). On the use of saliency maps and convolutional neural networks for improved Alzheimer\u2019s disease assessment. Proceedings of the 2021 Alzheimer\u2019s Association International Conference, Denver, CO, USA.","DOI":"10.1002\/alz.054710"},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1016\/j.specom.2011.03.007","article-title":"Characterization of atypical vocal source excitation, temporal dynamics and prosody for objective measurement of dysarthric word intelligibility","volume":"54","author":"Falk","year":"2012","journal-title":"Speech Commun."},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Paja, M.S., and Falk, T.H. (2012, January 9\u201313). Automated dysarthria severity classification for improved objective intelligibility assessment of spastic dysarthric speech. Proceedings of the Thirteenth Annual Conference of the International Speech Communication Association, Portland, OR, USA.","DOI":"10.21437\/Interspeech.2012-26"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Bedoya, S., Katz, N.B., Brian, J., O\u2019Shaughnessy, D., and Falk, T.H. (2020). Acoustic and prosodic analysis of vocalizations of 18-month-old toddlers with autism spectrum disorder. Acoustic Analysis of Pathologies, De Gruyter.","DOI":"10.1515\/9781501513138-003"},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Zhu, Y., and Falk, T.H. (2022, January 22\u201327). Fusion of Modulation Spectral and Spectral Features with Symptom Metadata for Improved Speech-Based Covid-19 Detection. Proceedings of the 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore.","DOI":"10.1109\/ICASSP43922.2022.9746471"},{"key":"ref_94","unstructured":"Atlas, L., Clark, P., and Schimmel, S. (2010). Modulation Toolbox Version 2.1 for Matlab, University of Washington."},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Cassani, R., Albuquerque, I., Monteiro, J., and Falk, T.H. (2019, January 11\u201314). AMA: An Open-source Amplitude Modulation Analysis Toolkit for Signal Processing Applications. Proceedings of the 2019 IEEE Global Conference on Signal and Information Processing (GlobalSIP), Ottawa, ON, Canada.","DOI":"10.1109\/GlobalSIP45357.2019.8969210"},{"key":"ref_96","unstructured":"Pimentel, A., Tiwari, A., and Falk, T.H. (2021, January 11\u201313). Human Mental State Monitoring in the Wild: Are We Better Off with Deeper Neural Networks or Improved Input Features?. Proceedings of the CMBES Proceedings, Virtual."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"e2632","DOI":"10.1002\/jnm.2632","article-title":"Cognitive health care system and its application in pill-rolling assessment","volume":"32","author":"Shah","year":"2019","journal-title":"Int. J. Numer. Model. Electron. Netw. Devices Fields"},{"key":"ref_98","doi-asserted-by":"crossref","unstructured":"Saeed, U., Yaseen Shah, S., Aziz Shah, S., Liu, H., Alhumaidi Alotaibi, A., Althobaiti, T., Ramzan, N., Ullah Jan, S., Ahmad, J., and H Abbasi, Q. (2022). Multiple Participants\u2019 Discrete Activity Recognition in a Well-Controlled Environment Using Universal Software Radio Peripheral Wireless Sensing. Sensors, 22.","DOI":"10.3390\/s22030809"},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.jvcir.2016.10.012","article-title":"Joint enhancement-compression of handwritten document images through DjVu encoder","volume":"41","author":"Yagoubi","year":"2016","journal-title":"J. Vis. Commun. Image Represent."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/12\/4579\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:33:49Z","timestamp":1760139229000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/12\/4579"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,17]]},"references-count":99,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22124579"],"URL":"https:\/\/doi.org\/10.3390\/s22124579","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,17]]}}}