{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T14:09:28Z","timestamp":1740146968145,"version":"3.37.3"},"reference-count":45,"publisher":"Public Library of Science (PLoS)","issue":"8","license":[{"start":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T00:00:00Z","timestamp":1691625600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-20-1-2590"],"award-info":[{"award-number":["N00014-20-1-2590"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Doppler ultrasound (DU) is used in decompression research to detect venous gas emboli in the precordium or subclavian vein, as a marker of decompression stress. This is of relevance to scuba divers, compressed air workers and astronauts to prevent decompression sickness (DCS) that can be caused by these bubbles upon or after a sudden reduction in ambient pressure. Doppler ultrasound data is graded by expert raters on the Kisman-Masurel or Spencer scales that are associated to DCS risk. Meta-analyses, as well as efforts to computer-automate DU grading, both necessitate access to large databases of well-curated and graded data. Leveraging previously collected data is especially important due to the difficulty of repeating large-scale extreme military pressure exposures that were conducted in the 70-90s in austere environments. Historically, DU data (Non-speech) were often captured on cassettes in one-channel audio with superimposed human speech describing the experiment (Speech). Digitizing and separating these audio files is currently a lengthy, manual task. In this paper, we develop a graphical user interface (GUI) to perform automatic speech recognition and aid in Non-speech and Speech separation. This constitutes the first study incorporating speech processing technology in the field of diving research. If successful, it has the potential to significantly accelerate the reuse of previously-acquired datasets. The recognition task incorporates the Google speech recognizer to detect the presence of human voice activity together with corresponding timestamps. The detected human speech is then separated from the audio Doppler ultrasound within the developed GUI. Several experiments were conducted on recently digitized audio Doppler recordings to corroborate the effectiveness of the developed GUI in recognition and separations tasks, and these are compared to manual labels for Speech timestamps. The following metrics are used to evaluate performance: the average absolute differences between the reference and detected Speech starting points, as well as the percentage of detected Speech over the total duration of the reference Speech. Results have shown the efficacy of the developed GUI in Speech\/Non-speech component separation.<\/jats:p>","DOI":"10.1371\/journal.pone.0283953","type":"journal-article","created":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T17:41:24Z","timestamp":1691689284000},"page":"e0283953","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Development of a graphical user interface for automatic separation of human voice from Doppler ultrasound audio in diving experiments"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8520-8457","authenticated-orcid":true,"given":"Arian","family":"Azarang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S. Lesley","family":"Blogg","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joshua","family":"Currens","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rachel M.","family":"Lance","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4432-0332","authenticated-orcid":true,"given":"Richard E.","family":"Moon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Lindholm","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Virginie","family":"Papadopoulou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2023,8,10]]},"reference":[{"key":"pone.0283953.ref001","doi-asserted-by":"crossref","unstructured":"Wu Z, Zhao D, Liang Q, Yu J, Gulati A, Pang R. Dynamic sparsity neural networks for automatic speech recognition. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2021 Jun 6 (pp. 6014\u20136018). IEEE.","DOI":"10.1109\/ICASSP39728.2021.9414505"},{"key":"pone.0283953.ref002","doi-asserted-by":"crossref","unstructured":"Azarang A, Hansen J, Kehtarnavaz N. Combining data augmentations for CNN-based voice command recognition. In 2019 12th International Conference on Human System Interaction (HSI) 2019 Jun 25 (pp. 17\u201321). IEEE.","DOI":"10.1109\/HSI47298.2019.8942638"},{"key":"pone.0283953.ref003","doi-asserted-by":"crossref","unstructured":"Sadhu S, Hermansky H. Continual Learning in Automatic Speech Recognition. In Interspeech 2020 (pp. 1246\u20131250).","DOI":"10.21437\/Interspeech.2020-2962"},{"issue":"1","key":"pone.0283953.ref004","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1177\/0023830920911079","article-title":"Vocabulary size influences spontaneous speech in native language users: Validating the use of automatic speech recognition in individual differences research","volume":"64","author":"SR Jongman","year":"2021","journal-title":"Language and Speech"},{"key":"pone.0283953.ref005","doi-asserted-by":"crossref","unstructured":"Yoshimura T, Hayashi T, Takeda K, Watanabe S. End-to-end automatic speech recognition integrated with CTC-based voice activity detection. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2020 May 4 (pp. 6999\u20137003). IEEE.","DOI":"10.1109\/ICASSP40776.2020.9054358"},{"key":"pone.0283953.ref006","doi-asserted-by":"crossref","unstructured":"Chen PY, Wu CH, Lee HS, Tsao SK, Ko MT, Wang HM. Using Taigi dramas with Mandarin Chinese subtitles to improve Taigi speech recognition. In 2020 23rd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA) 2020 Nov 5 (pp. 71\u201376). IEEE.","DOI":"10.1109\/O-COCOSDA50338.2020.9295005"},{"key":"pone.0283953.ref007","doi-asserted-by":"crossref","unstructured":"Indurthi S, Han H, Lakumarapu NK, Lee B, Chung I, Kim S, et al. End-end speech-to-text translation with modality agnostic meta-learning. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2020 May 4 (pp. 7904\u20137908). IEEE.","DOI":"10.1109\/ICASSP40776.2020.9054759"},{"key":"pone.0283953.ref008","doi-asserted-by":"crossref","unstructured":"Tang Y, Pino J, Wang C, Ma X, Genzel D. A general multi-task learning framework to leverage text data for speech to text tasks. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2021 Jun 6 (pp. 6209\u20136213). IEEE.","DOI":"10.1109\/ICASSP39728.2021.9415058"},{"key":"pone.0283953.ref009","doi-asserted-by":"crossref","unstructured":"Bano S, Jithendra P, Niharika GL, Sikhi Y. Speech to text translation enabling multilingualism. In 2020 IEEE International Conference for Innovation in Technology (INOCON) 2020 Nov 6 (pp. 1\u20134). IEEE.","DOI":"10.1109\/INOCON50539.2020.9298280"},{"key":"pone.0283953.ref010","doi-asserted-by":"crossref","unstructured":"Stoian MC, Bansal S, Goldwater S. Analyzing ASR pretraining for low-resource speech-to-text translation. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2020 May 4 (pp. 7909\u20137913). IEEE.","DOI":"10.1109\/ICASSP40776.2020.9053847"},{"key":"pone.0283953.ref011","doi-asserted-by":"crossref","unstructured":"Yang CH, Qi J, Chen SY, Chen PY, Siniscalchi SM, Ma X, et al. Decentralizing feature extraction with quantum convolutional neural network for automatic speech recognition. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2021 Jun 6 (pp. 6523\u20136527). IEEE.","DOI":"10.1109\/ICASSP39728.2021.9413453"},{"issue":"20","key":"pone.0283953.ref012","article-title":"A neuro fuzzy classifier with linguistic hedges for speech recognition","volume":"5","author":"V HY","year":"2020","journal-title":"EAI Endorsed Transactions on Internet of Things"},{"key":"pone.0283953.ref013","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/j.neucom.2020.07.101","article-title":"Acoustic-decoy: Detection of adversarial examples through audio modification on speech recognition system","volume":"417","author":"H Kwon","year":"2020","journal-title":"Neurocomputing"},{"key":"pone.0283953.ref014","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1109\/RBME.2020.3006860","article-title":"Speech technology for healthcare: Opportunities, challenges, and state of the art","volume":"14","author":"S Latif","year":"2020","journal-title":"IEEE Reviews in Biomedical Engineering"},{"issue":"5","key":"pone.0283953.ref015","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1109\/TSA.2004.832988","article-title":"Likelihood-maximizing beamforming for robust hands-free speech recognition","volume":"12","author":"ML Seltzer","year":"2004","journal-title":"IEEE Transactions on speech and audio processing"},{"key":"pone.0283953.ref016","doi-asserted-by":"crossref","unstructured":"Herbordt W, Horiuchi T, Fujimoto M, Jitsuhiro T, Nakamura S. Hands-free speech recognition and communication on PDAs using microphone array technology. In IEEE Workshop on Automatic Speech Recognition and Understanding, 2005. 2005 Nov 5 (pp. 302\u2013307). IEEE.","DOI":"10.1109\/ASRU.2005.1566509"},{"key":"pone.0283953.ref017","doi-asserted-by":"crossref","unstructured":"Nakamura S, Hiyane K, Asano F, Kaneda Y, Yamada T, Nishiura T, et al. Design and collection of acoustic sound data for hands-free speech recognition and sound scene understanding. In Proceedings. IEEE International Conference on Multimedia and Expo 2002 Aug 26 (Vol. 2, pp. 161\u2013164). IEEE.","DOI":"10.1109\/ICME.2002.1035537"},{"issue":"5","key":"pone.0283953.ref018","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1136\/jamia.2000.0070462","article-title":"Comparative evaluation of three continuous speech recognition software packages in the generation of medical reports","volume":"7","author":"EG Devine","year":"2000","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"1","key":"pone.0283953.ref019","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1197\/jamia.M1130","article-title":"Speech recognition as a transcription aid: a randomized comparison with standard transcription","volume":"10","author":"DN Mohr","year":"2003","journal-title":"Journal of the American Medical Informatics Association"},{"key":"pone.0283953.ref020","first-page":"67","article-title":"Automatic speech recognition\u2013a brief history of the technology development. Georgia Institute of Technology. Atlanta Rutgers University and the University of California","volume":"1","author":"BH Juang","year":"2005","journal-title":"Santa Barbara"},{"key":"pone.0283953.ref021","doi-asserted-by":"crossref","unstructured":"Kepuska V, Bohouta G. Next-generation of virtual personal assistants (microsoft cortana, apple siri, amazon alexa and google home). In 2018 IEEE 8th annual computing and communication workshop and conference (CCWC) 2018 Jan 8 (pp. 99\u2013103). IEEE.","DOI":"10.1109\/CCWC.2018.8301638"},{"key":"pone.0283953.ref022","doi-asserted-by":"crossref","unstructured":"Celebre AM, Dubouzet AZ, Medina IB, Surposa AN, Gustilo RC. Home automation using raspberry Pi through Siri enabled mobile devices. In 2015 International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM) 2015 Dec 9 (pp. 1\u20136). IEEE.","DOI":"10.1109\/HNICEM.2015.7393270"},{"key":"pone.0283953.ref023","unstructured":"Shakhovska N, Basystiuk O, Shakhovska K. Development of the Speech-to-Text Chatbot Interface Based on Google API. In MoMLeT 2019 (pp. 212\u2013221)."},{"key":"pone.0283953.ref024","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/j.jocs.2018.01.001","article-title":"PAPA: a parallel programming assistant powered by IBM Watson cognitive computing technology","volume":"26","author":"S Memeti","year":"2018","journal-title":"Journal of computational science"},{"key":"pone.0283953.ref025","doi-asserted-by":"crossref","unstructured":"Tatman R, Kasten C. Effects of Talker Dialect, Gender Race on Accuracy of Bing Speech and YouTube Automatic Captions. InInterspeech 2017 Aug (pp. 934\u2013938).","DOI":"10.21437\/Interspeech.2017-1746"},{"key":"pone.0283953.ref026","doi-asserted-by":"crossref","unstructured":"Jia Y, Johnson M, Macherey W, Weiss RJ, Cao Y, Chiu CC, et al. Leveraging weakly supervised data to improve end-to-end speech-to-text translation. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2019 May 12 (pp. 7180\u20137184). IEEE.","DOI":"10.1109\/ICASSP.2019.8683343"},{"key":"pone.0283953.ref027","doi-asserted-by":"crossref","unstructured":"Harris J, Barber D. Speech and gesture interfaces for squad-level human-robot teaming. In Unmanned Systems Technology Xvi 2014 Jun 3 (Vol. 9084, pp. 82\u201392). SPIE.","DOI":"10.1117\/12.2052961"},{"issue":"1","key":"pone.0283953.ref028","doi-asserted-by":"crossref","first-page":"59","DOI":"10.22462\/01.03.2021.8","article-title":"Ultrasound in decompression research: fundamentals, considerations, and future technologies","volume":"48","author":"DQ Le","year":"2021","journal-title":"Undersea Hyperbaric Medicine: Journal of the Undersea and Hyperbaric Medical Society, Inc"},{"issue":"1","key":"pone.0283953.ref029","first-page":"26","article-title":"Consensus guidelines for the use of ultrasound for diving research","volume":"46","author":"A M\u00f8llerl\u00f8kken","year":"2016","journal-title":"Diving and Hyperbaric Medicine"},{"issue":"13","key":"pone.0283953.ref030","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1056\/NEJMra2116554","article-title":"Decompression Sickness and Arterial Gas Embolism","volume":"386","author":"SJ Mitchell","year":"2022","journal-title":"New England Journal of Medicine"},{"key":"pone.0283953.ref031","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.cis.2013.02.002","article-title":"A critical review of physiological bubble formation in hyperbaric decompression","volume":"191","author":"V Papadopoulou","year":"2013","journal-title":"Advances in colloid and interface science"},{"issue":"1","key":"pone.0283953.ref032","first-page":"14","article-title":"Sample size requirement for comparison of decompression outcomes using ultrasonically detected venous gas emboli (VGE): power calculations using Monte Carlo resampling from real data","volume":"44","author":"DJ Doolette","year":"2014","journal-title":"Diving Hyperb Med"},{"issue":"1","key":"pone.0283953.ref033","doi-asserted-by":"crossref","first-page":"57","DOI":"10.22462\/01.03.2021.7","article-title":"An echo from the past: Building a Doppler repository for big data in diving research","volume":"48","author":"V Papadopoulou","year":"2021","journal-title":"Undersea Hyperbaric Medicine: Journal of the Undersea and Hyperbaric Medical Society, Inc"},{"key":"pone.0283953.ref034","first-page":"501","article-title":"Bubble detection","volume":"5","author":"RY Nishi","year":"2003","journal-title":"Bennett and Elliott\u2019s physiology and medicine of diving"},{"issue":"3","key":"pone.0283953.ref035","first-page":"326","article-title":"Correspondence between intravascular bubbles and symptoms of decompression sickness","volume":"11","author":"BC Eatock","year":"1984","journal-title":"Undersea Biomed Res"},{"issue":"2","key":"pone.0283953.ref036","first-page":"99","article-title":"The relationship between venous gas bubbles and adverse effects of decompression after air dives","volume":"34","author":"OS Eftedal","year":"2007","journal-title":"Undersea Hyperb Med"},{"key":"pone.0283953.ref037","unstructured":"Brubakk AO, Bennett PB, Neuman TS, Elliott DH, editors. Bennett and Elliott\u2019s physiology and medicine of diving. Saunders Limited; 2003."},{"key":"pone.0283953.ref038","first-page":"93","article-title":"The use of venous gas emboli to validate dive computers","author":"SL Blogg","year":"2012","journal-title":"European Underwater and Baromedical Society"},{"key":"pone.0283953.ref039","first-page":"4","article-title":"Venous gas emboli detected by two-dimensional echocardiography are an imperfect surrogate endpoint for decompression sickness","volume":"46","author":"DJ Doolette","year":"2016","journal-title":"Diving Hyperb. Med"},{"issue":"5","key":"pone.0283953.ref040","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1109\/89.928915","article-title":"Noise power spectral density estimation based on optimal smoothing and minimum statistics","volume":"9","author":"R Martin","year":"2001","journal-title":"IEEE Transactions on speech and audio processing"},{"key":"pone.0283953.ref041","doi-asserted-by":"crossref","unstructured":"Chan W, Jaitly N, Le Q, Vinyals O. Listen, attend and spell: A neural network for large vocabulary conversational speech recognition. In 2016 IEEE international conference on acoustics, speech and signal processing (ICASSP) 2016 Mar 20 (pp. 4960\u20134964). IEEE.","DOI":"10.1109\/ICASSP.2016.7472621"},{"key":"pone.0283953.ref042","doi-asserted-by":"crossref","unstructured":"He Y, Sainath TN, Prabhavalkar R, McGraw I, Alvarez R, Zhao D, et al. Streaming end-to-end speech recognition for mobile devices. Streaming end-to-end speech recognition for mobile devices. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2019 May 12 (pp. 6381\u20136385). IEEE.","DOI":"10.1109\/ICASSP.2019.8682336"},{"key":"pone.0283953.ref043","unstructured":"Dufaux A, Besacier L, Ansorge M, Pellandini F. Automatic sound detection and recognition for noisy environment. In 2000 10th European Signal Processing Conference 2000 Sep 4 (pp. 1\u20134). IEEE."},{"key":"pone.0283953.ref044","unstructured":"Beniz D, Espindola A. Using Tkinter of python to create graphical user interface (GUI) for scripts in LNLS. WEPOPRPO25. 2016 Oct 25;9:25\u20138."},{"issue":"4","key":"pone.0283953.ref045","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1109\/89.848229","article-title":"Voice activity detection in nonstationary noise","volume":"8","author":"SG Tanyer","year":"2000","journal-title":"IEEE Transactions on speech and audio processing"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0283953","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T00:45:21Z","timestamp":1729903521000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0283953"}},"subtitle":[],"editor":[{"given":"Viacheslav","family":"Kovtun","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2023,8,10]]},"references-count":45,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,8,10]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0283953","relation":{},"ISSN":["1932-6203"],"issn-type":[{"type":"electronic","value":"1932-6203"}],"subject":[],"published":{"date-parts":[[2023,8,10]]}}}