{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,8,2]],"date-time":"2023-08-02T04:06:47Z","timestamp":1690949207491},"reference-count":36,"publisher":"Acoustical Society of America (ASA)","issue":"4","content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2016,10,1]]},"abstract":"<jats:p>High-speed videoendoscopy (HSV) enables observation of the true vibratory behavior of the vocal folds. To quantify the vocal fold vibration captured by the HSV, lateral movement features (e.g., glottal width and vocal fold edge displacements) have been extracted as functions of time. The most common analysis method is to extract the features on a lateral strip used to form digital kymogram. The weakness of this method is that it can only capture the vibrational behavior local to the strip location. While the multi-line kymographic approach has been utilized to capture the spatial diversity, the observation points are either fixed or manually positioned. Behaviors of pathological vocal folds, especially those with lesions, are expected to be spatially diverse and also diverse among speakers, making fixed observation points ineffective. This paper proposes a technique to synthesize kymographic waveforms from full spatiotemporal HSV feature data to extract distinctive behaviors automatically. Each synthesized waveform represents a non-overlapping section of the glottis, where vocal folds are locally behaving homogeneously. The efficacy of the algorithm is demonstrated with four HSV recordings (three pathological) and discussed, including mitigation of the known drawbacks.<\/jats:p>","DOI":"10.1121\/1.4964400","type":"journal-article","created":{"date-parts":[[2016,10,17]],"date-time":"2016-10-17T17:00:46Z","timestamp":1476723646000},"page":"2703-2713","update-policy":"http:\/\/dx.doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":1,"title":["Synthetic multi-line kymographic analysis: A spatiotemporal data reduction technique for high-speed videoendoscopy"],"prefix":"10.1121","volume":"140","author":[{"given":"Takeshi","family":"Ikuma","sequence":"first","affiliation":[{"name":"Louisiana State University Health Sciences Center Department of Otolaryngology\u2013Head and Neck Surgery, , New Orleans, Louisiana 70112, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Melda","family":"Kunduk","sequence":"additional","affiliation":[{"name":"Louisiana State University Department of Communication Disorders, , Baton Rouge, Louisiana 70803, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Fink","sequence":"additional","affiliation":[{"name":"Louisiana State University Health Sciences Center Department of Otolaryngology\u2013Head and Neck Surgery, , New Orleans, Louisiana 70112, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew J.","family":"McWhorter","sequence":"additional","affiliation":[{"name":"Louisiana State University Health Sciences Center Department of Otolaryngology\u2013Head and Neck Surgery, , New Orleans, Louisiana 70112, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"231","published-online":{"date-parts":[[2016,10,17]]},"reference":[{"issue":"7","key":"2023080103300603800_c1","first-page":"203","article-title":"High speed motion pictures of human vocal cords","volume":"18","year":"1940","journal-title":"Bell Lab. Rec."},{"issue":"1","key":"2023080103300603800_c2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1001\/archotol.1958.00730020005001","article-title":"Laryngeal vibrations: Measurements of the glottic wave: Part I. the normal vibratory cycle","volume":"68","year":"1958","journal-title":"Arch. Otolaryngol."},{"issue":"4","key":"2023080103300603800_c3","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1001\/archotol.1959.00730030448011","article-title":"Laryngeal vibrations: Measurements of the glottic wave: Part II. physiologic variations","volume":"69","year":"1959","journal-title":"Arch. Otolaryngol."},{"issue":"1","key":"2023080103300603800_c4","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1001\/archotol.1960.03770010020003","article-title":"Laryngeal vibrations: Measurements of the glottic wave: Part III. the pathologic larynx","volume":"71","year":"1960","journal-title":"Arch. Otolaryngol."},{"issue":"6","key":"2023080103300603800_c5","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1016\/S0895-6111(99)00030-0","article-title":"Imaging of vocal fold vibration by digital multi-plane kymography","volume":"23","year":"1999","journal-title":"Comput. Med. Imag. Grap."},{"issue":"6","key":"2023080103300603800_c6","doi-asserted-by":"publisher","first-page":"3179","DOI":"10.1121\/1.1406498","article-title":"Spatio-temporal analysis of irregular vocal fold oscillations: Biphonation due to desynchronization of spatial modes","volume":"110","year":"2001","journal-title":"J. Acoust. Soc. Am."},{"issue":"2","key":"2023080103300603800_c7","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1159\/000263973","article-title":"Analysis of high-speed motion pictures of the vocal folds","volume":"27","year":"1975","journal-title":"Folia Phoniat."},{"issue":"6","key":"2023080103300603800_c8","doi-asserted-by":"publisher","first-page":"816.e13","DOI":"10.1016\/j.jvoice.2012.04.009","article-title":"Analysis of longitudinal phase differences in vocal-fold vibration using synchronous high-speed videoendoscopy and electroglottography","volume":"26","year":"2012","journal-title":"J. Voice"},{"issue":"2","key":"2023080103300603800_c9","doi-asserted-by":"publisher","first-page":"S648","DOI":"10.1044\/2014_JSLHR-S-12-0269","article-title":"Characteristics of vocal fold vibrations in vocally healthy subjects: Analysis with multi line kymography","volume":"57","year":"2014","journal-title":"J. Speech Lang. Hear. Res."},{"issue":"3","key":"2023080103300603800_c10","doi-asserted-by":"publisher","first-page":"035201","DOI":"10.1103\/PhysRevE.72.035201","article-title":"Spatiotemporal chaos in excised larynx vibrations","volume":"72","year":"2005","journal-title":"Phys. Rev. E"},{"issue":"3","key":"2023080103300603800_c11","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1109\/TMI.2007.903690","article-title":"Phonovibrography: Mapping high-speed movies of vocal fold vibrations into 2-d diagrams for visualizing and analyzing the underlying laryngeal dynamics","volume":"27","year":"2008","journal-title":"IEEE Trans. Med. Imag."},{"issue":"3","key":"2023080103300603800_c12","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1159\/000263565","article-title":"A data processing scheme for frame by frame film analysis","volume":"24","year":"1972","journal-title":"Folia Phoniat."},{"issue":"4","key":"2023080103300603800_c13","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1109\/TBME.1979.326556","article-title":"Automated analysis of ultra high-speed laryngeal films","volume":"BME-26","year":"1979","journal-title":"IEEE Trans. Biomed. Eng."},{"issue":"5","key":"2023080103300603800_c14","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1177\/000348940010900501","article-title":"Glottal area waveform analysis of benign vocal fold lesions before and after surgery","volume":"109","year":"2000","journal-title":"Ann. Otol. Rhinol. Laryngol."},{"issue":"2","key":"2023080103300603800_c15","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.jvoice.2004.04.006","article-title":"Analysis of vocal-fold vibrations from high-speed laryngeal images using a Hilbert transform-based methodology","volume":"19","year":"2005","journal-title":"J. Voice"},{"key":"2023080103300603800_c16","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1044\/2013_JSLHR-S-12-0202","article-title":"Objective quantification of pre and post phonosurgery vocal fold vibratory characteristics using high-speed videoendoscopy and a harmonic waveform model","volume":"57","year":"2014","journal-title":"J. Speech Lang. Hear. Res."},{"issue":"5","key":"2023080103300603800_c17","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1109\/79.952802","article-title":"Theoretical foundations of transform coding","volume":"18","year":"2001","journal-title":"IEEE Signal Process. Mag."},{"issue":"2","key":"2023080103300603800_c18","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/MASSP.1984.1162229","article-title":"Vector quantization","volume":"1","year":"1984","journal-title":"IEEE ASSP Mag."},{"issue":"3","key":"2023080103300603800_c19","doi-asserted-by":"publisher","first-page":"EL36","DOI":"10.1121\/1.2234519","article-title":"Mechanisms of irregular vibration in a physical model of the vocal folds","volume":"120","year":"2006","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080103300603800_c20","first-page":"1027","article-title":"k-means++: The advantages of careful seeding","year":"2007"},{"issue":"2","key":"2023080103300603800_c21","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least squares quantization in PCM","volume":"28","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"issue":"3","key":"2023080103300603800_c22","doi-asserted-by":"publisher","first-page":"736","DOI":"10.1121\/1.380498","article-title":"Normal modes in vocal cord tissues","volume":"57","year":"1975","journal-title":"J. Acoust. Soc. Am."},{"issue":"6","key":"2023080103300603800_c23","doi-asserted-by":"publisher","first-page":"1366","DOI":"10.1121\/1.381230","article-title":"On the mechanics of vocal-fold vibration","volume":"60","year":"1976","journal-title":"J. Acoust. Soc. Am."},{"issue":"4","key":"2023080103300603800_c24","doi-asserted-by":"publisher","first-page":"2656","DOI":"10.1121\/1.417435","article-title":"The normal modes of vocal fold tissues","volume":"100","year":"1996","journal-title":"J. Acoust. Soc. Am."},{"issue":"5","key":"2023080103300603800_c25","doi-asserted-by":"publisher","first-page":"576","DOI":"10.1016\/j.jvoice.2010.04.004","article-title":"Multiparametric analysis of vocal fold vibrations in healthy and disordered voices in high-speed imaging","volume":"25","year":"2011","journal-title":"J. Voice"},{"issue":"4","key":"2023080103300603800_c26","doi-asserted-by":"publisher","first-page":"1022","DOI":"10.1044\/1092-4388(2010\/10-0105)","article-title":"Quantitative study of vibrational symmetry of injured vocal folds via digital kymography in excised canine larynges","volume":"54","year":"2011","journal-title":"J. Speech Lang. Hear. Res."},{"issue":"1","key":"2023080103300603800_c27","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1044\/1092-4388(2010\/10-0026)","article-title":"Automated measurement of vocal fold vibratory asymmetry from high-speed videoendoscopy recordings","volume":"54","year":"2011","journal-title":"J. Speech Lang. Hear. Res."},{"issue":"6","key":"2023080103300603800_c28","doi-asserted-by":"publisher","first-page":"2996","DOI":"10.1121\/1.1314398","article-title":"Irregular vocal-fold vibration\u2014High-speed observation and modeling","volume":"108","year":"2000","journal-title":"J. Acoust. Soc. Am."},{"issue":"3","key":"2023080103300603800_c29","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1159\/000070724","article-title":"An automatic method to quantify the vibration properties of human vocal folds via videokymography","volume":"55","year":"2003","journal-title":"Folia Phoniat."},{"key":"2023080103300603800_c30","doi-asserted-by":"publisher","first-page":"182","DOI":"10.3109\/14015439.2012.731083","article-title":"Vocal fold vibration amplitude, open quotient, speed quotient and their variability along glottal length: Kymographic data from normal subjects","volume":"38","year":"2013","journal-title":"Logoped. Phoniatr. Vocol."},{"issue":"4","key":"2023080103300603800_c31","doi-asserted-by":"publisher","first-page":"043114","DOI":"10.1063\/1.2784384","article-title":"Quantifying the complexity of excised larynx vibrations from high-speed imaging using spatiotemporal and nonlinear dynamic analyses","volume":"17","year":"2007","journal-title":"Chaos"},{"issue":"4","key":"2023080103300603800_c32","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1016\/j.jvoice.2013.01.014","article-title":"Preprocessing techniques for high-speed videoendoscopy analysis","volume":"27","year":"2013","journal-title":"J. Voice"},{"key":"2023080103300603800_c33","doi-asserted-by":"publisher","article-title":"A spatiotemporal approach to the objective analysis of initiation and termination of vocal-fold oscillation with high-speed videoendoscopy","journal-title":"J. Voice","DOI":"10.1016\/j.jvoice.2015.09.007"},{"issue":"5","key":"2023080103300603800_c34","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1109\/MCOM.1977.1089500","article-title":"Quantization","volume":"15","year":"1977","journal-title":"IEEE Commun. Soc. Mag."},{"issue":"6","key":"2023080103300603800_c35","doi-asserted-by":"publisher","first-page":"1744","DOI":"10.1109\/TBME.2009.2015772","article-title":"Improving reliability and accuracy of vibration parameters of vocal folds based on high-speed video and electroglottography","volume":"56","year":"2009","journal-title":"IEEE Trans. Biomed. Eng."},{"issue":"1","key":"2023080103300603800_c36","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.jvoice.2008.03.003","article-title":"Efficient and effective extraction of vocal fold vibratory patterns from high-speed digital imaging","volume":"24","year":"2010","journal-title":"J. Voice"}],"container-title":["The Journal of the Acoustical Society of America"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/140\/4\/2703\/13693141\/2703_1_online.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/140\/4\/2703\/13693141\/2703_1_online.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T03:30:16Z","timestamp":1690860616000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jasa\/article\/140\/4\/2703\/920725\/Synthetic-multi-line-kymographic-analysis-A"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,10,1]]},"references-count":36,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,10,1]]}},"URL":"https:\/\/doi.org\/10.1121\/1.4964400","relation":{},"ISSN":["0001-4966","1520-8524"],"issn-type":[{"value":"0001-4966","type":"print"},{"value":"1520-8524","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2016,10]]},"published":{"date-parts":[[2016,10,1]]}}}