{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:46:47Z","timestamp":1761007607238,"version":"build-2065373602"},"reference-count":56,"publisher":"Wiley","issue":"6","license":[{"start":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T00:00:00Z","timestamp":1674518400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["aao-hnsfjournals.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Otolaryngol.--head neck surg."],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>Defining a clinician's ability to perceptually identify mass from voice will inform the feasibility, design priorities, and performance standards for tools developed to screen for laryngeal mass from voice. This study defined clinician ability of\u00a0and examined the impact of expertise on screening for laryngeal mass from voice.<\/jats:p><\/jats:sec><jats:sec><jats:title>Study Design<\/jats:title><jats:p>Task comparison study between experts and nonexperts rating voices for the probability of a laryngeal mass.<\/jats:p><\/jats:sec><jats:sec><jats:title>Setting<\/jats:title><jats:p>Online, remote.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Experts (voice\u2010focused speech\u2010language pathologists and otolaryngologists) and nonexperts (general medicine providers) rated 5\u2010s\/i\/voice samples (with pathology defined by laryngoscopy) for the probability of laryngeal mass via an online survey. The intraclass correlation coefficient (ICC) estimated interrater and intrarater reliability. Diagnostic performance metrics were calculated. A linear mixed effects model examined the impact of expertise and pathology on ratings.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Forty clinicians (21 experts and 19 nonexperts) evaluated 344 voice samples. Experts outperformed nonexperts, with a higher area under the curve (70% vs\u00a061%), sensitivity (49% vs\u00a036%), and specificity (83% vs\u00a077%) (all comparisons <jats:italic>p<\/jats:italic>\u2009&lt;\u2009.05). Interrater reliability was fair for experts and poor for nonexperts (ICC: 0.48 vs\u00a00.34), while intrarater reliability was excellent and good, respectively (ICC: 0.9 and 0.6). The main effects of expertise and underlying pathology were significant in the linear model (<jats:italic>p<\/jats:italic>\u2009&lt;\u2009.001).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Clinicians demonstrate inadequate performance screening for laryngeal mass from voice to use auditory perception for dysphonia triage. Experts' superior performance indicates that there is acoustic information in a voice that may be utilized to detect laryngeal mass based on voice.<\/jats:p><\/jats:sec>","DOI":"10.1002\/ohn.206","type":"journal-article","created":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T05:35:20Z","timestamp":1674538520000},"page":"1371-1380","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Defining the Performance of Clinician's Ability to Screen for Laryngeal Mass From Voice"],"prefix":"10.1002","volume":"168","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9799-742X","authenticated-orcid":false,"given":"Grace M.","family":"Wandell","sequence":"first","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Washington School of Medicine Seattle Washington USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anthony B.","family":"Law","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery Emory School of Medicine  Atlanta Georgia USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6697-9966","authenticated-orcid":false,"given":"Anthony","family":"Maxin","sequence":"additional","affiliation":[{"name":"School of Medicine Creighton University  Nebraska Omaha USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vivian T.","family":"Ha","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Washington School of Medicine Seattle Washington USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emily C.","family":"Wilson","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Washington School of Medicine Seattle Washington USA"},{"name":"Department of Speech and Hearing Sciences University of Washington  Seattle Washington USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael G.","family":"Nash","sequence":"additional","affiliation":[{"name":"Department of Biostatistics University of Washington  Seattle Washington USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Albert L.","family":"Merati","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Washington School of Medicine Seattle Washington USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1040-7528","authenticated-orcid":false,"given":"Mark E.","family":"Whipple","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Washington School of Medicine Seattle Washington USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1112-2674","authenticated-orcid":false,"given":"Tanya K.","family":"Meyer","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Washington School of Medicine Seattle Washington USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2023,1,24]]},"reference":[{"journal-title":"J Voice","article-title":"Can resident auditory\u2010perceptual voice assessments predict medical urgency of voice disorders?","author":"Fujiki RB","key":"e_1_2_9_2_1"},{"key":"e_1_2_9_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2020.06.017"},{"key":"e_1_2_9_4_1","doi-asserted-by":"publisher","DOI":"10.1177\/00034894211032779"},{"key":"e_1_2_9_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2018.02.003"},{"issue":"10","key":"e_1_2_9_6_1","first-page":"429","article-title":"Hoarseness\u2014causes and treatments","volume":"39","author":"Reiter R","year":"2016","journal-title":"Med Monatsschr Pharm"},{"key":"e_1_2_9_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.24280"},{"key":"e_1_2_9_8_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599817751030"},{"key":"e_1_2_9_9_1","doi-asserted-by":"publisher","DOI":"10.1097\/00005537-200104000-00018"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.mlg.0000236095.97947.26"},{"key":"e_1_2_9_11_1","doi-asserted-by":"publisher","DOI":"10.1097\/MOO.0000000000000684"},{"key":"e_1_2_9_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599813512982"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1749-4486.2008.01704.x"},{"key":"e_1_2_9_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/hed.10208"},{"key":"e_1_2_9_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.25192"},{"key":"e_1_2_9_16_1","doi-asserted-by":"publisher","DOI":"10.1159\/000515346"},{"key":"e_1_2_9_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.23630"},{"key":"e_1_2_9_18_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360(2012\/12-0014)"},{"key":"e_1_2_9_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.24688"},{"key":"e_1_2_9_20_1","article-title":"The geographic distribution of videolaryngostroboscopy in the United States","author":"Davis RJ","year":"2021","journal-title":"J Voice"},{"issue":"4","key":"e_1_2_9_21_1","first-page":"248","article-title":"Diagnosis of voice disorders","volume":"54","author":"Omori K","year":"2011","journal-title":"Jpn Med Assoc J"},{"key":"e_1_2_9_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2017.04.018"},{"key":"e_1_2_9_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2017.06.022"},{"key":"e_1_2_9_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2014.03.009"},{"key":"e_1_2_9_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2018.07.014"},{"key":"e_1_2_9_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2008.01.008"},{"key":"e_1_2_9_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2856238"},{"key":"e_1_2_9_28_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMp1606181"},{"key":"e_1_2_9_29_1","doi-asserted-by":"publisher","DOI":"10.3390\/jcm9113415"},{"key":"e_1_2_9_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2010.04.009"},{"key":"e_1_2_9_31_1","doi-asserted-by":"publisher","DOI":"10.2196\/25247"},{"key":"e_1_2_9_32_1","unstructured":"WagstaffKL.\u00a0Machine Learning That Matters: Proceedings of the 29th International Conference on Machine Learning; 2012 pp. 529\u2010534."},{"key":"e_1_2_9_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-013-5425-9"},{"key":"e_1_2_9_34_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-0258(20000229)19:4<453::AID-SIM350>3.0.CO;2-5"},{"key":"e_1_2_9_35_1","doi-asserted-by":"publisher","DOI":"10.1097\/EDE.0000000000001173"},{"key":"e_1_2_9_36_1","unstructured":"Sanchez\u2010SaezR ZhuY KhanU YoungS McQuilkinB BolandG.\u00a0ResearchKit\/ResearchKit: ResearchKit 1.5.3 (Version 1.5.3). Zenodo; 2017. doi:10.5281\/zenodo.826964"},{"key":"e_1_2_9_37_1","unstructured":"JeganR JayagowriR. Voice Disorder Detection and Classification\u2014A Review: Proceedings of the Second International Conference on IoT Social Mobile Analytics and Cloud in Computaitonal Vision and Bio\u2010Engineering; 2020 pp. 253\u2010267."},{"key":"e_1_2_9_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"e_1_2_9_39_1","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-144-3-200602070-00009"},{"key":"e_1_2_9_40_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.416074"},{"key":"e_1_2_9_41_1","doi-asserted-by":"publisher","DOI":"10.1037\/1040-3590.6.4.284"},{"key":"e_1_2_9_42_1","doi-asserted-by":"publisher","DOI":"10.1155\/2009\/982102"},{"key":"e_1_2_9_43_1","doi-asserted-by":"publisher","DOI":"10.1044\/0161-1461.0403.142"},{"key":"e_1_2_9_44_1","doi-asserted-by":"publisher","DOI":"10.1177\/000348940811700114"},{"key":"e_1_2_9_45_1","doi-asserted-by":"publisher","DOI":"10.1590\/S2179-64912012000200003"},{"key":"e_1_2_9_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bjorl.2018.04.014"},{"key":"e_1_2_9_47_1","doi-asserted-by":"publisher","DOI":"10.1177\/000348940010900808"},{"key":"e_1_2_9_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0021-9924(00)00039-3"},{"key":"e_1_2_9_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2019.08.016"},{"key":"e_1_2_9_50_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145561319840830"},{"key":"e_1_2_9_51_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20185022"},{"key":"e_1_2_9_52_1","doi-asserted-by":"publisher","DOI":"10.1159\/000368227"},{"issue":"4","key":"e_1_2_9_53_1","first-page":"270","article-title":"Novel approach to acoustical voice analysis using artificial neural networks","volume":"1","author":"Sch\u00f6nweiler R","year":"2000","journal-title":"J\u00a0Assoc\u00a0Res\u00a0Otolaryngol"},{"key":"e_1_2_9_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2017.12.018"},{"key":"e_1_2_9_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2009.12.009"},{"key":"e_1_2_9_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2010.02.002"},{"key":"e_1_2_9_57_1","doi-asserted-by":"publisher","DOI":"10.12688\/f1000research.13114.2"}],"container-title":["Otolaryngology\u2013Head and Neck Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ohn.206","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/ohn.206","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ohn.206","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T14:44:10Z","timestamp":1760971450000},"score":1,"resource":{"primary":{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/10.1002\/ohn.206"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,24]]},"references-count":56,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["10.1002\/ohn.206"],"URL":"https:\/\/doi.org\/10.1002\/ohn.206","archive":["Portico"],"relation":{},"ISSN":["0194-5998","1097-6817"],"issn-type":[{"type":"print","value":"0194-5998"},{"type":"electronic","value":"1097-6817"}],"subject":[],"published":{"date-parts":[[2023,1,24]]},"assertion":[{"value":"2022-03-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-03","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-01-24","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}