{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,12]],"date-time":"2026-09-12T12:27:04Z","timestamp":1789216024874,"version":"build-2803163510"},"reference-count":54,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"Ludeman Family Center for Women\u2019s Health"},{"DOI":"10.13039\/100000055","name":"National Institute on Deafness and Other Communication Disorders","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000055","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 DC005805"],"award-info":[{"award-number":["R01 DC005805"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["K23 DC014747"],"award-info":[{"award-number":["K23 DC014747"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["1P01AI145818-01"],"award-info":[{"award-number":["1P01AI145818-01"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Compare machine learning (ML)-based predictive analytics methods to traditional logistic regression in classification of olfactory dysfunction in chronic rhinosinusitis (CRS-OD) and identify predictors within a large multi-institutional cohort of refractory CRS patients.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Adult CRS patients enrolled in a prospective, multi-institutional, observational cohort study were assessed for baseline CRS-OD using a smell identification test (SIT) or brief SIT (bSIT). Four different ML methods were compared to traditional logistic regression for classification of CRS normosmics versus CRS-OD.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Data were collected for 611 study participants who met inclusion criteria between 2011 April and 2015 July. Thirty-four percent of enrolled patients demonstrated olfactory loss on psychophysical testing. Differences between CRS normosmics and those with smell loss included objective disease measures (CT and endoscopy scores), age, sex, prior surgeries, socioeconomic status, steroid use, polyp presence, asthma, and aspirin sensitivity. Most ML methods performed favorably in terms of predictive ability. Top predictors include factors previously reported in the literature, as well as several socioeconomic factors.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Olfactory dysfunction is a variable phenomenon in CRS patients. ML methods perform well compared to traditional logistic regression in classification of normosmia versus smell loss in CRS, and are able to include numerous risk factors into prediction models. Several actionable features were identified as risk factors for CRS-OD. These results suggest that ML methods may be useful for current understanding and future study of hyposmia secondary to sinonasal disease, the most common cause of persistent olfactory loss in the general population.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/chemse\/bjab042","type":"journal-article","created":{"date-parts":[[2021,9,2]],"date-time":"2021-09-02T09:24:08Z","timestamp":1630574648000},"source":"Crossref","is-referenced-by-count":10,"title":["Predicting olfactory loss in chronic rhinosinusitis using machine learning"],"prefix":"10.1093","volume":"46","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2748-0705","authenticated-orcid":false,"given":"Vijay R","family":"Ramakrishnan","sequence":"first","affiliation":[{"name":"Department of Otolaryngology-Head and Neck Surgery, University of Colorado, Aurora, CO, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jaron","family":"Arbet","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Informatics, Colorado School of Public Health, University of Colorado\u2013Denver Anschutz Medical Campus, Aurora, CO, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jess C","family":"Mace","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology-Head and Neck Surgery, Oregon Health Sciences University, Portland, OR, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Krithika","family":"Suresh","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Informatics, Colorado School of Public Health, University of Colorado\u2013Denver Anschutz Medical Campus, Aurora, CO, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie","family":"Shintani Smith","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology-Head and Neck Surgery, Northwestern University, Chicago, IL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zachary M","family":"Soler","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology-Head and Neck Surgery, Medical University of South Carolina, Charleston, SC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Timothy L","family":"Smith","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology-Head and Neck Surgery, Oregon Health Sciences University, Portland, OR, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,9,2]]},"reference":[{"key":"2021110106251646700_CIT0001","author":"Agency for Healthcare Research and Quality","year":"2018"},{"issue":"6","key":"2021110106251646700_CIT0002","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.1016\/j.jaci.2013.02.036","article-title":"Endotypes and phenotypes of chronic rhinosinusitis: a PRACTALL document of the European Academy of Allergy and Clinical Immunology and the American Academy of Allergy, Asthma & Immunology","volume":"131","author":"Akdis","year":"2013","journal-title":"J Allergy Clin Immunol"},{"issue":"1","key":"2021110106251646700_CIT0003","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J Royal Stat Soc B (Methodol)"},{"issue":"6","key":"2021110106251646700_CIT0004","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1002\/widm.1072","article-title":"Overview of random forest methodology and practical guidance with emphasis on computational biology and bioinformatics","volume":"2","author":"Boulesteix","year":"2012","journal-title":"Data Min Knowl Disc"},{"issue":"4","key":"2021110106251646700_CIT0005","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1038\/nmeth.4642","article-title":"Statistics versus machine learning","volume":"15","author":"Bzdok","year":"2018","journal-title":"Nat Methods"},{"key":"2021110106251646700_CIT0006","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511801389","volume-title":"An introduction to support vector machines and other kernel-based learning methods","author":"Cristianini","year":"2000"},{"key":"2021110106251646700_CIT0007","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1038\/s41746-020-0254-2","article-title":"Machine intelligence in healthcare-perspectives on trustworthiness, explainability, usability, and transparency","volume":"3","author":"Cutillo","year":"2020","journal-title":"NPJ Digit Med"},{"issue":"3","key":"2021110106251646700_CIT0008","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1002\/alr.21458","article-title":"Longitudinal improvement and stability of the SNOT-22 survey in the evaluation of surgical management for chronic rhinosinusitis","volume":"5","author":"DeConde","year":"2015","journal-title":"Int Forum Allergy Rhinol"},{"issue":"9","key":"2021110106251646700_CIT0009","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1002\/alr.21350","article-title":"Comparative effectiveness of medical and surgical therapy on olfaction in chronic rhinosinusitis: a prospective, multi-institutional study","volume":"4","author":"DeConde","year":"2014","journal-title":"Int Forum Allergy Rhinol"},{"key":"2021110106251646700_CIT0010","volume-title":"The smell identification test administration manual. 3","author":"Doty","year":"1995"},{"key":"2021110106251646700_CIT0011","volume-title":"The brief smell identification test administration manual","author":"Doty","year":"2001"},{"issue":"3","key":"2021110106251646700_CIT0012","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1002\/alr.21670","article-title":"Sensitivity analysis and diagnostic accuracy of the Brief Smell Identification Test in patients with chronic rhinosinusitis","volume":"6","author":"El Rassi","year":"2016","journal-title":"Int Forum Allergy Rhinol"},{"issue":"1","key":"2021110106251646700_CIT0013","first-page":"3133","article-title":"Do we need hundreds of classifiers to solve real world classification problems?","volume":"15","author":"Fern\u00e1ndez-Delgado","year":"2014","journal-title":"J Mach Learn Res"},{"key":"2021110106251646700_CIT0014","first-page":"1","article-title":"European position paper on rhinosinusitis and nasal polyps 2012","volume":"23","author":"Fokkens","year":"2012","journal-title":"Rhinology"},{"key":"2021110106251646700_CIT0015","first-page":"1","article-title":"Multivariate adaptive regression splines","volume":"19","author":"Friedman","year":"1991","journal-title":"Ann Stat"},{"issue":"1","key":"2021110106251646700_CIT0016","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v033.i01","article-title":"Regularization paths for generalized linear models via coordinate descent","volume":"33","author":"Friedman","year":"2010","journal-title":"J Stat Softw"},{"issue":"1","key":"2021110106251646700_CIT0017","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1177\/0194599816637856","article-title":"Clinical examination of tissue eosinophilia in patients with chronic rhinosinusitis and nasal polyposis","volume":"155","author":"Gitomer","year":"2016","journal-title":"Otolaryngol Head Neck Surg"},{"key":"2021110106251646700_CIT0018","first-page":"245","volume-title":"The wrong and right way to do cross-validation. In: Elements of statistical learning, data mining, inference, prediction","author":"Hastie","year":"2009"},{"key":"2021110106251646700_CIT0019","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The elements of statistical learning: data mining, inference, and prediction","author":"Hastie","year":"2009"},{"issue":"9","key":"2021110106251646700_CIT0020","doi-asserted-by":"crossref","first-page":"1263","DOI":"10.1109\/TKDE.2008.239","article-title":"Learning from imbalanced data","volume":"21","author":"He","year":"2009","journal-title":"IEEE Transact Knowl Data Eng"},{"issue":"5","key":"2021110106251646700_CIT0021","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1111\/j.1749-4486.2009.01995.x","article-title":"Psychometric validity of the 22-item Sinonasal Outcome Test","volume":"34","author":"Hopkins","year":"2009","journal-title":"Clin Otolaryngol"},{"issue":"1","key":"2021110106251646700_CIT0022","doi-asserted-by":"crossref","first-page":"22","DOI":"10.4193\/Rhin17.247","article-title":"CHronic Rhinosinusitis Outcome MEasures (CHROME), developing a core outcome set for trials of interventions in chronic rhinosinusitis","volume":"56","author":"Hopkins","year":"2018","journal-title":"Rhinology"},{"issue":"3","key":"2021110106251646700_CIT0023","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1198\/106186006X133933","article-title":"Unbiased recursive partitioning: a conditional inference framework","volume":"15","author":"Hothorn","year":"2006","journal-title":"J Computat Graph Stat"},{"issue":"1","key":"2021110106251646700_CIT0024","first-page":"1","article-title":"Position paper on olfactory dysfunction","volume":"56","author":"Hummel","year":"2016","journal-title":"Rhinology"},{"issue":"4","key":"2021110106251646700_CIT0025","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1007\/s00405-013-2626-6","article-title":"Predictors of quality of life outcomes in chronic rhinosinusitis after sinus surgery","volume":"271","author":"Katotomichelakis","year":"2014","journal-title":"Eur Arch Otorhinolaryngol"},{"issue":"11","key":"2021110106251646700_CIT0026","doi-asserted-by":"crossref","first-page":"3735","DOI":"10.1016\/j.csda.2009.04.009","article-title":"Estimating classification error rate: repeated cross-validation, repeated hold-out and bootstrap","volume":"53","author":"Kim","year":"2009","journal-title":"Computat Stat Data Anal"},{"issue":"2","key":"2021110106251646700_CIT0027","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1002\/lary.26316","article-title":"The prevalence of olfactory dysfunction in chronic rhinosinusitis","volume":"127","author":"Kohli","year":"2017","journal-title":"Laryngoscope"},{"issue":"5","key":"2021110106251646700_CIT0028","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v028.i05","article-title":"Building predictive models in R using the caret package","volume":"28","author":"Kuhn","year":"2008","journal-title":"J Stat Softw"},{"issue":"12","key":"2021110106251646700_CIT0029","doi-asserted-by":"crossref","first-page":"2225","DOI":"10.1097\/MLG.0b013e318184e216","article-title":"Predictors of olfactory dysfunction in patients with chronic rhinosinusitis","volume":"118","author":"Litvack","year":"2008","journal-title":"Laryngoscope"},{"issue":"1","key":"2021110106251646700_CIT0030","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1093\/chemse\/bjy067","article-title":"Machine learning in human olfactory research","volume":"44","author":"L\u00f6tsch","year":"2019","journal-title":"Chem Senses"},{"key":"2021110106251646700_CIT0031","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1177\/000348949510410s02","article-title":"Quantification for staging sinusitis. The Staging and Therapy Group","volume":"167","author":"Lund","year":"1995","journal-title":"Ann Otol Rhinol Laryngol Suppl"},{"issue":"4","key":"2021110106251646700_CIT0032","first-page":"183","article-title":"Staging in rhinosinusitus","volume":"31","author":"Lund","year":"1992","journal-title":"Rhinology"},{"key":"2021110106251646700_CIT0033","volume-title":"Machine learning, neural, and statistical classification","author":"Michie","year":"1994"},{"issue":"26","key":"2021110106251646700_CIT0034","doi-asserted-by":"crossref","first-page":"786","DOI":"10.21105\/joss.00786","article-title":"iml: an R package for interpretable machine learning","volume":"3","author":"Molnar","year":"2018","journal-title":"J Open Source Softw"},{"key":"2021110106251646700_CIT0035","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1023\/A:1024068626366","article-title":"Inference for the generalization error","volume":"52","author":"Nadeau","year":"2003","journal-title":"Mach Learn"},{"key":"2021110106251646700_CIT0036","first-page":"S22","article-title":"International consensus statement on allergy and rhinology: rhinosinusitis","volume":"6 Suppl 1","author":"Orlandi","year":"2016","journal-title":"Int Forum Allergy Rhinol"},{"issue":"1","key":"2021110106251646700_CIT0037","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1067\/mhn.2002.121022","article-title":"Psychometric and clinimetric validity of the 20-Item Sino-Nasal Outcome Test (SNOT-20)","volume":"126","author":"Piccirillo","year":"2002","journal-title":"Otolaryngol Head Neck Surg"},{"key":"2021110106251646700_CIT0038","volume-title":"R: a language and environment for statistical computing","author":"R Core Team","year":"2019"},{"issue":"14","key":"2021110106251646700_CIT0039","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.1056\/NEJMra1814259","article-title":"Machine learning in medicine","volume":"380","author":"Rajkomar","year":"2019","journal-title":"N Engl J Med"},{"issue":"4","key":"2021110106251646700_CIT0040","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1002\/alr.21903","article-title":"Examination of high-antibiotic users in a multi-institutional cohort of chronic rhinosinusitis patients","volume":"7","author":"Ramakrishnan","year":"2017","journal-title":"Int Forum Allergy Rhinol"},{"issue":"5","key":"2021110106251646700_CIT0041","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s11882-016-0617-6","article-title":"Olfaction in chronic rhinosinusitis","volume":"16","author":"Rombaux","year":"2016","journal-title":"Curr Allergy Asthma Rep"},{"issue":"2 Suppl","key":"2021110106251646700_CIT0042","first-page":"S1","article-title":"Clinical practice guideline (update): adult sinusitis","volume":"152","author":"Rosenfeld","year":"2015","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"1","key":"2021110106251646700_CIT0043","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1002\/alr.22445","article-title":"Factors driving olfactory loss in patients with chronic rhinosinusitis: a case control study","volume":"10","author":"Schlosser","year":"2020","journal-title":"Int Forum Allergy Rhinol"},{"issue":"1","key":"2021110106251646700_CIT0044","doi-asserted-by":"crossref","first-page":"15","DOI":"10.2500\/105065801781329428","article-title":"Use of the Rhinosinusitis Disability Index (RSDI) in rhinologic disease","volume":"15","author":"Senior","year":"2001","journal-title":"Am J Rhinol"},{"issue":"5","key":"2021110106251646700_CIT0045","doi-asserted-by":"crossref","first-page":"269","DOI":"10.2500\/108854196778662237","article-title":"Nasal polyps and immunoglobulin E (IgE)","volume":"17","author":"Settipane","year":"1996","journal-title":"Allergy Asthma Proc"},{"issue":"7","key":"2021110106251646700_CIT0046","doi-asserted-by":"crossref","first-page":"1450","DOI":"10.1002\/lary.23349","article-title":"Olfaction-associated quality of life in chronic rhinosinusitis: adaptation and validation of an olfaction-specific questionnaire","volume":"122","author":"Simopoulos","year":"2012","journal-title":"Laryngoscope"},{"issue":"1","key":"2021110106251646700_CIT0047","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1002\/alr.21065","article-title":"Medical therapy vs surgery for chronic rhinosinusitis: a prospective, multi-institutional study with 1-year follow-up","volume":"3","author":"Smith","year":"2013","journal-title":"Int Forum Allergy Rhinol"},{"issue":"9","key":"2021110106251646700_CIT0048","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1093\/chemse\/bjw080","article-title":"Olfactory impairment in chronic rhinosinusitis using threshold, discrimination, and identification scores","volume":"41","author":"Soler","year":"2016","journal-title":"Chem Senses"},{"issue":"2","key":"2021110106251646700_CIT0049","doi-asserted-by":"crossref","first-page":"110","DOI":"10.2500\/ajra.2012.26.3741","article-title":"Chronic rhinosinusitis, race, and ethnicity","volume":"26","author":"Soler","year":"2012","journal-title":"Am J Rhinol Allergy"},{"issue":"4","key":"2021110106251646700_CIT0050","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1002\/alr.21679","article-title":"Olfactory-specific quality of life outcomes after endoscopic sinus surgery","volume":"6","author":"Soler","year":"2016","journal-title":"Int Forum Allergy Rhinol"},{"key":"2021110106251646700_CIT0051","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1186\/1471-2105-8-25","article-title":"Bias in random forest variable importance measures: illustrations, sources and a solution","volume":"8","author":"Strobl","year":"2007","journal-title":"BMC Bioinformatics"},{"issue":"4","key":"2021110106251646700_CIT0052","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1037\/a0016973","article-title":"An introduction to recursive partitioning: rationale, application, and characteristics of classification and regression trees, bagging, and random forests","volume":"14","author":"Strobl","year":"2009","journal-title":"Psychol Methods"},{"key":"2021110106251646700_CIT0053","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1093\/bioinformatics\/btr597","article-title":"MissForest\u2013non-parametric missing value imputation for mixed-type data","volume":"28","author":"Stekhoven","year":"2012","journal-title":"Bioinformatics"},{"issue":"1","key":"2021110106251646700_CIT0054","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J Royal Stat Soc B (Methodol)"}],"container-title":["Chemical Senses"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/chemse\/advance-article-pdf\/doi\/10.1093\/chemse\/bjab042\/40243487\/bjab042.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/chemse\/article-pdf\/doi\/10.1093\/chemse\/bjab042\/41028595\/bjab042.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/chemse\/article-pdf\/doi\/10.1093\/chemse\/bjab042\/41028595\/bjab042.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,7]],"date-time":"2024-09-07T13:38:18Z","timestamp":1725716298000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/chemse\/article\/doi\/10.1093\/chemse\/bjab042\/6362514"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,1]]},"references-count":54,"URL":"https:\/\/doi.org\/10.1093\/chemse\/bjab042","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.10.12.20210500","asserted-by":"object"}]},"ISSN":["0379-864X","1464-3553"],"issn-type":[{"value":"0379-864X","type":"print"},{"value":"1464-3553","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,1,1]]},"published":{"date-parts":[[2021,1,1]]},"article-number":"bjab042"}}