{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T01:50:32Z","timestamp":1783389032526,"version":"3.54.6"},"reference-count":44,"publisher":"American Medical Association (AMA)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Otolaryngol Head Neck Surg"],"published-print":{"date-parts":[[2022,12,1]]},"abstract":"<jats:sec id=\"ab-ooi220066-4\"><jats:title>Importance<\/jats:title><jats:p>Olfactory dysfunction (OD) is an increasingly common and morbid condition, especially given the ongoing COVID-19 pandemic. Thus, the ability to reproducibly measure smell loss\u2013associated quality of life (QOL) and its response to treatment is paramount.<\/jats:p><\/jats:sec><jats:sec id=\"ab-ooi220066-5\"><jats:title>Objective<\/jats:title><jats:p>To develop and validate a concise and visually appealing smell loss\u2013associated QOL patient-reported outcome measure for OD.<\/jats:p><\/jats:sec><jats:sec id=\"ab-ooi220066-6\"><jats:title>Design, Setting, and Participants<\/jats:title><jats:p>A secondary analysis of comments to an online survey by 1000 patients with olfactory dysfunction published in 2013 was used as the primary source to generate items of the Olfactory Dysfunction Outcomes Rating (ODOR). In addition, 30 patients with OD enrolled in 2 clinical studies at a tertiary care medical center (Washington University) were asked to identify their main concerns associated with smell loss. And finally, 4 otolaryngologists reviewed the items generated from the online survey and the patients\u2019 interviews to identify any additional items. Prospective study design was used for data collection from the 30 patients and 4 otolaryngologists. Prospective study design was used for survey validation. Validation of the ODOR was performed with 283 patients enrolled in several prospective studies at a single institution that completed the ODOR as an outcome measure.<\/jats:p><\/jats:sec><jats:sec id=\"ab-ooi220066-7\"><jats:title>Main Outcomes and Measures<\/jats:title><jats:p>Item generation and selection were the outcomes of ODOR development. The psychometric and clinimetric measures evaluated for validation were internal consistency, test-retest reliability, face and content validity, concurrent validity, and discriminant validity. Minimal clinically important difference was also determined.<\/jats:p><\/jats:sec><jats:sec id=\"ab-ooi220066-8\"><jats:title>Results<\/jats:title><jats:p>The ODOR is a 28-item instrument with each item scored as either no difficulty or very rarely bothered (0) to complete difficulty or very frequently bothered (4) with a total instrument score range of 0 to 112 points. Higher scores indicate higher degree of dysfunction and limitation. Validation in the cohort of 283 patients (mean [SD] age, 47.0 [14.4] years; 198 female participants [73%]; 179 White participants [80%]) revealed that the instrument has high internal consistency (Cronbach \u03b1\u2009=\u20090.968), test-retest reliability (<jats:italic>r<\/jats:italic>\u2009=\u20090.90 [95% CI, 0.81-0.95]), face validity, content validity, concurrent validity (<jats:italic>r<\/jats:italic>\u2009=\u20090.87 [95% CI, 0.80-0.91] compared with the Questionnaire of Olfactory Disorders\u2013Negative Statements; \u03c1\u2009=\u2009\u22120.76 [95% CI, \u22120.81 to \u22120.71] compared with a patient-reported symptom severity scale), and divergent validity (mean score difference, \u221233.9 [95% CI, \u221238.3 to \u221229.6] between normosmic patients and hyposmic\/anosmic patients). The minimal clinically important difference was 15 points. The estimated time for survey completion was approximately 5 minutes.<\/jats:p><\/jats:sec><jats:sec id=\"ab-ooi220066-9\"><jats:title>Conclusions and Relevance<\/jats:title><jats:p>In this survey creation and validation study, the ODOR was shown to be a novel, concise, reliable, and valid patient-reported outcome measure of OD-associated QOL. It can be used to measure physical problems, functional limitations, and emotional consequences associated with OD and how they change after a given intervention, which is clinically applicable and particularly pertinent given the growing burden of OD associated with COVID-19.<\/jats:p><\/jats:sec>","DOI":"10.1001\/jamaoto.2022.3299","type":"journal-article","created":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T15:02:45Z","timestamp":1666278165000},"page":"1132","source":"Crossref","is-referenced-by-count":23,"title":["Development and Psychometric Validation of the Olfactory Dysfunction Outcomes Rating"],"prefix":"10.1001","volume":"148","author":[{"given":"Jake J.","family":"Lee","sequence":"first","affiliation":[{"name":"Clinical Outcomes Research Office, Department of Otolaryngology\u2013Head and Neck Surgery, Washington University School of Medicine, St Louis, Missouri"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ashna","family":"Mahadev","sequence":"additional","affiliation":[{"name":"Clinical Outcomes Research Office, Department of Otolaryngology\u2013Head and Neck Surgery, Washington University School of Medicine, St Louis, Missouri"},{"name":"University of Missouri Kansas City School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dorina","family":"Kallogjeri","sequence":"additional","affiliation":[{"name":"Clinical Outcomes Research Office, Department of Otolaryngology\u2013Head and Neck Surgery, Washington University School of Medicine, St Louis, Missouri"},{"name":"Statistical Editor, JAMA Otolaryngology\u2013Head & Neck Surgery"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew M.","family":"Peterson","sequence":"additional","affiliation":[{"name":"Clinical Outcomes Research Office, Department of Otolaryngology\u2013Head and Neck Surgery, Washington University School of Medicine, St Louis, Missouri"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shruti","family":"Gupta","sequence":"additional","affiliation":[{"name":"Clinical Outcomes Research Office, Department of Otolaryngology\u2013Head and Neck Surgery, Washington University School of Medicine, St Louis, Missouri"},{"name":"Medical College of Georgia, Augusta"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amish M.","family":"Khan","sequence":"additional","affiliation":[{"name":"Clinical Outcomes Research Office, Department of Otolaryngology\u2013Head and Neck Surgery, Washington University School of Medicine, St Louis, Missouri"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pawina","family":"Jiramongkolchai","sequence":"additional","affiliation":[{"name":"Clinical Outcomes Research Office, Department of Otolaryngology\u2013Head and Neck Surgery, Washington University School of Medicine, St Louis, Missouri"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John S.","family":"Schneider","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2013Head and Neck Surgery, Washington University School of Medicine, St Louis, Missouri"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jay F.","family":"Piccirillo","sequence":"additional","affiliation":[{"name":"Clinical Outcomes Research Office, Department of Otolaryngology\u2013Head and Neck Surgery, Washington University School of Medicine, St Louis, Missouri"},{"name":"Editor, JAMA Otolaryngology\u2013Head & Neck Surgery"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","reference":[{"issue":"4","key":"ooi220066r1","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1097\/00005537-200404000-00026","article-title":"Prevalence of olfactory dysfunction: the Sk\u00f6vde population-based study.","volume":"114","author":"Br\u00e4merson","year":"2004","journal-title":"Laryngoscope"},{"issue":"11","key":"ooi220066r2","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2016-013246","article-title":"Prevalence and risk factors of taste and smell impairment in a nationwide representative sample of the US population: a cross-sectional study.","volume":"6","author":"Liu","year":"2016","journal-title":"BMJ Open"},{"issue":"1","key":"ooi220066r3","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1177\/0194599820922992","article-title":"COVID-19 anosmia reporting tool: initial findings.","volume":"163","author":"Kaye","year":"2020","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"8","key":"ooi220066r4","doi-asserted-by":"crossref","first-page":"2251","DOI":"10.1007\/s00405-020-05965-1","article-title":"Olfactory and gustatory dysfunctions as a clinical presentation of mild-to-moderate forms of the coronavirus disease (COVID-19): a multicenter European study.","volume":"277","author":"Lechien","year":"2020","journal-title":"Eur Arch Otorhinolaryngol"},{"issue":"7","key":"ooi220066r5","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1038\/s41591-020-0916-2","article-title":"Real-time tracking of self-reported symptoms to predict potential COVID-19.","volume":"26","author":"Menni","year":"2020","journal-title":"Nat Med"},{"issue":"2","key":"ooi220066r6","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1080\/00016480410022787","article-title":"Olfactory disorders and their consequences for quality of life.","volume":"125","author":"Hummel","year":"2005","journal-title":"Acta Otolaryngol"},{"issue":"5","key":"ooi220066r7","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1001\/archotol.1991.01870170065015","article-title":"Smell and taste disorders, a study of 750 patients from the University of Pennsylvania Smell and Taste Center.","volume":"117","author":"Deems","year":"1991","journal-title":"Arch Otolaryngol Head Neck Surg"},{"issue":"1","key":"ooi220066r8","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/1472-6815-13-8","article-title":"Hidden consequences of olfactory dysfunction: a patient report series.","volume":"13","author":"Keller","year":"2013","journal-title":"BMC Ear Nose Throat Disord"},{"issue":"6","key":"ooi220066r9","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1001\/jamaoto.2021.0086","article-title":"Association of olfactory training with neural connectivity in adults with postviral olfactory dysfunction.","volume":"147","author":"Jiramongkolchai","year":"2021","journal-title":"JAMA Otolaryngol Head Neck Surg"},{"issue":"10","key":"ooi220066r10","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0107541","article-title":"Olfactory dysfunction predicts 5-year mortality in older adults.","volume":"9","author":"Pinto","year":"2014","journal-title":"PLoS One"},{"key":"ooi220066r11","first-page":"61","article-title":"Patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs).","volume":"6","author":"Weldring","year":"2013","journal-title":"Health Serv Insights"},{"key":"ooi220066r12","doi-asserted-by":"crossref","first-page":"f167","DOI":"10.1136\/bmj.f167","article-title":"Patient reported outcome measures could help transform healthcare.","volume":"346","author":"Black","year":"2013","journal-title":"BMJ"},{"key":"ooi220066r13","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1186\/1477-7525-4-79","article-title":"Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance.","volume":"4","author":"US Department of Health and Human Services FDA Center for Drug Evaluation and Research","year":"2006","journal-title":"Health Qual Life Outcomes"},{"key":"ooi220066r15","doi-asserted-by":"crossref","first-page":"297","DOI":"10.2500\/105065895781808711","article-title":"Psychometric and clinimetric validity of the 31-item Rhinosinusitis Outcome Measure (RSOM-31).","volume":"9","author":"Piccirillo","year":"1995","journal-title":"Am J Rhinol"},{"issue":"2","key":"ooi220066r16","first-page":"133","article-title":"A systematic review of olfactory related questionnaires and scales.","volume":"59","author":"Han","year":"2021","journal-title":"Rhinology"},{"issue":"3","key":"ooi220066r17","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1007\/s00405-004-0796-y","article-title":"Olfactory dysfunction and daily life.","volume":"262","author":"Frasnelli","year":"2005","journal-title":"Eur Arch Otorhinolaryngol"},{"issue":"7","key":"ooi220066r18","doi-asserted-by":"crossref","first-page":"1450","DOI":"10.1002\/lary.23349","article-title":"Olfaction-associated quality of life in chronic rhinosinusitis: adaptation and validation of an olfaction-specific questionnaire.","volume":"122","author":"Simopoulos","year":"2012","journal-title":"Laryngoscope"},{"issue":"9","key":"ooi220066r19","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1002\/alr.22135","article-title":"Establishing the minimal clinically important difference for the Questionnaire of Olfactory Disorders.","volume":"8","author":"Mattos","year":"2018","journal-title":"Int Forum Allergy Rhinol"},{"issue":"10","key":"ooi220066r20","doi-asserted-by":"crossref","first-page":"1436","DOI":"10.1002\/alr.22800","article-title":"Psychometric properties of the brief version of the questionnaire of olfactory disorders in patients with chronic rhinosinusitis.","volume":"11","author":"Mattos","year":"2021","journal-title":"Int Forum Allergy Rhinol"},{"issue":"10","key":"ooi220066r21","doi-asserted-by":"crossref","first-page":"1144","DOI":"10.1002\/alr.22392","article-title":"A brief version of the questionnaire of olfactory disorders in patients with chronic rhinosinusitis.","volume":"9","author":"Mattos","year":"2019","journal-title":"Int Forum Allergy Rhinol"},{"issue":"2","key":"ooi220066r22","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1001\/jamaoto.2019.3744","article-title":"Importance of defining and interpreting a clinically meaningful difference in clinical research.","volume":"146","author":"Kallogjeri","year":"2020","journal-title":"JAMA Otolaryngol Head Neck Surg"},{"key":"ooi220066r23","doi-asserted-by":"crossref","first-page":"149","DOI":"10.3389\/fpubh.2018.00149","article-title":"Best practices for developing and validating scales for health, social, and behavioral research: a primer.","volume":"6","author":"Boateng","year":"2018","journal-title":"Front Public Health"},{"issue":"6","key":"ooi220066r25","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1016\/0021-9681(87)90027-0","article-title":"Clinimetric perspectives.","volume":"40","author":"Feinstein","year":"1987","journal-title":"J Chronic Dis"},{"issue":"3","key":"ooi220066r26","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1001\/jamaoto.2021.3994","article-title":"Development and validation of a novel at-home smell assessment.","volume":"148","author":"Gupta","year":"2022","journal-title":"JAMA Otolaryngol Head Neck Surg"},{"issue":"9","key":"ooi220066r27","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1001\/jamaoto.2022.1573","article-title":"Efficacy and safety of saline nasal irrigation plus theophylline for treatment of COVID-19-related olfactory dysfunction: the SCENT2 phase 2 randomized clinical trial.","volume":"148","author":"Gupta","year":"2022","journal-title":"JAMA Otolaryngol Head Neck Surg"},{"issue":"8","key":"ooi220066r28","doi-asserted-by":"crossref","first-page":"936","DOI":"10.1002\/alr.22586","article-title":"Randomized clinical trial to evaluate mometasone lavage vs spray for patients with chronic rhinosinusitis without nasal polyps who have not undergone sinus surgery.","volume":"10","author":"Jiramongkolchai","year":"2020","journal-title":"Int Forum Allergy Rhinol"},{"issue":"9","key":"ooi220066r29","doi-asserted-by":"crossref","first-page":"885","DOI":"10.1001\/jamaoto.2022.1574","article-title":"Safety of high-dose nasal theophylline irrigation in the treatment of postviral olfactory dysfunction: a dose-escalation study.","volume":"148","author":"Lee","year":"2022","journal-title":"JAMA Otolaryngol Head Neck Surg"},{"issue":"2","key":"ooi220066r30","doi-asserted-by":"crossref","DOI":"10.1016\/j.amjoto.2021.103299","article-title":"Smell Changes and Efficacy of Nasal Theophylline (SCENT) irrigation: a randomized controlled trial for treatment of post-viral olfactory dysfunction.","volume":"43","author":"Lee","year":"2022","journal-title":"Am J Otolaryngol"},{"issue":"7","key":"ooi220066r31","first-page":"28","article-title":"The clinical global impressions scale: applying a research tool in clinical practice.","volume":"4","author":"Busner","year":"2007","journal-title":"Psychiatry (Edgmont)"},{"issue":"3","key":"ooi220066r32","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/0031-9384(84)90269-5","article-title":"Development of the University of Pennsylvania Smell Identification Test: a standardized microencapsulated test of olfactory function.","volume":"32","author":"Doty","year":"1984","journal-title":"Physiol Behav"},{"issue":"2, pt 1","key":"ooi220066r33","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1288\/00005537-198402000-00004","article-title":"University of Pennsylvania Smell Identification Test: a rapid quantitative olfactory function test for the clinic.","volume":"94","author":"Doty","year":"1984","journal-title":"Laryngoscope"},{"issue":"4","key":"ooi220066r34","doi-asserted-by":"crossref","first-page":"460","DOI":"10.2500\/ajr.2007.21.3043","article-title":"Office procedures for quantitative assessment of olfactory function.","volume":"21","author":"Doty","year":"2007","journal-title":"Am J Rhinol"},{"issue":"10","key":"ooi220066r35","doi-asserted-by":"crossref","first-page":"1183","DOI":"10.1001\/archotol.1995.01890100087015","article-title":"Long-term follow-up of olfactory loss secondary to head trauma and upper respiratory tract infection.","volume":"121","author":"Duncan","year":"1995","journal-title":"Arch Otolaryngol Head Neck Surg"},{"issue":"8","key":"ooi220066r36","doi-asserted-by":"crossref","first-page":"1611","DOI":"10.1002\/lary.21890","article-title":"Olfactory outcomes after endoscopic transsphenoidal pituitary surgery.","volume":"121","author":"Rotenberg","year":"2011","journal-title":"Laryngoscope"},{"issue":"7","key":"ooi220066r37","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1001\/jamaoto.2020.0673","article-title":"Risk factors for patient-reported olfactory dysfunction after endoscopic transsphenoidal hypophysectomy.","volume":"146","author":"Lee","year":"2020","journal-title":"JAMA Otolaryngol Head Neck Surg"},{"key":"ooi220066r38","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/BF02310555","article-title":"Coefficient alpha and the internal structure of tests.","volume":"16","author":"Cronbach","year":"1951","journal-title":"Psychometrika"},{"issue":"3","key":"ooi220066r39","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1023\/A:1015291021312","article-title":"Assessing health status and quality-of-life instruments: attributes and review criteria.","volume":"11","author":"Aaronson","year":"2002","journal-title":"Qual Life Res"},{"issue":"4","key":"ooi220066r40","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/j.parkreldis.2011.12.001","article-title":"Validation of a new scale to assess olfactory dysfunction in patients with Parkinson\u2019s disease.","volume":"18","author":"Millar Vernetti","year":"2012","journal-title":"Parkinsonism Relat Disord"},{"issue":"4","key":"ooi220066r41","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1080\/00016480310001411","article-title":"A Scandinavian adaptation of the Multi-Clinic Smell and Taste Questionnaire: evaluation of questions about olfaction.","volume":"123","author":"Nordin","year":"2003","journal-title":"Acta Otolaryngol"},{"key":"ooi220066r42","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1007\/s12078-012-9127-7","article-title":"Development of a brief self-report inventory to measure olfactory dysfunction and quality of life in patients with problems with the sense of smell.","volume":"5","author":"Pusswald","year":"2012","journal-title":"Chemosens Percept"},{"issue":"1","key":"ooi220066r43","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.anl.2010.05.013","article-title":"Clinical availability of a self-administered odor questionnaire for patients with olfactory disorders.","volume":"38","author":"Takebayashi","year":"2011","journal-title":"Auris Nasus Larynx"},{"issue":"12","key":"ooi220066r44","doi-asserted-by":"crossref","first-page":"E786","DOI":"10.1002\/lary.28419","article-title":"Self-reported mini olfactory questionnaire (Self-MOQ): a simple and useful measurement for the screening of olfactory dysfunction.","volume":"130","author":"Zou","year":"2020","journal-title":"Laryngoscope"},{"key":"ooi220066r14","first-page":"49","volume-title":"Quality of Life and Pharmacoeconomics in Clinical Trials","author":"Juniper","year":"1996"},{"key":"ooi220066r24","doi-asserted-by":"crossref","DOI":"10.2307\/j.ctt1xp3vbc","volume-title":"Clinimetrics","author":"Feinstein","year":"1987"}],"container-title":["JAMA Otolaryngology\u2013Head &amp; Neck Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamaotolaryngology\/articlepdf\/2797522\/jamaotolaryngology_lee_2022_oi_220066_1695134692.96058.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,21]],"date-time":"2023-09-21T15:04:36Z","timestamp":1695308676000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamaotolaryngology\/fullarticle\/2797522"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,1]]},"references-count":44,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,12,1]]}},"URL":"https:\/\/doi.org\/10.1001\/jamaoto.2022.3299","relation":{},"ISSN":["2168-6181"],"issn-type":[{"value":"2168-6181","type":"print"}],"subject":[],"published":{"date-parts":[[2022,12,1]]}}}