{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T09:35:13Z","timestamp":1791538513461,"version":"4.3.4"},"reference-count":71,"publisher":"Wiley","issue":"7","license":[{"start":{"date-parts":[[2022,11,1]],"date-time":"2022-11-01T00:00:00Z","timestamp":1667260800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["K76 AG079040"],"award-info":[{"award-number":["K76 AG079040"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["The Laryngoscope"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:sec><jats:title>Objectives<\/jats:title><jats:p>Mobile applications (apps) are multiplying in laryngology, with little standardization of content, functionality, or accessibility. The purpose of this study is to evaluate the quality, functionality, health literacy, readability, accessibility, and inclusivity of laryngology mobile applications.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Of the 3230 apps identified from the Apple and Google Play stores, 28 patient\u2010facing apps met inclusion criteria. Apps were evaluated using validated scales assessing quality and functionality: the Mobile App Rating Scale (MARS) and the Institute for Healthcare Informatics App Functionality Scale. The Clear Communication Index (CDC) Institute of Medicine Strategies for Creating Health Literate Mobile Applications, and Patient Education Materials Assessment Tool (PEMAT) were used to evaluate apps health literacy level. Readability was assessed using established readability formulas. Apps were evaluated for language, accessibility features, and representation of a diverse population.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Twenty\u2010six apps (92%) had adequate quality (MARS score\u2009&gt;\u20093). The mean PEMAT score was 89% for actionability and 86% for understandability. On average, apps utilized 25\/33 health literate strategies. Twenty\u2010two apps (79%) did not pass the CDC index threshold of 90% for health literacy. Twenty\u2010four app descriptions (86%) were above an 8<jats:sup>th<\/jats:sup> grade reading level. Only 4 apps (14%) showed diverse representation, 3 (11%) had non\u2010English language functions, and 2 (7%) offered subtitles. Inter\u2010rater reliability for MARS was adequate (CA\u2010ICC\u00a0=\u00a00.715).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>While most apps scored well in quality and functionality, many laryngology apps did not meet standards for health literacy. Most apps were written at a reading level above the national average, lacked accessibility features, and did not represent diverse populations. <jats:italic>Laryngoscope<\/jats:italic>, 133:1540\u20131549, 2023<\/jats:p><\/jats:sec>","DOI":"10.1002\/lary.30465","type":"journal-article","created":{"date-parts":[[2022,11,1]],"date-time":"2022-11-01T11:33:33Z","timestamp":1667302413000},"page":"1540-1549","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Are Mobile Applications in Laryngology Designed for All Patients?"],"prefix":"10.1002","volume":"133","author":[{"given":"Eseosa","family":"Odigie","sequence":"first","affiliation":[{"name":"Sean Parker Institute for the Voice, Department of Otolaryngology Weill Cornell Medical College  New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8586-450X","authenticated-orcid":false,"given":"Katerina","family":"Andreadis","sequence":"additional","affiliation":[{"name":"Sean Parker Institute for the Voice, Department of Otolaryngology Weill Cornell Medical College  New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Iyra","family":"Chandra","sequence":"additional","affiliation":[{"name":"Sean Parker Institute for the Voice, Department of Otolaryngology Weill Cornell Medical College  New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentina","family":"Mocchetti","sequence":"additional","affiliation":[{"name":"Sean Parker Institute for the Voice, Department of Otolaryngology Weill Cornell Medical College  New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hal","family":"Rives","sequence":"additional","affiliation":[{"name":"Sean Parker Institute for the Voice, Department of Otolaryngology Weill Cornell Medical College  New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven","family":"Cox","sequence":"additional","affiliation":[{"name":"Department of Communication Sciences and Disorders Adelphi University  Garden City USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1543-2634","authenticated-orcid":false,"given":"Ana\u00efs","family":"Rameau","sequence":"additional","affiliation":[{"name":"Sean Parker Institute for the Voice, Department of Otolaryngology Weill Cornell Medical College  New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2022,11]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.2196\/13057"},{"key":"e_1_2_8_3_1","unstructured":"IQVIA Institute for Human Data Science.Digital Health Trends 2021: Innovation Evidence Regulation and Adoption. Accessed July 7 2022.https:\/\/www.iqvia.com\/-\/media\/iqvia\/pdfs\/institute-reports\/digital-health-trends-2021\/iqvia-institute-digital-health-trends-2021.pdf?_=1628089218603"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmrj.2017.02.018"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocy052"},{"key":"e_1_2_8_6_1","first-page":"186","article-title":"The U.S. National Action Plan to improve health literacy: a model for positive organizational change","volume":"240","author":"Baur C","year":"2017","journal-title":"Stud Health Technol Inform"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/10810730.2010.499985"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1080\/10810730.2015.1131776"},{"issue":"4","key":"e_1_2_8_9_1","first-page":"76","article-title":"African Americans and health literacy: a systematic review","volume":"23","author":"Weekes CV","year":"2012","journal-title":"ABNF J"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.3928\/24748307-20210712-01"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-019-05472-y"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0897-1897(96)80254-0"},{"issue":"3","key":"e_1_2_8_13_1","first-page":"463","article-title":"Health literacy: the gap between physicians and patients","volume":"72","author":"Safeer RS","year":"2005","journal-title":"Am Fam Physician"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjmed.2016.01.008"},{"key":"e_1_2_8_15_1","volume-title":"Health Literacy and Patient Safety: Help Patients Understand. Manual for Clinicians","author":"Weiss BD","year":"2007"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/nur.22078"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1177\/1049909120959057"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.invent.2019.100243"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.26341"},{"key":"e_1_2_8_20_1","volume-title":"Ensuring Digital Accessibility through Process and Policy","author":"Lazar J","year":"2015"},{"key":"e_1_2_8_21_1","unstructured":"W3C Web Accessibility Initiative (WAI).Mobile Accessibility at W3C. Published April 14 2021. Accessed July 30 2022.https:\/\/www.w3.org\/WAI\/standards-guidelines\/mobile\/"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-015-0416-1"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1093\/infdis\/jiz198"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.2105\/AJPH.2020.305784"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.2196\/13300"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.7326\/M19-0283"},{"key":"e_1_2_8_27_1","doi-asserted-by":"publisher","DOI":"10.21106\/ijtmrph.148"},{"key":"e_1_2_8_28_1","unstructured":"Statistics Research Department.Share of U.S. health apps that can be downloaded at no cost 2015. Published September 21 2015. Accessed July 30 2022.https:\/\/www.statista.com\/statistics\/624104\/share-of-health-apps-free\/"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.1177\/1073274819901125"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.1177\/2473974X211032644"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MITP.2016.50"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.2196\/16795"},{"key":"e_1_2_8_33_1","unstructured":"Digital Health Literacy.Proceedings of the First Meeting of the WHO GCM\/NCD Working Group on Health Literacy for NCDs. Published 2017. Accessed July 30 2022.https:\/\/www.who.int\/global-coordination-mechanism\/working-groups\/digital_hl.pdf"},{"key":"e_1_2_8_34_1","doi-asserted-by":"publisher","DOI":"10.1080\/10410236.2018.1485077"},{"key":"e_1_2_8_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijcard.2019.06.039"},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijcard.2019.05.070"},{"key":"e_1_2_8_37_1","first-page":"506","volume-title":"2021 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)","author":"Md S","year":"2021"},{"key":"e_1_2_8_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/0003489420940350"},{"key":"e_1_2_8_39_1","doi-asserted-by":"publisher","DOI":"10.1177\/0003489420951113"},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1002\/lio2.201"},{"key":"e_1_2_8_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijsu.2014.07.014"},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.3422"},{"key":"e_1_2_8_43_1","volume-title":"Patient Apps for Improved Healthcare: From Novelty to Mainstream","author":"Aitken M","year":"2013"},{"key":"e_1_2_8_44_1","unstructured":"CDC.The CDC Clear Communication Index."},{"key":"e_1_2_8_45_1","doi-asserted-by":"crossref","unstructured":"BroderickJ DevineT LanghansE LemeriseAJ LierS HarrisLM.Designing Health Literate Mobile Apps.2014.","DOI":"10.31478\/201401a"},{"key":"e_1_2_8_46_1","unstructured":"PEMAT Tool for Audiovisual Materials. Accessed July 7 2022.https:\/\/www.ahrq.gov\/health-literacy\/patient-education\/pemat-av.html"},{"key":"e_1_2_8_47_1","doi-asserted-by":"publisher","DOI":"10.1093\/jpepsy\/jsaa094"},{"key":"e_1_2_8_48_1","doi-asserted-by":"publisher","DOI":"10.5888\/pcd12.140433"},{"key":"e_1_2_8_49_1","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.7073"},{"key":"e_1_2_8_50_1","unstructured":"Readability score. Published January 18 2018. Accessed July 7 2022.https:\/\/readable.com\/"},{"key":"e_1_2_8_51_1","doi-asserted-by":"crossref","unstructured":"KincaidJP FishburneRP RogersRL ChissomBS.Derivation of new readability formulas (automated readability index fog count and Flesch Reading ease formula) for navy enlisted personnel.1975.","DOI":"10.21236\/ADA006655"},{"key":"e_1_2_8_52_1","volume-title":"The Technique of Clear Writing","author":"Gunning R","year":"1952"},{"key":"e_1_2_8_53_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0076540"},{"key":"e_1_2_8_54_1","article-title":"SMOG grading \u2010 a new readability formula","author":"Mclaughlin GH","year":"1969","journal-title":"J Read"},{"key":"e_1_2_8_55_1","volume-title":"Readability Revisited: The New Dale\u2010Chall Readability Formula","author":"Chall JSDE","year":"1995"},{"key":"e_1_2_8_56_1","doi-asserted-by":"publisher","DOI":"10.1080\/13548509608400003"},{"key":"e_1_2_8_57_1","unstructured":"Federal Plain Language Guidelines. Published March 2011. Accessed July 7 2022.https:\/\/www.plainlanguage.gov\/media\/FederalPLGuidelines.pdf"},{"key":"e_1_2_8_58_1","unstructured":"The Joint Commission.Advancing Effective Communication Cultural Competence and Patient\u2010 and Family\u2010Centered Care. Published 2010. Accessed July 7 2022.https:\/\/www.jointcommission.org\/\u2010\/media\/tjc\/documents\/resources\/patient\u2010safety\u2010topics\/health\u2010equity\/aroadmapforhospitalsfinalversion727pdf.pdf?db=web&hash=AC3AC4BED1D973713C2CA6B2E5ACD01B&hash=AC3AC4BED1D973713C2CA6B2E5ACD01B"},{"key":"e_1_2_8_59_1","unstructured":"Agency for Healthcare Research and Quality.Strategy 2: Communicating to Improve Quality. Published June 2013. Accessed July 7 2022.https:\/\/www.ahrq.gov\/patient-safety\/patients-families\/engagingfamilies\/strategy2\/index.html"},{"key":"e_1_2_8_60_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1525-1497.2006.00540.x"},{"key":"e_1_2_8_61_1","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M2464"},{"key":"e_1_2_8_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.outlook.2010.12.002"},{"key":"e_1_2_8_63_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMp1008755"},{"key":"e_1_2_8_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-51732-2_11"},{"key":"e_1_2_8_65_1","doi-asserted-by":"publisher","DOI":"10.3233\/SHTI200045"},{"issue":"1","key":"e_1_2_8_66_1","first-page":"11","article-title":"MEDLINEplus: building and maintaining the National Library of Medicine's consumer health web service","volume":"88","author":"Miller N","year":"2000","journal-title":"Bull Med Libr Assoc"},{"key":"e_1_2_8_67_1","unstructured":"Agency for Healthcare Research and Quality.Improving Patient Safety Systems for Patients With Limited English Proficiency. Published 2012. Accessed July 7 2022.https:\/\/www.ahrq.gov\/health-literacy\/professional-training\/lepguide\/chapter1.html"},{"key":"e_1_2_8_68_1","unstructured":"HHS.Limited English Proficiency (LEP). Published November 2 2020. Accessed July 7 2022.https:\/\/www.hhs.gov\/civil-rights\/for-individuals\/special-topics\/limited-english-proficiency\/index.html"},{"key":"e_1_2_8_69_1","volume-title":"Disordered Speech Data Collection: Lessons Learned at 1 Million Utterances from Project Euphonia","author":"MacDonald B","year":"2021"},{"key":"e_1_2_8_70_1","doi-asserted-by":"publisher","DOI":"10.1089\/heq.2017.0045"},{"key":"e_1_2_8_71_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12884-021-03785-7"},{"key":"e_1_2_8_72_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocab093"}],"container-title":["The Laryngoscope"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lary.30465","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/lary.30465","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lary.30465","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,20]],"date-time":"2023-08-20T20:00:11Z","timestamp":1692561611000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/lary.30465"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11]]},"references-count":71,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["10.1002\/lary.30465"],"URL":"https:\/\/doi.org\/10.1002\/lary.30465","archive":["Portico"],"relation":{},"ISSN":["0023-852X","1531-4995"],"issn-type":[{"value":"0023-852X","type":"print"},{"value":"1531-4995","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11]]},"assertion":[{"value":"2022-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-10-10","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}