{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T06:14:23Z","timestamp":1775024063912,"version":"3.50.1"},"reference-count":35,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2023,10,23]],"date-time":"2023-10-23T00:00:00Z","timestamp":1698019200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003032","name":"Association Nationale de la Recherche et de la Technologie","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003032","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001665","name":"Agence Nationale de la Recherche","doi-asserted-by":"publisher","award":["ANR\u201019\u2010P3IA\u20100001"],"award-info":[{"award-number":["ANR\u201019\u2010P3IA\u20100001"]}],"id":[{"id":"10.13039\/501100001665","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Histopathology"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:sec><jats:title>Background<\/jats:title><jats:p>Diagnosis of head and neck (HN) squamous dysplasias and carcinomas is critical for patient care, cure, and follow\u2010up. It can be challenging, especially for grading intraepithelial lesions. Despite recent simplification in the last WHO grading system, the inter\u2010 and intraobserver variability remains substantial, particularly for nonspecialized pathologists, exhibiting the need for new tools to support pathologists.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>In this study we investigated the potential of deep learning to assist the pathologist with automatic and reliable classification of HN lesions following the 2022 WHO classification system. We created, for the first time, a large\u2010scale database of histological samples (&gt;2000 slides) intended for developing an automatic diagnostic tool. We developed and trained a weakly supervised model performing classification from whole\u2010slide images (WSI). We evaluated our model on both internal and external test sets and we defined and validated a new confidence score to assess the predictions that can be used to identify difficult cases.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Our model demonstrated high classification accuracy across all lesion types on both internal and external test sets (respectively average area under the curve [AUC]: 0.878 (95% confidence interval [CI]: [0.834\u20130.918]) and 0.886 (95% CI: [0.813\u20130.947])) and the confidence score allowed for accurate differentiation between reliable and uncertain predictions.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Our results demonstrate that the model, associated with confidence measurements, can help in the difficult task of classifying HN squamous lesions by limiting variability and detecting ambiguous cases, taking us one step closer to a wider adoption of AI\u2010based assistive tools.<\/jats:p><\/jats:sec>","DOI":"10.1111\/his.15067","type":"journal-article","created":{"date-parts":[[2023,10,24]],"date-time":"2023-10-24T04:10:57Z","timestamp":1698120657000},"page":"343-355","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Diagnosis with confidence: deep learning for reliable classification of laryngeal dysplasia"],"prefix":"10.1111","volume":"84","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1128-8049","authenticated-orcid":false,"given":"M\u00e9lanie","family":"Lubrano","sequence":"first","affiliation":[{"name":"Centre for Computational Biology (CBIO) Mines Paris, PSL University  Paris France"},{"name":"Keen Eye  Paris France"},{"name":"Tribun Health  Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ya\u00eblle","family":"Bellahsen\u2010Harrar","sequence":"additional","affiliation":[{"name":"Department of Pathology, APHP H\u00f4pital Europ\u00e9en Georges\u2010Pompidou  Paris France"},{"name":"Universit\u00e9 Paris Cit\u00e9  Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sylvain","family":"Berlemont","sequence":"additional","affiliation":[{"name":"Keen Eye  Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8702-1119","authenticated-orcid":false,"given":"Sarah","family":"Atallah","sequence":"additional","affiliation":[{"name":"Sorbonne Universit\u00e9  Paris France"},{"name":"Head and Neck Surgery Department H\u00f4pital Tenon  Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emmanuelle","family":"Vaz","sequence":"additional","affiliation":[{"name":"Department of Pathology H\u00f4pital Tenon  Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Walter","sequence":"additional","affiliation":[{"name":"Centre for Computational Biology (CBIO) Mines Paris, PSL University  Paris France"},{"name":"Institut Curie, PSL Universit\u00e9  Paris France"},{"name":"INSERM U900  Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C\u00e9cile","family":"Badoual","sequence":"additional","affiliation":[{"name":"Department of Pathology, APHP H\u00f4pital Europ\u00e9en Georges\u2010Pompidou  Paris France"},{"name":"Universit\u00e9 Paris Cit\u00e9  Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2023,10,23]]},"reference":[{"key":"e_1_2_12_2_1","doi-asserted-by":"publisher","DOI":"10.3322\/caac.21492"},{"key":"e_1_2_12_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41572-020-00224-3"},{"key":"e_1_2_12_4_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12885-019-5614-4"},{"key":"e_1_2_12_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oraloncology.2020.104885"},{"key":"e_1_2_12_6_1","doi-asserted-by":"publisher","DOI":"10.5772\/intechopen.97870"},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12105-020-01149-9"},{"key":"e_1_2_12_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12325-020-01348-4"},{"key":"e_1_2_12_9_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.27228"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12105-010-0208-0"},{"key":"e_1_2_12_11_1","doi-asserted-by":"publisher","DOI":"10.1038\/modpathol.2011.50"},{"key":"e_1_2_12_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599813516733"},{"key":"e_1_2_12_13_1","doi-asserted-by":"publisher","DOI":"10.4103\/0973-029X.185928"},{"key":"e_1_2_12_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12105-021-01405-6"},{"key":"e_1_2_12_15_1","volume-title":"WHO classification of head and neck tumours","author":"El\u2010Naggar AK","year":"2017"},{"key":"e_1_2_12_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/his.12427"},{"key":"e_1_2_12_17_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41571-019-0252-y"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2017.14585"},{"key":"e_1_2_12_19_1","doi-asserted-by":"publisher","DOI":"10.1097\/PAS.0000000000001151"},{"key":"e_1_2_12_20_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41379-020-0551-y"},{"key":"e_1_2_12_21_1","doi-asserted-by":"publisher","DOI":"10.1038\/s43018-020-0099-2"},{"key":"e_1_2_12_22_1","unstructured":"BultenW LitjensG PinckaersHet\u00a0al.The PANDA challenge: prostate cANcer graDe Assessment using the Gleason grading system.2020https:\/\/zenodo.org\/record\/3715938."},{"key":"e_1_2_12_23_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-17678-4"},{"key":"e_1_2_12_24_1","unstructured":"LuMY ZhaoM ShadyMet\u00a0al.Deep learning\u2010based computational pathology predicts origins for cancers of unknown primary. ArXiv Prepr ArXiv2006139322020."},{"key":"e_1_2_12_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0177-5"},{"key":"e_1_2_12_26_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-019-0583-3"},{"key":"e_1_2_12_27_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41416-021-01386-x"},{"key":"e_1_2_12_28_1","first-page":"1050","volume-title":"International conference on machine learning","author":"Gal Y","year":"2016"},{"key":"e_1_2_12_29_1","article-title":"Simple and scalable predictive uncertainty estimation using deep ensembles","volume":"30","author":"Lakshminarayanan B","year":"2017","journal-title":"Adv. Neural Inf. Process Syst."},{"key":"e_1_2_12_30_1","unstructured":"OsbandI.Risk versus uncertainty in deep learning: Bayes bootstrap and the dangers of dropout. NIPS workshop on bayesian deep learning2016."},{"key":"e_1_2_12_31_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-11826-0"},{"key":"e_1_2_12_32_1","unstructured":"DolezalJM SrisuwananukornA KarpeyevDet\u00a0al.Uncertainty\u2010informed deep learning models enable high\u2010confidence predictions for digital histopathology. ArXiv Prepr ArXiv2204045162022."},{"key":"e_1_2_12_33_1","unstructured":"IlseM TomczakJ WellingM.Attention\u2010based deep multiple instance learning. In International conference on machine learning.PMLR 2018;2127\u20132136."},{"key":"e_1_2_12_34_1","unstructured":"ChenT KornblithS NorouziM HintonG.A simple framework for contrastive learning of visual representations. In International conference on machine learning.PMLR 2020;1597\u20131607."},{"key":"e_1_2_12_35_1","volume-title":"Cost\u2010aware pre\u2010training for multiclass cost\u2010sensitive deep learning","author":"Chung YA","year":"2016"},{"key":"e_1_2_12_36_1","volume-title":"Medical imaging with deep learning","author":"Lubrano M","year":"2023"}],"container-title":["Histopathology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/his.15067","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,3]],"date-time":"2024-01-03T04:21:46Z","timestamp":1704255706000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/his.15067"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,23]]},"references-count":35,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["10.1111\/his.15067"],"URL":"https:\/\/doi.org\/10.1111\/his.15067","archive":["Portico"],"relation":{},"ISSN":["0309-0167","1365-2559"],"issn-type":[{"value":"0309-0167","type":"print"},{"value":"1365-2559","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,23]]},"assertion":[{"value":"2023-07-04","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-24","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}