{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T07:50:37Z","timestamp":1790754637175,"version":"4.1.0"},"reference-count":25,"publisher":"Wiley","issue":"4","license":[{"start":{"date-parts":[[2020,2,3]],"date-time":"2020-02-03T00:00:00Z","timestamp":1580688000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["acsjournals.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Cancer Cytopathology"],"published-print":{"date-parts":[[2020,4]]},"abstract":"<jats:sec><jats:title>Background<\/jats:title><jats:p>The Bethesda System for Reporting Thyroid Cytopathology (TBSRTC) comprises 6 categories used for the diagnosis of thyroid fine\u2010needle aspiration biopsy (FNAB). Each category has an associated risk of malignancy, which is important in the management of a thyroid nodule. More accurate predictions of malignancy may help to reduce unnecessary surgery. A machine learning algorithm (MLA) was developed to evaluate thyroid FNAB via whole slide images (WSIs) to predict malignancy.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Files were searched for all thyroidectomy specimens with preceding FNAB over 8\u00a0years. All cytologic and surgical pathology diagnoses were recorded and correlated for each nodule. One representative slide from each case was scanned to create a WSI. An MLA was designed to identify follicular cells and predict the malignancy of the final pathology. The test set comprised cases blindly reviewed by a cytopathologist who assigned a TBSRTC category. The area under the receiver operating characteristic curve was used to assess the MLA performance.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Nine hundred eight FNABs met the criteria. The MLA predicted malignancy with a sensitivity and specificity of 92.0% and 90.5%, respectively. The areas under the curve for the prediction of malignancy by the cytopathologist and the MLA were 0.931 and 0.932, respectively.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The performance of the MLA in predicting thyroid malignancy from FNAB WSIs is comparable to the performance of an expert cytopathologist. When the MLA and electronic medical record diagnoses are combined, the performance is superior to the performance of either alone. An MLA may be used as an adjunct to FNAB to assist in refining the indeterminate categories.<\/jats:p><\/jats:sec>","DOI":"10.1002\/cncy.22238","type":"journal-article","created":{"date-parts":[[2020,2,3]],"date-time":"2020-02-03T16:35:20Z","timestamp":1580747720000},"page":"287-295","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":100,"title":["Application of a machine learning algorithm to predict malignancy in thyroid cytopathology"],"prefix":"10.1002","volume":"128","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7347-0722","authenticated-orcid":false,"given":"Danielle D.","family":"Elliott Range","sequence":"first","affiliation":[{"name":"Department of Pathology Duke University School of Medicine Durham North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Dov","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering Pratt School of Engineering, Duke University Durham North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shahar Z.","family":"Kovalsky","sequence":"additional","affiliation":[{"name":"Department of Mathematics Trinity College of Arts and Sciences, Duke University Durham North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ricardo","family":"Henao","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering Pratt School of Engineering, Duke University Durham North Carolina"},{"name":"Department of Biostatistics and Bioinformatics Duke University Durham North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lawrence","family":"Carin","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering Pratt School of Engineering, Duke University Durham North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan","family":"Cohen","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery and Communication Sciences Duke University School of Medicine Durham North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2020,2,3]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40842-016-0035-7"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcna.2012.02.002"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2017.0500"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2015.0020"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/cncy.21631"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1245\/s10434-019-07187-0"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2016.0649"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3065386"},{"key":"e_1_2_8_10_1","first-page":"1802.04712","article-title":"Attention\u2010based deep multiple instance learning","author":"Ilse M","year":"2018","journal-title":"arXiv"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btw252"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-28931-6_31"},{"key":"e_1_2_8_13_1","first-page":"1409.1556v6","article-title":"Very deep convolutional networks for large\u2010scale image recognition","author":"Simonyan K","year":"2015","journal-title":"arXiv"},{"key":"e_1_2_8_14_1","first-page":"248","article-title":"ImageNet: a large\u2010scale hierarchical image database","author":"Deng J","year":"2009","journal-title":"IEEE Conf Comput Vision Pattern Recognit"},{"key":"e_1_2_8_15_1","first-page":"1904.00839","article-title":"Thyroid cancer malignancy prediction from whole slide cytopathology images","author":"Dov D","year":"2019","journal-title":"arXiv"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2019.03.009"},{"key":"e_1_2_8_17_1","first-page":"1705.10694","article-title":"Deep learning is robust to massive label noise","author":"Rolnick D","year":"2017","journal-title":"arXiv"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/cncy.22120"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/dc.23880"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2016.06.078"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.4103\/jpi.jpi_43_18"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2007.09.005"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13246-013-0199-8"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2014.04.004"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1159\/000339959"},{"key":"e_1_2_8_26_1","first-page":"323","article-title":"Cascaded learning vector quantizer neural networks for the discrimination of thyroid lesions","volume":"33","author":"Varlatzidou A","year":"2011","journal-title":"Anal Quant Cytol Histol"}],"container-title":["Cancer Cytopathology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fcncy.22238","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cncy.22238","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/cncy.22238","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/acsjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cncy.22238","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T15:24:49Z","timestamp":1760282689000},"score":1,"resource":{"primary":{"URL":"https:\/\/acsjournals.onlinelibrary.wiley.com\/doi\/10.1002\/cncy.22238"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,3]]},"references-count":25,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,4]]}},"alternative-id":["10.1002\/cncy.22238"],"URL":"https:\/\/doi.org\/10.1002\/cncy.22238","archive":["Portico"],"relation":{},"ISSN":["1934-662X","1934-6638"],"issn-type":[{"value":"1934-662X","type":"print"},{"value":"1934-6638","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,3]]},"assertion":[{"value":"2019-10-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-12-12","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-02-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}