{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T10:39:38Z","timestamp":1788259178709,"version":"build-2803163510"},"reference-count":31,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2019,11,19]],"date-time":"2019-11-19T00:00:00Z","timestamp":1574121600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,5,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Ultrasound plays a critical role in evaluating thyroid nodules. We compared the performance of the two most popular ultrasound malignancy risk stratification systems, the 2015 American Thyroid Association (ATA) guidelines and the American College of Radiology Thyroid Imaging and Reporting Data System (ACR TI-RADS).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We retrospectively identified 250 thyroid nodules that were surgically removed from 137 patients. Their ultrasound images were independently rated using both ATA and ACR TI-RADS by six raters with expertise in ultrasound interpretation. For each system, we generated a receiver operating characteristic curve and calculated the area under the curve (AUC).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Sixty-five (26%) nodules were malignant. There was \u201cfair agreement\u201d among raters for both ATA and ACR TI-RADS. Our observed malignancy risks for ATA and ACR TI-RADS categories were similar to expected risk thresholds with a few notable exceptions including the intermediate ATA risk category and the three highest risk categories for ACR TI-RADS. Biopsy of 226 of the 250 nodules would be indicated by ATA guidelines based on nodule size and mean ATA rating. One hundred forty-six nodules would be biopsied based on ACR TI-RADS. The sensitivity, specificity, and negative and positive predictive values were 92%, 10%, 79%, and 27%, respectively, for ATA and 74%, 47%, 84%, and 33%, respectively, for ACR TI-RADS. The AUC for ATA was 0.734 and for ACR TI-RADS was 0.718.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Although both systems demonstrated good diagnostic performance, ATA guidelines resulted in a greater number of thyroid biopsies and exhibited more consistent malignancy risk prediction for higher risk categories.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Implications for Practice<\/jats:title>\n                  <jats:p>With the rising incidence of thyroid nodules, the need for accurate detection of malignancy is important to avoid the overtreatment of benign nodules. Ultrasonography is one of the key tools for the evaluation of thyroid nodules, although the use of many different ultrasound risk stratification systems is a hindrance to clinical collaboration in everyday practice and the comparison of data in research. The first step toward the development of a universal thyroid nodule ultrasound malignancy risk stratification system is to better understand the strengths and weaknesses of the current systems in use.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1634\/theoncologist.2019-0362","type":"journal-article","created":{"date-parts":[[2019,11,18]],"date-time":"2019-11-18T20:35:21Z","timestamp":1574109321000},"page":"398-403","source":"Crossref","is-referenced-by-count":30,"title":["A Multidisciplinary Head-to-Head Comparison of American College of Radiology Thyroid Imaging and Reporting Data System and American Thyroid Association Ultrasound Risk Stratification Systems"],"prefix":"10.1093","volume":"25","author":[{"given":"Bernice L.","family":"Huang","sequence":"first","affiliation":[{"name":"Department of Surgery, Columbia University Medical Center, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susana A.","family":"Ebner","sequence":"additional","affiliation":[{"name":"Division of Endocrinology, Department of Medicine, Columbia University Medical Center, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jasnit S.","family":"Makkar","sequence":"additional","affiliation":[{"name":"Department of Radiology, Columbia University Medical Center, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stuart","family":"Bentley-Hibbert","sequence":"additional","affiliation":[{"name":"Department of Radiology, Columbia University Medical Center, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert J.","family":"McConnell","sequence":"additional","affiliation":[{"name":"Division of Endocrinology, Department of Medicine, Columbia University Medical Center, New York, New York, USA"},{"name":"The Columbia Thyroid Center, Columbia University Medical Center, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James A.","family":"Lee","sequence":"additional","affiliation":[{"name":"The Columbia Thyroid Center, Columbia University Medical Center, New York, New York, USA"},{"name":"Division of GI\/Endocrine Surgery, Department of Surgery, Columbia University Irving Medical Center, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth M.","family":"Hecht","sequence":"additional","affiliation":[{"name":"Department of Radiology, Columbia University Medical Center, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer H.","family":"Kuo","sequence":"additional","affiliation":[{"name":"The Columbia Thyroid Center, Columbia University Medical Center, New York, New York, USA"},{"name":"Division of GI\/Endocrine Surgery, Department of Surgery, Columbia University Irving Medical Center, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2019,11,19]]},"reference":[{"key":"2021122510233304200_onco13167-bib-0001","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1111\/j.1365-2362.2009.02162.x","article-title":"Very high prevalence of thyroid nodules detected by high frequency (13 MHz) ultrasound examination","volume":"39","author":"Guth","year":"2009","journal-title":"Eur J Clin Invest"},{"key":"2021122510233304200_onco13167-bib-0002","doi-asserted-by":"crossref","first-page":"1270","DOI":"10.1210\/jcem-15-10-1270","article-title":"Gross and microscopic findings in clinically normal thyroid glands","volume":"15","author":"Mortensen","year":"1955","journal-title":"J Clin Endocrinol Metab"},{"key":"2021122510233304200_onco13167-bib-0003","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1089\/thy.2015.0116","article-title":"The impact of diagnostic changes on the rise in thyroid cancer incidence: A population-based study in selected high-resource countries","volume":"25","author":"Vaccarella","year":"2015","journal-title":"Thyroid"},{"key":"2021122510233304200_onco13167-bib-0004","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1089\/thy.2015.0020","article-title":"2015 American Thyroid Association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: The American Thyroid Association guidelines task force on thyroid nodules and differentiated thyroid cancer","volume":"26","author":"Haugen","year":"2016","journal-title":"Thyroid"},{"key":"2021122510233304200_onco13167-bib-0005","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1210\/jc.2013-2928","article-title":"The accuracy of thyroid nodule ultrasound to predict thyroid cancer: Systematic review and meta-analysis","volume":"99","author":"Brito","year":"2014","journal-title":"J Clin Endocrinol Metab"},{"key":"2021122510233304200_onco13167-bib-0006","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1148\/radiol.11110206","article-title":"Thyroid imaging reporting and data system for US features of nodules: A step in establishing better stratification of cancer risk","volume":"260","author":"Kwak","year":"2011","journal-title":"Radiology"},{"key":"2021122510233304200_onco13167-bib-0007","doi-asserted-by":"crossref","first-page":"1788","DOI":"10.1001\/jamainternmed.2013.9245","article-title":"Risk of thyroid cancer based on thyroid ultrasound imaging characteristics: Results of a population-based study","volume":"173","author":"Smith-Bindman","year":"2013","journal-title":"JAMA Intern Med"},{"key":"2021122510233304200_onco13167-bib-0008","doi-asserted-by":"crossref","first-page":"1748","DOI":"10.1210\/jc.2008-1724","article-title":"An ultrasonogram reporting system for thyroid nodules stratifying cancer risk for clinical management","volume":"94","author":"Horvath","year":"2009","journal-title":"J Clin Endocrinol Metab"},{"key":"2021122510233304200_onco13167-bib-0009","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1159\/000478927","article-title":"European Thyroid Association guidelines for ultrasound malignancy risk stratification of thyroid nodules in adults: The EU-TIRADS","volume":"6","author":"Russ","year":"2017","journal-title":"Eur Thyroid J"},{"key":"2021122510233304200_onco13167-bib-0010","doi-asserted-by":"crossref","first-page":"622","DOI":"10.4158\/EP161208.GL","article-title":"American Association of Clinical Endocrinologists, American College of Endocrinology, and Associazione Medici Endocrinologi medical guidelines for clinical practice for the diagnosis and management of thyroid nodules - 2016 update","volume":"22","author":"Gharib","year":"2016","journal-title":"Endocr Pract"},{"issue":"suppl 1","key":"2021122510233304200_onco13167-bib-0011","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/cen.12515","article-title":"Guidelines for the management of thyroid cancer","volume":"81","author":"Perros","year":"2014","journal-title":"Clin Endocrinol (Oxf)"},{"key":"2021122510233304200_onco13167-bib-0012","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.jacr.2017.01.046","article-title":"ACR Thyroid Imaging, Reporting and Data System (TI-RADS): White paper of the ACR TI-RADS committee","volume":"14","author":"Tessler","year":"2017","journal-title":"J Am Coll Radiol"},{"key":"2021122510233304200_onco13167-bib-0013","doi-asserted-by":"crossref","first-page":"1077","DOI":"10.1089\/thy.2016.0555","article-title":"Validation of American Thyroid Association ultrasound risk assessment of thyroid nodules selected for ultrasound fine-needle aspiration","volume":"27","author":"Tang","year":"2017","journal-title":"Thyroid"},{"key":"2021122510233304200_onco13167-bib-0014","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1097\/RUQ.0000000000000350","article-title":"A single-center retrospective validation study of the American College of Radiology Thyroid Imaging Reporting and Data System","volume":"34","author":"Zheng","year":"2018","journal-title":"Ultrasound Q"},{"key":"2021122510233304200_onco13167-bib-0015","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many raters","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychol Bull"},{"key":"2021122510233304200_onco13167-bib-0016","doi-asserted-by":"crossref","first-page":"1331","DOI":"10.2214\/AJR.16.17613","article-title":"Multiinstitutional analysis of thyroid nodule risk stratification using the American College of Radiology Thyroid Imaging Reporting and Data System","volume":"208","author":"Middleton","year":"2017","journal-title":"AJR Am J Roentgenol"},{"key":"2021122510233304200_onco13167-bib-0017","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1148\/radiology.148.3.6878708","article-title":"A method of comparing the areas under receiver operating characteristic curves derived from the same cases","volume":"148","author":"Hanley","year":"1983","journal-title":"Radiology"},{"key":"2021122510233304200_onco13167-bib-0018"},{"key":"2021122510233304200_onco13167-bib-0019"},{"key":"2021122510233304200_onco13167-bib-0020","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1186\/1471-2105-12-77","article-title":"pROC: An open-source package for R and S+ to analyze and compare ROC curves","volume":"12","author":"Robin","year":"2011","journal-title":"BMC Bioinformatics"},{"key":"2021122510233304200_onco13167-bib-0021","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1148\/radiol.2015150056","article-title":"Malignancy risk stratification of thyroid nodules: Comparison between the Thyroid Imaging Reporting and Data System and the 2014 American Thyroid Association Management Guidelines","volume":"278","author":"Yoon","year":"2016","journal-title":"Radiology"},{"key":"2021122510233304200_onco13167-bib-0022","doi-asserted-by":"crossref","first-page":"578","DOI":"10.11622\/smedj.2018062","article-title":"Diagnostic performance of ATA, BTA and TIRADS sonographic patterns in the prediction of malignancy in histologically proven thyroid nodules","volume":"59","author":"Chng","year":"2018","journal-title":"Singapore Med J"},{"key":"2021122510233304200_onco13167-bib-0023","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1148\/radiol.2018171074","article-title":"US fine-needle aspiration biopsy for thyroid malignancy: Diagnostic performance of seven society guidelines applied to 2000 thyroid nodules","volume":"287","author":"Ha","year":"2018","journal-title":"Radiology"},{"key":"2021122510233304200_onco13167-bib-0024","first-page":"131","article-title":"Reliability of Thyroid Imaging Reporting and Data System (TI-RADS), and ultrasonographic classification of the American Thyroid Association (ATA) in differentiating benign from malignant thyroid nodules","volume":"62","author":"Macedo","year":"2018","journal-title":"Arch Endocrinol Metab"},{"key":"2021122510233304200_onco13167-bib-0025","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1007\/s12020-019-01843-x","article-title":"Comparison among TIRADS (ACR TI-RADS and KWAK- TI-RADS) and 2015 ATA Guidelines in the diagnostic efficiency of thyroid nodules","volume":"64","author":"Gao","year":"2019","journal-title":"Endocrine"},{"key":"2021122510233304200_onco13167-bib-0026","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.2214\/AJR.17.18822","article-title":"Comparison of performance characteristics of American College of Radiology TI-RADS, Korean Society of Thyroid Radiology TIRADS, and American Thyroid Association Guidelines","volume":"210","author":"Middleton","year":"2018","journal-title":"AJR Am J Roentgenol"},{"key":"2021122510233304200_onco13167-bib-0027","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"2021122510233304200_onco13167-bib-0028","doi-asserted-by":"crossref","first-page":"162","DOI":"10.2214\/AJR.17.19192","article-title":"Interobserver variability of sonographic features used in the American College of Radiology Thyroid Imaging Reporting and Data System","volume":"211","author":"Hoang","year":"2018","journal-title":"AJR Am J Roentgenol"},{"key":"2021122510233304200_onco13167-bib-0029","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1530\/EC-17-0336","article-title":"Interobserver agreement of various thyroid imaging reporting and data systems","volume":"7","author":"Grani","year":"2018","journal-title":"Endocr Connect"},{"key":"2021122510233304200_onco13167-bib-0030","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.1089\/thy.2018.0094","article-title":"Diagnostic performance of ultrasound-based risk-stratification systems for thyroid nodules: Comparison of the 2015 American Thyroid Association Guidelines with the 2016 Korean Thyroid Association\/Korean Society of Thyroid Radiology and 2017 American Congress of Radiology Guidelines","volume":"28","author":"Ha","year":"2018","journal-title":"Thyroid"},{"key":"2021122510233304200_onco13167-bib-0031","doi-asserted-by":"crossref","first-page":"2362","DOI":"10.1210\/jc.2018-00274","article-title":"Prospective validation of ATA and ETA sonographic pattern risk of thyroid nodules selected for FNAC","volume":"103","author":"Maino","year":"2018","journal-title":"J Clin Endocrinol Metab"}],"container-title":["The Oncologist"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1634\/theoncologist.2019-0362","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1634\/theoncologist.2019-0362","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/oncolo\/article-pdf\/25\/5\/398\/41918928\/oncolo_25_5_398.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/oncolo\/article-pdf\/25\/5\/398\/41918928\/oncolo_25_5_398.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,25]],"date-time":"2021-12-25T10:24:20Z","timestamp":1640427860000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/oncolo\/article\/25\/5\/398\/6444351"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,19]]},"references-count":31,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2019,11,19]]},"published-print":{"date-parts":[[2020,5,1]]}},"URL":"https:\/\/doi.org\/10.1634\/theoncologist.2019-0362","relation":{},"ISSN":["1083-7159","1549-490X"],"issn-type":[{"value":"1083-7159","type":"print"},{"value":"1549-490X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,5,1]]},"published":{"date-parts":[[2019,11,19]]}}}