{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,31]],"date-time":"2026-01-31T02:40:51Z","timestamp":1769827251595,"version":"3.49.0"},"reference-count":29,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2017,12,23]],"date-time":"2017-12-23T00:00:00Z","timestamp":1513987200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/about_us\/legal\/notices"}],"funder":[{"DOI":"10.13039\/501100004861","name":"Mackay Memorial Hospital","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004861","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001691","name":"JSPS","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["MH086633 and MH092335"],"award-info":[{"award-number":["MH086633 and MH092335"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["SES-1357666 and DMS-1407655"],"award-info":[{"award-number":["SES-1357666 and DMS-1407655"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004917","name":"Cancer Prevention Research Institute of Texas","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004917","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,5,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>The aim of precision medicine is to harness new knowledge and technology to optimize the timing and targeting of interventions for maximal therapeutic benefit. This study explores the possibility of building AI models without precise pixel-level annotation in prediction of the tumor size, extrathyroidal extension, lymph node metastasis, cancer stage and BRAF mutation in thyroid cancer diagnosis, providing the patients\u2019 background information, histopathological and immunohistochemical tissue images.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>A novel framework for objective evaluation of automatic patient diagnosis algorithms has been established under the auspices of the IEEE International Symposium on Biomedical Imaging 2017\u2014 A Grand Challenge for Tissue Microarray Analysis in Thyroid Cancer Diagnosis. Here, we present the datasets, methods and results of the challenge and lay down the principles for future uses of this benchmark. The main contributions of the challenge include the creation of the data repository of tissue microarrays; the creation of the clinical diagnosis classification data repository of thyroid cancer; and the definition of objective quantitative evaluation for comparison and ranking of the algorithms. With this benchmark, three automatic methods for predictions of the five clinical outcomes have been compared, and detailed quantitative evaluation results are presented in this paper. Based on the quantitative evaluation results, we believe automatic patient diagnosis is still a challenging and unsolved problem.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>The datasets and the evaluation software will be made available to the research community, further encouraging future developments in this field. (http:\/\/www-o.ntust.edu.tw\/cvmi\/ISBI2017\/).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Supplementary information<\/jats:title>\n                  <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btx838","type":"journal-article","created":{"date-parts":[[2017,12,22]],"date-time":"2017-12-22T21:39:01Z","timestamp":1513978741000},"page":"1767-1773","source":"Crossref","is-referenced-by-count":14,"title":["A benchmark for comparing precision medicine methods in thyroid cancer diagnosis using tissue microarrays"],"prefix":"10.1093","volume":"34","author":[{"given":"Ching-Wei","family":"Wang","sequence":"first","affiliation":[{"name":"Graduate Institute of Biomedical Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan"},{"name":"NTUST Center of Computer Vision and Medical Imaging, Taipei, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu-Ching","family":"Lee","sequence":"additional","affiliation":[{"name":"NTUST Center of Computer Vision and Medical Imaging, Taipei, Taiwan"},{"name":"Graduate Institute of Applied Science and Technology, National Taiwan University of Science and Technology, Taipei, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Evelyne","family":"Calista","sequence":"additional","affiliation":[{"name":"Graduate Institute of Biomedical Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan"},{"name":"NTUST Center of Computer Vision and Medical Imaging, Taipei, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fan","family":"Zhou","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, University of North Carolina at Chapel Hill, NC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongtu","family":"Zhu","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, University of North Carolina at Chapel Hill, NC, USA"},{"name":"Department of Biostatistics, University of Texas, MD Anderson Cancer Center, TX, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ryohei","family":"Suzuki","sequence":"additional","affiliation":[{"name":"Department of Genomic Pathology, Medical Research Institute, Tokyo Medical and Dental University, Tokyo, Japan"},{"name":"Department of Physics, The University of Tokyo, Tokyo, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daisuke","family":"Komura","sequence":"additional","affiliation":[{"name":"Department of Genomic Pathology, Medical Research Institute, Tokyo Medical and Dental University, Tokyo, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shumpei","family":"Ishikawa","sequence":"additional","affiliation":[{"name":"Department of Genomic Pathology, Medical Research Institute, Tokyo Medical and Dental University, Tokyo, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shih-Ping","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Surgery, Mackay Memorial Hospital, Taipei, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2017,12,23]]},"reference":[{"key":"2023012810011155800_btx838-B1","doi-asserted-by":"crossref","first-page":"158","DOI":"10.4103\/0022-3859.40790","article-title":"Tissue microarray: a simple technology that has revolutionized research in pathology","volume":"54","author":"Avninder","year":"2008","journal-title":"J. Postgrad. Med"},{"key":"2023012810011155800_btx838-B2","doi-asserted-by":"crossref","first-page":"R100","DOI":"10.1186\/gb-2006-7-10-r100","article-title":"CellProfiler: image analysis software for identifying and quantifying cell phenotypes","volume":"7","author":"Carpenter","year":"2006","journal-title":"Genome Biol"},{"key":"2023012810011155800_btx838-B3","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.aca.2005.11.083","article-title":"Advances in cancer tissue microarray technology: towards improved understanding and diagnostics","volume":"564","author":"Chen","year":"2006","journal-title":"Anal. Chim. Acta"},{"key":"2023012810011155800_btx838-B4","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1145\/2939672.2939785","volume-title":"Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Chen","year":"2016"},{"key":"2023012810011155800_btx838-B5","doi-asserted-by":"crossref","first-page":"S619","DOI":"10.1245\/s10434-014-3723-5","article-title":"Significance of allelic percentage of BRAF c.1799T &gt; A (V600E) mutation in papillary thyroid carcinoma","volume":"21(Suppl 4)","author":"Cheng","year":"2014","journal-title":"Ann. Surg. Oncol"},{"key":"2023012810011155800_btx838-B6","volume-title":"World Health Organization Classification of Tumours. Pathology and Genetics of Tumours of Endocrine Organs","author":"DeLellis","year":"2004"},{"key":"2023012810011155800_btx838-B7","volume-title":"AJCC Cancer Staging Manual","author":"Edge","year":"2010","edition":"7th edn."},{"key":"2023012810011155800_btx838-B8","volume-title":"Data Mining: Practical Machine Learning Tools and Techniques","author":"Frank","year":"2016","edition":"4th edn."},{"key":"2023012810011155800_btx838-B31"},{"key":"2023012810011155800_btx838-B9","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/RBME.2013.2295804","article-title":"Methods for nuclei detection, segmentation, and classification in digital histopathology: a review-current status and future potential","volume":"7","author":"Irshad","year":"2014","journal-title":"IEEE Rev. Biomed. Eng"},{"key":"2023012810011155800_btx838-B10","doi-asserted-by":"crossref","first-page":"123","DOI":"10.4103\/0256-4947.51806","article-title":"Tissue microarray: a rapidly evolving diagnostic and research tool","volume":"29","author":"Jawhar","year":"2009","journal-title":"Ann. Saudi Med"},{"key":"2023012810011155800_btx838-B11","volume-title":"Harrison\u2019s Principal of Internal Medicine","author":"Kasper","year":"2015"},{"key":"2023012810011155800_btx838-B12","doi-asserted-by":"crossref","first-page":"1729","DOI":"10.1109\/TBME.2014.2303294","article-title":"A nonlinear mapping approach to stain normalization in digital histopathology images using image-specific color deconvolution","volume":"61","author":"Khan","year":"2014","journal-title":"IEEE Trans. Biomed. Eng"},{"key":"2023012810011155800_btx838-B13","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans Syst. Man Cybern"},{"key":"2023012810011155800_btx838-B14","first-page":"291","article-title":"Quantification of histochemical staining by color deconvolution","volume":"23","author":"Ruifrok","year":"2001","journal-title":"Anal. Quant. Cytol. Histol"},{"key":"2023012810011155800_btx838-B15","first-page":"234","article-title":"U-Net: convolutional networks for biomedical image Segmentation","volume":"2015","author":"Ronneberger","year":"2015","journal-title":"Proc. MICCAI"},{"key":"2023012810011155800_btx838-B16","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1007\/978-1-60761-806-5_12","volume-title":"Tissue Microarrays Methods and Protocols","author":"Simon","year":"2010"},{"key":"2023012810011155800_btx838-B17","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1002\/(SICI)1097-0142(19990625)87:3<155::AID-CNCR9>3.0.CO;2-#","article-title":"Image analysis of papillary thyroid carcinoma fine-needle aspirates: significant association between aneuploidy and death from disease","volume":"87","author":"Sturgis","year":"1999","journal-title":"Cancer"},{"key":"2023012810011155800_btx838-B18","first-page":"1","author":"Szegedy","year":"2015"},{"key":"2023012810011155800_btx838-B19","author":"TissueGnosticsGmbh","year":"2014"},{"key":"2023012810011155800_btx838-B20","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1109\/TPAMI.2016.2554555","article-title":"A deep matrix factorization method for learning attribute representations","volume":"39","author":"Trigeorgis","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mac. Intell"},{"key":"2023012810011155800_btx838-B22","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.semradonc.2007.10.006","article-title":"Tissue microarrays in clinical oncology","volume":"18","author":"Voduc","year":"2008","journal-title":"Semin. Radiat. Oncol"},{"key":"2023012810011155800_btx838-B23","first-page":"707","article-title":"Fast quantification of immunohistochemistry tissue microarrays in lung carcinoma","volume":"16","author":"Wang","year":"2013","journal-title":"Taylor & Francis"},{"key":"2023012810011155800_btx838-B24","doi-asserted-by":"crossref","first-page":"1879","DOI":"10.1093\/bioinformatics\/btt309","article-title":"Improved image alignment method in application to X-ray images and biological images","volume":"29","author":"Wang","year":"2013","journal-title":"Bioinformatics"},{"key":"2023012810011155800_btx838-B26","doi-asserted-by":"crossref","first-page":"e15818","DOI":"10.1371\/journal.pone.0015818","article-title":"Robust automated tumour segmentation on histological and immunohistochemical tissue images","volume":"6","author":"Wang","year":"2011","journal-title":"PLoS One"},{"key":"2023012810011155800_btx838-B27","doi-asserted-by":"crossref","first-page":"6050","DOI":"10.1038\/srep06050","article-title":"Robust image registration of biological microscopic images","volume":"4","author":"Wang","year":"2014","journal-title":"Sci. Rep"},{"key":"2023012810011155800_btx838-B28","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1111\/his.12562","article-title":"Expression of haem oxygenase-1 correlates with tumour aggressiveness and BRAFV600E expression in thyroid cancer","volume":"66","author":"Wang","year":"2014","journal-title":"Histopathology"},{"key":"2023012810011155800_btx838-B29","author":"Wang","year":"2016"},{"key":"2023012810011155800_btx838-B30","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1186\/1747-1028-4-20","article-title":"Proteomics, pathway array and signaling network-based medicine in cancer","volume":"4","author":"Zhang","year":"2009","journal-title":"Cell Div"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/10\/1767\/48935779\/bioinformatics_34_10_1767.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/10\/1767\/48935779\/bioinformatics_34_10_1767.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,28]],"date-time":"2023-01-28T10:01:51Z","timestamp":1674900111000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/34\/10\/1767\/4774301"}},"subtitle":[],"editor":[{"given":"Robert","family":"Murphy","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2017,12,23]]},"references-count":29,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2018,5,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btx838","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,5,15]]},"published":{"date-parts":[[2017,12,23]]}}}