{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T20:14:36Z","timestamp":1775160876338,"version":"3.50.1"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,10,10]],"date-time":"2021-10-10T00:00:00Z","timestamp":1633824000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,10]],"date-time":"2021-10-10T00:00:00Z","timestamp":1633824000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"national institutes of health","doi-asserted-by":"publisher","award":["P20GM121325"],"award-info":[{"award-number":["P20GM121325"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Breast Cancer Res"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Transcriptome sequencing has been broadly available in clinical studies. However, it remains a challenge to utilize these data effectively for clinical applications due to the high dimension of the data and the highly correlated expression between individual genes.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We proposed a method to transform RNA sequencing data into artificial image objects (AIOs) and applied convolutional neural network (CNN) algorithms to classify these AIOs. With the AIO technique, we considered each gene as a pixel in an image and its expression level as pixel intensity. Using the GSE96058 (<jats:italic>n<\/jats:italic>\u2009=\u20092976), GSE81538 (<jats:italic>n<\/jats:italic>\u2009=\u2009405), and GSE163882 (<jats:italic>n<\/jats:italic>\u2009=\u2009222) datasets, we created AIOs for the subjects and designed CNN models to classify biomarker Ki67 and Nottingham histologic grade (NHG).<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>With fivefold cross-validation, we accomplished a classification accuracy and AUC of 0.821\u2009\u00b1\u20090.023 and 0.891\u2009\u00b1\u20090.021 for Ki67 status. For NHG, the weighted average of categorical accuracy was 0.820\u2009\u00b1\u20090.012, and the weighted average of AUC was 0.931\u2009\u00b1\u20090.006. With GSE96058 as training data and GSE81538 as testing data, the accuracy and AUC for Ki67 were 0.826\u2009\u00b1\u20090.037 and 0.883\u2009\u00b1\u20090.016, and that for NHG were 0.764\u2009\u00b1\u20090.052 and 0.882\u2009\u00b1\u20090.012, respectively. These results were 10%\u00a0better than the results reported in the original studies. For Ki67, the calls generated from our models had a better power for prediction of survival as compared to the calls from trained pathologists in survival analyses.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>We demonstrated that RNA sequencing data could be transformed into AIOs and be used to classify Ki67 status and NHG with CNN algorithms. The AIO method could handle high-dimensional data with highly correlated variables, and there was no need for variable selection. With the AIO technique, a data-driven, consistent, and automation-ready model could be developed to classify biomarkers with RNA sequencing data and provide more efficient care for cancer patients.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s13058-021-01474-z","type":"journal-article","created":{"date-parts":[[2021,10,10]],"date-time":"2021-10-10T21:51:25Z","timestamp":1633902685000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Artificial image objects for classification of breast cancer biomarkers with transcriptome sequencing data and convolutional neural network algorithms"],"prefix":"10.1186","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9575-9447","authenticated-orcid":false,"given":"Xiangning","family":"Chen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel G.","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhongming","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Justin M.","family":"Balko","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingchun","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,10,10]]},"reference":[{"issue":"Suppl 2","key":"1474_CR1","doi-asserted-by":"publisher","first-page":"S67","DOI":"10.1016\/j.breast.2015.07.017","volume":"24","author":"C Denkert","year":"2015","unstructured":"Denkert C, Budczies J, von Minckwitz G, Wienert S, Loibl S, Klauschen F. Strategies for developing Ki67 as a useful biomarker in breast cancer. Breast. 2015;24(Suppl 2):S67-72.","journal-title":"Breast"},{"key":"1474_CR2","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1016\/j.pathol.2016.11.006","volume":"49","author":"F Penault-Llorca","year":"2017","unstructured":"Penault-Llorca F, Radosevic-Robin N. Ki67 assessment in breast cancer: an update. Pathology. 2017;49:166\u201371.","journal-title":"Pathology"},{"key":"1474_CR3","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1186\/1741-7015-11-151","volume":"11","author":"RD Baird","year":"2013","unstructured":"Baird RD, Caldas C. Genetic heterogeneity in breast cancer: the road to personalized medicine? BMC Med. 2013;11:151.","journal-title":"BMC Med"},{"key":"1474_CR4","doi-asserted-by":"publisher","first-page":"8","DOI":"10.21037\/cco.2018.06.04","volume":"7","author":"Y Naito","year":"2018","unstructured":"Naito Y, Urasaki T. Precision medicine in breast cancer. Chin Clin Oncol. 2018;7:8\u20138.","journal-title":"Chin Clin Oncol"},{"key":"1474_CR5","doi-asserted-by":"publisher","first-page":"3418","DOI":"10.1245\/s10434-015-4703-0","volume":"22","author":"A Gupta","year":"2015","unstructured":"Gupta A, Mutebi M, Bardia A. Gene-expression-based predictors for breast cancer. Ann Surg Oncol. 2015;22:3418\u201332.","journal-title":"Ann Surg Oncol"},{"key":"1474_CR6","doi-asserted-by":"publisher","first-page":"1812","DOI":"10.1016\/S0140-6736(11)61539-0","volume":"378","author":"JS Reis-Filho","year":"2011","unstructured":"Reis-Filho JS, Pusztai L. Gene expression profiling in breast cancer: classification, prognostication, and prediction. Lancet. 2011;378:1812\u201323.","journal-title":"Lancet"},{"key":"1474_CR7","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1038\/nrclinonc.2017.74","volume":"14","author":"M Kwa","year":"2017","unstructured":"Kwa M, Makris A, Esteva FJ. Clinical utility of gene-expression signatures in early stage breast cancer. Nat Rev Clin Oncol. 2017;14:595\u2013610.","journal-title":"Nat Rev Clin Oncol"},{"key":"1474_CR8","doi-asserted-by":"publisher","first-page":"1160","DOI":"10.1200\/JCO.2008.18.1370","volume":"27","author":"JS Parker","year":"2009","unstructured":"Parker JS, Mullins M, Cheang MCU, Leung S, Voduc D, Vickery T, et al. Supervised risk predictor of breast cancer based on intrinsic subtypes. J Clin Oncol. 2009;27:1160\u20137.","journal-title":"J Clin Oncol"},{"key":"1474_CR9","doi-asserted-by":"publisher","first-page":"2352","DOI":"10.1162\/neco_a_00990","volume":"29","author":"W Rawat","year":"2017","unstructured":"Rawat W, Wang Z. Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput. 2017;29:2352\u2013449.","journal-title":"Neural Comput"},{"key":"1474_CR10","doi-asserted-by":"crossref","unstructured":"Al-Saffar AAM, Tao H, Talab MA. Review of deep convolution neural network in image classification. In: 2017 International conference on radar, antenna, microwave, electronics, and telecommunications (ICRAMET); 2017. p. 26\u201331.","DOI":"10.1109\/ICRAMET.2017.8253139"},{"key":"1474_CR11","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1016\/j.artmed.2018.08.008","volume":"95","author":"J Bernal","year":"2019","unstructured":"Bernal J, Kushibar K, Asfaw DS, Valverde S, Oliver A, Mart\u00ed R, et al. Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review. Artif Intell Med. 2019;95:64\u201381.","journal-title":"Artif Intell Med"},{"key":"1474_CR12","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1038\/s41568-018-0016-5","volume":"18","author":"A Hosny","year":"2018","unstructured":"Hosny A, Parmar C, Quackenbush J, Schwartz LH, Aerts HJWL. Artificial intelligence in radiology. Nat Rev Cancer. 2018;18:500\u201310.","journal-title":"Nat Rev Cancer"},{"key":"1474_CR13","doi-asserted-by":"publisher","first-page":"2173","DOI":"10.1038\/s41467-019-10212-1","volume":"10","author":"Z Tang","year":"2019","unstructured":"Tang Z, Chuang KV, DeCarli C, Jin L-W, Beckett L, Keiser MJ, et al. Interpretable classification of Alzheimer\u2019s disease pathologies with a convolutional neural network pipeline. Nat Commun. 2019;10:2173.","journal-title":"Nat Commun"},{"key":"1474_CR14","doi-asserted-by":"publisher","first-page":"e0230536","DOI":"10.1371\/journal.pone.0230536","volume":"15","author":"G L\u00f3pez-Garc\u00eda","year":"2020","unstructured":"L\u00f3pez-Garc\u00eda G, Jerez JM, Franco L, Veredas FJ. Transfer learning with convolutional neural networks for cancer survival prediction using gene-expression data. PLoS ONE. 2020;15:e0230536.","journal-title":"PLoS ONE"},{"key":"1474_CR15","doi-asserted-by":"publisher","first-page":"103030","DOI":"10.1016\/j.ebiom.2020.103030","volume":"61","author":"Y Zhao","year":"2020","unstructured":"Zhao Y, Pan Z, Namburi S, Pattison A, Posner A, Balachander S, et al. CUP-AI-Dx: A tool for inferring cancer tissue of origin and molecular subtype using RNA gene-expression data and artificial intelligence. EBioMedicine. 2020;61:103030.","journal-title":"EBioMedicine"},{"key":"1474_CR16","doi-asserted-by":"publisher","first-page":"11399","DOI":"10.1038\/s41598-019-47765-6","volume":"9","author":"A Sharma","year":"2019","unstructured":"Sharma A, Vans E, Shigemizu D, Boroevich KA, Tsunoda T. DeepInsight: A methodology to transform a non-image data to an image for convolution neural network architecture. Sci Rep. 2019;9:11399.","journal-title":"Sci Rep"},{"key":"1474_CR17","doi-asserted-by":"publisher","first-page":"100303","DOI":"10.1016\/j.patter.2021.100303","volume":"2","author":"X Chen","year":"2021","unstructured":"Chen X, Chen DG, Zhao Z, Zhan J, Ji C, Chen J. Artificial image objects for classification of schizophrenia with GWAS-selected SNVs and convolutional neural network. Patterns (N Y). 2021;2:100303.","journal-title":"Patterns (N Y)."},{"key":"1474_CR18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1200\/PO.17.00135","volume":"2","author":"C Brueffer","year":"2018","unstructured":"Brueffer C, Vallon-Christersson J, Grabau D, Ehinger A, H\u00e4kkinen J, Hegardt C, et al. Clinical value of RNA sequencing-based classifiers for prediction of the five conventional breast cancer biomarkers: a report from the population-based multicenter sweden cancerome analysis network-breast initiative. JCO Precis Oncol. 2018;2:1\u201318.","journal-title":"JCO Precis Oncol"},{"key":"1474_CR19","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1186\/s13073-015-0131-9","volume":"7","author":"LH Saal","year":"2015","unstructured":"Saal LH, Vallon-Christersson J, H\u00e4kkinen J, Hegardt C, Grabau D, Winter C, et al. The Sweden Cancerome Analysis Network - Breast (SCAN-B) Initiative: a large-scale multicenter infrastructure towards implementation of breast cancer genomic analyses in the clinical routine. Genome Med. 2015;7:20.","journal-title":"Genome Med"},{"key":"1474_CR20","unstructured":"Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, et al. TensorFlow: a system for large-scale machine learning. arXiv:1605.08695 [Cs]. 2016. 27 May 2016."},{"key":"1474_CR21","unstructured":"Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, et al. TensorFlow: large-scale machine learning on heterogeneous distributed systems. arXiv:1603.04467 [Cs]. 2016. 14 March 2016."},{"key":"1474_CR22","doi-asserted-by":"crossref","unstructured":"Ciresan DC, Meier U, Gambardella LM, Schmidhuber J. Convolutional neural network committees for handwritten character classification. In: 2011 International conference on document analysis and recognition; 2011. p. 1135\u20131139.","DOI":"10.1109\/ICDAR.2011.229"},{"key":"1474_CR23","doi-asserted-by":"crossref","unstructured":"Chen X, Xiang S, Liu C, Pan C. Vehicle detection in satellite images by parallel deep convolutional neural networks. In: 2013 2nd IAPR Asian conference on pattern recognition; 2013. p. 181\u2013185.","DOI":"10.1109\/ACPR.2013.33"},{"key":"1474_CR24","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: machine learning in python. J Mach Learn Res. 2011;12:2825\u201330.","journal-title":"J Mach Learn Res"},{"key":"1474_CR25","doi-asserted-by":"publisher","first-page":"107398","DOI":"10.1016\/j.ymssp.2020.107398","volume":"151","author":"S Kiranyaz","year":"2021","unstructured":"Kiranyaz S, Avci O, Abdeljaber O, Ince T, Gabbouj M, Inman DJ. 1D convolutional neural networks and applications: a survey. Mech Syst Signal Process. 2021;151:107398.","journal-title":"Mech Syst Signal Process"},{"key":"1474_CR26","doi-asserted-by":"crossref","unstructured":"Wang Z, Yan W, Oates T. Time series classification from scratch with deep neural networks: a strong baseline. In: 2017 International joint conference on neural networks (IJCNN); 2017. p. 1578\u20131585.","DOI":"10.1109\/IJCNN.2017.7966039"}],"container-title":["Breast Cancer Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13058-021-01474-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13058-021-01474-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13058-021-01474-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T17:49:01Z","timestamp":1725904141000},"score":1,"resource":{"primary":{"URL":"https:\/\/breast-cancer-research.biomedcentral.com\/articles\/10.1186\/s13058-021-01474-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,10]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1474"],"URL":"https:\/\/doi.org\/10.1186\/s13058-021-01474-z","relation":{},"ISSN":["1465-542X"],"issn-type":[{"value":"1465-542X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,10]]},"assertion":[{"value":"22 January 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 September 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study used 3 publicly available datasets, therefore, ethical approval and participants consent were not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"XC had filed a USPTO and PCT patent application for the AIO technology. The patent is currently under examination by the agencies.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"96"}}