{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T17:03:09Z","timestamp":1775667789505,"version":"3.50.1"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,1,6]],"date-time":"2020-01-06T00:00:00Z","timestamp":1578268800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,1,6]],"date-time":"2020-01-06T00:00:00Z","timestamp":1578268800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"crossref","award":["2016R1E1A1A0191433"],"award-info":[{"award-number":["2016R1E1A1A0191433"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Samsung Medical Center","award":["SMX1170501"],"award-info":[{"award-number":["SMX1170501"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>We used the Surveillance, Epidemiology, and End Results (SEER) database to develop and validate deep survival neural network machine learning (ML) algorithms to predict survival following a spino-pelvic chondrosarcoma diagnosis.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Methods<\/jats:title>\n<jats:p>The SEER 18 registries were used to apply the Risk Estimate Distance Survival Neural Network (RED_SNN) in the model. Our model was evaluated at each time window with receiver operating characteristic curves and areas under the curves (AUCs), as was the concordance index (c-index).<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>The subjects (<jats:italic>n<\/jats:italic>\u2009=\u20091088) were separated into training (80%, <jats:italic>n<\/jats:italic>\u2009=\u2009870) and test sets (20%, <jats:italic>n<\/jats:italic>\u2009=\u2009218). The training data were randomly sorted into training and validation sets using 5-fold cross validation. The median c-index of the five validation sets was 0.84 (95% confidence interval 0.79\u20130.87). The median AUC of the five validation subsets was 0.84. This model was evaluated with the previously separated test set. The c-index was 0.82 and the mean AUC of the 30 different time windows was 0.85 (standard deviation 0.02). According to the estimated survival probability (by 62\u2009months), we divided the test group into five subgroups. The survival curves of the subgroups showed statistically significant separation (<jats:italic>p<\/jats:italic>\u2009&lt;\u20090.001).<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusions<\/jats:title>\n<jats:p>This study is the first to analyze population-level data using artificial neural network ML algorithms for the role and outcomes of surgical resection and radiation therapy in spino-pelvic chondrosarcoma.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12911-019-1008-4","type":"journal-article","created":{"date-parts":[[2020,1,6]],"date-time":"2020-01-06T14:02:46Z","timestamp":1578319366000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Novel prognostication of patients with spinal and pelvic chondrosarcoma using deep survival neural networks"],"prefix":"10.1186","volume":"20","author":[{"given":"Sung Mo","family":"Ryu","sequence":"first","affiliation":[]},{"given":"Sung Wook","family":"Seo","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3357-4329","authenticated-orcid":false,"given":"Sun-Ho","family":"Lee","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,1,6]]},"reference":[{"key":"1008_CR1","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1016\/j.spinee.2011.01.013","volume":"11","author":"MJ McGirt","year":"2011","unstructured":"McGirt MJ, Gokaslan ZL, Chaichana KL. Preoperative grading scale to predict survival in patients undergoing resection of malignant primary osseous spinal neoplasms. Spine J. 2011;11:190\u20136.","journal-title":"Spine J"},{"key":"1008_CR2","doi-asserted-by":"publisher","first-page":"580","DOI":"10.1016\/j.wneu.2011.05.016","volume":"76","author":"D Mukherjee","year":"2011","unstructured":"Mukherjee D, Chaichana KL, Adogwa O, Gokaslan Z, Aaronson O, Cheng JS, et al. Association of extent of local tumor invasion and survival in patients with malignant primary osseous spinal neoplasms from the surveillance, epidemiology, and end results (SEER) database. World Neurosurg. 2011;76:580\u20135.","journal-title":"World Neurosurg"},{"key":"1008_CR3","doi-asserted-by":"publisher","first-page":"143","DOI":"10.3171\/2010.10.SPINE10189","volume":"14","author":"D Mukherjee","year":"2011","unstructured":"Mukherjee D, Chaichana KL, Gokaslan ZL, Aaronson O, Cheng JS, McGirt MJ. Survival of patients with malignant primary osseous spinal neoplasms: results from the surveillance, epidemiology, and end results (SEER) database from 1973 to 2003. J Neurosurg Spine. 2011;14:143\u201350.","journal-title":"J Neurosurg Spine"},{"key":"1008_CR4","doi-asserted-by":"publisher","first-page":"1375","DOI":"10.1007\/s00586-012-2621-4","volume":"22","author":"D Mukherjee","year":"2013","unstructured":"Mukherjee D, Chaichana KL, Parker SL, Gokaslan ZL, McGirt MJ. Association of surgical resection and survival in patients with malignant primary osseous spinal neoplasms from the surveillance, epidemiology, and end results (SEER) database. Eur Spine J. 2013;22:1375\u201382.","journal-title":"Eur Spine J"},{"key":"1008_CR5","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1016\/j.critrevonc.2007.03.004","volume":"63","author":"M Reni","year":"2007","unstructured":"Reni M, Gatta G, Mazza E, Vecht C. Ependymoma. Crit Rev Oncol Hematol. 2007;63:81\u20139.","journal-title":"Crit Rev Oncol Hematol"},{"key":"1008_CR6","doi-asserted-by":"publisher","first-page":"1063","DOI":"10.2106\/JBJS.H.00416","volume":"91","author":"AY Giuffrida","year":"2009","unstructured":"Giuffrida AY, Burgueno JE, Koniaris LG, Gutierrez JC, Duncan R, Scully SP. Chondrosarcoma in the United States (1973 to 2003): an analysis of 2890 cases from the SEER database. J Bone Joint Surg Am. 2009;91:1063\u201372.","journal-title":"J Bone Joint Surg Am"},{"key":"1008_CR7","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1016\/j.wneu.2011.06.043","volume":"76","author":"N Nathoo","year":"2011","unstructured":"Nathoo N, Mendel E. The National Cancer Institute's SEER registry and primary malignant osseous spine tumors. World Neurosurg. 2011;76:531\u20132.","journal-title":"World Neurosurg"},{"key":"1008_CR8","doi-asserted-by":"publisher","first-page":"644","DOI":"10.1097\/BRS.0000000000001870","volume":"42","author":"A Arshi","year":"2017","unstructured":"Arshi A, Sharim J, Park DY, Park HY, Bernthal NM, Yazdanshenas H, et al. Chondrosarcoma of the Osseous Spine: An Analysis of Epidemiology, Patient Outcomes, and Prognostic Factors Using the SEER Registry From 1973 to 2012. Spine (Phila Pa 1976). 2017;42:644\u201352.","journal-title":"Spine (Phila Pa 1976)"},{"key":"1008_CR9","doi-asserted-by":"publisher","first-page":"1216","DOI":"10.1056\/NEJMp1606181","volume":"375","author":"Z Obermeyer","year":"2016","unstructured":"Obermeyer Z, Emanuel EJ. Predicting the future - big data, machine learning, and clinical medicine. N Engl J Med. 2016;375:1216\u20139.","journal-title":"N Engl J Med"},{"key":"1008_CR10","first-page":"59","volume":"2","author":"JA Cruz","year":"2007","unstructured":"Cruz JA, Wishart DS. Applications of machine learning in cancer prediction and prognosis. Cancer Inform. 2007;2:59\u201377.","journal-title":"Cancer Inform"},{"key":"1008_CR11","doi-asserted-by":"publisher","first-page":"e842","DOI":"10.1016\/j.wneu.2018.07.276","volume":"119","author":"AV Karhade","year":"2018","unstructured":"Karhade AV, Thio Q, Ogink P, Kim J, Lozano-Calderon S, Raskin K, et al. Development of machine learning algorithms for prediction of 5-year spinal Chordoma survival. World Neurosurg. 2018;119:e842\u20137.","journal-title":"World Neurosurg"},{"key":"1008_CR12","doi-asserted-by":"publisher","first-page":"1201","DOI":"10.1002\/1097-0142(20010401)91:7<1201::AID-CNCR1120>3.0.CO;2-W","volume":"91","author":"P Bergh","year":"2001","unstructured":"Bergh P, Gunterberg B, Meis-Kindblom JM, Kindblom LG. Prognostic factors and outcome of pelvic, sacral, and spinal chondrosarcomas: a center-based study of 69 cases. Cancer. 2001;91:1201\u201312.","journal-title":"Cancer"},{"key":"1008_CR13","doi-asserted-by":"publisher","first-page":"804","DOI":"10.1097\/00007632-200004010-00008","volume":"25","author":"S Boriani","year":"2000","unstructured":"Boriani S, De Iure F, Bandiera S, Campanacci L, Biagini R, Di Fiore M, et al. Chondrosarcoma of the mobile spine: report on 22 cases. Spine (Phila Pa 1976). 2000;25:804\u201312.","journal-title":"Spine (Phila Pa 1976)"},{"key":"1008_CR14","doi-asserted-by":"publisher","first-page":"1248","DOI":"10.2106\/00004623-198163080-00006","volume":"63","author":"S Gitelis","year":"1981","unstructured":"Gitelis S, Bertoni F, Picci P, Campanacci M. Chondrosarcoma of bone. The experience at the Istituto Ortopedico Rizzoli. J Bone Joint Surg Am. 1981;63:1248\u201357.","journal-title":"J Bone Joint Surg Am"},{"key":"1008_CR15","doi-asserted-by":"publisher","first-page":"1450","DOI":"10.2106\/00004623-196345070-00010","volume":"45","author":"ED Henderson","year":"1963","unstructured":"Henderson ED, Dahlin DC. Chondrosarcoma of bone--a study of two hundred and eighty-eight cases. J Bone Joint Surg Am. 1963;45:1450\u20138.","journal-title":"J Bone Joint Surg Am"},{"key":"1008_CR16","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1097\/BRS.0b013e31823d2143","volume":"37","author":"AJ Schoenfeld","year":"2012","unstructured":"Schoenfeld AJ, Hornicek FJ, Pedlow FX, Kobayashi W, Raskin KA, Springfield D, et al. Chondrosarcoma of the mobile spine: a review of 21 cases treated at a single center. Spine (Phila Pa 1976). 2012;37:119\u201326.","journal-title":"Spine (Phila Pa 1976)"},{"key":"1008_CR17","doi-asserted-by":"publisher","first-page":"1158","DOI":"10.2106\/00004623-198971080-00006","volume":"71","author":"TC Shives","year":"1989","unstructured":"Shives TC, McLeod RA, Unni KK, Schray MF. Chondrosarcoma of the spine. J Bone Joint Surg Am. 1989;71:1158\u201365.","journal-title":"J Bone Joint Surg Am"},{"key":"1008_CR18","doi-asserted-by":"publisher","first-page":"274281","DOI":"10.1155\/2011\/274281","volume":"2011","author":"RM Stuckey","year":"2011","unstructured":"Stuckey RM, Marco RA. Chondrosarcoma of the mobile spine and sacrum. Sarcoma. 2011;2011:274281.","journal-title":"Sarcoma"},{"key":"1008_CR19","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1109\/TITB.2003.808498","volume":"7","author":"ZH Zhou","year":"2003","unstructured":"Zhou ZH, Jiang Y. Medical diagnosis with C4.5 Rule preceded by artificial neural network ensemble. IEEE Trans Inf Technol Biomed. 2003;7:37\u201342.","journal-title":"IEEE Trans Inf Technol Biomed"},{"key":"1008_CR20","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/j.artmed.2004.07.002","volume":"34","author":"D Delen","year":"2005","unstructured":"Delen D, Walker G, Kadam A. Predicting breast cancer survivability: a comparison of three data mining methods. Artif Intell Med. 2005;34:113\u201327.","journal-title":"Artif Intell Med"},{"key":"1008_CR21","first-page":"11","volume":"13","author":"A Endo","year":"2008","unstructured":"Endo A, Shibata T, Tanaka H. Comparison of seven algorithms to predict breast Cancer survival(<special issue>contribution to 21 century intelligent technologies and bioinformatics). Int J Biomedical Soft Computing Hum Sci. 2008;13:11\u20136.","journal-title":"Int J Biomedical Soft Computing Hum Sci"},{"key":"1008_CR22","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1016\/j.spinee.2014.07.005","volume":"15","author":"ML Groves","year":"2015","unstructured":"Groves ML, Zadnik PL, Kaloostian P, Sui J, Goodwin CR, Wolinsky JP, et al. Epidemiologic, functional, and oncologic outcome analysis of spinal sarcomas treated surgically at a single institution over 10 years. Spine J. 2015;15:110\u20134.","journal-title":"Spine J"},{"key":"1008_CR23","doi-asserted-by":"publisher","first-page":"2233","DOI":"10.1097\/BRS.0b013e3181b61b90","volume":"34","author":"PC Hsieh","year":"2009","unstructured":"Hsieh PC, Xu R, Sciubba DM, McGirt MJ, Nelson C, Witham TF, et al. Long-term clinical outcomes following en bloc resections for sacral chordomas and chondrosarcomas: a series of twenty consecutive patients. Spine (Phila Pa 1976). 2009;34:2233\u20139.","journal-title":"Spine (Phila Pa 1976)"},{"key":"1008_CR24","first-page":"154","volume":"31","author":"SA Strike","year":"2011","unstructured":"Strike SA, McCarthy EF. Chondrosarcoma of the spine: a series of 16 cases and a review of the literature. Iowa Orthop J. 2011;31:154\u20139.","journal-title":"Iowa Orthop J"},{"key":"1008_CR25","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1080\/02688699646862","volume":"10","author":"S Sgouros","year":"1996","unstructured":"Sgouros S, Malluci CL, Jackowski A. Spinal ependymomas--the value of postoperative radiotherapy for residual disease control. Br J Neurosurg. 1996;10:559\u201366.","journal-title":"Br J Neurosurg"},{"key":"1008_CR26","first-page":"632786","volume":"2009","author":"D Chen","year":"2009","unstructured":"Chen D, Xing K, Henson D, Sheng L, Schwartz AM, Cheng X. Developing prognostic systems of cancer patients by ensemble clustering. J Biomed Biotechnol. 2009;2009:632786.","journal-title":"J Biomed Biotechnol"},{"key":"1008_CR27","doi-asserted-by":"publisher","first-page":"1114","DOI":"10.1016\/j.ijrobp.2008.09.034","volume":"74","author":"A Pica","year":"2009","unstructured":"Pica A, Miller R, Villa S, Kadish SP, Anacak Y, Abusaris H, et al. The results of surgery, with or without radiotherapy, for primary spinal myxopapillary ependymoma: a retrospective study from the rare cancer network. Int J Radiat Oncol Biol Phys. 2009;74:1114\u201320.","journal-title":"Int J Radiat Oncol Biol Phys"},{"key":"1008_CR28","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1007\/BF01840841","volume":"22","author":"PM Ravdin","year":"1992","unstructured":"Ravdin PM, Clark GM. A practical application of neural network analysis for predicting outcome of individual breast cancer patients. Breast Cancer Res Treat. 1992;22:285\u201393.","journal-title":"Breast Cancer Res Treat"},{"key":"1008_CR29","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1002\/sim.4780140108","volume":"14","author":"D Faraggi","year":"1995","unstructured":"Faraggi D, Simon R. A neural network model for survival data. Stat Med. 1995;14:73\u201382.","journal-title":"Stat Med"},{"issue":"9","key":"1008_CR30","doi-asserted-by":"publisher","first-page":"2194","DOI":"10.1016\/j.engappai.2013.06.013","volume":"26","author":"Kanghee Park","year":"2013","unstructured":"Park K, Ali A, Kim D, An Y, Kim M, Shin H. Robust predictive model for evaluating breast cancer survivability. Eng Appl Artif Intell. 2013;26:2194\u2013205.","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"1008_CR31","doi-asserted-by":"publisher","first-page":"1153","DOI":"10.1245\/s10434-018-6343-7","volume":"25","author":"SE Oh","year":"2018","unstructured":"Oh SE, Seo SW, Choi MG, Sohn TS, Bae JM, Kim S. Prediction of overall survival and novel classification of patients with gastric Cancer using the survival recurrent network. Ann Surg Oncol. 2018;25:1153\u20139.","journal-title":"Ann Surg Oncol"},{"key":"1008_CR32","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1002\/cncr.23586","volume":"113","author":"F Navid","year":"2008","unstructured":"Navid F, Willert JR, McCarville MB, Furman W, Watkins A, Roberts W, et al. Combination of gemcitabine and docetaxel in the treatment of children and young adults with refractory bone sarcoma. Cancer. 2008;113:419\u201325.","journal-title":"Cancer"},{"key":"1008_CR33","doi-asserted-by":"publisher","first-page":"120","DOI":"10.3171\/SPI\/2008\/9\/8\/120","volume":"9","author":"G Rao","year":"2008","unstructured":"Rao G, Suki D, Chakrabarti I, Feiz-Erfan I, Mody MG, McCutcheon IE, et al. Surgical management of primary and metastatic sarcoma of the mobile spine. J Neurosurg Spine. 2008;9:120\u20138.","journal-title":"J Neurosurg Spine"},{"key":"1008_CR34","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1002\/pbc.20697","volume":"48","author":"LM Wagner","year":"2007","unstructured":"Wagner LM, McAllister N, Goldsby RE, Rausen AR, McNall-Knapp RY, McCarville MB, et al. Temozolomide and intravenous irinotecan for treatment of advanced Ewing sarcoma. Pediatr Blood Cancer. 2007;48:132\u20139.","journal-title":"Pediatr Blood Cancer"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-019-1008-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12911-019-1008-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-019-1008-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,5]],"date-time":"2021-01-05T00:12:22Z","timestamp":1609805542000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-019-1008-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,6]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["1008"],"URL":"https:\/\/doi.org\/10.1186\/s12911-019-1008-4","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,6]]},"assertion":[{"value":"24 March 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 December 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 January 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The study did not require IRB by the Samsung Medical Center Human Subjects Institutional Review Board.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Consent to publish is not applicable as human subjects were not recruited, and we used public and de-identified data from the webpage of the Surveillance, Epidemiology, and End Results Program.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"3"}}