{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T16:56:59Z","timestamp":1780333019672,"version":"3.54.1"},"reference-count":26,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2021,1,31]],"date-time":"2021-01-31T00:00:00Z","timestamp":1612051200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"IBM Watson Health"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,3,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>IBM(R) Watson for Oncology (WfO) is a clinical decision-support system (CDSS) that provides evidence-informed therapeutic options to cancer-treating clinicians. A panel of experienced oncologists compared CDSS treatment options to treatment decisions made by clinicians to characterize the quality of CDSS therapeutic options and decisions made in practice.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>This study included patients treated between 1\/2017 and 7\/2018 for breast, colon, lung, and rectal cancers at Bumrungrad International Hospital (BIH), Thailand. Treatments selected by clinicians were paired with therapeutic options presented by the CDSS and coded to mask the origin of options presented. The panel rated the acceptability of each treatment in the pair by consensus, with acceptability defined as compliant with BIH\u2019s institutional practices. Descriptive statistics characterized the study population and treatment-decision evaluations by cancer type and stage.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Nearly 60% (187) of 313 treatment pairs for breast, lung, colon, and rectal cancers were identical or equally acceptable, with 70% (219) of WfO therapeutic options identical to, or acceptable alternatives to, BIH therapy. In 30% of cases (94), 1 or both treatment options were rated as unacceptable. Of 32 cases where both WfO and BIH options were acceptable, WfO was preferred in 18 cases and BIH in 14 cases. Colorectal cancers exhibited the highest proportion of identical or equally acceptable treatments; stage IV cancers demonstrated the lowest.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>This study demonstrates that a system designed in the US to support, rather than replace, cancer-treating clinicians provides therapeutic options which are generally consistent with recommendations from oncologists outside the US.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocaa334","type":"journal-article","created":{"date-parts":[[2021,1,26]],"date-time":"2021-01-26T20:11:34Z","timestamp":1611691894000},"page":"832-838","source":"Crossref","is-referenced-by-count":30,"title":["Comparison of an oncology clinical decision-support system\u2019s recommendations with actual treatment decisions"],"prefix":"10.1093","volume":"28","author":[{"given":"Suthida","family":"Suwanvecho","sequence":"first","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harit","family":"Suwanrusme","sequence":"additional","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tanawat","family":"Jirakulaporn","sequence":"additional","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Surasit","family":"Issarachai","sequence":"additional","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nimit","family":"Taechakraichana","sequence":"additional","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Palita","family":"Lungchukiet","sequence":"additional","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wimolrat","family":"Decha","sequence":"additional","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wisanu","family":"Boonpakdee","sequence":"additional","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nittaya","family":"Thanakarn","sequence":"additional","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pattanawadee","family":"Wongrattananon","sequence":"additional","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8011-9391","authenticated-orcid":false,"given":"Anita M","family":"Preininger","sequence":"additional","affiliation":[{"name":"IBM Watson Health, Cambridge, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Metasebya","family":"Solomon","sequence":"additional","affiliation":[{"name":"IBM Watson Health, Cambridge, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suwei","family":"Wang","sequence":"additional","affiliation":[{"name":"IBM Watson Health, Cambridge, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rezzan","family":"Hekmat","sequence":"additional","affiliation":[{"name":"IBM Watson Health, Cambridge, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Irene","family":"Dankwa-Mullan","sequence":"additional","affiliation":[{"name":"IBM Watson Health, Cambridge, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edward","family":"Shortliffe","sequence":"additional","affiliation":[{"name":"IBM Watson Health, Cambridge, Massachusetts, USA"},{"name":"Columbia University, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vimla L","family":"Patel","sequence":"additional","affiliation":[{"name":"IBM Watson Health, Cambridge, Massachusetts, USA"},{"name":"New York Academy of Medicine, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yull","family":"Arriaga","sequence":"additional","affiliation":[{"name":"IBM Watson Health, Cambridge, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gretchen Purcell","family":"Jackson","sequence":"additional","affiliation":[{"name":"IBM Watson Health, Cambridge, Massachusetts, USA"},{"name":"Vanderbilt University Medical Center, Nashville, Tennessee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Narongsak","family":"Kiatikajornthada","sequence":"additional","affiliation":[{"name":"Bumrungrad International Hospital, Khlong Toei Nuea, Bangkok, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,1,31]]},"reference":[{"issue":"1","key":"2021031906035857800_ocaa334-B1","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1200\/JOP.2013.001319","article-title":"Projected supply of and demand for oncologists and radiation oncologists through 2025: an aging, better-insured population will result in shortage","volume":"10","author":"Yang","year":"2014","journal-title":"JOP"},{"issue":"2","key":"2021031906035857800_ocaa334-B2","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1093\/annonc\/mdx781","article-title":"Watson for Oncology and breast cancer treatment recommendations: agreement with an expert multidisciplinary tumor board","volume":"29","author":"Somashekhar","year":"2018","journal-title":"Ann Oncol"},{"issue":"2","key":"2021031906035857800_ocaa334-B3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1200\/CCI.17.00060","article-title":"CancerLinQ: origins, implementation, and future directions","volume":"2","author":"Rubinstein","year":"2018","journal-title":"JCO Clin Cancer Inform"},{"issue":"4","key":"2021031906035857800_ocaa334-B4","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1089\/gen.37.04.04","article-title":"Making every cancer care outcome count: Flatiron Health aggregates cancer treatment data from clinical trials and the \u201creal world","volume":"37","author":"Dutton","year":"2017","journal-title":"Genet Eng Biotechnol News"},{"key":"2021031906035857800_ocaa334-B5","first-page":"14","article-title":"Tempus and Mayo Clinic partner for data-driven cancer care","volume":"4","author":"Kwon","year":"2017","journal-title":"Clin OMICs"},{"issue":"1","key":"2021031906035857800_ocaa334-B6","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1046\/j.1369-6513.2000.00084.x","article-title":"Lessons learned from the decision board: a unique and evolving decision aid","volume":"3","author":"Whelan","year":"2000","journal-title":"Health Expect"},{"issue":"15","key":"2021031906035857800_ocaa334-B7","doi-asserted-by":"crossref","first-page":"6558","DOI":"10.1200\/JCO.2019.37.15_suppl.6558","article-title":"Use of machine learning to identify relevant research publications in clinical oncology","volume":"37","author":"Suarez Saiz","year":"2019","journal-title":"American Society of Clinical Oncology"},{"issue":"6","key":"2021031906035857800_ocaa334-B8","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1634\/theoncologist.2018-0257","article-title":"Applying artificial intelligence to address the knowledge gaps in cancer care","volume":"24","author":"Simon","year":"2019","journal-title":"The Oncol"},{"key":"2021031906035857800_ocaa334-B9","first-page":"e18588","author":"Suarez Saiz","year":"2018"},{"key":"2021031906035857800_ocaa334-B10","author":"Suarez Saiz"},{"issue":"7","key":"2021031906035857800_ocaa334-B11","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1200\/JCO.2017.74.8442","article-title":"Improving breast cancer surgical treatment decision making: the iCanDecide randomized clinical trial","volume":"36","author":"Hawley","year":"2018","journal-title":"JCO"},{"issue":"suppl 15","key":"2021031906035857800_ocaa334-B12","doi-asserted-by":"crossref","first-page":"6553","DOI":"10.1200\/JCO.2019.37.15_suppl.6553","article-title":"A blinded evaluation of a clinical decision-support system at a regional cancer care center","volume":"37","author":"Suwanvecho","year":"2019","journal-title":"JCO"},{"issue":"4","key":"2021031906035857800_ocaa334-B13","doi-asserted-by":"crossref","first-page":"811","DOI":"10.1007\/s00146-020-00945-9","article-title":"Concordance as evidence in the Watson for Oncology decision-support system","volume":"35","author":"Tupasela","year":"2020","journal-title":"AI & Soc"},{"key":"2021031906035857800_ocaa334-B14","article-title":"Concordance study between IBM Watson for oncology and real clinical practice for cervical cancer patients in China: a retrospective analysis","volume":"11 (200): 1\u20138","author":"Zou","year":"2020","journal-title":"Front Genet"},{"key":"2021031906035857800_ocaa334-B15","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-40618-3","volume-title":"AJCC Cancer Staging Manual","author":"Amin","year":"2017"},{"key":"2021031906035857800_ocaa334-B16","first-page":"824","author":"Xu"},{"issue":"3","key":"2021031906035857800_ocaa334-B17","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1093\/jamiaopen\/ooaa033","article-title":"Evaluating AI in medicine: phases of clinical research","volume":"3","author":"Park","year":"2020","journal-title":"JAMIA Open"},{"issue":"2","key":"2021031906035857800_ocaa334-B18","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1007\/s00428-017-2183-2","article-title":"Lung cancer as a paradigm for precision oncology in solid tumours","volume":"471","author":"Schallenberg","year":"2017","journal-title":"Virchows Arch"},{"issue":"7","key":"2021031906035857800_ocaa334-B19","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1056\/NEJMoa1914609","article-title":"Tucatinib, Trastuzumab, and Capecitabine for HER2-positive metastatic breast cancer","volume":"382","author":"Murthy","year":"2020","journal-title":"N Engl J Med"},{"issue":"10","key":"2021031906035857800_ocaa334-B20","doi-asserted-by":"crossref","first-page":"3164","DOI":"10.1158\/1078-0432.CCR-18-2814","article-title":"Capmatinib (INC280) is active against models of non-small cell lung cancer and other cancer types with defined mechanisms of MET activation","volume":"25","author":"Baltschukat","year":"2019","journal-title":"Clin Cancer Res"},{"issue":"22","key":"2021031906035857800_ocaa334-B21","doi-asserted-by":"crossref","first-page":"2108","DOI":"10.1056\/NEJMoa1809615","article-title":"Atezolizumab and nab-paclitaxel in advanced triple-negative breast cancer","volume":"379","author":"Schmid","year":"2018","journal-title":"N Engl J Med"},{"issue":"21","key":"2021031906035857800_ocaa334-B22","doi-asserted-by":"crossref","first-page":"2020","DOI":"10.1056\/NEJMoa1910231","article-title":"Nivolumab plus ipilimumab in advanced non-small-cell lung cancer","volume":"381","author":"Hellmann","year":"2019","journal-title":"N Engl J Med"},{"issue":"21","key":"2021031906035857800_ocaa334-B23","doi-asserted-by":"crossref","first-page":"2199","DOI":"10.1001\/jama.2018.17163","article-title":"Clinical decision support in the era of artificial intelligence","volume":"320","author":"Shortliffe","year":"2018","journal-title":"JAMA"},{"issue":"12","key":"2021031906035857800_ocaa334-B24","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1001\/jama.1979.03300120033020","article-title":"Antimicrobial selection by a computer. A blinded evaluation by infectious diseases experts","volume":"242","author":"Yu","year":"1979","journal-title":"JAMA"},{"key":"2021031906035857800_ocaa334-B25","doi-asserted-by":"crossref","first-page":"211","DOI":"10.2147\/JMDH.S104807","article-title":"Information bias in health research: definition, pitfalls, and adjustment methods","volume":"9","author":"Althubaiti","year":"2016","journal-title":"J Multidiscip Healthc"},{"issue":"3","key":"2021031906035857800_ocaa334-B26","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1093\/ije\/dyt270","article-title":"Observer bias in randomized clinical trials with time-to-event outcomes: systematic review of trials with both blinded and non-blinded outcome assessors","volume":"43","author":"Hrobjartsson","year":"2014","journal-title":"Int J Epidemiol"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/4\/832\/36642073\/ocaa334.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/4\/832\/36642073\/ocaa334.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T06:05:38Z","timestamp":1616133938000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/4\/832\/6124728"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,31]]},"references-count":26,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,1,31]]},"published-print":{"date-parts":[[2021,3,18]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa334","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,4,1]]},"published":{"date-parts":[[2021,1,31]]}}}