{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T16:53:29Z","timestamp":1775667209223,"version":"3.50.1"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2020,2,1]],"date-time":"2020-02-01T00:00:00Z","timestamp":1580515200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,2,1]],"date-time":"2020-02-01T00:00:00Z","timestamp":1580515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI &amp; Soc"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Machine learning platforms have emerged as a new promissory technology that some argue will revolutionize work practices across a broad range of professions, including medical care. During the past few years, IBM has been testing its Watson for Oncology platform at several oncology departments around the world. Published reports, news stories, as well as our own empirical research show that in some cases, the levels of concordance over recommended treatment protocols between the platform and human oncologists have been quite low. Other studies supported by IBM claim concordance rates as high as 96%. We use the Watson for Oncology case to examine the practice of using concordance levels between tumor boards and a machine learning decision-support system as a form of evidence. We address a challenge related to the epistemic authority between oncologists on tumor boards and the Watson Oncology platform by arguing that the use of concordance levels as a form of evidence of quality or trustworthiness is problematic. Although the platform provides links to the literature from which it draws its conclusion, it obfuscates the scoring criteria that it uses to value some studies over others. In other words, the platform \u201cblack boxes\u201d the values that are coded into its scoring system.<\/jats:p>","DOI":"10.1007\/s00146-020-00945-9","type":"journal-article","created":{"date-parts":[[2020,2,1]],"date-time":"2020-02-01T07:02:23Z","timestamp":1580540543000},"page":"811-818","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Concordance as evidence in the Watson for Oncology decision-support system"],"prefix":"10.1007","volume":"35","author":[{"given":"Aaro","family":"Tupasela","sequence":"first","affiliation":[]},{"given":"Ezio","family":"Di Nucci","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,2,1]]},"reference":[{"key":"945_CR1","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1038\/518161a","volume":"518","author":"M Buchanan","year":"2015","unstructured":"Buchanan M (2015) Trading at the speed of light. Nature 518:161\u2013163","journal-title":"Nature"},{"issue":"5","key":"945_CR2","doi-asserted-by":"publisher","first-page":"1755","DOI":"10.1177\/1461444817706684","volume":"20","author":"M Carlson","year":"2018","unstructured":"Carlson M (2018) Automating judgment? Algorithmic judgment, news knowledge, and journalistic professionalism. New Media Soc 20(5):1755\u20131772. https:\/\/doi.org\/10.1177\/1461444817706684","journal-title":"New Media Soc"},{"key":"945_CR3","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1056\/NEJMp1714229","volume":"378","author":"DS Char","year":"2018","unstructured":"Char DS, Shah NH, Magnus D (2018) Implementing machine learning in health care\u2014addressing ethical changes. N Engl J Med 378:981\u2013983","journal-title":"N Engl J Med"},{"key":"945_CR4","unstructured":"Choi MH (2018) Major Hospitals in S. Korea not very interested in Watson. 2 March 28, 2018. http:\/\/www.businesskorea.co.kr\/news\/articleView.html?idxno=21308. Accessed 14 May 2019"},{"key":"945_CR5","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/8072928","author":"YI Choi","year":"2019","unstructured":"Choi YI, Chung J, Kim KO et al (2019) Concordance rate between Clinicians and Watson for Oncology among patients with advanced gastric cancer: early, real-world experience in Korea. Can J Gastroenterol Hepatol. https:\/\/doi.org\/10.1155\/2019\/8072928(Article ID 8072928)","journal-title":"Can J Gastroenterol Hepatol"},{"key":"945_CR6","unstructured":"Coeira E (2018) Journal review: Watson for Oncology in Breast cancer. The Guide to health informatics 3rd edn. https:\/\/coiera.com\/2018\/03\/09\/journal-review-watson-for-oncology-in-breast-cancer\/. Accessed 26 Aug 2019"},{"issue":"5","key":"945_CR7","first-page":"181","volume":"33","author":"MS Copur","year":"2019","unstructured":"Copur MS (2019) State of cancer research around the globe. Oncology 33(5):181\u2013185","journal-title":"Oncology"},{"issue":"4","key":"945_CR8","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1007\/s13347-018-0337-z","volume":"31","author":"M D\u2019Agostino","year":"2018","unstructured":"D\u2019Agostino M, Durante M (2018) Introduction: the governance of algorithms. Philos Technol 31(4):499\u2013505","journal-title":"Philos Technol"},{"issue":"4","key":"945_CR9","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1097\/HCO.0b013e32832af21b","volume":"24","author":"N Devasenapathy","year":"2009","unstructured":"Devasenapathy N, Singh K, Prabhakaran D (2009) Conduct of clinical trials in developing countries: a perspective. Curr Opin Cardiol 24(4):295\u2013300","journal-title":"Curr Opin Cardiol"},{"key":"945_CR10","doi-asserted-by":"publisher","first-page":"556","DOI":"10.1136\/medethics-2018-105281","volume":"45","author":"E Di Nucci","year":"2019","unstructured":"Di Nucci E (2019) Should we be afraid of medical AI? J Med Ethics 45:556\u2013558","journal-title":"J Med Ethics"},{"key":"945_CR11","volume-title":"The master algorithm","author":"P Domingos","year":"2015","unstructured":"Domingos P (2015) The master algorithm. Penguin Books, London"},{"issue":"11","key":"945_CR12","doi-asserted-by":"publisher","first-page":"1544","DOI":"10.1001\/jamainternmed.2018.3763","volume":"178","author":"MA Gianfrancesco","year":"2018","unstructured":"Gianfrancesco MA, Tamang S, Yazdany J, Schmajuk G (2018) Potential biases in machine learning algorithms using electronic health record data. JAMA Intern Med 178(11):1544\u20131547","journal-title":"JAMA Intern Med"},{"key":"945_CR13","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1038\/s41591-018-0307-0","volume":"316","author":"J He","year":"2019","unstructured":"He J, Baxter SL, Xu J, Xu J, Zhou X, Zhang K (2019) The practical implementation of artificial intelligence technologies in medicine. Nat Med 316:30\u201336","journal-title":"Nat Med"},{"key":"945_CR14","unstructured":"Healio (2018) FDA allows marketing of IDx-DR artificial intelligence device for diabetic retinopathy detection. www.healio.com. Accessed 13 May 2018"},{"issue":"11","key":"945_CR15","doi-asserted-by":"publisher","first-page":"1101","DOI":"10.1001\/jama.2018.11100","volume":"320","author":"G Hinton","year":"2018","unstructured":"Hinton G (2018) Deep learning\u2014a technology with the potential to transform health care. JAMA 320(11):1101\u20131102. https:\/\/doi.org\/10.1001\/jama.2018.11100","journal-title":"JAMA"},{"key":"945_CR16","doi-asserted-by":"publisher","first-page":"6169","DOI":"10.1136\/bmj.i6169","volume":"355","author":"PK Hodgkin","year":"2016","unstructured":"Hodgkin PK (2016) The computer may be assessing you now, but who decides its values. BMJ 355:6169","journal-title":"BMJ"},{"key":"945_CR17","unstructured":"IBM (2018) Product vignette: IBM Watson for Oncology. https:\/\/www.ibm.com\/watson\/health\/oncology-and-genomics\/oncology\/. Accessed 28 May 2018"},{"issue":"6","key":"945_CR18","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1177\/0306312717730428","volume":"47","author":"F Jaton","year":"2017","unstructured":"Jaton F (2017) We get the algorithms of our ground truths: designing referential databases in digital image processing. Soc Stud Sci 47(6):811\u2013840. https:\/\/doi.org\/10.1177\/0306312717730428","journal-title":"Soc Stud Sci"},{"key":"945_CR19","doi-asserted-by":"publisher","first-page":"2803","DOI":"10.1002\/cncr.32166","volume":"125","author":"M Kim","year":"2019","unstructured":"Kim M, Kim BH, Kim JM, Kim EH, Kim K, Pak K, Lee BJ (2019a) Concordance in postsurgical radioactive iodine therapy recommendations between Watson for Oncology and clinical practice in patients with differentiated thyroid carcinoma. Cancer 125:2803\u20132809","journal-title":"Cancer"},{"issue":"1","key":"945_CR20","doi-asserted-by":"publisher","first-page":"3","DOI":"10.14216\/kjco.19002","volume":"15","author":"D Kim","year":"2019","unstructured":"Kim D, Kim YY, Lee JH, Chung YS, Choi S, Kang JM, Chun YS (2019b) A comparative study of Watson for Oncology and tumor boards in breast cancer treatment. Korean J Clin Oncol 15(1):3\u20136","journal-title":"Korean J Clin Oncol"},{"issue":"7751","key":"945_CR21","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1038\/d41586-019-01080-2","volume":"568","author":"H Ledford","year":"2019","unstructured":"Ledford H (2019) Cancer geneticists tackle ethnic bias in studies. Nature 568(7751):154\u2013155","journal-title":"Nature"},{"issue":"2","key":"945_CR22","first-page":"1","volume":"2","author":"Lee","year":"2018","unstructured":"Lee et al (2018) Assessing concordance with Watson for Oncology, a cognitive computing decision support system for colon cancer treatment in Korea. JCO Clin Cancer Inform 2(2):1\u20138","journal-title":"JCO Clin Cancer Inform"},{"issue":"4","key":"945_CR23","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1007\/s13347-017-0279-x","volume":"31","author":"B Lepri","year":"2018","unstructured":"Lepri B, Oliver N, Letouz\u00e9 E, Pentland A, Vinck P (2018) Fair, transparent, and accountable algorithmic decision-making processes. Philos Technol 31(4):611\u2013627","journal-title":"Philos Technol"},{"issue":"9","key":"945_CR24","doi-asserted-by":"publisher","first-page":"e11087","DOI":"10.2196\/11087","volume":"20","author":"C Liu","year":"2018","unstructured":"Liu C, Liu X, Wu F, Xie M, Feng Y, Hu C (2018) Using artificial intelligence (Watson for Oncology) for treatment recommendations amongst Chinese patients with lung cancer: feasibility study. J Med Internet Res 20(9):e11087","journal-title":"J Med Internet Res"},{"key":"945_CR25","doi-asserted-by":"publisher","DOI":"10.1136\/medethics-2018-105118","author":"RJ McDougall","year":"2018","unstructured":"McDougall RJ (2018) Computer knows best? The need for value-flexibility in medical AI. J Med Ethics. https:\/\/doi.org\/10.1136\/medethics-2018-105118","journal-title":"J Med Ethics"},{"key":"945_CR26","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1136\/medethics-2019-105572","volume":"45","author":"RJ McDougall","year":"2019","unstructured":"McDougall RJ (2019) No we shouldn\u2019t be afraid of medical AI; it involves risks and opportunities. J Med Ethics 45:559","journal-title":"J Med Ethics"},{"issue":"4","key":"945_CR27","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1007\/s13347-016-0248-9","volume":"30","author":"ST Mckinlay","year":"2017","unstructured":"Mckinlay ST (2017) Evidence, explanation and predictive data modelling. Philos Technol 30(4):461\u2013473","journal-title":"Philos Technol"},{"key":"945_CR28","first-page":"4991","volume":"10","author":"BDM Mittelstadt","year":"2016","unstructured":"Mittelstadt BDM (2016) Auditing for transparency in content personalization systems. Int J Commun 10:4991\u20135002","journal-title":"Int J Commun"},{"key":"945_CR29","doi-asserted-by":"publisher","first-page":"l5221","DOI":"10.1136\/bmj.l5221","volume":"366","author":"H Naci","year":"2019","unstructured":"Naci H, Davis C, Savovi\u0107 J, Higgins JP, Sterne J, Gyawali B et al (2019) Design characteristics, risk of bias, and reporting of randomised controlled trials supporting approvals of cancer drugs by European Medicines Agency, 2014\u201316: cross sectional analysis. BMJ 366:l5221","journal-title":"BMJ"},{"issue":"7132","key":"945_CR30","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1038\/446137a","volume":"446","author":"M Piccart","year":"2007","unstructured":"Piccart M, Goldhirsch A, Wood W, Pritchard K, Baselga J, Reaby L, Coates A (2007) Keeping faith with trial volunteers. Nature 446(7132):137\u2013138","journal-title":"Nature"},{"issue":"5","key":"945_CR31","doi-asserted-by":"publisher","first-page":"646","DOI":"10.1080\/02841860902913546","volume":"48","author":"E Pukkala","year":"2009","unstructured":"Pukkala E, Martinsen JI, Lynge E, Gunnarsdottir HK, Spar\u00e9n P, Tryggvadottir L, Kjaerheim K (2009) Occupation and cancer-follow-up of 15 million people in five Nordic countries. Acta Oncol 48(5):646\u2013790","journal-title":"Acta Oncol"},{"issue":"4","key":"945_CR32","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1080\/0284186X.2017.1407039","volume":"57","author":"E Pukkala","year":"2018","unstructured":"Pukkala E, Engholm G, H\u00f8jsgaard Schmidt LK, Storm H, Khan S, Lambe M, Malila N (2018) Nordic cancer registries\u2014an overview of their procedures and data comparability. Acta Oncol 57(4):440\u2013455","journal-title":"Acta Oncol"},{"key":"945_CR33","unstructured":"Ross C, Swetlitz (2017) IBM pitched its Watson supercomputer as a revolution in cancer care. It\u2019s nowhere close. https:\/\/www.statnews.com\/2017\/09\/05\/watson-ibm-cancer\/. Accessed 12 May 2019"},{"issue":"6","key":"945_CR34","doi-asserted-by":"publisher","first-page":"563","DOI":"10.2217\/pme-2016-0057","volume":"13","author":"T Sharon","year":"2016","unstructured":"Sharon T (2016) The Googlization of health research: From disruptive innovation to disruptive ethics. Pers Med 13(6):563\u2013574","journal-title":"Pers Med"},{"issue":"15_suppl","key":"945_CR35","doi-asserted-by":"publisher","first-page":"8527","DOI":"10.1200\/JCO.2017.35.15_suppl.8527","volume":"35","author":"SP Somashekhar","year":"2017","unstructured":"Somashekhar SP et al (2017) Early experiences with IBM Watson for Oncology (WFO) cognitive computing system for lung and colorectal cancer. J Clin Oncol 35(15_suppl):8527 (San Antonio Breast Cancer Symposium, December 9th, 2016)","journal-title":"J Clin Oncol"},{"key":"945_CR36","doi-asserted-by":"publisher","DOI":"10.1093\/annonc\/mdw601.002","author":"SP Somashekhar","year":"2016","unstructured":"Somashekhar SP et al (2016) Validation study to assess performance of IBM cognitive computing system Watson for oncology with Manipal multidisciplinary tumour board for 1000 consecutive cases: an Indian experience. Ann Oncol. https:\/\/doi.org\/10.1093\/annonc\/mdw601.002","journal-title":"Ann Oncol"},{"issue":"2","key":"945_CR37","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1093\/annonc\/mdx781","volume":"29","author":"SP Somashekhar","year":"2018","unstructured":"Somashekhar SP et al (2018) Watson for Oncology and breast cancer treatment recommendations: agreement with an expert multidisciplinary tumor board. Ann Oncol 29(2):418\u2013423. https:\/\/doi.org\/10.1093\/annonc\/mdx781","journal-title":"Ann Oncol"},{"issue":"4\u20135","key":"945_CR38","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1177\/1367549415577392","volume":"18","author":"T Striphas","year":"2015","unstructured":"Striphas T (2015) Algorithmic culture. Eur J Cult Stud 18(4\u20135):395\u2013412","journal-title":"Eur J Cult Stud"},{"issue":"3PB","key":"945_CR39","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1016\/j.jacr.2018.01.028","volume":"15","author":"T Syeda-Mahmood","year":"2018","unstructured":"Syeda-Mahmood T (2018) Role of big data and machine learning in diagnostic decision support in radiology. J Am Coll Radiol 15(3PB):569\u2013576","journal-title":"J Am Coll Radiol"},{"issue":"3PB","key":"945_CR40","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1016\/j.jacr.2017.12.026","volume":"15","author":"JH Thrall","year":"2018","unstructured":"Thrall JH et al (2018) Artificial intelligence and machine learning in radiology: opportunities, challenges, pitfalls, and criteria for success. J Am Coll Radiol 15(3PB):504\u2013508","journal-title":"J Am Coll Radiol"},{"key":"945_CR41","volume-title":"The gold standard. The challenge of evidence-based medicine and standardization in health care","author":"S Timmermans","year":"2003","unstructured":"Timmermans S, Berg M (2003) The gold standard. The challenge of evidence-based medicine and standardization in health care. Temple University Press, Philadelphia"},{"key":"945_CR42","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720907107","author":"A Tupasela","year":"2020","unstructured":"Tupasela A, Snell K, Tarkkala H (2020) The Nordic data imaginary. Big Data Soc. https:\/\/doi.org\/10.1177\/2053951720907107","journal-title":"Big Data Soc"},{"key":"945_CR43","volume-title":"Trustworthy AI\u2014joining efforts for strategic leadership and societal prosperity","author":"European Union","year":"2019","unstructured":"Union European (2019) Trustworthy AI\u2014joining efforts for strategic leadership and societal prosperity. European Commission, Brussels"},{"issue":"1","key":"945_CR44","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1111\/1468-4446.12239","volume":"68","author":"J Wajcman","year":"2017","unstructured":"Wajcman J (2017) Automation: is it really different this time? Br J Sociol 68(1):119\u2013127","journal-title":"Br J Sociol"},{"key":"945_CR45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1200\/CCI.18.00159","volume":"3","author":"F Xu","year":"2019","unstructured":"Xu F, Sep\u00falveda MJ, Jiang Z, Wang H, Li J, Yin Y, Song Y (2019) Artificial intelligence treatment decision support for complex breast cancer among oncologists with varying expertise. JCO Clin Cancer Inform 3:1\u201315","journal-title":"JCO Clin Cancer Inform"},{"issue":"1","key":"945_CR46","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1177\/0162243915605575","volume":"41","author":"T Zarsky","year":"2015","unstructured":"Zarsky T (2015) The trouble with algorithmic decisions. Sci Technol Hum Values 41(1):118\u2013132","journal-title":"Sci Technol Hum Values"}],"container-title":["AI &amp; SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-020-00945-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s00146-020-00945-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-020-00945-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,31]],"date-time":"2021-01-31T00:16:33Z","timestamp":1612052193000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s00146-020-00945-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,1]]},"references-count":46,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["945"],"URL":"https:\/\/doi.org\/10.1007\/s00146-020-00945-9","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,1]]},"assertion":[{"value":"20 September 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 January 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}