{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T23:19:32Z","timestamp":1790810372845,"version":"4.1.0"},"reference-count":19,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2017,10,27]],"date-time":"2017-10-27T00:00:00Z","timestamp":1509062400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100001602","name":"Science Foundation Ireland","doi-asserted-by":"publisher","award":["13\/CDA\/2224"],"award-info":[{"award-number":["13\/CDA\/2224"]}],"id":[{"id":"10.13039\/501100001602","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002081","name":"Irish Research Council","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002081","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006662","name":"National Institute on Handicapped Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006662","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000672","name":"Pathological Society of Great Britain and Ireland","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000672","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Histopathology"],"published-print":{"date-parts":[[2018,1]]},"abstract":"<jats:sec>\n                    <jats:title>Aims<\/jats:title>\n                    <jats:p>\n                      Evaluating expression of the human epidermal growth factor receptor 2 (\n                      <jats:styled-content style=\"fixed-case\">HER<\/jats:styled-content>\n                      2) by visual examination of immunohistochemistry (\n                      <jats:styled-content style=\"fixed-case\">IHC<\/jats:styled-content>\n                      ) on invasive breast cancer (\n                      <jats:styled-content style=\"fixed-case\">BC<\/jats:styled-content>\n                      a) is a key part of the diagnostic assessment of\n                      <jats:styled-content style=\"fixed-case\">BC<\/jats:styled-content>\n                      a due to its recognized importance as a predictive and prognostic marker in clinical practice. However, visual scoring of\n                      <jats:styled-content style=\"fixed-case\">HER<\/jats:styled-content>\n                      2 is subjective, and consequently prone to interobserver variability. Given the prognostic and therapeutic implications of\n                      <jats:styled-content style=\"fixed-case\">HER<\/jats:styled-content>\n                      2 scoring, a more objective method is required. In this paper, we report on a recent automated\n                      <jats:styled-content style=\"fixed-case\">HER<\/jats:styled-content>\n                      2 scoring contest, held in conjunction with the annual PathSoc meeting held in Nottingham in June 2016, aimed at systematically comparing and advancing the state\u2010of\u2010the\u2010art artificial intelligence (\n                      <jats:styled-content style=\"fixed-case\">AI<\/jats:styled-content>\n                      )\u2010based automated methods for\n                      <jats:styled-content style=\"fixed-case\">HER<\/jats:styled-content>\n                      2 scoring.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods and results<\/jats:title>\n                    <jats:p>\n                      The contest data set comprised digitized whole slide images (\n                      <jats:styled-content style=\"fixed-case\">WSI<\/jats:styled-content>\n                      ) of sections from 86 cases of invasive breast carcinoma stained with both haematoxylin and eosin (H&amp;E) and\n                      <jats:styled-content style=\"fixed-case\">IHC<\/jats:styled-content>\n                      for\n                      <jats:styled-content style=\"fixed-case\">HER<\/jats:styled-content>\n                      2. The contesting algorithms predicted scores of the\n                      <jats:styled-content style=\"fixed-case\">IHC<\/jats:styled-content>\n                      slides automatically for an unseen subset of the data set and the predicted scores were compared with the \u2018ground truth\u2019 (a consensus score from at least two experts). We also report on a simple \u2018Man versus Machine\u2019 contest for the scoring of\n                      <jats:styled-content style=\"fixed-case\">HER<\/jats:styled-content>\n                      2 and show that the automated methods could beat the pathology experts on this contest data set.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>\n                      This paper presents a benchmark for comparing the performance of automated algorithms for scoring of\n                      <jats:styled-content style=\"fixed-case\">HER<\/jats:styled-content>\n                      2. It also demonstrates the enormous potential of automated algorithms in assisting the pathologist with objective\n                      <jats:styled-content style=\"fixed-case\">IHC<\/jats:styled-content>\n                      scoring.\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1111\/his.13333","type":"journal-article","created":{"date-parts":[[2017,8,3]],"date-time":"2017-08-03T16:30:10Z","timestamp":1501777810000},"page":"227-238","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":154,"title":["<scp>HER<\/scp>\n                    2 challenge contest: a detailed assessment of automated\n                    <scp>HER<\/scp>\n                    2 scoring algorithms in whole slide images of breast cancer tissues"],"prefix":"10.1111","volume":"72","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5014-7399","authenticated-orcid":false,"given":"Talha","family":"Qaiser","sequence":"first","affiliation":[{"name":"Department of Computer Science University of Warwick Coventry UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abhik","family":"Mukherjee","sequence":"additional","affiliation":[{"name":"Department of Histopathology Division of Cancer and Stem Cells School of Medicine University of Nottingham Nottingham UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chaitanya","family":"Reddy PB","sequence":"additional","affiliation":[{"name":"Department of Electronics and Electrical Engineering Indian Institute of Technology Guwahati India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sai D","family":"Munugoti","sequence":"additional","affiliation":[{"name":"Department of Electronics and Electrical Engineering Indian Institute of Technology Guwahati India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vamsi","family":"Tallam","sequence":"additional","affiliation":[{"name":"Department of Electronics and Electrical Engineering Indian Institute of Technology Guwahati India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tomi","family":"Pitk\u00e4aho","sequence":"additional","affiliation":[{"name":"Department of Computer Science Maynooth University Maynooth Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taina","family":"Lehtim\u00e4ki","sequence":"additional","affiliation":[{"name":"Department of Computer Science Maynooth University Maynooth Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"Naughton","sequence":"additional","affiliation":[{"name":"Department of Computer Science Maynooth University Maynooth Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matt","family":"Berseth","sequence":"additional","affiliation":[{"name":"NLP Logix LLC Jacksonville FL USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7748-6756","authenticated-orcid":false,"given":"An\u00edbal","family":"Pedraza","sequence":"additional","affiliation":[{"name":"VISILAB, E.T.S.I.I University of Castilla\u2010La Mancha Ciudad Real Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ramakrishnan","family":"Mukundan","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering University of Canterbury Canterbury New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Smith","sequence":"additional","affiliation":[{"name":"Department of Statistics University of Warwick Coventry UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abhir","family":"Bhalerao","sequence":"additional","affiliation":[{"name":"Department of Computer Science University of Warwick Coventry UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erik","family":"Rodner","sequence":"additional","affiliation":[{"name":"Computer Vision Group Friedrich Schiller University of Jena Jena Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcel","family":"Simon","sequence":"additional","affiliation":[{"name":"Computer Vision Group Friedrich Schiller University of Jena Jena Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joachim","family":"Denzler","sequence":"additional","affiliation":[{"name":"Computer Vision Group Friedrich Schiller University of Jena Jena Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao\u2010Hui","family":"Huang","sequence":"additional","affiliation":[{"name":"MSD International GmbH Singapore Singapore"},{"name":"Singapore Agency for Science, Technology and Research Singapore Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gloria","family":"Bueno","sequence":"additional","affiliation":[{"name":"VISILAB, E.T.S.I.I University of Castilla\u2010La Mancha Ciudad Real Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Snead","sequence":"additional","affiliation":[{"name":"Department of Pathology University Hospitals Coventry and Warwickshire Coventry UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ian O","family":"Ellis","sequence":"additional","affiliation":[{"name":"Department of Histopathology Division of Cancer and Stem Cells School of Medicine University of Nottingham Nottingham UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad","family":"Ilyas","sequence":"additional","affiliation":[{"name":"Department of Histopathology Division of Cancer and Stem Cells School of Medicine University of Nottingham Nottingham UK"},{"name":"Nottingham Molecular Pathology Node University of Nottingham Nottingham UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nasir","family":"Rajpoot","sequence":"additional","affiliation":[{"name":"Department of Computer Science University of Warwick Coventry UK"},{"name":"Department of Pathology University Hospitals Coventry and Warwickshire Coventry UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2017,10,27]]},"reference":[{"key":"e_1_2_7_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymeth.2014.06.015"},{"key":"e_1_2_7_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-5647-6_1"},{"key":"e_1_2_7_4_1","unstructured":"Breast Cancer Statistics Cancer Research UK. Available at:http:\/\/www.cancerresearchuk.org\/cancer-info\/cancerstats\/types\/breast\/(accessed 12\/09\/2017)."},{"key":"e_1_2_7_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/modpathol.2013.134"},{"key":"e_1_2_7_6_1","doi-asserted-by":"publisher","DOI":"10.5858\/arpa.2012-0561-CP"},{"key":"e_1_2_7_7_1","doi-asserted-by":"publisher","DOI":"10.1136\/jclinpath-2016-203800"},{"key":"e_1_2_7_8_1","doi-asserted-by":"publisher","DOI":"10.1136\/jclinpath-2014-202571"},{"key":"e_1_2_7_9_1","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2007.11.4363"},{"key":"e_1_2_7_10_1","first-page":"1097","volume-title":"Advances in neural information processing systems 25","author":"Krizhevsky A","year":"2012"},{"key":"e_1_2_7_11_1","doi-asserted-by":"crossref","unstructured":"SzegedyC LiuW JiaYet al.Going deeper with convolutions. Proceedings of the IEEE conference on computer vision and pattern recognition Boston Massachusetts: 2015 1\u20139.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"e_1_2_7_12_1","doi-asserted-by":"publisher","DOI":"10.1155\/2014\/157308"},{"key":"e_1_2_7_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2559.2011.04142.x"},{"key":"e_1_2_7_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10549-011-1514-2"},{"key":"e_1_2_7_15_1","doi-asserted-by":"publisher","DOI":"10.1038\/srep10690"},{"key":"e_1_2_7_16_1","doi-asserted-by":"publisher","DOI":"10.5858\/arpa.2016-0265-SA"},{"key":"e_1_2_7_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10549-015-3475-3"},{"key":"e_1_2_7_18_1","doi-asserted-by":"publisher","DOI":"10.18632\/oncotarget.1891"},{"key":"e_1_2_7_19_1","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1097\/PAI.0000000000000126","article-title":"Predictive biomarkers and companion diagnostics. The future of immunohistochemistry \u2013\u2019in situ proteomics\u2019, or just a \u2018stain\u2019?","volume":"22","author":"Taylor CR","year":"2014","journal-title":"Appl. Immunohistochem. Mol. Morphol."},{"key":"e_1_2_7_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00428-016-1910-4"}],"container-title":["Histopathology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fhis.13333","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/his.13333","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T23:45:08Z","timestamp":1696031108000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/his.13333"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,27]]},"references-count":19,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,1]]}},"alternative-id":["10.1111\/his.13333"],"URL":"https:\/\/doi.org\/10.1111\/his.13333","archive":["Portico"],"relation":{},"ISSN":["0309-0167","1365-2559"],"issn-type":[{"value":"0309-0167","type":"print"},{"value":"1365-2559","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10,27]]},"assertion":[{"value":"2017-05-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-07-29","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-10-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}