{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T08:44:06Z","timestamp":1772873046027,"version":"3.50.1"},"reference-count":27,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2020,10,29]],"date-time":"2020-10-29T00:00:00Z","timestamp":1603929600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["SFRH\/BD\/120435\/2016"],"award-info":[{"award-number":["SFRH\/BD\/120435\/2016"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["SFRH\/BD\/122365\/2016"],"award-info":[{"award-number":["SFRH\/BD\/122365\/2016"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Funds"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,3,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>This study evaluated the usefulness of artificial intelligence (AI) algorithms as tools in improving the accuracy of histologic classification of breast tissue.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>Overall, 100 microscopic photographs (test A) and 152 regions of interest in whole-slide images (test B) of breast tissue were classified into 4 classes: normal, benign, carcinoma in situ (CIS), and invasive carcinoma. The accuracy of 4 pathologists and 3 pathology residents were evaluated without and with the assistance of algorithms.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>In test A, algorithm A had accuracy of 0.87, with the lowest accuracy in the benign class (0.72). The observers had average accuracy of 0.80, and most clinically relevant discordances occurred in distinguishing benign from CIS (7.1% of classifications). With the assistance of algorithm A, the observers significantly increased their average accuracy to 0.88. In test B, algorithm B had accuracy of 0.49, with the lowest accuracy in the CIS class (0.06). The observers had average accuracy of 0.86, and most clinically relevant discordances occurred in distinguishing benign from CIS (6.3% of classifications). With the assistance of algorithm B, the observers maintained their average accuracy.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>AI tools can increase the classification accuracy of pathologists in the setting of breast lesions.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/ajcp\/aqaa151","type":"journal-article","created":{"date-parts":[[2020,8,4]],"date-time":"2020-08-04T19:17:19Z","timestamp":1596568639000},"page":"527-536","source":"Crossref","is-referenced-by-count":30,"title":["Artificial Intelligence Improves the Accuracy in Histologic Classification of Breast Lesions"],"prefix":"10.1093","volume":"155","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8312-1681","authenticated-orcid":false,"given":"Ant\u00f3nio","family":"Pol\u00f3nia","sequence":"first","affiliation":[{"name":"Department of Pathology, Ipatimup Diagnostics, Institute of Molecular Pathology and Immunology, University of Porto, Porto, Portugal"},{"name":"I3S \u2013 Instituto de Investiga\u00e7\u00e3o e Inova\u00e7\u00e3o em Sa\u00fade, University of Porto, Porto, Portugal"}]},{"given":"Sofia","family":"Campelos","sequence":"additional","affiliation":[{"name":"Department of Pathology, Ipatimup Diagnostics, Institute of Molecular Pathology and Immunology, University of Porto, Porto, Portugal"},{"name":"I3S \u2013 Instituto de Investiga\u00e7\u00e3o e Inova\u00e7\u00e3o em Sa\u00fade, University of Porto, Porto, Portugal"}]},{"given":"Ana","family":"Ribeiro","sequence":"additional","affiliation":[{"name":"Department of Pathology, Centro Hospitalar de Vila Nova de Gaia \/ Espinho, EPE, Vila Nova de Gaia, Portugal"}]},{"given":"Ierece","family":"Aymore","sequence":"additional","affiliation":[{"name":"Department of Pathology, Ipatimup Diagnostics, Institute of Molecular Pathology and Immunology, University of Porto, Porto, Portugal"},{"name":"I3S \u2013 Instituto de Investiga\u00e7\u00e3o e Inova\u00e7\u00e3o em Sa\u00fade, University of Porto, Porto, Portugal"}]},{"given":"Daniel","family":"Pinto","sequence":"additional","affiliation":[{"name":"Department of Pathology, Centro Hospitalar de Lisboa Ocidental, EPE, Lisboa, Portugal"}]},{"given":"Magdalena","family":"Biskup-Fruzynska","sequence":"additional","affiliation":[{"name":"Department of Tumor Pathology, Maria Sklodowska-Curie National Research Institute of Oncology (MSCNRIO), Gliwice, Poland"}]},{"given":"Ricardo Santana","family":"Veiga","sequence":"additional","affiliation":[{"name":"Department of Surgical Pathology, Hospital da Luz Lisboa, Lisboa, Portugal"}]},{"given":"Rita","family":"Canas-Marques","sequence":"additional","affiliation":[{"name":"Pathology Service, Champalimaud Clinical Center, Lisboa, Portugal"}]},{"given":"Guilherme","family":"Aresta","sequence":"additional","affiliation":[{"name":"INESC TEC - Institute for Systems and Computer Engineering, Technology and Science, Porto, Portugal"},{"name":"Faculty of Engineering, University of Porto, Porto, Portugal"}]},{"given":"Teresa","family":"Ara\u00fajo","sequence":"additional","affiliation":[{"name":"INESC TEC - Institute for Systems and Computer Engineering, Technology and Science, Porto, Portugal"},{"name":"Faculty of Engineering, University of Porto, Porto, Portugal"}]},{"given":"Aur\u00e9lio","family":"Campilho","sequence":"additional","affiliation":[{"name":"INESC TEC - Institute for Systems and Computer Engineering, Technology and Science, Porto, Portugal"},{"name":"Faculty of Engineering, University of Porto, Porto, Portugal"}]},{"given":"Scotty","family":"Kwok","sequence":"additional","affiliation":[{"name":"Sebit Company Limited, Sha Tin, Hong Kong"}]},{"given":"Paulo","family":"Aguiar","sequence":"additional","affiliation":[{"name":"I3S \u2013 Instituto de Investiga\u00e7\u00e3o e Inova\u00e7\u00e3o em Sa\u00fade, University of Porto, Porto, Portugal"},{"name":"Instituto Nacional de Engenharia Biom\u00e9dica (INEB), Universidade do Porto, Porto, Portugal"}]},{"given":"Catarina","family":"Eloy","sequence":"additional","affiliation":[{"name":"Department of Pathology, Ipatimup Diagnostics, Institute of Molecular Pathology and Immunology, University of Porto, Porto, Portugal"},{"name":"I3S \u2013 Instituto de Investiga\u00e7\u00e3o e Inova\u00e7\u00e3o em Sa\u00fade, University of Porto, Porto, Portugal"},{"name":"Faculty of Medicine, University of Porto, Porto, Portugal"}]}],"member":"286","published-online":{"date-parts":[[2020,10,29]]},"reference":[{"key":"2021031518095228500_CIT0001","doi-asserted-by":"crossref","first-page":"15","DOI":"10.4103\/2153-3539.114206","article-title":"Going fully digital: perspective of a Dutch academic pathology lab","volume":"4","author":"Stathonikos","year":"2013","journal-title":"J Pathol Inform."},{"key":"2021031518095228500_CIT0002","doi-asserted-by":"crossref","first-page":"14","DOI":"10.4103\/2153-3539.129452","article-title":"Implementation of large-scale routine diagnostics using whole slide imaging in Sweden: digital pathology experiences 2006-2013","volume":"5","author":"Thorstenson","year":"2014","journal-title":"J Pathol Inform."},{"key":"2021031518095228500_CIT0003","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1111\/his.12879","article-title":"Validation of digital pathology imaging for primary histopathological diagnosis","volume":"68","author":"Snead","year":"2016","journal-title":"Histopathology."},{"key":"2021031518095228500_CIT0004","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1136\/jclinpath-2015-203600","article-title":"Enabling digital pathology in the diagnostic setting: navigating through the implementation journey in an academic medical centre","volume":"69","author":"Cheng","year":"2016","journal-title":"J Clin Pathol."},{"key":"2021031518095228500_CIT0005","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1007\/s10278-017-9946-9","article-title":"Enterprise implementation of digital pathology: feasibility, challenges, and opportunities","volume":"30","author":"Hartman","year":"2017","journal-title":"J Digit Imaging."},{"key":"2021031518095228500_CIT0006","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/s00428-018-02519-z","article-title":"The performance of digital microscopy for primary diagnosis in human pathology: a systematic review","volume":"474","author":"Ara\u00fajo","year":"2019","journal-title":"Virchows Arch."},{"key":"2021031518095228500_CIT0007","doi-asserted-by":"crossref","first-page":"26286","DOI":"10.1038\/srep26286","article-title":"Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis","volume":"6","author":"Litjens","year":"2016","journal-title":"Sci Rep."},{"key":"2021031518095228500_CIT0008","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1016\/0959-8049(95)00609-5","article-title":"Reproducibility of histological diagnosis of breast lesions: results of a panel in Italy","volume":"32A","author":"Palli","year":"1996","journal-title":"Eur J Cancer."},{"key":"2021031518095228500_CIT0009","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1093\/jnci\/90.2.142","article-title":"Statewide study of diagnostic agreement in breast pathology","volume":"90","author":"Wells","year":"1998","journal-title":"J Natl Cancer Inst."},{"key":"2021031518095228500_CIT0010","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1001\/jama.2015.1405","article-title":"Diagnostic concordance among pathologists interpreting breast biopsy specimens","volume":"313","author":"Elmore","year":"2015","journal-title":"JAMA."},{"key":"2021031518095228500_CIT0011","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.artmed.2015.04.004","article-title":"An unsupervised feature learning framework for basal cell carcinoma image analysis","volume":"64","author":"Arevalo","year":"2015","journal-title":"Artif Intell Med."},{"key":"2021031518095228500_CIT0012","doi-asserted-by":"crossref","first-page":"e0177544","DOI":"10.1371\/journal.pone.0177544","article-title":"Classification of breast cancer histology images using convolutional neural networks","volume":"12","author":"Ara\u00fajo","year":"2017","journal-title":"PLoS One."},{"key":"2021031518095228500_CIT0013","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.compmedimag.2017.06.001","article-title":"Deep convolutional neural networks for automatic classification of gastric carcinoma using whole slide images in digital histopathology","volume":"61","author":"Sharma","year":"2017","journal-title":"Comput Med Imaging Graph."},{"key":"2021031518095228500_CIT0014","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.compbiomed.2018.03.003","article-title":"Automatic classification of tissue malignancy for breast carcinoma diagnosis","volume":"96","author":"Fond\u00f3n","year":"2018","journal-title":"Comput Biol Med."},{"key":"2021031518095228500_CIT0015","doi-asserted-by":"crossref","first-page":"12054","DOI":"10.1038\/s41598-018-30535-1","article-title":"Automated Gleason grading of prostate cancer tissue microarrays via deep learning","volume":"8","author":"Arvaniti","year":"2018","journal-title":"Sci Rep."},{"key":"2021031518095228500_CIT0016","doi-asserted-by":"crossref","first-page":"1559","DOI":"10.1038\/s41591-018-0177-5","article-title":"Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning","volume":"24","author":"Coudray","year":"2018","journal-title":"Nat Med."},{"key":"2021031518095228500_CIT0017","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.media.2018.09.005","article-title":"Automatic grading of prostate cancer in digitized histopathology images: learning from multiple experts","volume":"50","author":"Nir","year":"2018","journal-title":"Med Image Anal."},{"key":"2021031518095228500_CIT0018","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1097\/PGP.0000000000000615","article-title":"A new classification of benign, premalignant, and malignant endometrial tissues using machine learning applied to 1413 candidate variables","volume":"39","author":"Downing","year":"2020","journal-title":"Int J Gynecol Pathol."},{"key":"2021031518095228500_CIT0019","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1111\/his.13760","article-title":"Artificial intelligence\u2014the third revolution in pathology","volume":"74","author":"Salto-Tellez","year":"2019","journal-title":"Histopathology."},{"key":"2021031518095228500_CIT0020","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.media.2019.05.010","article-title":"BACH: grand challenge on breast cancer histology images","volume":"56","author":"Aresta","year":"2019","journal-title":"Med Image Anal."},{"key":"2021031518095228500_CIT0021","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-93000-8_106","volume-title":"Multiclass classification of breast cancer in whole-slide images","author":"Kwok","year":"2018"},{"key":"2021031518095228500_CIT0022","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics."},{"key":"2021031518095228500_CIT0023","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1259\/bjr\/19733434","article-title":"Short communication: a method for verified access when using soft copy display","volume":"78","author":"Brettle","year":"2005","journal-title":"Br J Radiol."},{"key":"2021031518095228500_CIT0024","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1148\/radiol.2423051403","article-title":"Choosing a radiology workstation: technical and clinical considerations","volume":"242","author":"Krupinski","year":"2007","journal-title":"Radiology."},{"key":"2021031518095228500_CIT0025","doi-asserted-by":"crossref","first-page":"151","DOI":"10.5858\/arpa.2016-0025-RA","article-title":"The diagnostic concordance of whole slide imaging and light microscopy: a systematic review","volume":"141","author":"Goacher","year":"2017","journal-title":"Arch Pathol Lab Med."},{"key":"2021031518095228500_CIT0026","doi-asserted-by":"crossref","first-page":"1710","DOI":"10.5858\/arpa.2013-0093-CP","article-title":"Validating whole slide imaging for diagnostic purposes in pathology: guideline from the College of American Pathologists Pathology and Laboratory Quality Center","volume":"137","author":"Pantanowitz","year":"2013","journal-title":"Arch Pathol Lab Med."},{"key":"2021031518095228500_CIT0027","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.humpath.2005.11.005","article-title":"Use of whole slide imaging in surgical pathology quality assurance: design and pilot validation studies","volume":"37","author":"Ho","year":"2006","journal-title":"Hum Pathol."}],"container-title":["American Journal of Clinical Pathology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/ajcp\/article-pdf\/155\/4\/527\/36603510\/aqaa151.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/ajcp\/article-pdf\/155\/4\/527\/36603510\/aqaa151.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,15]],"date-time":"2021-03-15T18:10:39Z","timestamp":1615831839000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ajcp\/article\/155\/4\/527\/5942773"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,29]]},"references-count":27,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,10,29]]},"published-print":{"date-parts":[[2021,3,15]]}},"URL":"https:\/\/doi.org\/10.1093\/ajcp\/aqaa151","relation":{},"ISSN":["0002-9173","1943-7722"],"issn-type":[{"value":"0002-9173","type":"print"},{"value":"1943-7722","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,4,1]]},"published":{"date-parts":[[2020,10,29]]}}}