{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T01:20:07Z","timestamp":1787016007362,"version":"build-2736575974"},"reference-count":39,"publisher":"Wiley","issue":"4","license":[{"start":{"date-parts":[[2022,2,8]],"date-time":"2022-02-08T00:00:00Z","timestamp":1644278400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Vet Radiology Ultrasound"],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Convolutional neural networks (CNNs) are commonly used as artificial intelligence (AI) tools for evaluating radiographs, but published studies testing their performance in veterinary patients are currently lacking. The purpose of this retrospective, secondary analysis, diagnostic accuracy study was to compare the error rates of four CNNs to the error rates of 13 veterinary radiologists for evaluating canine thoracic radiographs using an independent gold standard. Radiographs acquired at a referral institution were used to evaluate the four CNNs sharing a common architecture. Fifty radiographic studies were selected at random. The studies were evaluated independently by three board\u2010certified veterinary radiologists for the presence or absence of 15 thoracic labels, thus creating the gold standard through the majority rule. The labels included \u201ccardiovascular,\u201d \u201cpulmonary,\u201d \u201cpleural,\u201d \u201cairway,\u201d and \u201cother categories.\u201d The error rates for each of the CNNs and for 13 additional board\u2010certified veterinary radiologists were calculated on those same studies. There was no statistical difference in the error rates among the four CNNs for the majority of the labels. However, the CNN's training method impacted the overall error rate for three of 15 labels. The veterinary radiologists had a statistically lower error rate than all four CNNs overall and for five labels (33%). There was only one label (\u201cesophageal dilation\u201d) for which two CNNs were superior to the veterinary radiologists. Findings from the current study raise numerous questions that need to be addressed to further develop and standardize AI in the veterinary radiology environment and to optimize patient care.<\/jats:p>","DOI":"10.1111\/vru.13069","type":"journal-article","created":{"date-parts":[[2022,2,9]],"date-time":"2022-02-09T02:38:18Z","timestamp":1644374298000},"page":"456-468","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Comparison of error rates between four pretrained DenseNet convolutional neural network models and 13 board\u2010certified veterinary radiologists when evaluating 15 labels of canine thoracic radiographs"],"prefix":"10.1111","volume":"63","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9060-2309","authenticated-orcid":false,"given":"Hespel","family":"Adrien\u2010Maxence","sequence":"first","affiliation":[{"name":"Department of Small Animal Clinical Sciences University of Tennessee  Knoxville Tennessee USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Boissady","family":"Emilie","sequence":"additional","affiliation":[{"name":"PicoxIA  Maisons\u2010Alfort France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"De La Comble","family":"Alois","sequence":"additional","affiliation":[{"name":"PicoxIA  Maisons\u2010Alfort France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2576-0105","authenticated-orcid":false,"given":"Acierno","family":"Michelle","sequence":"additional","affiliation":[{"name":"Michelle Acierno Veterinary Radiology Consulting, Kirkland WA and Summit Veterinary Referral Center  Tacoma Washington USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2916-6392","authenticated-orcid":false,"given":"Alexander","family":"Kate","sequence":"additional","affiliation":[{"name":"DMV Veterinary Center Diagnostic Imaging  Montreal Quebec Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5915-7710","authenticated-orcid":false,"given":"Auger","family":"Mylene","sequence":"additional","affiliation":[{"name":"Animages  Longueil Quebec Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Biller","family":"David","sequence":"additional","affiliation":[{"name":"Kansas State University College of Veterinary Medicine Clinical Sciences  Manhattan Kansas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"de Swarte","family":"Marie","sequence":"additional","affiliation":[{"name":"VetCT  Orlando Florida USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fuerst","family":"Jason","sequence":"additional","affiliation":[{"name":"VCA  Santa Monica California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Green","family":"Eric","sequence":"additional","affiliation":[{"name":"The Ohio State University Veterinary Clinical Sciences  Columbus Ohio USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1049-7658","authenticated-orcid":false,"given":"Hoey","family":"S\u00e9amus","sequence":"additional","affiliation":[{"name":"University College Dublin Veterinary Diagnostic Imaging  Dublin Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Koernig","family":"Kevin","sequence":"additional","affiliation":[{"name":"AIS  Fountain Valley California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4452-1935","authenticated-orcid":false,"given":"Lee","family":"Alison","sequence":"additional","affiliation":[{"name":"Mississippi State University College of Veterinary Medicine Department of Clinical Sciences  Starkville Mississippi USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"MacLellan","family":"Megan","sequence":"additional","affiliation":[{"name":"BluePearl Veterinary Partners  Elden Prairie Minnesota USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"McAllister","family":"Hester","sequence":"additional","affiliation":[{"name":"University College Dublin Veterinary Diagnostic Imaging  Dublin Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rechy Jr","family":"Jaime","sequence":"additional","affiliation":[{"name":"Bluepearl Veterinary Partners  Franklin Tennessee USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaojuan","family":"Zhu","sequence":"additional","affiliation":[{"name":"Office of Information Technology The University of Tennessee  Knoxville Tennessee USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zarelli","family":"Micaela","sequence":"additional","affiliation":[{"name":"AIS  Fountain Valley California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Morandi","family":"Federica","sequence":"additional","affiliation":[{"name":"Department of Small Animal Clinical Sciences University of Tennessee  Knoxville Tennessee USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2022,2,8]]},"reference":[{"key":"e_1_2_11_2_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-83515-3"},{"key":"e_1_2_11_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/vru.12901"},{"key":"e_1_2_11_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tvjl.2020.105505"},{"key":"e_1_2_11_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/vru.12912"},{"key":"e_1_2_11_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tvjl.2018.05.009"},{"key":"e_1_2_11_7_1","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky A","year":"2012","journal-title":"Advances in neural information processing systems"},{"key":"e_1_2_11_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2009.36"},{"key":"e_1_2_11_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.carj.2018.02.002"},{"key":"e_1_2_11_10_1","unstructured":"AlganG UlusoyI Label noise types and their effects on deep learning. arXiv preprint arXiv:200310471.2020."},{"key":"e_1_2_11_11_1","first-page":"1196","article-title":"Learning with noisy labels","author":"Natarajan N","year":"2013","journal-title":"NIPS"},{"key":"e_1_2_11_12_1","first-page":"1","article-title":"Sensitivity of neural networks to corruption of image classification","author":"Kaplan S","year":"2021","journal-title":"AI and Ethics"},{"key":"e_1_2_11_13_1","first-page":"1944","article-title":"Making deep neural networks robust to label noise: a loss correction approach","author":"Patrini G","year":"2017","journal-title":"Proceedings of the IEEE conference on computer vision and pattern recognition"},{"key":"e_1_2_11_14_1","unstructured":"RoyP GhoshS BhattacharyaS PalU Effects of degradations on deep neural network architectures.arXiv preprint arXiv:180710108.2018."},{"key":"e_1_2_11_15_1","doi-asserted-by":"crossref","unstructured":"DodgeS KaramL Understanding how image quality affects deep neural networks. 2016.Eighth International Conference on Quality of Multimedia Experience (QoMEX):IEEE 2016;1\u20106.","DOI":"10.1109\/QoMEX.2016.7498955"},{"key":"e_1_2_11_16_1","unstructured":"PeiY HuangY ZouQ ZangH ZhangX WangS Effects of image degradations to cnn\u2010based image classification.arXiv preprint arXiv:181005552.2018."},{"key":"e_1_2_11_17_1","unstructured":"PaszkeA GrossS ChintalaS et\u00a0al.Automatic differentiation in pytorch.2017."},{"key":"e_1_2_11_18_1","first-page":"4700","article-title":"Densely connected convolutional networks","author":"Huang G","year":"2017","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"e_1_2_11_19_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.3301590"},{"key":"e_1_2_11_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1754-9485.2012.02348.x"},{"key":"e_1_2_11_21_1","unstructured":"L. G.Pitfalls of Thoracic Radiography: don't Let Them Trap You.WSAVA Proceedings 2010."},{"key":"e_1_2_11_22_1","unstructured":"PerezL WangJ The effectiveness of data augmentation in image classification using deep learning.arXiv preprint arXiv:171204621.2017."},{"key":"e_1_2_11_23_1","first-page":"360","article-title":"Understanding interobserver agreement: the kappa statistic","volume":"37","author":"Viera AJ","year":"2005","journal-title":"Fam Med"},{"key":"e_1_2_11_24_1","unstructured":"TEAM R.A language and environment for statistical computing. R Foundation for Statistical Computing Vienna Autriche.2017."},{"key":"e_1_2_11_25_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1002697"},{"key":"e_1_2_11_26_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2015142346"},{"key":"e_1_2_11_27_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-020-01192-7"},{"key":"e_1_2_11_28_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-019-0447-x"},{"key":"e_1_2_11_29_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41568-018-0016-5"},{"key":"e_1_2_11_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-019-00186-3"},{"key":"e_1_2_11_31_1","doi-asserted-by":"publisher","DOI":"10.4103\/0971-3026.134367"},{"key":"e_1_2_11_32_1","first-page":"3","article-title":"Automating data mining of medical reports","volume":"1","author":"Geetha Mahadevaiah D","year":"2019","journal-title":"Comput Sci Technol"},{"key":"e_1_2_11_33_1","volume-title":"Textbook of Veterinary Diagnostic Radiology\u2010E\u2010Book","author":"Thrall DE","year":"2013"},{"key":"e_1_2_11_34_1","doi-asserted-by":"publisher","DOI":"10.1067\/j.cpradiol.2016.05.004"},{"key":"e_1_2_11_35_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13244-019-0799-2"},{"key":"e_1_2_11_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacr.2017.10.027"},{"key":"e_1_2_11_37_1","first-page":"2921","article-title":"Learning deep features for discriminative localization","author":"Zhou B","year":"2016","journal-title":"Proceedings of the IEEE Conference On Computer Vision And Pattern Recognition"},{"key":"e_1_2_11_38_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-019-0105-1"},{"key":"e_1_2_11_39_1","unstructured":"JohnsonAE PollardTJ GreenbaumNR et\u00a0al. MIMIC\u2010CXR\u2010JPG a large publicly available database of labeled chest radiographs.arXiv preprint arXiv:190107042.2019."},{"key":"e_1_2_11_40_1","doi-asserted-by":"publisher","DOI":"10.1111\/vru.12383"}],"container-title":["Veterinary Radiology &amp; Ultrasound"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/vru.13069","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/vru.13069","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/vru.13069","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,23]],"date-time":"2023-08-23T16:06:03Z","timestamp":1692806763000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/vru.13069"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,8]]},"references-count":39,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["10.1111\/vru.13069"],"URL":"https:\/\/doi.org\/10.1111\/vru.13069","archive":["Portico"],"relation":{},"ISSN":["1058-8183","1740-8261"],"issn-type":[{"value":"1058-8183","type":"print"},{"value":"1740-8261","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,8]]},"assertion":[{"value":"2021-07-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-21","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-02-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}