{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T05:30:58Z","timestamp":1791437458148,"version":"4.3.3"},"reference-count":33,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T00:00:00Z","timestamp":1634774400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100013704","name":"Consejo Nacional de Ciencia y Tecnolog\u00eda","doi-asserted-by":"publisher","award":["PINV18-1293"],"award-info":[{"award-number":["PINV18-1293"]}],"id":[{"id":"10.13039\/501100013704","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>In the automatic diagnosis of ocular toxoplasmosis (OT), Deep Learning (DL) has arisen as a powerful and promising approach for diagnosis. However, despite the good performance of the models, decision rules should be interpretable to elicit trust from the medical community. Therefore, the development of an evaluation methodology to assess DL models based on interpretability methods is a challenging task that is necessary to extend the use of AI among clinicians. In this work, we propose a novel methodology to quantify the similarity between the decision rules used by a DL model and an ophthalmologist, based on the assumption that doctors are more likely to trust a prediction that was based on decision rules they can understand. Given an eye fundus image with OT, the proposed methodology compares the segmentation mask of OT lesions labeled by an ophthalmologist with the attribution matrix produced by interpretability methods. Furthermore, an open dataset that includes the eye fundus images and the segmentation masks is shared with the community. The proposal was tested on three different DL architectures. The results suggest that complex models tend to perform worse in terms of likelihood to be trusted while achieving better results in sensitivity and specificity.<\/jats:p>","DOI":"10.3390\/diagnostics11111951","type":"journal-article","created":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T14:37:48Z","timestamp":1634827068000},"page":"1951","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A Trust-Based Methodology to Evaluate Deep Learning Models for Automatic Diagnosis of Ocular Toxoplasmosis from Fundus Images"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0218-4267","authenticated-orcid":false,"given":"Rodrigo","family":"Parra","sequence":"first","affiliation":[{"name":"Centro de Investigaci\u00f3n, Universidad Americana, Avenida Brasilia 1100, Asunci\u00f3n 1206, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Verena","family":"Ojeda","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n, Universidad Americana, Avenida Brasilia 1100, Asunci\u00f3n 1206, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9766-4182","authenticated-orcid":false,"given":"Jose Luis","family":"V\u00e1zquez Noguera","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n, Universidad Americana, Avenida Brasilia 1100, Asunci\u00f3n 1206, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6867-7080","authenticated-orcid":false,"given":"Miguel","family":"Garc\u00eda-Torres","sequence":"additional","affiliation":[{"name":"Data Science and Big Data Lab., Universidad Pablo de Olavide, ES-41013 Seville, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3698-4043","authenticated-orcid":false,"given":"Julio C\u00e9sar","family":"Mello-Rom\u00e1n","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n, Universidad Americana, Avenida Brasilia 1100, Asunci\u00f3n 1206, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cynthia","family":"Villalba","sequence":"additional","affiliation":[{"name":"Facultad Polit\u00e9cnica, Universidad Nacional de Asunci\u00f3n, San Lorenzo 2169, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5711-2826","authenticated-orcid":false,"given":"Jacques","family":"Facon","sequence":"additional","affiliation":[{"name":"Department of Computer and Electronics, Universidade Federal do Esp\u00edrito Santo, S\u00e3o Mateus 29932-540, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0964-9506","authenticated-orcid":false,"given":"Federico","family":"Divina","sequence":"additional","affiliation":[{"name":"Data Science and Big Data Lab., Universidad Pablo de Olavide, ES-41013 Seville, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olivia","family":"Cardozo","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, Hospital General Pedi\u00e1trico Ni\u00f1os de Acosta \u00d1u, San Lorenzo 2169, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ver\u00f3nica Elisa","family":"Castillo","sequence":"additional","affiliation":[{"name":"Departamento de Retina, C\u00e1tedra de Oftalmolog\u00eda, Hospital de Cl\u00ednicas, Facultad de Ciencias M\u00e9dicas, Universidad Nacional de Asunci\u00f3n, San Lorenzo 2169, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ingrid Castro","family":"Matto","sequence":"additional","affiliation":[{"name":"Departamento de Retina, C\u00e1tedra de Oftalmolog\u00eda, Hospital de Cl\u00ednicas, Facultad de Ciencias M\u00e9dicas, Universidad Nacional de Asunci\u00f3n, San Lorenzo 2169, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1016\/S0020-7519(00)00124-7","article-title":"Toxoplasma gondii: From animals to humans","volume":"30","author":"Tenter","year":"2000","journal-title":"Int. J. Parasitol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"393","DOI":"10.3347\/kjp.2013.51.4.393","article-title":"Clinical features and treatment of ocular toxoplasmosis","volume":"51","author":"Park","year":"2013","journal-title":"Korean J. Parasitol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"255","DOI":"10.3109\/09273948.2011.595872","article-title":"Diagnostic approach to ocular toxoplasmosis","volume":"19","author":"Garweg","year":"2011","journal-title":"Ocul. Immunol. Inflamm."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1186\/s40662-020-00183-6","article-title":"Application of machine learning in ophthalmic imaging modalities","volume":"7","author":"Tong","year":"2020","journal-title":"Eye Vis."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Mahony, N.O., Campbell, S., Carvalho, A., Harapanahalli, S., Velasco-Hernandez, G., Krpalkova, L., Riordan, D., and Walsh, J. (2019, January 25\u201326). Deep Learning vs. Traditional Computer Vision. Proceedings of the Science and Information Conference, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-030-17795-9_10"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1016\/j.survophthal.2019.02.003","article-title":"Automated detection of age-related macular degeneration in color fundus photography: A systematic review","volume":"64","author":"Pead","year":"2019","journal-title":"Surv. Ophthalmol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"100377","DOI":"10.1016\/j.imu.2020.100377","article-title":"Diabetic retinopathy detection through deep learning techniques: A review","volume":"20","author":"Alyoubi","year":"2020","journal-title":"Inform. Med. Unlocked"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"104599","DOI":"10.1016\/j.compbiomed.2021.104599","article-title":"Deep learning for diabetic retinopathy detection and classification based on fundus images: A review","volume":"135","author":"Tsiknakis","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Yang, Y., Li, T., Li, W., and Zhang, W. (2017). Lesion Detection and Grading of Diabetic Retinopathy via Two-Stages Deep Convolutional Neural Networks. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-319-66179-7_61"},{"key":"ref_11","first-page":"1627","article-title":"Ocular Toxoplasmosis Lesion Detection on Fundus Photograph using a Deep Learning Model","volume":"61","author":"Hasanreisoglu","year":"2020","journal-title":"Invest. Ophthalmol. Vis. Sci."},{"key":"ref_12","first-page":"173","article-title":"Automatic Diagnosis of Ocular Toxoplasmosis from Fundus Images with Residual Neural Networks","volume":"281","author":"Parra","year":"2021","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lockey, S., Gillespie, N., Holm, D., and Someh, I.A. (2021, January 5\u20138). A Review of Trust in Artificial Intelligence: Challenges, Vulnerabilities and Future Directions. Proceedings of the 54th Hawaii International Conference on System Sciences, Kauai, HI, USA.","DOI":"10.24251\/HICSS.2021.664"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e15154","DOI":"10.2196\/15154","article-title":"Artificial Intelligence and Human Trust in Healthcare: Focus on Clinicians","volume":"22","author":"Asan","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ribeiro, M.T., Singh, S., and Guestrin, C. (2016). \u201cWhy Should I Trust You?\u201d: Explaining the Predictions of Any Classifier. arXiv.","DOI":"10.1145\/2939672.2939778"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1109\/TETCI.2021.3100641","article-title":"A Survey on Neural Network Interpretability","volume":"5","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Emerg. Top. Comput. Intell."},{"key":"ref_17","unstructured":"Shrikumar, A., Greenside, P., Shcherbina, A., and Kundaje, A. (2016). Not Just a Black Box: Learning Important Features Through Propagating Activation Differences. arXiv."},{"key":"ref_18","unstructured":"Sundararajan, M., Taly, A., and Yan, Q. (2017, January 6\u201311). Axiomatic Attribution for Deep Networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bach, S., Binder, A., Montavon, G., Klauschen, F., M\u00fcller, K.R., and Samek, W. (2015). On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0130140"},{"key":"ref_20","unstructured":"Shrikumar, A., Greenside, P., and Kundaje, A. (2017, January 6\u201311). Learning Important Features Through Propagating Activation Differences. Proceedings of the International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_21","unstructured":"Ancona, M., Ceolini, E., \u00d6ztireli, C., and Gross, M. (2017). Towards better understanding of gradient-based attribution methods for Deep Neural Networks. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1016\/j.ophtha.2018.11.016","article-title":"Using a Deep Learning Algorithm and Integrated Gradients Explanation to Assist Grading for Diabetic Retinopathy","volume":"126","author":"Sayres","year":"2019","journal-title":"Ophthalmology"},{"key":"ref_23","first-page":"1150","article-title":"Automated detection of glaucoma using retinal images with interpretable deep learning","volume":"61","author":"Mehta","year":"2020","journal-title":"Invest. Ophthalmol. Vis. Sci."},{"key":"ref_24","unstructured":"Wong, A., Wang, X.Y., and Hryniowski, A. (2020). How Much Can We Really Trust You? Towards Simple, Interpretable Trust Quantification Metrics for Deep Neural Networks. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hryniowski, A., Wang, X.Y., and Wong, A. (2020). Where Does Trust Break Down? A Quantitative Trust Analysis of Deep Neural Networks via Trust Matrix and Conditional Trust Densities. arXiv.","DOI":"10.15353\/jcvis.v6i1.3539"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Carvalho, D.V., Pereira, E.M., and Cardoso, J.S. (2019). Machine Learning Interpretability: A Survey on Methods and Metrics. Electronics, 8.","DOI":"10.3390\/electronics8080832"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"7068349","DOI":"10.1155\/2018\/7068349","article-title":"Deep Learning for Computer Vision: A Brief Review","volume":"2018","author":"Voulodimos","year":"2018","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1186\/s40537-021-00444-8","article-title":"Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions","volume":"8","author":"Alzubaidi","year":"2021","journal-title":"J. Big Data"},{"key":"ref_29","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201312). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., and Liu, C. (2018, January 4\u20137). A Survey on Deep Transfer Learning. Proceedings of the International Conference on Artificial Neural Networks, Rhodes, Greece.","DOI":"10.1007\/978-3-030-01424-7_27"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e1379","DOI":"10.1002\/widm.1379","article-title":"Interpretability of machine learning based prediction models in healthcare","volume":"10","author":"Stiglic","year":"2020","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_33","unstructured":"Merrill, J., Ward, G., Kamkar, S., Budzik, J., and Merrill, D. (2019). Generalized Integrated Gradients: A practical method for explaining diverse ensembles. arXiv."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/11\/11\/1951\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:19:59Z","timestamp":1760167199000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/11\/11\/1951"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,21]]},"references-count":33,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["diagnostics11111951"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics11111951","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,21]]}}}