{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T16:37:26Z","timestamp":1773247046599,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2025,7,7]],"date-time":"2025-07-07T00:00:00Z","timestamp":1751846400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Portuguese Foundation for Science and Technology (FCT)","award":["UID\/04516\/NOVA"],"award-info":[{"award-number":["UID\/04516\/NOVA"]}]},{"name":"Portuguese Foundation for Science and Technology (FCT)","award":["UIDB\/00319\/2020"],"award-info":[{"award-number":["UIDB\/00319\/2020"]}]},{"name":"FCT project ALGORITMI","award":["UID\/04516\/NOVA"],"award-info":[{"award-number":["UID\/04516\/NOVA"]}]},{"name":"FCT project ALGORITMI","award":["UIDB\/00319\/2020"],"award-info":[{"award-number":["UIDB\/00319\/2020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>Pneumonia is a respiratory condition caused by various microorganisms, including bacteria, viruses, fungi, and parasites. It manifests with symptoms such as coughing, chest pain, fever, breathing difficulties, and fatigue. Early and accurate detection is crucial for effective treatment, yet traditional diagnostic methods often fall short in reliability and speed. Chest X-rays have become widely used for detecting pneumonia; however, current approaches still struggle with achieving high accuracy and interpretability, leaving room for improvement. PneumoNet, an artificial intelligence assistant for X-ray pneumonia detection, is proposed in this work. The framework comprises (a) a new deep learning-based classification model for the detection of pneumonia, which expands on the AlexNet backbone for feature extraction in X-ray images and a new head in its final layers that is tailored for (X-ray) pneumonia classification. (b) GPT-Neo, a large language model, which is used to integrate the results and produce medical reports. The classification model is trained and evaluated on three publicly available datasets to ensure robustness and generalisability. Using multiple datasets mitigates biases from single-source data, addresses variations in patient demographics, and allows for meaningful performance comparisons with prior research. PneumoNet classifier achieves accuracy rates between 96.70% and 98.70% in those datasets.<\/jats:p>","DOI":"10.3390\/app15137605","type":"journal-article","created":{"date-parts":[[2025,7,7]],"date-time":"2025-07-07T10:03:27Z","timestamp":1751882607000},"page":"7605","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["PneumoNet: Artificial Intelligence Assistance for Pneumonia Detection on X-Rays"],"prefix":"10.3390","volume":"15","author":[{"given":"Carlos","family":"Antunes","sequence":"first","affiliation":[{"name":"Escola de Ci\u00eancias e Tecnologia, Universidade de Tr\u00e1s-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3562-6025","authenticated-orcid":false,"given":"Jo\u00e3o M. F.","family":"Rodrigues","sequence":"additional","affiliation":[{"name":"NOVA LINCS & Instituto Superior de Engenharia, Universidade do Algarve, 8005-139 Faro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3458-7693","authenticated-orcid":false,"given":"Ant\u00f3nio","family":"Cunha","sequence":"additional","affiliation":[{"name":"Escola de Ci\u00eancias e Tecnologia, Universidade de Tr\u00e1s-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal"},{"name":"ALGORITMI Research Centre, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2025,7,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1017\/S0959259810000341","article-title":"Pneumonia in Older People","volume":"21","author":"Krajcik","year":"2010","journal-title":"Rev. Clin. Gerontol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4180949","DOI":"10.1155\/2019\/4180949","article-title":"An Efficient Deep Learning Approach to Pneumonia Classification in Healthcare","volume":"2019","author":"Stephen","year":"2019","journal-title":"J. Healthc. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1296","DOI":"10.1007\/s10489-020-01862-6","article-title":"COVID-19 Open Source Data Sets: A Comprehensive Survey","volume":"51","author":"Shuja","year":"2021","journal-title":"Appl. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1515\/cclm-2020-0198","article-title":"Laboratory Abnormalities in Patients with COVID-2019 Infection","volume":"58","author":"Lippi","year":"2020","journal-title":"Clin. Chem. Lab. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"490","DOI":"10.3390\/make2040027","article-title":"COVID-19 Symptoms Detection Based on NasNetMobile with Explainable AI Using Various Imaging Modalities","volume":"2","author":"Ahsan","year":"2020","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"070007","DOI":"10.1063\/5.0227658","article-title":"A Review on Key Algorithms for Pneumonia Detection in X-ray Images","volume":"3156","author":"Chhajed","year":"2024","journal-title":"AIP Conf. Proc."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"100190","DOI":"10.1016\/j.ibmed.2024.100190","article-title":"CTCovid19: Automatic Covid-19 Model for Computed Tomography Scans Using Deep Learning","volume":"11","author":"Antunes","year":"2024","journal-title":"Intell. Based Med."},{"key":"ref_8","unstructured":"(2025, May 02). Chest X-Ray (COVID-19 & Pneumonia). Available online: https:\/\/www.kaggle.com\/datasets\/prashant268\/chest-xray-covid19-pneumonia."},{"key":"ref_9","unstructured":"Kermany, D. (2025, May 02). Labeled Optical Coherence Tomography (OCT) and Chest X-Ray Images for Classification. Mendeley Dataset 2018. Available online: https:\/\/data.mendeley.com\/datasets\/rscbjbr9sj\/2."},{"key":"ref_10","unstructured":"Mooney, P. (2025, May 02). Chest X-Ray Images (Pneumonia). Available online: https:\/\/www.kaggle.com\/datasets\/paultimothymooney\/chest-xray-pneumonia."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"210","DOI":"10.54254\/2755-2721\/22\/20231219","article-title":"A Systematic Review: Deep Learning-Based Methods for Pneumonia Region Detection","volume":"22","author":"Xu","year":"2023","journal-title":"Appl. Comput. Eng."},{"key":"ref_12","first-page":"7","article-title":"Diagnosis of Pneumonia from Chest X-Ray Images Using Transfer Learning and Generative Adversarial Network","volume":"9","author":"Yaraghi","year":"2024","journal-title":"Int. J. Innov. Sci. Res. Technol."},{"key":"ref_13","first-page":"210087","article-title":"What Is Pneumonia?","volume":"17","author":"Waterer","year":"2021","journal-title":"Eur. Respir. Soc."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"24101","DOI":"10.1007\/s11042-023-16419-1","article-title":"A Systematic Literature Review on Deep Learning Approaches for Pneumonia Detection Using Chest X-ray Images","volume":"83","author":"Sharma","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Siddiqi, R., and Javaid, S. (2024). Deep Learning for Pneumonia Detection in Chest X-ray Images: A Comprehensive Survey. J. Imaging, 10.","DOI":"10.3390\/jimaging10080176"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"174","DOI":"10.9734\/ajrcos\/2025\/v18i1556","article-title":"Pneumonia and COVID-19 Classification and Detection Based on Convolutional Neural Network: A Review","volume":"18","author":"Eido","year":"2025","journal-title":"Asian J. Res. Comput. Sci."},{"key":"ref_17","first-page":"2","article-title":"Pneumonia Detection Using Transfer Learning: A Systematic Literature Review","volume":"16","author":"Abueed","year":"2025","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bhalke, D.G., and Shaikh, A.S. (2025, January 16\u201317). Classification of Pneumonia Subtypes in Chest X-Rays Using a Custom CNN. Proceedings of the 1st International Conference on AIML-Applications for Engineering & Technology, Pune, India.","DOI":"10.1109\/ICAET63349.2025.10932287"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/j.procs.2023.01.018","article-title":"A Deep Learning Based Model for the Detection of Pneumonia from Chest X-Ray Images Using VGG-16 and Neural Networks","volume":"218","author":"Sharma","year":"2023","journal-title":"Procedia Comput. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Reshan, M.S.A., Gill, K.S., Anand, V., Gupta, S., Alshahrani, H., Sulaiman, A., and Shaikh, A. (2023). Detection of Pneumonia from Chest X-ray Images Utilizing MobileNet Model. Healthcare, 11.","DOI":"10.3390\/healthcare11111561"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., and Summers, R.M. (2017, January 21\u201326). ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.369"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1007\/s11517-022-02746-2","article-title":"PneuNet: Deep Learning for COVID-19 Pneumonia Diagnosis on Chest X-ray Image Analysis Using Vision Transformer","volume":"61","author":"Wang","year":"2023","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"467","DOI":"10.11591\/ijai.v13.i1.pp467-474","article-title":"Pneumonia Prediction on Chest X-ray Images Using Deep Learning Approach","volume":"13","author":"Puspita","year":"2024","journal-title":"IAES Int. J. Artif. Intell."},{"key":"ref_24","unstructured":"Black, S., Leo, G., Wang, P., Leahy, C., and Biderman, S. (2025, May 02). GPT-Neo: Large Scale Autoregressive Language Modeling with Mesh-Tensorflow. Zenodo 2021. Available online: https:\/\/www.semanticscholar.org\/paper\/GPT-Neo%3A-Large-Scale-Autoregressive-Language-with-Black-Gao\/7e5008713c404445dd8786753526f1a45b93de12."},{"key":"ref_25","first-page":"8","article-title":"Convolutional Neural Networks (CNNs) for Pneumonia Classification on Pediatric Chest Radiographs","volume":"15","author":"Saboo","year":"2023","journal-title":"Cureus"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Varshni, D., Thakral, K., Agarwal, L., Nijhawan, R., and Mittal, A. (2019, January 20\u201322). Pneumonia Detection Using CNN Based Feature Extraction. Proceedings of the IEEE International Conference on Electrical, Computer and Communication Technologies, Coimbatore, India.","DOI":"10.1109\/ICECCT.2019.8869364"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1007\/s42979-021-00762-x","article-title":"HOG + CNN Net: Diagnosing COVID-19 and Pneumonia by Deep Neural Network from Chest X-Ray Images","volume":"2","author":"Rahman","year":"2021","journal-title":"SN Comput. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.radi.2022.09.011","article-title":"The Effect of Gaussian Noise on Pneumonia Detection on Chest Radiographs, Using Convolutional Neural Networks","volume":"29","author":"Kusk","year":"2023","journal-title":"Radiography"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ortiz-Toro, C., Garc\u00eda-Pedrero, A., Lillo-Saavedra, M., and Gonzalo-Mart\u00edn, C. (2022). Automatic Detection of Pneumonia in Chest X-ray Images Using Textural Features. Comput. Biol. Med., 145.","DOI":"10.1016\/j.compbiomed.2022.105466"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chouhan, V., Singh, S.K., Khamparia, A., Gupta, D., Tiwari, P., Moreira, C., and de Albuquerque, V.H.C. (2020). A Novel Transfer Learning Based Approach for Pneumonia Detection in Chest X-ray Images. Appl. Sci., 10.","DOI":"10.3390\/app10020559"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tang, J., Zhang, B., Liu, J., Dong, Z., Zhou, Y., Meng, X., and Toe, T.T. (2024, January 5\u20137). Pneumonia Image Classification: Deep Learning and Machine Learning Fusion. Proceedings of the 7th International Conference on Artificial Intelligence and Big Data, Beijing, China.","DOI":"10.1109\/ICAIBD62003.2024.10604438"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Mabrouk, A., D\u00edaz Redondo, R.P., Dahou, A., Abd Elaziz, M., and Kayed, M. (2022). Pneumonia Detection on Chest X-ray Images Using Ensemble of Deep Convolutional Neural Networks. Appl. Sci., 12.","DOI":"10.3390\/app12136448"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Singh, S., Kumar, M., Kumar, A., Verma, B.K., and Shitharth, S. (2023). Pneumonia Detection with QCSA Network on Chest X-ray. Sci. Rep., 13.","DOI":"10.1038\/s41598-023-35922-x"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1007\/s10916-021-01745-4","article-title":"Deep Learning on Chest X-ray Images to Detect and Evaluate Pneumonia Cases at the Era of COVID-19","volume":"45","author":"Hammoudi","year":"2021","journal-title":"J. Med. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1016\/j.bbe.2022.08.001","article-title":"Detection of Pneumonia Using Convolutional Neural Networks and Deep Learning","volume":"42","author":"Szepesi","year":"2022","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Colin, J., and Surantha, N. (2025). Interpretable Deep Learning for Pneumonia Detection Using Chest X-Ray Images. Information, 16.","DOI":"10.3390\/info16010053"},{"key":"ref_37","unstructured":"Antona, M., and Stephanidis, C. (2024). Web Diagnosis for COVID-19 and Pneumonia Based on Computed Tomography Scans and X-rays. Universal Access in Human-Computer Interaction, Springer. HCII 2024."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1007\/s11263-019-01228-7","article-title":"Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization","volume":"128","author":"Selvaraju","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13\u201317). \u201cWhy Should I Trust You?\u201d: Explaining the Predictions of Any Classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939778"},{"key":"ref_40","unstructured":"(2016). Medical Devices\u2014Quality Management Systems\u2014Requirements for Regulatory Purposes (Standard No. ISO 13485)."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/15\/13\/7605\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:05:55Z","timestamp":1760033155000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/15\/13\/7605"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,7]]},"references-count":40,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["app15137605"],"URL":"https:\/\/doi.org\/10.3390\/app15137605","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,7]]}}}