{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T15:41:12Z","timestamp":1787845272734,"version":"build-2784847793"},"reference-count":49,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,9,5]],"date-time":"2025-09-05T00:00:00Z","timestamp":1757030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Vet. Sci."],"abstract":"<jats:p>The swine farming industry, a key pillar of Chinese animal husbandry, faces significant challenges due to frequent outbreaks of porcine gastrointestinal infectious diseases (PGID). Traditional diagnostic methods reliant on human expertise suffer from low efficiency, high subjectivity, and poor accuracy. To address these issues, this paper proposes a multimodal diagnostic method based on artificial intelligence (AI) and large language model (LLM) for six common types of PGID. In this method, ChatGPT and image augmentation techniques were first used to expand the dataset. Next, the Multi-scale TextCNN (MS-TextCNN) model was employed to capture multi-granularity semantic features from text. Subsequently, an improved Mask R-CNN model was applied to segment small intestine lesion regions, after which seven convolutional neural network (CNN) models were used to classify the segmented images. Finally, five machine learning models were utilized for multimodal classification diagnosis. Experimental results demonstrate that the multimodal diagnostic model can accurately identify six common types of PGID. This study provides an efficient and accurate intelligent solution for diagnosing PGID and demonstrates superior performance compared with single-modality methods.<\/jats:p>","DOI":"10.3389\/fvets.2025.1660745","type":"journal-article","created":{"date-parts":[[2025,9,5]],"date-time":"2025-09-05T04:12:24Z","timestamp":1757045544000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["An intelligent diagnostic method for porcine gastrointestinal infectious diseases based on multimodal AI and large language model"],"prefix":"10.3389","volume":"12","author":[{"given":"Haiyan","family":"Wen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongtao","family":"Shi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiashang","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaobin","family":"Fan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haicheng","family":"Dai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lili","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qinye","family":"Song","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,9,5]]},"reference":[{"key":"ref1","volume-title":"The agricultural economic situation was stable and showed a positive trend in 2024","author":"Fenghua","year":"2025"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1007\/s11259-021-09808-0","article-title":"Porcine enteric coronaviruses: an updated overview of the pathogenesis, prevalence, and diagnosis","volume":"45","author":"Liu","year":"2021","journal-title":"Vet Res Commun"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"e58","DOI":"10.4142\/jvs.23090","article-title":"Porcine epidemic diarrhea virus: an update overview of virus epidemiology, vaccines, and control strategies in South Korea","volume":"24","author":"Jang","year":"2023","journal-title":"J Vet Sci"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"109691","DOI":"10.1016\/j.vetmic.2023.109691","article-title":"Clostridial diarrheas in piglets: a review","volume":"280","author":"Uzal","year":"2023","journal-title":"Vet Microbiol"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"402","DOI":"10.3390\/vetsci10060402","article-title":"Development of a multiplex quantitative PCR for detecting porcine epidemic diarrhea virus, transmissible gastroenteritis virus, and porcine Deltacoronavirus simultaneously in China","volume":"10","author":"Chen","year":"2023","journal-title":"Vet Sci"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"882","DOI":"10.3390\/v15040882","article-title":"Development of an indirect enzyme-linked immunosorbent assay based on the yeast-expressed CO-26K-equivalent epitope-containing antigen for detection of serum antibodies against porcine epidemic diarrhea virus","volume":"15","author":"Yang","year":"2023","journal-title":"Viruses"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"105987","DOI":"10.1016\/j.compag.2021.105987","article-title":"An automated method to quantify the composition of live pigs based on computed tomography segmentation using deep neural networks","volume":"183","author":"Pan","year":"2021","journal-title":"Comput Electron Agric"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"106016","DOI":"10.1016\/j.compag.2021.106016","article-title":"Using a CNN-LSTM for basic behaviors detection of a single dairy cow in a complex environment","volume":"182","author":"Wu","year":"2021","journal-title":"Comput Electron Agric"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"365","DOI":"10.5187\/jast.2022.e107","article-title":"An intelligent method for pregnancy diagnosis in breeding sows according to ultrasonography algorithms","volume":"65","author":"Chae","year":"2023","journal-title":"J Anim Sci Technol"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1186\/s40537-024-01057-7","article-title":"A deep contrastive learning-based image retrieval system for automatic detection of infectious cattle diseases","volume":"12","author":"Kittichai","year":"2025","journal-title":"J Big Data"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"e0302862","DOI":"10.1371\/journal.pone.0302862","article-title":"Lumpy skin disease diagnosis in cattle: a deep learning approach optimized with RMSProp and MobileNetV2","volume":"19","author":"Muhammad Saqib","year":"2024","journal-title":"PLoS One"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"1443234","DOI":"10.3389\/fvets.2024.1443234","article-title":"Deep learning-based ultrasonographic classification of canine chronic kidney disease","volume":"11","author":"Yu","year":"2024","journal-title":"Front Vet Sci"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"e38287","DOI":"10.1016\/j.heliyon.2024.e38287","article-title":"Diagnosis of ophthalmologic diseases in canines based on images using neural networks for image segmentation","volume":"10","author":"Buric","year":"2024","journal-title":"Heliyon"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"19539","DOI":"10.1038\/s41598-023-46625-8","article-title":"Multimodal graph attention network for COVID-19 outcome prediction","volume":"13","author":"Keicher","year":"2023","journal-title":"Sci Rep"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1038\/s41551-023-01045-x","article-title":"A transformer-based representation-learning model with unified processing of multimodal input for clinical diagnostics","volume":"7","author":"Zhou","year":"2023","journal-title":"Nat Biomed Eng"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1109\/TMI.2023.3312524","article-title":"Clinically-inspired multi-agent transformers for disease trajectory forecasting from multimodal data","volume":"43","author":"Nguyen","year":"2023","journal-title":"IEEE Trans Med Imaging"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"dmm052086","DOI":"10.1242\/dmm.052086","article-title":"Translating animal models of SARS-CoV-2 infection to vascular, neurological and gastrointestinal manifestations of COVID-19","volume":"18","author":"Chung","year":"2025","journal-title":"Dis Model Mech"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.1109\/TBDATA.2025.3536934","article-title":"AugGPT: leveraging ChatGPT for text data augmentation","author":"Dai","year":"2025","journal-title":"arXiv"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2308.13517","article-title":"ChatGPT as data augmentation for compositional generalization: a case study in open intent detection","author":"Fang","year":"2023","journal-title":"ArXiv"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2402.11764","article-title":"ChatGPT based data augmentation for improved parameter-efficient Debiasing of LLMs","author":"Han","year":"2024","journal-title":"ArXiv"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"2651","DOI":"10.1007\/s10115-023-02036-9","article-title":"Ontology-based text convolution neural network (TextCNN) for prediction of construction accidents","volume":"66","author":"Shi","year":"2024","journal-title":"Knowl Inf Syst"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"108751","DOI":"10.1016\/j.compeleceng.2023.108751","article-title":"TextCNN-based ensemble learning model for Japanese text multi-classification","volume":"109","author":"Chen","year":"2023","journal-title":"Comput Electr Eng"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"2470","DOI":"10.3390\/electronics10202470","article-title":"CNN variants for computer vision: history, architecture, application, challenges and future scope","volume":"10","author":"Bhatt","year":"2021","journal-title":"Electronics"},{"key":"ref24","article-title":"Very deep convolutional networks for large-scale image recognition","author":"Simonyan","year":"2014"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.62836\/iaet.v1i1.1006","article-title":"Comprehensive survey of state-of-the-art convolutional neural network architectures and their applications in image classification. Innovations in applied","volume":"1","author":"Pan","year":"2022","journal-title":"Eng Technol"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1109\/CVPR.2016.90","article-title":"Deep residual learning for image recognition","author":"He","year":"2016","journal-title":"Proc IEEE Conf Comput Vis Pattern Recognit"},{"key":"ref27","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR.2017.243","article-title":"Densely connected convolutional networks","author":"Huang","year":"2017"},{"key":"ref28","first-page":"6105","article-title":"EfficientNet: rethinking model scaling for convolutional neural networks","author":"Tan","year":"2019"},{"key":"ref29","article-title":"An image is worth 16x16 words: transformers for image recognition at scale","author":"Dosovitskiy","year":"2020"},{"key":"ref30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1201\/9781003164265-1","article-title":"Introduction to naive Bayes and a review on its subtypes with applications","volume-title":"Bayesian reasoning and gaussian processes for machine learning applications","author":"Reddy","year":"2022"},{"key":"ref31","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/978-3-031-40688-1_4","article-title":"Reusability analysis of K-nearest neighbors variants for classification models","volume-title":"Innovations in machine and deep learning: case studies and applications","author":"Villarreal-Hern\u00e1ndez","year":"2023"},{"key":"ref32","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/B978-0-12-815739-8.00006-7","article-title":"Support vector machine","volume-title":"Machine learning","author":"Pisner","year":"2020"},{"key":"ref33","doi-asserted-by":"crossref","DOI":"10.1109\/IDEA49133.2020.9170675","article-title":"Ensemble learning techniques and its efficiency in machine learning: A survey","volume-title":"2nd international conference on data, engineering and applications (IDEA)","author":"Rincy","year":"2020"},{"key":"ref34","doi-asserted-by":"publisher","first-page":"746","DOI":"10.3390\/plants13050746","article-title":"A comparative analysis of XGBoost and neural network models for predicting some tomato fruit quality traits from environmental and meteorological data","volume":"13","author":"M\u2019hamdi","year":"2024","journal-title":"Plants"},{"key":"ref35","doi-asserted-by":"crossref","DOI":"10.1109\/ICIC54025.2021.9632912","article-title":"SMOTE for handling imbalanced data problem: a review","author":"Pradipta","year":"2021"},{"key":"ref36","article-title":"ADASYN: adaptive synthetic sampling approach for imbalanced learning","author":"He","year":"2008"},{"key":"ref37","doi-asserted-by":"crossref","DOI":"10.1051\/matecconf\/201713900222","article-title":"AdaBoost typical algorithm and its application research","author":"Chengsheng","year":"2017"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"1066","DOI":"10.1016\/j.procs.2022.01.135","article-title":"A review of Yolo algorithm developments","volume":"199","author":"Jiang","year":"2022","journal-title":"Proc Comput Sci"},{"key":"ref39","doi-asserted-by":"crossref","DOI":"10.1007\/978-981-99-7962-2_39","article-title":"A review on YOLOv8 and its advancements","author":"Sohan","year":"2024"},{"key":"ref40","article-title":"A review of YOLOv12: attention-based enhancements vs. previous versions","author":"Khanam","year":"2025"},{"key":"ref41","article-title":"YOLOv13: real-time object detection with hypergraph-enhanced adaptive visual perception","author":"Lei","year":"2025"},{"key":"ref42","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.biosystemseng.2024.08.001","article-title":"Harnessing multimodal data fusion to advance accurate identification of fish feeding intensity","volume":"246","author":"Du","year":"2024","journal-title":"Biosyst Eng"},{"key":"ref43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3649447","article-title":"Deep multimodal data fusion","volume":"56","author":"Zhao","year":"2024","journal-title":"ACM Comput Surv"},{"key":"ref44","doi-asserted-by":"crossref","DOI":"10.1109\/ICCV.2017.322","article-title":"Mask R-CNN","author":"He","year":"2017"},{"key":"ref45","doi-asserted-by":"publisher","first-page":"922797","DOI":"10.3389\/fpls.2022.922797","article-title":"Symptom recognition of disease and insect damage based on mask R-CNN, wavelet transform, and F-RNet","volume":"13","author":"Li","year":"2022","journal-title":"Front Plant Sci"},{"key":"ref46","doi-asserted-by":"publisher","first-page":"1129","DOI":"10.1111\/tbed.13439","article-title":"A molecular epidemiological investigation of PEDV in China: characterization of co-infection and genetic diversity of S1-based genes","volume":"67","author":"Su","year":"2020","journal-title":"Transbound Emerg Dis"},{"key":"ref47","doi-asserted-by":"publisher","first-page":"359","DOI":"10.3390\/v15020359","article-title":"Transmissible gastroenteritis virus: an update review and perspective","volume":"15","author":"Chen","year":"2023","journal-title":"Viruses"},{"key":"ref48","doi-asserted-by":"publisher","first-page":"109959","DOI":"10.1016\/j.vetimm.2019.109959","article-title":"Immune response and protection against Lawsonia intracellularis infections in pigs","volume":"219","author":"Obradovic","year":"2020","journal-title":"Vet Immunol Immunopathol"},{"key":"ref49","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1186\/s40813-017-0063-4","article-title":"Swine enteric colibacillosis: diagnosis, therapy and antimicrobial resistance","volume":"3","author":"Luppi","year":"2017","journal-title":"Porcine Health Manag"}],"container-title":["Frontiers in Veterinary Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fvets.2025.1660745\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,5]],"date-time":"2025-09-05T04:12:26Z","timestamp":1757045546000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fvets.2025.1660745\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,5]]},"references-count":49,"alternative-id":["10.3389\/fvets.2025.1660745"],"URL":"https:\/\/doi.org\/10.3389\/fvets.2025.1660745","relation":{},"ISSN":["2297-1769"],"issn-type":[{"value":"2297-1769","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,5]]},"article-number":"1660745"}}