{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T10:35:28Z","timestamp":1787654128574,"version":"build-2736575974"},"reference-count":36,"publisher":"Public Library of Science (PLoS)","issue":"6","license":[{"start":{"date-parts":[[2022,6,10]],"date-time":"2022-06-10T00:00:00Z","timestamp":1654819200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Capsule endoscopy has been widely used as a non-invasive diagnostic tool for small or large intestinal lesions. In recent years, automated lesion detection systems using machine learning have been devised. This study aimed to develop an automated system for capsule endoscopic severity in patients with ulcerative colitis along the entire length of the colon using ResNet50. Capsule endoscopy videos from patients with ulcerative colitis were collected prospectively. Each single examination video file was partitioned into four segments: the cecum and ascending colon, transverse colon, descending and sigmoid colon, and rectum. Fifty still pictures (576 \u00d7 576 pixels) were extracted from each partitioned video. A patch (128 \u00d7 128 pixels) was trimmed from the still picture at every 32-pixel-strides. A total of 739,021 patch images were manually classified into six categories: 0) Mayo endoscopic subscore (MES) 0, 1) MES1, 2) MES2, 3) MES3, 4) inadequate quality for evaluation, and 5) ileal mucosa. ResNet50, a deep learning framework, was trained using 483,644 datasets and validated using 255,377 independent datasets. In total, 31 capsule endoscopy videos from 22 patients were collected. The accuracy rates of the training and validation datasets were 0.992 and 0.973, respectively. An automated evaluation system for the capsule endoscopic severity of ulcerative colitis was developed. This could be a useful tool for assessing topographic disease activity, thus decreasing the burden of image interpretation on endoscopists.<\/jats:p>","DOI":"10.1371\/journal.pone.0269728","type":"journal-article","created":{"date-parts":[[2022,6,10]],"date-time":"2022-06-10T13:34:22Z","timestamp":1654868062000},"page":"e0269728","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":27,"title":["Automated evaluation of colon capsule endoscopic severity of ulcerative colitis using ResNet50"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6232-4727","authenticated-orcid":true,"given":"Naoki","family":"Higuchi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6874-4415","authenticated-orcid":true,"given":"Hiroto","family":"Hiraga","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7856-5277","authenticated-orcid":true,"given":"Yoshihiro","family":"Sasaki","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Noriko","family":"Hiraga","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shohei","family":"Igarashi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Keisuke","family":"Hasui","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kohei","family":"Ogasawara","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Takato","family":"Maeda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3305-1248","authenticated-orcid":true,"given":"Yasuhisa","family":"Murai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tetsuya","family":"Tatsuta","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hidezumi","family":"Kikuchi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daisuke","family":"Chinda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tatsuya","family":"Mikami","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8199-3037","authenticated-orcid":true,"given":"Masashi","family":"Matsuzaka","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hirotake","family":"Sakuraba","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shinsaku","family":"Fukuda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2022,6,10]]},"reference":[{"key":"pone.0269728.ref001","doi-asserted-by":"crossref","first-page":"1606","DOI":"10.1016\/S0140-6736(12)60150-0","article-title":"Ulcerative colitis","volume":"380","author":"I Ord\u00e1s","year":"2012","journal-title":"Lancet"},{"key":"pone.0269728.ref002","doi-asserted-by":"crossref","first-page":"782","DOI":"10.1093\/ibd\/izy300","article-title":"Efficacy of therapeutic intervention for patients With an ulcerative colitis Mayo endoscopic score of 1","volume":"25","author":"T Fukuda","year":"2019","journal-title":"Inflamm Bowel Dis"},{"key":"pone.0269728.ref003","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1046\/j.1443-1661.2003.00246.x","article-title":"Computer-aided grading system for endoscopic severity in patients with ulcerative colitis","volume":"15","author":"Y Sasaki","year":"2003","journal-title":"Dig Endosc"},{"key":"pone.0269728.ref004","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1111\/j.1443-1661.2008.00778.x","article-title":"Endoscopic quantification of mucosal surface roughness for grading severity of ulcerative colitis","volume":"20","author":"Y Sasaki","year":"2008","journal-title":"Dig Endosc"},{"key":"pone.0269728.ref005","doi-asserted-by":"crossref","first-page":"103950","DOI":"10.1016\/j.compbiomed.2020.103950","article-title":"Anatomical classification of upper gastrointestinal organs under various image capture conditions using AlexNet","volume":"124","author":"S Igarashi","year":"2020","journal-title":"Comput Biol Med"},{"key":"pone.0269728.ref006","doi-asserted-by":"crossref","first-page":"1625","DOI":"10.1056\/NEJM198712243172603","article-title":"Coated oral 5-aminosalicylic acid therapy for mildly to moderately active ulcerative colitis. A randomized study","volume":"317","author":"KW Schroeder","year":"1987","journal-title":"N Engl J Med"},{"key":"pone.0269728.ref007","doi-asserted-by":"crossref","first-page":"e193963","DOI":"10.1001\/jamanetworkopen.2019.3963","article-title":"Performance of a deep learning model vs human reviewers in grading endoscopic disease severity of patients with ulcerative colitis","volume":"2","author":"RW Stidham","year":"2019","journal-title":"JAMA Netw Open"},{"key":"pone.0269728.ref008","doi-asserted-by":"crossref","first-page":"2150","DOI":"10.1053\/j.gastro.2020.02.012","article-title":"Development and validation of a deep neural network for accurate evaluation of endoscopic images from patients with ulcerative colitis","volume":"158","author":"K Takenaka","year":"2020","journal-title":"Gastroenterology"},{"key":"pone.0269728.ref009","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1016\/j.gie.2018.10.020","article-title":"Novel computer-assisted diagnosis system for endoscopic disease activity in patients with ulcerative colitis.","volume":"89","author":"T Ozawa","year":"2019","journal-title":"Gastrointest Endosc"},{"key":"pone.0269728.ref010","first-page":"2631774521990623","article-title":"Training and deploying a deep learning model for endoscopic severity grading in ulcerative colitis using multicenter clinical trial data","volume":"14","author":"B Gutierrez Becker","year":"2021","journal-title":"Ther Adv Gastrointest Endosc"},{"key":"pone.0269728.ref011","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1111\/j.1365-2036.2011.04711.x","article-title":"Low prevalence of colonoscopic surveillance of inflammatory bowel disease patients with longstanding extensive colitis: a clinical practice survey nested in the CESAME cohort","volume":"34","author":"A Vienne","year":"2011","journal-title":"Aliment Pharmacol Ther"},{"key":"pone.0269728.ref012","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1038\/35013140","article-title":"Wireless capsule endoscopy","volume":"405","author":"G Iddan","year":"2000","journal-title":"Nature"},{"key":"pone.0269728.ref013","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1055\/s-2006-944832","article-title":"Evaluation of the PillCam Colon capsule in the detection of colonic pathology: results of the first multicenter, prospective, comparative study","volume":"38","author":"R Eliakim","year":"2006","journal-title":"Endoscopy"},{"key":"pone.0269728.ref014","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1111\/jgh.12203","article-title":"Applicability of second-generation colon capsule endoscope to ulcerative colitis: a clinical feasibility study","volume":"28","author":"N Hosoe","year":"2013","journal-title":"J Gastroenterol Hepatol"},{"key":"pone.0269728.ref015","first-page":"393","article-title":"The value of rectal biopsy in the diagnosis of ulcerative colitis","volume":"30","author":"SG Matts","year":"1961","journal-title":"Q J Med"},{"key":"pone.0269728.ref016","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.compbiomed.2017.03.031","article-title":"Quantitative analysis of patients with celiac disease by video capsule endoscopy: A deep learning method","volume":"85","author":"T Zhou","year":"2017","journal-title":"Comput Biol Med"},{"key":"pone.0269728.ref017","doi-asserted-by":"crossref","first-page":"2379","DOI":"10.1109\/TIP.2018.2801119","article-title":"Hookworm detection in wireless capsule endoscopy images with deep learning","volume":"27","author":"JY He","year":"2018","journal-title":"IEEE Trans Image Process"},{"key":"pone.0269728.ref018","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.compbiomed.2016.10.011","article-title":"Generic feature learning for wireless capsule endoscopy analysis","volume":"79","author":"S Segu\u00ed","year":"2016","journal-title":"Comput Biol Med"},{"key":"pone.0269728.ref019","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.clinre.2011.09.009","article-title":"Evaluations of capsule endoscopy software in reducing the reading time and the rate of false negatives by inexperienced endoscopists","volume":"36","author":"N Hosoe","year":"2012","journal-title":"Clin Res Hepatol Gastroenterol"},{"key":"pone.0269728.ref020","doi-asserted-by":"crossref","first-page":"e92","DOI":"10.1097\/MCG.0b013e31824fff94","article-title":"Analysis of small-bowel capsule endoscopy reading by using Quickview mode training assistants for reading may produce a high diagnostic yield and save time for physicians","volume":"46","author":"A Shiotani","year":"2012","journal-title":"J Clin Gastroenterol"},{"key":"pone.0269728.ref021","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1016\/j.gie.2014.06.026","article-title":"Automatic lesion detection in capsule endoscopy based on color saliency: closer to an essential adjunct for reviewing software","volume":"80","author":"DK Iakovidis","year":"2014","journal-title":"Gastrointest Endosc"},{"key":"pone.0269728.ref022","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.gie.2018.06.036","article-title":"A neural network algorithm for detection of GI angiectasia during small-bowel capsule endoscopy","volume":"89","author":"R Leenhardt","year":"2019","journal-title":"Gastrointest Endosc"},{"key":"pone.0269728.ref023","doi-asserted-by":"crossref","first-page":"105236","DOI":"10.1016\/j.cmpb.2019.105236","article-title":"Celiac disease diagnosis from videocapsule endoscopy images with residual learning and deep feature extraction","volume":"187","author":"X Wang","year":"2020","journal-title":"Comput Methods Programs Biomed"},{"key":"pone.0269728.ref024","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1111\/den.13259","article-title":"Multicenter feasibility study of bowel preparation with castor oil for colon capsule endoscopy","volume":"31","author":"N Ohmiya","year":"2019","journal-title":"Dig Endosc"},{"key":"pone.0269728.ref025","doi-asserted-by":"crossref","first-page":"1026","DOI":"10.1055\/s-0029-1215360","article-title":"Prospective multicenter performance evaluation of the second-generation colon capsule compared with colonoscopy","volume":"41","author":"R Eliakim","year":"2009","journal-title":"Endoscopy"},{"key":"pone.0269728.ref026","unstructured":"GitHub [Internet]. San Francisco. Available from: https:\/\/github.com\/pytorch\/pytorch."},{"key":"pone.0269728.ref027","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1136\/bmj.298.6666.82","article-title":"Coated mesalazine (5-aminosalicylic acid) versus sulphasalazine in the treatment of active ulcerative colitis: a randomised trial","volume":"298","author":"D. Rachmilewitz","year":"1989","journal-title":"BMJ"},{"key":"pone.0269728.ref028","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/S0016-5107(02)70037-0","article-title":"Capsule endoscopy in the evaluation of patients with suspected small intestinal bleeding: results of a pilot study","volume":"56","author":"BS Lewis","year":"2002","journal-title":"Gastrointest Endosc"},{"key":"pone.0269728.ref029","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1016\/j.dld.2011.12.021","article-title":"Can we shorten the small-bowel capsule reading time with the \"Quick-view\" image detection system?","volume":"44","author":"JC Saurin","year":"2012","journal-title":"Dig Liver Dis"},{"key":"pone.0269728.ref030","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1016\/S0016-5107(05)00372-X","article-title":"A prospective two-center study comparing wireless capsule endoscopy with intraoperative enteroscopy in patients with obscure GI bleeding","volume":"61","author":"D Hartmann","year":"2005","journal-title":"Gastrointest Endosc"},{"key":"pone.0269728.ref031","doi-asserted-by":"crossref","first-page":"e0241474","DOI":"10.1371\/journal.pone.0241474","article-title":"Artificial intelligence that determines the clinical significance of capsule endoscopy images can increase the efficiency of reading","volume":"15","author":"J Park","year":"2020","journal-title":"PLoS One"},{"key":"pone.0269728.ref032","doi-asserted-by":"crossref","first-page":"17751","DOI":"10.1038\/s41598-019-54369-7","article-title":"Endoscopic score vs blood cell indices for determining timing of immunomodulator withdrawal in quiescent ulcerative colitis, Sci Rep: 17751","volume":"9","author":"K Takenaka","year":"2019","journal-title":"Sci Rep."},{"key":"pone.0269728.ref033","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1002\/jgh3.12260","article-title":"Relationship between Mayo endoscopic score and histological scores in ulcerative colitis: A prospective study","volume":"4","author":"J Shah","year":"2020","journal-title":"JGH Open"},{"key":"pone.0269728.ref034","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1159\/000509512","article-title":"Role of ulcerative colitis endoscopic index of severity (UCEIS) versus mayo endoscopic subscore (MES) in predicting patients\u2019 response to biological therapy and the need for colectomy","volume":"102","author":"M Di Ruscio","year":"2021","journal-title":"Digestion"},{"key":"pone.0269728.ref035","first-page":"CD011450","article-title":"Endoscopic scoring indices for evaluation of disease activity in ulcerative colitis","volume":"1","author":"N Mohammed Vashist","year":"2018","journal-title":"Cochrane Database Syst Rev."},{"key":"pone.0269728.ref036","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/j.giec.2014.03.005","article-title":"Mucosal healing as a target of therapy for colonic inflammatory bowel disease and methods to score disease activity","volume":"24","author":"A Walsh","year":"2014","journal-title":"Gastrointest Endosc Clin N Am"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0269728","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,10]],"date-time":"2022-06-10T13:34:57Z","timestamp":1654868097000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0269728"}},"subtitle":[],"editor":[{"given":"Emiko","family":"Mizoguchi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2022,6,10]]},"references-count":36,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,6,10]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0269728","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,10]]}}}