{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T17:55:10Z","timestamp":1780595710280,"version":"3.54.1"},"reference-count":28,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2019,10,31]],"date-time":"2019-10-31T00:00:00Z","timestamp":1572480000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100007694","name":"Korea Agency for Infrastructure Technology Advancement","doi-asserted-by":"publisher","award":["19RTRP-C136506-03"],"award-info":[{"award-number":["19RTRP-C136506-03"]}],"id":[{"id":"10.13039\/501100007694","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010418","name":"Institute for Information and Communications Technology Promotion","doi-asserted-by":"publisher","award":["2014-0-00077"],"award-info":[{"award-number":["2014-0-00077"]}],"id":[{"id":"10.13039\/501100010418","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>For sustainable operation and maintenance of urban railway infrastructure, intelligent visual inspection of the railway infrastructure attracts increasing attention to avoid unreliable, manual observation by humans at night, while trains do not operate. Although various automatic approaches were proposed using image processing and computer vision techniques, most of them are focused only on railway tracks. In this paper, we present a novel railway inspection system using facility detection based on deep convolutional neural network and computer vision-based image comparison approach. The proposed system aims to automatically detect wears and cracks by comparing a pair of corresponding image sets acquired at different times. We installed line scan camera on the roof of the train. Unlike an area-based camera, the line scan camera quickly acquires images with a wide field of view. The proposed system consists of three main modules: (i) image reconstruction for registration of facility positions, (ii) facility detection using an improved single shot detector, and (iii) deformed region detection using image processing and computer vision techniques. In experiments, we demonstrate that the proposed system accurately finds facilities and detects their potential defects. For that reason, the proposed system can provide various advantages such as cost reduction for maintenance and accident prevention.<\/jats:p>","DOI":"10.3390\/s19214738","type":"journal-article","created":{"date-parts":[[2019,10,31]],"date-time":"2019-10-31T12:38:23Z","timestamp":1572525503000},"page":"4738","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Intelligent Image-Based Railway Inspection System Using Deep Learning-Based Object Detection and Weber Contrast-Based Image Comparison"],"prefix":"10.3390","volume":"19","author":[{"given":"Jinbeum","family":"Jang","sequence":"first","affiliation":[{"name":"Graduate School of Advanced Imaging Science, Multimedia and Film Chung-Ang University, Seoul 06974, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minwoo","family":"Shin","sequence":"additional","affiliation":[{"name":"Graduate School of Advanced Imaging Science, Multimedia and Film Chung-Ang University, Seoul 06974, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sohee","family":"Lim","sequence":"additional","affiliation":[{"name":"Graduate School of Advanced Imaging Science, Multimedia and Film Chung-Ang University, Seoul 06974, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonggook","family":"Park","sequence":"additional","affiliation":[{"name":"2iSYS Co. Ltd., Uiwang 15850, Gyeonggi-do, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joungyeon","family":"Kim","sequence":"additional","affiliation":[{"name":"2iSYS Co. Ltd., Uiwang 15850, Gyeonggi-do, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8593-7155","authenticated-orcid":false,"given":"Joonki","family":"Paik","sequence":"additional","affiliation":[{"name":"Graduate School of Advanced Imaging Science, Multimedia and Film Chung-Ang University, Seoul 06974, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1016\/j.aej.2017.01.020","article-title":"Crack Detection Using Image Processing: A Critical Review and Analysis","volume":"57","author":"Mohan","year":"2018","journal-title":"Alex. Eng. J."},{"key":"ref_2","first-page":"5121","article-title":"Developing a New Automatic Vision Defect Inspection System for Curved Surfaces with Highly Specular Reflection","volume":"8","author":"Li","year":"2012","journal-title":"Int. J. Innov. Comput. Inf. Control"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Tao, X., Zhang, D., Ma, W., Liu, X., and Xu, D. (2018). Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural Networks. Appl. Sci., 8.","DOI":"10.3390\/app8091575"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0203192","article-title":"Automatic Detection and Classification of Manufacturing Defects in Metal Boxes Using Deep Neural Networks","volume":"13","author":"Essid","year":"2018","journal-title":"PLoS ONE"},{"key":"ref_5","unstructured":"(2019, September 29). The Railway Technical Website. Available online: http:\/\/www.railway-technical.com\/infrastructure\/."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13640-017-0241-y","article-title":"Real Time Detection System for Rail Surface Defects Based on Machine Vision","volume":"2018","author":"Min","year":"2018","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"22","DOI":"10.18178\/ijmerr.6.1.22-27","article-title":"A New Computer Vision-Based Method for Rail Track Detection and Fault Diagnosis in Railways","volume":"6","author":"Karakose","year":"2017","journal-title":"Int. J. Mech. Eng. Robot. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/1729881418773943","article-title":"Computer Vision-Based Automatic Rod-Insulator Defect Detection in High-Speed Rarilway Catenary System","volume":"15","author":"Han","year":"2018","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, W., Zhang, Z., Qi, D., and Liu, Y. (2014). Automatic Crack Detection and Classification Method for Subway Tunnel Safety Monitoring. Sensors, 14.","DOI":"10.3390\/s141019307"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.autcon.2018.03.020","article-title":"Vision-Based Change Detection for Inspection of Tunnel Liners","volume":"91","author":"Attard","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"440","DOI":"10.5573\/IEIESPC.2018.7.6.440","article-title":"Vision-Based Railway Inspection System Using Multiple Object Detection and Image Registration","volume":"7","author":"Jang","year":"2018","journal-title":"IEEE Trans. Smart Process. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"James, A., Jie, W., Xulei, Y., Chenghao, Y., Ngan, N.B., Yuxin, L., Yi, S., Chandrasekhar, V., and Zeng, Z. (2018, January 12\u201314). TrackNet\u2014A Deep Learning Based Fault Detection for Railway Track Inspection. Proceedings of the 2018 International Conference on Intelligent Rail Transportation (ICIRT), Singapore.","DOI":"10.1109\/ICIRT.2018.8641608"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2017, January 22\u201325). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1109\/TITS.2016.2568758","article-title":"Deep Multitask Learning foro Railway Track Inspection","volume":"18","author":"Gibert","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.aei.2017.03.003","article-title":"Inspection Equipment Study for Subway Tunnel Defects by Grey-Scale Image Processing","volume":"32","author":"Huang","year":"2017","journal-title":"Adv. Eng. Inform."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xiong, Z., Li, Q., Mao, Q., and Zou, Q. (2017). A 3D Laser Profiling System for Rail Surface Defect Detection. Sensors, 17.","DOI":"10.3390\/s17081791"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/S0886-7798(03)00024-5","article-title":"Tunnel Maintenance in Japan","volume":"18","author":"Asakura","year":"2003","journal-title":"Tunn. Undergr. Space Technol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bodenstorfer, E., Hasani, Y., F\u00fcrtler, J., Brodersen, J., and Mayer, K.J. (2012, January 20\u201325). High-Speed Line-Scan Camera with Multi-Line CMOS Color Sensor. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238888"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8\u201316). SSD: Single Shot MultiBox Detector. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_21","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_22","unstructured":"Fu, C.Y., Liu, W., Ranga, A., Tyagi, A., and Berg, A.C. (2017). DSSD: Deconvolutional Single Shot Detector. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). SURF: Speeded Up Robust Features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random Sample Consensus: a Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_25","unstructured":"Chen, J., Shan, S., Zhao, G., Chen, X., Gao, W., and Pietik\u00e4inen, M. (July, January 29). Two-Frame Motion Estimation Based on Polynomial Expansion. Proceedings of the Scandinavian Conference on Image Analysis, Halmstad, Sweden."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1085\/jgp.7.2.235","article-title":"The Visual Discrimination of Intensity and the Weber-Fechner Law","volume":"7","author":"Hecht","year":"1924","journal-title":"J. Gen. Physiol."},{"key":"ref_27","unstructured":"Chen, J., Shan, S., Zhao, G., Chen, X., Gao, W., and Pietik\u00e4inen, M. (2008, January 24\u201326). A Robust Descriptor based on Weber\u2019s Law. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AL, USA."},{"key":"ref_28","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, CA, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4738\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:30:53Z","timestamp":1760189453000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4738"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,31]]},"references-count":28,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["s19214738"],"URL":"https:\/\/doi.org\/10.3390\/s19214738","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,31]]}}}