{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T17:54:05Z","timestamp":1780595645882,"version":"3.54.1"},"reference-count":50,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2019,7,11]],"date-time":"2019-07-11T00:00:00Z","timestamp":1562803200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"China Energy","award":["SHGF-17-56-9"],"award-info":[{"award-number":["SHGF-17-56-9"]}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development of China","doi-asserted-by":"publisher","award":["2016YFB1200402"],"award-info":[{"award-number":["2016YFB1200402"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Research of National Railway Administration of China","award":["AJ2019-033"],"award-info":[{"award-number":["AJ2019-033"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Foreign object intrusion is a great threat to high-speed railway safety operations. Accurate foreign object intrusion detection is particularly important. As a result of the lack of intruding foreign object samples during the operational period, artificially generated ones will greatly benefit the development of the detection methods. In this paper, we propose a novel method to generate railway intruding object images based on an improved conditional deep convolutional generative adversarial network (C-DCGAN). It consists of a generator and multi-scale discriminators. Loss function is also improved so as to generate samples with a high quality and authenticity. The generator is extracted in order to generate foreign object images from input semantic labels. We synthesize the generated objects to the railway scene. To make the generated objects more similar to real objects, on scale in different positions of a railway scene, a scale estimation algorithm based on the gauge constant is proposed. The experimental results on the railway intruding object dataset show that the proposed C-DCGAN model outperforms several state-of-the-art methods and achieves a higher quality (the pixel-wise accuracy, mean intersection-over-union (mIoU), and mean average precision (mAP) are 80.46%, 0.65, and 0.69, respectively) and diversity (the Fr\u00e9chet-Inception Distance (FID) score is 26.87) of generated samples. The mIoU of the real-generated pedestrian pairs reaches 0.85, and indicates a higher scale of accuracy for the generated intruding objects in the railway scene.<\/jats:p>","DOI":"10.3390\/s19143075","type":"journal-article","created":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T11:49:38Z","timestamp":1562932178000},"page":"3075","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["High-Speed Railway Intruding Object Image Generating with Generative Adversarial Networks"],"prefix":"10.3390","volume":"19","author":[{"given":"Baoqing","family":"Guo","sequence":"first","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"},{"name":"Key Laboratory of Vehicle Advanced Manufacturing, Measuring and Control Technology, Ministry of Education, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gan","family":"Geng","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"},{"name":"Key Laboratory of Vehicle Advanced Manufacturing, Measuring and Control Technology, Ministry of Education, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5436-6660","authenticated-orcid":false,"given":"Liqiang","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"},{"name":"Key Laboratory of Vehicle Advanced Manufacturing, Measuring and Control Technology, Ministry of Education, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongmei","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"},{"name":"Key Laboratory of Vehicle Advanced Manufacturing, Measuring and Control Technology, Ministry of Education, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zujun","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"},{"name":"Key Laboratory of Vehicle Advanced Manufacturing, Measuring and Control Technology, Ministry of Education, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,11]]},"reference":[{"key":"ref_1","first-page":"15","article-title":"Intrusion detection algorithm for railway clearance with rapid DBSCAN clustering","volume":"33","author":"Guo","year":"2012","journal-title":"Chin. J. Sci. Instrum."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2473","DOI":"10.1007\/s11042-015-2654-x","article-title":"Visual railway detection by superpixel based intracellular decisions","volume":"75","author":"Zhu","year":"2016","journal-title":"Multimed. Tools Appl."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ye, T., Wang, B., Song, P., and Li, J. (2018). Automatic Railway Traffic Object Detection System Using Feature Fusion Refine Neural Network under Shunting Mode. Sensors, 18.","DOI":"10.3390\/s18061916"},{"key":"ref_4","first-page":"1371","article-title":"High-speed Railway Clearance Intrusion Detection Algorithm with Fast Background Subtraction","volume":"37","author":"Guo","year":"2016","journal-title":"Chin. J. Sci. Instrum."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3040","DOI":"10.3788\/OPE.20182612.3040","article-title":"Pedestrian intruding railway clearance classification algorithm based on improved deep convolutional network","volume":"26","author":"Guo","year":"2018","journal-title":"Opt. Precis. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"P\u0142awiak, P., and Acharya, U.R. (2019). Novel deep genetic ensemble of classifiers for arrhythmia detection using ecg signals. Neural Comput. Appl., 1\u201325.","DOI":"10.1007\/s00521-018-03980-2"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1016\/j.neucom.2014.04.026","article-title":"An estimation of the state of consumption of a positive displacement pump based on dynamic pressure or vibrations using neural networks","volume":"144","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rzecki, K., So\u015bnicki, T., Baran, M., Nied\u017awiecki, M., Kr\u00f3l, M., \u0141ojewski, T., Acharya, U.R., Yildirim, \u00d6., and P\u0142awiak, P. (2018). Application of Computational Intelligence Methods for the Automated Identification of Paper-Ink Samples Based on LIBS. Sensors, 18.","DOI":"10.20944\/preprints201808.0402.v1"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.ins.2017.05.041","article-title":"Person recognition based on touch screen gestures using computational intelligence methods","volume":"415","author":"Rzecki","year":"2017","journal-title":"Inf. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.cogsys.2018.12.001","article-title":"A novel machine learning approach for early detection of hepatocellular carcinoma patients","volume":"54","author":"Abdar","year":"2019","journal-title":"Cogn. Syst. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1718","DOI":"10.1109\/TGRS.2017.2767205","article-title":"Joint gaussian processes for biophysical parameter retrieval","volume":"56","author":"Svendsen","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1016\/j.rse.2004.11.001","article-title":"A hybrid inversion method for mapping leaf area index from modis data: Experiments and application to broadleaf and needleleaf canopies","volume":"94","author":"Fang","year":"2005","journal-title":"Remote Sens. Environ."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2052","DOI":"10.1109\/TGRS.2003.813493","article-title":"Retrieving leaf area index with a neural network method: Simulation and validation","volume":"41","author":"Fang","year":"2003","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_15","unstructured":"Mirza, M., and Osindero, S. (2014, January 8\u201313). Conditional generative adversarial. Proceedings of the Neural Information Processing Systems (NIPS), Montreal, QC, Canada."},{"key":"ref_16","unstructured":"Radford, A., Metz, L., and Chintala, S. (2016, January 2\u20134). Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. Proceedings of the International Conference on Learning Representations (ICLR), San Juan, PR, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 22\u201325). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., and Huszar, F. (2017, January 22\u201329). Photo-Realistic Single Image Super-Resolution Using a Generative Adversial Network. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bousmails, K., Silberman, N., Dohan, D., Erhan, D., and Krishnan, D. (2017, January 22\u201329). Unsupervised pixel-level domain adaptation with generative adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/CVPR.2017.18"},{"key":"ref_21","unstructured":"Arjovsky, M., Chintala, S., and Bottou, L. (2017). Wasserstein GAN. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Mao, X.D., Li, Q., Xie, H.R., Lau, R.Y.K., Wang, Y., and Smol-ley, S.P. (2017, January 22\u201329). Least squares generative adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.304"},{"key":"ref_23","unstructured":"Lecun, Y., and Bengio, Y. (1995). Convolutional Networks for Images, Speech, and Time Series. Handbook of Brain Theory & Neural Networks, MIT Press."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, J.N., Liang, X.D., Wei, Y.C., Xu, T.F., Feng, J.S., and Yan, S.C. (2017, January 21\u201326). Perceptual generative adversarial networks for small object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.211"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Engin, D., Gen\u00e7, A., and Ekenel, H.K. (2018, January 18\u201322). Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00127"},{"key":"ref_26","first-page":"1","article-title":"Texture synthesis method based on generative adversarial networks","volume":"47","author":"Yu","year":"2018","journal-title":"Infrared Laser Eng."},{"key":"ref_27","unstructured":"Hinz, T., Heinrich, S., and Wermter, S. (2019, January 6\u20139). Generating Multiple Objects at Spatially Distinct Locations. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA."},{"key":"ref_28","unstructured":"Ostyakov, P., Suvorov, R., Logacheva, E., Khomenko, O., and Nikolenko, S.I. (2018). SEIGAN: Towards Compositional Image Generation by Simultaneously Learning to Segment, Enhance, and Inpaint. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U\u2013Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_30","unstructured":"Kim, T., Cha, M., Kim, H., Lee, J.K., and Kim, J. (2017, January 6\u201311). Learning to discover cross-domain relations with generative adversarial networks. Proceedings of the International Conference on Machine Learning, Sydney, NSW, Australia."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yi, Z., Zhang, H., Tan, P., and Gong, M. (2017, January 22\u201329). Dualgan: Unsupervised dual learning for image-to-image translation. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.310"},{"key":"ref_32","unstructured":"Justin, J., Alexandre, A., and Li, F.F. (2016, January 8\u201316). Perceptual Losses for Real-Time Style Transfer and Super-Resolution. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kaneko, T., Hiramatsu, K., and Kashino, K. (2017, January 22\u201325). Generative Attribute Controller with Conditional Filtered Generative Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.741"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Wang, X.L., and Gupta, A. (2016, January 8\u201316). Generative Image Modeling using Style and Structure Adversarial Networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46493-0_20"},{"key":"ref_35","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegan, NV, USA."},{"key":"ref_36","unstructured":"Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2016). Instance Normalization: The Missing Ingredient for Fast Stylization. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kudo, Y., and Aoki, Y. (2017, January 8\u201312). Dilated convolutions for image classification and object localization. Proceedings of the international conference on Machine Vision Applications, Nagoya, Japan.","DOI":"10.23919\/MVA.2017.7986898"},{"key":"ref_38","unstructured":"Yu, F., and Koltun, V. (2015). Multi-Scale Context Aggregation by Dilated Convolutions. arXiv."},{"key":"ref_39","unstructured":"Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., and Chen, X. (2016, January 5\u201310). Improved techniques for training gans. Proceedings of the 30th Conference on Advances in Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_40","unstructured":"Liu, M., and Tuzel, O. (2016). Coupled Generative Adversarial Networks. arXiv."},{"key":"ref_41","first-page":"151","article-title":"Incident and traffic-bottle-neck detection algorithm in high-resolution remote sensing imagery","volume":"6","author":"Kahaki","year":"2012","journal-title":"ITB J. Inf. Commun. Technol."},{"key":"ref_42","unstructured":"Kahaki, S.M.M., Fathy, M., and Ganj, M. (2009, January 4\u20135). Road-Following and Traffic Analysis using High-Resolution Remote Sensing Imagery. Proceedings of the 3rd International Workshop on Intelligent Vehicle Controls and Intelligent Transportation Systems Held in Conjunction with ICINCO 2009, Milan, Italy."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Kahaki, S.M.M., Nordin, J., and Ashtari, A.H. (2011, January 17\u201319). Incident detection algorithm based on radon transform using high-resolution remote sensing imagery. Proceedings of the IEEE 2011 International Conference on Electrical Engineering and Informatics (ICEEI), Bandung, Indonesia.","DOI":"10.1109\/ICEEI.2011.6021622"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"642","DOI":"10.5626\/JOK.2015.42.5.642","article-title":"A Vanishing Point Detection Method Based on the Empirical Weighting of the Lines of Artificial Structures","volume":"42","author":"Kim","year":"2015","journal-title":"J. KIISE"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., and Zitnick, C.L. (2014, January 6\u201312). Microsoft COCO: Common Objects in Context. European Conference on Computer Vision. Proceedings of the European Conference on Computer, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_46","unstructured":"(2017). Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsing. arXiv."},{"key":"ref_47","unstructured":"Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv."},{"key":"ref_48","unstructured":"Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., and Hochreiter, S. (2018). GAN strained by a two time-scale update rule converge to a local Nash equilibrium. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Chen, Q., and Koltun, V. (2017, January 22\u201329). Photographic image synthesis with cascaded refinement networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.168"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/14\/3075\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:04:50Z","timestamp":1760187890000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/14\/3075"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,11]]},"references-count":50,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2019,7]]}},"alternative-id":["s19143075"],"URL":"https:\/\/doi.org\/10.3390\/s19143075","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,11]]}}}