{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T21:32:40Z","timestamp":1769549560630,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,29]],"date-time":"2022-12-29T00:00:00Z","timestamp":1672272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51975468"],"award-info":[{"award-number":["51975468"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Research on coal foreign object detection based on deep learning is of great significance to safe, efficient, and green production of coal mines. However, the foreign object image dataset is scarce due to collection conditions, which brings an enormous challenge to coal foreign object detection. To achieve augmentation of foreign object datasets, a high-quality coal foreign object image generation method based on improved StyleGAN is proposed. Firstly, the dual self-attention module is introduced into the generator to strengthen the long-distance dependence of features between spatial and channel, refine the details of the generated images, accurately distinguish the front background information, and improve the quality of the generated images. Secondly, the depthwise separable convolution is introduced into the discriminator to solve the problem of low efficiency caused by the large number of parameters of multi-stage convolutional networks, to realize the lightweight model, and to accelerate the training speed. Experimental results show that the improved model has significant advantages over several classical GANS and original StyleGAN in terms of quality and diversity of the generated images, with an average improvement of 2.52 in IS and a decrease of 5.80 in FID for each category. As for the model complexity, the parameters and training time of the improved model are reduced to 44.6% and 58.8% of the original model without affecting the generated images quality. Finally, the results of applying different data augmentation methods to the foreign object detection task show that our image generation method is more effective than the traditional methods, and that, under the optimal conditions, it improves APbox by 5.8% and APmask by 4.5%.<\/jats:p>","DOI":"10.3390\/s23010374","type":"journal-article","created":{"date-parts":[[2022,12,30]],"date-time":"2022-12-30T03:19:46Z","timestamp":1672370386000},"page":"374","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD"],"prefix":"10.3390","volume":"23","author":[{"given":"Xiangang","family":"Cao","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Xi\u2019an University of Science and Technology, Xi\u2019an 710054, China"},{"name":"Shaanxi Provincial Key Laboratory of Intelligent Testing of Mine Mechanical and Electrical Equipment, Xi\u2019an 710054, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3846-3206","authenticated-orcid":false,"given":"Hengyang","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Xi\u2019an University of Science and Technology, Xi\u2019an 710054, China"},{"name":"Shaanxi Provincial Key Laboratory of Intelligent Testing of Mine Mechanical and Electrical Equipment, Xi\u2019an 710054, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5134-3287","authenticated-orcid":false,"given":"Peng","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Xi\u2019an University of Science and Technology, Xi\u2019an 710054, China"},{"name":"Shaanxi Provincial Key Laboratory of Intelligent Testing of Mine Mechanical and Electrical Equipment, Xi\u2019an 710054, China"}]},{"given":"Chiyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Xi\u2019an University of Science and Technology, Xi\u2019an 710054, China"},{"name":"Shaanxi Provincial Key Laboratory of Intelligent Testing of Mine Mechanical and Electrical Equipment, Xi\u2019an 710054, China"}]},{"given":"Shikai","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Xi\u2019an University of Science and Technology, Xi\u2019an 710054, China"},{"name":"Shaanxi Provincial Key Laboratory of Intelligent Testing of Mine Mechanical and Electrical Equipment, Xi\u2019an 710054, China"}]},{"given":"Hu","family":"Li","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Xi\u2019an University of Science and Technology, Xi\u2019an 710054, China"},{"name":"Shaanxi Provincial Key Laboratory of Intelligent Testing of Mine Mechanical and Electrical Equipment, Xi\u2019an 710054, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,29]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"Research on coal safety range and green low-carbon technology path under the dual-carbon background","volume":"47","author":"Liu","year":"2022","journal-title":"J. China Coal Soc."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kiseleva, T.V., Mikhailov, V.G., and Karasev, V.A. (2016, January 7\u201310). Management of local economic and ecological system of coal processing company. Proceedings of the IOP Conference Series: Earth and Environmental Science, Novokuznetsk, Russia.","DOI":"10.1088\/1755-1315\/45\/1\/012013"},{"key":"ref_3","first-page":"1","article-title":"Current technological innovation and development direction of the 14th five-year plan period in China coal industry","volume":"46","author":"Liu","year":"2021","journal-title":"J. China Coal Soc."},{"key":"ref_4","first-page":"237","article-title":"Research on coal gangue identification and positioning system based on coal-gangue sorting robot","volume":"50","author":"Cao","year":"2022","journal-title":"Coal Sci. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, Y., Wang, Y., and Dang, L. (2020). Video detection of foreign objects on the surface of belt conveyor underground coal mine based on improved SSD. J. Ambient Intell. Humaniz. Comput., 1\u201310.","DOI":"10.1007\/s12652-020-02495-w"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"Shorten","year":"2019","journal-title":"J. Big Data"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"104242","DOI":"10.1016\/j.engappai.2021.104242","article-title":"Computer vision detection of foreign objects in coal processing using attention CNN","volume":"102","author":"Zhang","year":"2021","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_8","first-page":"4147","article-title":"Foreign object detection in coal mine conveyor belt based on CBAM-YOLOv5","volume":"47","author":"Hao","year":"2022","journal-title":"J. China Coal Soc."},{"key":"ref_9","unstructured":"Zhong, Z., Zheng, L., and Kang, G. (2020, January 7\u201312). Random erasing data augmentation. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"58774","DOI":"10.1109\/ACCESS.2018.2872698","article-title":"Understanding mixup training methods","volume":"6","author":"Liang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_11","unstructured":"Hu, J., Gao, Y., Zhang, H.J., and Jin, B.Q. (2021). Research on the identification method of non-coal foreign object of belt convey or based on deep learning. Ind. Mine Autom., 47."},{"key":"ref_12","first-page":"1149","article-title":"Study on illuminance adjustment method for image-based coal and gangue separation","volume":"46","author":"Li","year":"2021","journal-title":"J. China Coal Soc."},{"key":"ref_13","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative adversarialnets. Proceedings of the 27th International Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_14","unstructured":"Arjovsky, M., Chintala, S., and Bottou, L. (2017, January 6\u201311). Wasserstein generative adversarial networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_15","unstructured":"Gulrajani, I., Ahmed, F., and Arjovsky, M. (2017, January 4\u20139). Improved training of Wasserstein GANs. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_16","unstructured":"Radford, A., Metz, L., and Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv."},{"key":"ref_17","unstructured":"Brock, A., Donahue, J., and Simonyan, K. (2018). Large scale GAN training for high fidelity natural image synthesis. arXiv."},{"key":"ref_18","unstructured":"Karras, T., Aila, T., Laine, S., and Lehtinen, J. (May, January 30). Progressive growing of GANs for improved quality, stability, and variation. Proceedings of the International Conference on Learning Representations (ICLR), Vancouver, BC, Canada."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Shi, Z., Sang, M., and Huang, Y. (2022). Defect detection of MEMS based on data augmentation, WGAN-DIV-DC, and a YOLOv5 model. Sensors, 22.","DOI":"10.3390\/s22239400"},{"key":"ref_20","first-page":"137","article-title":"Multi-angle facial expression recognition algorithm combined with dual-channel WGAN-GP","volume":"59","author":"Deng","year":"2022","journal-title":"Laser Optoelectron. Prog."},{"key":"ref_21","first-page":"3066","article-title":"Generative adversarial networks based sample generation of coal and rock images","volume":"46","author":"Wang","year":"2021","journal-title":"J. China Coal Soc."},{"key":"ref_22","unstructured":"Wang, L., Wang, X., and Li, B. (2022). A data expansion strategy for improving coal-gangue detection. Int. J. Coal Prep. Util., 1\u201319."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Karras, T., Laine, S., and Aila, T. (2019, January 16\u201320). A style-based generator architecture for generative adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00453"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"125385","DOI":"10.1016\/j.conbuildmat.2021.125385","article-title":"A multi-defect detection system for sewer pipelines based on StyleGAN-SDM and fusion CNN","volume":"312","author":"Ma","year":"2021","journal-title":"Constr. Build. Mater."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"13857","DOI":"10.1109\/ACCESS.2021.3051723","article-title":"StyleGAN-LSRO method for person re-identification","volume":"9","author":"Hussin","year":"2021","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"106779","DOI":"10.1016\/j.compag.2022.106779","article-title":"FWDGAN-based data augmentation for tomato leaf disease identification","volume":"194","author":"Li","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_27","unstructured":"Zhang, H., Goodfellow, I., Metaxas, D., and Odena, A. (2019, January 9\u201315). Self-attention generative adversarial networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yang, Y., Sun, L., and Mao, X. (2022). Data augmentation based on generative adversarial network with mixed attention mechanism. Electronics, 11.","DOI":"10.3390\/electronics11111718"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Fu, J., Liu, J., and Tian, H. (2019, January 16\u201320). Dual attention network for scene segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00326"},{"key":"ref_30","unstructured":"Howard, A.G., Zhu, M., and Chen, B. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_31","first-page":"6629","article-title":"GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium","volume":"Volume 30","author":"Heusel","year":"2017","journal-title":"Advances in Neural Information Processing Systems (NeurIPS)"},{"key":"ref_32","unstructured":"Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., and Chen, X. (2016, January 5\u201310). Improved Techniques for Training GANs. Proceedings of the Advances in Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Chen, H., Sun, K., Tian, Z., Shen, C., and Yan, Y. (2020, January 13\u201319). Blendmask: Top-down meets bottom-up for instance segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00860"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/374\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:55:38Z","timestamp":1760147738000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/374"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,29]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23010374"],"URL":"https:\/\/doi.org\/10.3390\/s23010374","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,29]]}}}