{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:00:47Z","timestamp":1760230847670,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2022,8,16]],"date-time":"2022-08-16T00:00:00Z","timestamp":1660608000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004826","name":"Beijing Natural Science Foundation","doi-asserted-by":"publisher","award":["8202013","41771413"],"award-info":[{"award-number":["8202013","41771413"]}],"id":[{"id":"10.13039\/501100004826","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["8202013","41771413"],"award-info":[{"award-number":["8202013","41771413"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Image style transfer is a challenging problem in computer vision which aims at rendering an image into different styles. A lot of progress has been made to transfer the style of one painting of a representative artist in real time, whereas less attention has been focused on transferring an artist\u2019s style from a collection of his paintings. This task requests capturing the artist\u2019s precise style from his painting collection. Existing methods did not pay more attention on the possible disruption of original content details and image structures by texture elements and noises, which leads to the structure deformation or edge blurring of the generated images. To address this problem, we propose IFFMStyle, a high-quality image style transfer framework. Specifically, we introduce invalid feature filtering modules (IFFM) to the encoder\u2013decoder architecture to filter the content-independent features in the original image and the generated image. Then, the content-consistency constraint is used to enhance the model\u2019s content-preserving capability. We also introduce style perception consistency loss to jointly train a network with content loss and adversarial loss to maintain the distinction of different semantic content in the generated image. Additionally, we have no requirement for paired content image and style image. The experimental results show that the stylized image generated by the proposed method significantly improves the quality of the generated images, and can realize the style transfer based on the semantic information of the content image. Compared with the advanced method, our method is more favored by users.<\/jats:p>","DOI":"10.3390\/s22166134","type":"journal-article","created":{"date-parts":[[2022,8,17]],"date-time":"2022-08-17T03:15:27Z","timestamp":1660706127000},"page":"6134","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["IFFMStyle: High-Quality Image Style Transfer Using Invalid Feature Filter Modules"],"prefix":"10.3390","volume":"22","author":[{"given":"Zhijie","family":"Xu","sequence":"first","affiliation":[{"name":"School of Science, Beijing University of Civil Engineering and Architecture, Beijing 102616, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9995-9729","authenticated-orcid":false,"given":"Liyan","family":"Hou","sequence":"additional","affiliation":[{"name":"School of Science, Beijing University of Civil Engineering and Architecture, Beijing 102616, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianqin","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 102616, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Gatys, L.A., Ecker, A.S., and Bethge, M. (2016, January 27\u201330). Image style transfer using convolutional neural networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.265"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Johnson, J., Alahi, A., and Li, F.-F. (2016, January 8\u201316). Perceptual losses for real-time style transfer and super-resolution. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"ref_3","unstructured":"Ulyanov, D., Lebedev, V., Vedaldi, A., and Lempitsky, V. (2016). Texture Networks: Feed-forward Synthesis of Textures and Stylized Images. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2017). Improved texture networks: Maximizing quality and diversity in feed-forward stylization and texture synthesis. arXiv.","DOI":"10.1109\/CVPR.2017.437"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chen, D., Yuan, L., Liao, J., Yu, N., and Hua, G. (2017, January 21\u201326). Stylebank: An explicit representation for neural image style transfer. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.296"},{"key":"ref_6","unstructured":"Dumoulin, V., Shlens, J., and Kudlur, M. (2016, January 2\u20134). A learned representation for artistic style. Proceedings of the International Conference on Learning Representations, San Juan, Puerto Rico."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Huang, X., and Belongie, S. (2017, January 22\u201329). Arbitrary style transfer in real-time with adaptive instance normalization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.167"},{"key":"ref_8","unstructured":"Li, Y., Fang, C., Yang, J., Wang, Z., Lu, X., and Yang, M.-H. (2017). Universal Style Transfer via Feature Transforms. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Park, D.Y., and Lee, K.H. (2018). Arbitrary Style Transfer with Style-Attentional Networks. arXiv.","DOI":"10.1109\/CVPR.2019.00603"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sheng, L., Lin, Z., Shao, J., and Wang, X. (2018, January 18\u201323). Avatar-net: Multi-scale zero-shot style transfer by feature decoration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00860"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.neucom.2020.04.027","article-title":"Semantic-Related Image Style Transfer with Dual-Consistency Loss","volume":"406","author":"Ma","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sanakoye, A., Kotovenko, D., Lang, S., and Ommer, B. (2018, January 8\u201314). A style-aware content loss for real-time hd style transfer. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01237-3_43"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, ICCV, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gooch, B., and Gooch, A. (2001). Non-Photorealistic Rendering, A. K. Peters, Ltd.","DOI":"10.1201\/9781439864173"},{"key":"ref_15","unstructured":"Strothotte, T., and Schlechtweg, S. (2002). Non-Photorealistic Computer Graphics: Modeling, Rendering, and Animation, Morgan Kaufmann."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, S., Xu, X., Nie, L., and Chua, T.S. (2017, January 23\u201327). Laplacian-steered neural style transfer. Proceedings of the 2017 ACM on Multimedia Conference, ACM, Mountain View, CA, USA.","DOI":"10.1145\/3123266.3123425"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, Y., Wang, N., Liu, J., and Hou, X. (2017, January 19\u201325). Demystifying neural style transfer. Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, Melbourne, Australia.","DOI":"10.24963\/ijcai.2017\/310"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Li, C., and Wand, M. (2016, January 27\u201330). Combining markov random fields and convolutional neural networks for image synthesis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.272"},{"key":"ref_19","first-page":"2672","article-title":"Generative Adversarial Networks","volume":"3","author":"Goodfellow","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_20","unstructured":"Chen, T., Kornblith, S., Norouzi, M., and Hinton, G. (2020). A Simple Framework for Contrastive Learning of Visual Representations. arXiv."},{"key":"ref_21","unstructured":"Chen, T., Kornblith, S., Swersky, K., Norouzi, M., and Hinton, G. (2020). Big Self-Supervised Models are Strong Semi-Supervised Learners. arXiv."},{"key":"ref_22","unstructured":"Chen, X., Fan, H., Girshick, R., and He, K. (2020). Improved Baselines with Momentum Contrastive Learning. arXiv, Available online: https:\/\/arxiv.org\/pdf\/2003.04297v1.pdf."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chen, X., and He, K. (2021). Exploring Simple Siamese Representation Learning. arXiv.","DOI":"10.1109\/CVPR46437.2021.01549"},{"key":"ref_24","unstructured":"Ding, X., Zhang, X., Han, J., and Ding, J. (2021). RepMLP: Re-parameterizing Convolutions into Fully-connected Layers for Image Recognition. arXiv, Available online: https:\/\/arxiv.org\/pdf\/2105.01883v1.pdf."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Guo, M.H., Liu, Z.N., Mu, T.J., and Hu, S.M. (2021). Beyond Self-attention: External Attention using Two Linear Layers for Visual Tasks. arXiv, Available online: https:\/\/arxiv.org\/pdf\/2105.02358v1.pdf.","DOI":"10.1109\/TPAMI.2022.3211006"},{"key":"ref_26","unstructured":"Luke, M.K. (2021). Do You Even Need Attention? A Stack of Feed-Forward Layers Does Surprisingly Well on ImageNet. arXiv, Available online: https:\/\/arxiv.org\/pdf\/2105.02723v1.pdf."},{"key":"ref_27","unstructured":"Tolstikhin, I., Houlsby, N., Kolesnikov, A., Beyer, L., Zhai, X., Unterthiner, T., Yung, J., Steiner, A., Keysers, D., and Uszkoreit, J. (2021). MLP-Mixer: An all-MLP Architecture for Vision. arXiv, Available online: https:\/\/arxiv.org\/abs\/2105.01601."},{"key":"ref_28","unstructured":"Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2016). Instance normalization: The missing ingredient for fast stylization. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_30","unstructured":"Kingma, D.P., and Ba, J. (2015). Adam: A method for stochastic optimization, in international Conference on Learning Representations. arXiv."},{"key":"ref_31","unstructured":"Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., and Oliva, A. (2014). Learning deep features for scene recognition using places database. Advances in Neural Information Processing Systems, Morgan Kaufmann Publishers. Available online: http:\/\/places.csail.mit.edu."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Karayev, S., Trentacoste, M., Han, H., Agarwala, A., Darrell, T., Hertzmann, A., and Winnemoeller, H. (2013). Recognizing image style. arXiv.","DOI":"10.5244\/C.28.122"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/16\/6134\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:10:39Z","timestamp":1760141439000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/16\/6134"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,16]]},"references-count":32,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22166134"],"URL":"https:\/\/doi.org\/10.3390\/s22166134","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,8,16]]}}}