{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T13:09:41Z","timestamp":1771679381864,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2020,8,28]],"date-time":"2020-08-28T00:00:00Z","timestamp":1598572800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>The deep-learning steganography of current hotspots can conceal an image secret message in a cover image of the same size. While the steganography secret message is primarily removed via active steganalysis. The document image as the secret message in deep-learning steganography can deliver a considerable amount of effective information in a secret communication process. This study builds and implements deep-learning steganography removal models of document image secret messages based on the idea of adversarial perturbation removal: feed-forward denoising convolutional neural networks (DnCNN) and high-level representation guided denoiser (HGD). Further\u2014considering the large computation cost and storage overheads of the above model\u2014we use the document image-quality assessment (DIQA) as threshold, calculate the importance of filters using geometric median and prune redundant filters as extensively as possible through the overall iterative pruning and artificial bee colony (ABC) automatic pruning algorithms to reduce the size of the network structure of the existing vast and over-parameterized deep-learning steganography removal model, while maintaining the good removal effects of the model in the pruning process. Experiment results showed that the model generated by this method has better adaptability and scalability. Compared with the original deep-learning steganography removal model without pruning in this paper, the classic indicators params and flops are reduced by more than 75%.<\/jats:p>","DOI":"10.3390\/sym12091426","type":"journal-article","created":{"date-parts":[[2020,8,28]],"date-time":"2020-08-28T10:23:08Z","timestamp":1598610188000},"page":"1426","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Deep-Learning Steganalysis for Removing Document Images on the Basis of Geometric Median Pruning"],"prefix":"10.3390","volume":"12","author":[{"given":"Shangping","family":"Zhong","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, Fuzhou University, Fuzhou 350100, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5213-0024","authenticated-orcid":false,"given":"Wude","family":"Weng","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Fuzhou University, Fuzhou 350100, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2859-8924","authenticated-orcid":false,"given":"Kaizhi","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Fuzhou University, Fuzhou 350100, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianhua","family":"Lai","sequence":"additional","affiliation":[{"name":"Fujian Institute of Scientific and Technological Information, Fuzhou 350003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,28]]},"reference":[{"key":"ref_1","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Neural Information Processing Systems 25 (NIPS), Curran Associates Inc."},{"key":"ref_2","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 26\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_5","unstructured":"Baluja, S. (2017). Hiding Images in Plain Sight: Deep Steganography. Neural Information Processing Systems (NIPS), Curran Associates Inc."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wu, P., Yang, Y., and Li, X. (2018). StegNet: Mega Image Steganography Capacity with Deep Convolutional Network. Future Internet, 10.","DOI":"10.3390\/fi10060054"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhang, R., Dong, S., and Liu, J. (2018). Invisible Steganography via Generative Adversarial Networks. Multimed. Tools Appl.","DOI":"10.1007\/s11042-018-6951-z"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1109\/MWC.001.1900440","article-title":"Trust2Privacy: A Novel Fuzzy Trust-to-Privacy Mechanism for Mobile Social Networks","volume":"27","author":"Xu","year":"2020","journal-title":"IEEE Wirel. Commun."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Hor\u00e9, A., and Ziou, D. (2010, January 23\u201326). Image Quality Metrics: PSNR vs. SSIM. Proceedings of the 20th International Conference on Pattern Recognition (ICPR), Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kang, L., Ye, P., Li, Y., and Doermann, D. (2014, January 27\u201330). A deep learning approach to document image quality assessment. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.","DOI":"10.1109\/ICIP.2014.7025520"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Johnson, N.F., and Jajodia, S. (1998). Steganalysis of Images Created Using Current Steganography Software. International Workshop on Information Hiding, Springer.","DOI":"10.1007\/3-540-49380-8_19"},{"key":"ref_12","unstructured":"Jung, D., Bae, H., Choi, H.S., and Yoon, S. (2019). PixelSteganalysis: Pixel-wise Hidden Information Removal with Low Visual Degradation. arXiv."},{"key":"ref_13","unstructured":"Oord, A.V.D., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., and Kavukcuoglu, K. (2016, January 5\u201310). Conditional Image Generation with PixelCNN Decoders. Proceedings of the 30th International Conference on Neural Information Processing, Barcelona, Spain."},{"key":"ref_14","unstructured":"Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., and Fergus, R. (2014, January 14\u201316). ntriguing properties of neural networks. Proceedings of the International Conference on Learning Representations (ICLR), Banff, AB, Canada."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Jia, X., Wei, X., Cao, X., and Foroosh, H. (2019, January 15\u201320). ComDefend: An Efficient Image Compression Model to Defend Adversarial Examples. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00624"},{"key":"ref_16","unstructured":"Lei, B.J., and Caurana, R. (2014, January 8\u201311). Do Deep Nets Really Need to be Deep?. Proceedings of the Neural Information Processing Systems (NIPS), Montreal, QC, Canada."},{"key":"ref_17","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv."},{"key":"ref_18","unstructured":"Cun, Y.L., Denker, J.S., and Solla, S.A. (1990). Optimal brain damage. Neural Information Processing Systems (NIPS), Curran Associates Inc."},{"key":"ref_19","unstructured":"Liu, Z., Sun, M., Zhou, T., Huang, G., and Darrell, T. (May, January 30). Rethinking the Value of Network Pruning. Proceedings of the International Conference on Learning Representations (ICLR), Vancouver, BC, Canada."},{"key":"ref_20","unstructured":"Han, S., Pool, J., Tran, J., and Dally, W.J. (2015). Learning both Weights and Connections for Efficient Neural Networks. Neural Information Processing Systems (NIPS), Curran Associates Inc."},{"key":"ref_21","unstructured":"Han, S., Mao, H., and Dally, W.J. (2016, January 2\u20134). Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding. Proceedings of the International Conference on Learning Representations (ICLR), San Juan, Puerto Rico."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fridrich, J., Goljan, M., and Hogea, D. (2002). Steganalysis of JPEG Images: Breaking the F5 Algorithm. 5th International Workshop on Information Hiding, Springer.","DOI":"10.1007\/3-540-36415-3_20"},{"key":"ref_23","first-page":"VI-97","article-title":"Noise Features for Image Tampering Detection and Steganalysis","volume":"6","author":"Gou","year":"2007","journal-title":"IEEE Int. Conf. Image Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"574","DOI":"10.14429\/dsj.66.10797","article-title":"On the Removal of Steganographic Content from Images","volume":"66","author":"Amritha","year":"2016","journal-title":"Def. Ence J."},{"key":"ref_25","unstructured":"Corley, I., Lwowski, J., and Hoffman, J. (2019). Destruction of Image Steganography using Generative Adversarial Networks. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3142","DOI":"10.1109\/TIP.2017.2662206","article-title":"Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","unstructured":"Song, Y., Kim, T., Nowozin, S., Ermon, S., and Kushman, N. (2017). PixelDefend: Leveraging Generative Models to Understand and Defend against Adversarial Examples. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Liao, F., Liang, M., Dong, Y., Pang, T., Hu, X., and Zhu, J. (2017). Defense against Adversarial Attacks Using High-Level Representation Guided Denoiser. arXiv.","DOI":"10.1109\/CVPR.2018.00191"},{"key":"ref_29","unstructured":"Li, H., Kadav, A., Durdanovic, I., Samet, H., and Graf, H.P. (2016, January 2\u20134). Pruning Filters for Efficient ConvNets. Proceedings of the International Conference on Learning Representations (ICLR), San Juan, Puerto Rico."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"He, Y., Kang, G., Dong, X., Fu, Y., and Yang, Y. (2018, January 13\u201319). Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI), Stockholm, Sweden.","DOI":"10.24963\/ijcai.2018\/309"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"He, Y., Liu, P., Wang, Z., Hu, Z., and Yang, Y. (2019, January 16\u201320). Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00447"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chen, J., Zhu, Z., and Li, C. (2019). Self-Adaptive Network Pruning. arXiv.","DOI":"10.1007\/978-3-030-36708-4_15"},{"key":"ref_33","unstructured":"Madaan, D., Shin, J., and Hwang, S.J. (2020). Adversarial Neural Pruning with Latent Vulnerability Suppression. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Luo, J.-H., Wu, J., and Lin, W. (2017, January 22\u201329). ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.541"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, Y., Zhang, X., and Sun, J. (2017, January 22\u201329). Channel Pruning for Accelerating Very Deep Neural Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.155"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Yu, R., Li, A., Chen, C.-F., Lai, J.-H., Morariu, V.I., Han, X., Gao, M., Lin, C.-Y., and Davis, L.S. (2018, January 18\u201323). NISP: Pruning Networks using Neuron Importance Score Propagation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00958"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., and Zhang, C. (2017). Learning Efficient Convolutional Networks through Network Slimming. IEEE International Conference on Computer Vision (ICCV), IEEE.","DOI":"10.1109\/ICCV.2017.298"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Huang, Z., and Wang, N. (2018, January 8\u201314). Data-Driven Sparse Structure Selection for Deep Neural Networks. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01270-0_19"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lin, S., Ji, R., Yan, C., Zhang, B., Cao, L., Ye, Q., Huang, F., and Doermann, D. (2019, January 16\u201320). Towards Optimal Structured CNN Pruning via Generative Adversarial Learning. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00290"},{"key":"ref_40","unstructured":"Zhao, K., Zhang, X.-Y., Han, Q., and Cheng, M.-M. (2020). Dependency Aware Filter Pruning. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Guerra, L., Zhuang, B., Reid, I., and Drummond, T. (2020). Automatic Pruning for Quantized Neural Network. arXiv.","DOI":"10.1109\/DICTA52665.2021.9647074"},{"key":"ref_42","unstructured":"Dong, X., and Yang, Y. (2019). Network Pruning via Transformable Architecture Search. Advances in Neural Information Processing Systems, Curran Associates Inc."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Liu, N., Ma, X., Xu, Z., Wang, Y., and Ye, J. (2020). AutoCompress: An Automatic DNN Structured Pruning Framework for Ultra-High Compression Rates. AAAI.","DOI":"10.1609\/aaai.v34i04.5924"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Lin, M., Ji, R., Zhang, Y., Zhang, B., Wu, Y., and Tian, Y. (2020). Channel Pruning via Automatic Structure Search. IJCAI.","DOI":"10.24963\/ijcai.2020\/94"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P.A. (2008, January 5\u20139). Extracting and composing robust features with denoising autoencoders. Proceedings of the International Conference on Machine Learning, Helsinki, Finland.","DOI":"10.1145\/1390156.1390294"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_47","unstructured":"Gou, J., Yu, B., Maybank, S.J., and Tao, D. (2020, January 16\u201318). Knowledge Distillation: A Survey. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, DC, USA."},{"key":"ref_48","unstructured":"Zhou, G., Xu, G., Hao, J., Chen, S., Xu, J., and Zheng, X. (2019). Generalized Centered 2-D Principal Component Analysis. IEEE Trans. Cybern., 1\u201312."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/9\/1426\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:04:02Z","timestamp":1760177042000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/9\/1426"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,28]]},"references-count":48,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["sym12091426"],"URL":"https:\/\/doi.org\/10.3390\/sym12091426","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,28]]}}}