{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T18:18:58Z","timestamp":1772907538469,"version":"3.50.1"},"reference-count":70,"publisher":"Association for Computing Machinery (ACM)","issue":"7","license":[{"start":{"date-parts":[[2024,5,16]],"date-time":"2024-05-16T00:00:00Z","timestamp":1715817600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2021YFF0900500"],"award-info":[{"award-number":["2021YFF0900500"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62302128 and 62272128"],"award-info":[{"award-number":["62302128 and 62272128"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2024,7,31]]},"abstract":"<jats:p>Existing image compressed sensing (CS) coding frameworks usually solve an inverse problem based on measurement coding and optimization-based image reconstruction, which still exist the following two challenges: (1) the widely used random sampling matrix, such as the Gaussian Random Matrix (GRM), usually leads to low measurement coding efficiency, and (2) the optimization-based reconstruction methods generally maintain a much higher computational complexity. In this article, we propose a new convolutional neural network based image CS coding framework using local structural sampling (dubbed CSCNet) that includes three functional modules: local structural sampling, measurement coding, and Laplacian pyramid reconstruction. In the proposed framework, instead of GRM, a new local structural sampling matrix is first developed, which is able to enhance the correlation between the measurements through a local perceptual sampling strategy. Besides, the designed local structural sampling matrix can be jointly optimized with the other functional modules during the training process. After sampling, the measurements with high correlations are produced, which are then coded into final bitstreams by the third-party image codec. Last, a Laplacian pyramid reconstruction network is proposed to efficiently recover the target image from the measurement domain to the image domain. Extensive experimental results demonstrate that the proposed scheme outperforms the existing state-of-the-art CS coding methods while maintaining fast computational speed.<\/jats:p>","DOI":"10.1145\/3649441","type":"journal-article","created":{"date-parts":[[2024,2,26]],"date-time":"2024-02-26T12:35:33Z","timestamp":1708950933000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Deep Network for Image Compressed Sensing Coding Using Local Structural Sampling"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8656-0954","authenticated-orcid":false,"given":"Wenxue","family":"Cui","sequence":"first","affiliation":[{"name":"Department of Computer Science and Technology, Harbin Institute of Technology, Harbin, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5763-2493","authenticated-orcid":false,"given":"Xingtao","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Harbin Institute of Technology, Harbin, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9660-3636","authenticated-orcid":false,"given":"Xiaopeng","family":"Fan","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Harbin Institute of Technology, Harbin, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1810-5412","authenticated-orcid":false,"given":"Shaohui","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Harbin Institute of Technology, Harbin, China and Peng Cheng Laboratory, Shenzhen, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-7399-601X","authenticated-orcid":false,"given":"Xinwei","family":"Gao","sequence":"additional","affiliation":[{"name":"Wechat Business Group, Shenzhen, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3434-9967","authenticated-orcid":false,"given":"Debin","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Harbin Institute of Technology, Harbin, China and Peng Cheng Laboratory, Shenzhen, China"}]}],"member":"320","published-online":{"date-parts":[[2024,5,16]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00031"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2007.914731"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2022.3195319"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2021.3058615"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2774004"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2019.2898908"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2019.2953383"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240508.3240706"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1002\/cpa.20042"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2016.2587398"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2013.6738003"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2329449"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2006.871582"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2007.914730"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/2818712"},{"key":"e_1_3_2_17_2","unstructured":"Mark Everingham and John Winn. 2011. The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Development Kit. Retrieved March 5 2024 from http:\/\/host.robots.ox.ac.uk\/pascal\/VOC\/voc2012\/htmldoc\/index.html"},{"key":"e_1_3_2_18_2","article-title":"Block compressed sensing of natural images","author":"Gan Lu","year":"2007","unstructured":"Lu Gan. 2007. Block compressed sensing of natural images. In Proceedings of the International Conference on Digital Signal Processing. 403\u2013406.","journal-title":"Proceedings of the International Conference on Digital Signal Processing."},{"key":"e_1_3_2_19_2","article-title":"Block-based compressive sensing coding of natural images by local structural measurement matrix","author":"Gao Xinwei","year":"2015","unstructured":"Xinwei Gao, Jian Zhang, Wenbin Che, Xiaopeng Fan, and Debin Zhao. 2015. Block-based compressive sensing coding of natural images by local structural measurement matrix. In Proceedings of the IEEE Data Compression Conference (DCC \u201915). 133\u2013142.","journal-title":"Proceedings of the IEEE Data Compression Conference (DCC \u201915)."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2023.3240862"},{"key":"e_1_3_2_21_2","article-title":"Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification","author":"He Kaiming","year":"2015","unstructured":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. In Proceedings of the IEEE International Conference on Computer Vision (ICCV \u201915). 1026\u20131034.","journal-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV \u201915)."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2013.6738433"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2010.2093310"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/JETCAS.2018.2886642"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2017.2734838"},{"key":"e_1_3_2_26_2","unstructured":"C. Li W. Yin and Y. Zhang. 2013. TVAL3: TV Minimization by Augmented Lagrangian and Alternating Direction Algorithms. Retrieved March 5 2024 from https:\/\/nuit-blanch\/blogspot.com\/2009\/06\/cs-tval3-tv-minimization-by-augmented.html"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2020.2985225"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2020.2983926"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2872876"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2017.2727682"},{"issue":"4","key":"e_1_3_2_31_2","first-page":"1","article-title":"Image encryption based on compressive sensing and scrambled index for secure multimedia transmission","volume":"12","author":"Li Yinghua","year":"2016","unstructured":"Yinghua Li, Bin Song, Rong Cao, Yue Zhang, and Hao Qin. 2016. Image encryption based on compressive sensing and scrambled index for secure multimedia transmission. ACM Transactions on Multimedia Computing, Communications, and Applications 12, 4s (2016), 1\u201322.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2018.2884203"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2554320"},{"key":"e_1_3_2_34_2","first-page":"1","article-title":"Deep compressive imaging with meta-learning","volume":"72","author":"Liu Zhi","year":"2022","unstructured":"Zhi Liu, Shuyuan Yang, Zhixi Feng, Min Wang, and Zhifan Yu. 2022. Deep compressive imaging with meta-learning. IEEE Transactions on Instrumentation and Measurement 72 (2022), 1\u20139.","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2007.914728"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/78.258082"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2016.2556683"},{"key":"e_1_3_2_38_2","doi-asserted-by":"crossref","DOI":"10.1109\/ALLERTON.2015.7447163","article-title":"A deep learning approach to structured signal recovery","author":"Mousavi Ali","year":"2015","unstructured":"Ali Mousavi, Ankit B. Patel, and Richard G. Baraniuk. 2015. A deep learning approach to structured signal recovery. In Proceedings of the IEEE Allerton Conference on Communication, Control, and Computing (Allerton \u201915). 1336\u20131343.","journal-title":"Proceedings of the IEEE Allerton Conference on Communication, Control, and Computing (Allerton \u201915)."},{"key":"e_1_3_2_39_2","article-title":"DPCM for quantized blockbased compressed sensing of images","author":"Mun Sungkwang","year":"2012","unstructured":"Sungkwang Mun and James E. Fowler. 2012. DPCM for quantized blockbased compressed sensing of images. In Proceedings of the IEEE Signal Processing Conference. 1424\u20131428.","journal-title":"Proceedings of the IEEE Signal Processing Conference."},{"key":"e_1_3_2_40_2","first-page":"12290","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Shi Wuzhen","year":"2019","unstructured":"Wuzhen Shi, Feng Jiang, Shaohui Liu, and Debin Zhao. 2019. Scalable convolutional neural network for image compressed sensing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 12290\u201312299."},{"issue":"1","key":"e_1_3_2_41_2","first-page":"375","article-title":"Image compressed sensing using convolutional neural network","volume":"29","author":"Shi Wuzhen","year":"2020","unstructured":"Wuzhen Shi, Feng Jiang, Shaohui Liu, and Debin Zhao. 2020. Image compressed sensing using convolutional neural network. IEEE Transactions on Image Processing 29, 1 (2020), 375\u2013388.","journal-title":"IEEE Transactions on Image Processing"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2020.2978703"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2023.3246523"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475562"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2221191"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2020.3023629"},{"issue":"8","key":"e_1_3_2_47_2","doi-asserted-by":"crossref","first-page":"5287","DOI":"10.1109\/TIM.2019.2962562","article-title":"Feature-supervised compressed sensing for microwave imaging systems","volume":"69","author":"Tang Chaoqing","year":"2019","unstructured":"Chaoqing Tang, Guiyun Tian, Said Boussakta, and Jianbo Wu. 2019. Feature-supervised compressed sensing for microwave imaging systems. IEEE Transactions on Instrumentation and Measurement 69, 8 (2019), 5287\u20135297.","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/MMSP48831.2020.9287074"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2007.909108"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2021.3102394"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2023.3274967"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2003.815165"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2009.2016892"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/2978570"},{"issue":"5","key":"e_1_3_2_55_2","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1109\/TIM.2013.2292359","article-title":"Compressive blind mixing matrix estimation of audio signals","volume":"63","author":"Xu Hongwei","year":"2014","unstructured":"Hongwei Xu, Ning Fu, Liyan Qiao, Wei Yu, and Xiyuan Peng. 2014. Compressive blind mixing matrix estimation of audio signals. IEEE Transactions on Instrumentation and Measurement 63, 5 (2014), 1253\u20131261.","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"e_1_3_2_56_2","article-title":"LAPRAN: A scalable Laplacian pyramid reconstructive adversarial network for flexible compressive sensing reconstruction","author":"Xu Kai","year":"2018","unstructured":"Kai Xu, Zhikang Zhang, and Fengbo Ren. 2018. LAPRAN: A scalable Laplacian pyramid reconstructive adversarial network for flexible compressive sensing reconstruction. In Proceedings of the European Conference on Computer Vision (ECCV \u201918). 491\u2013507.","journal-title":"Proceedings of the European Conference on Computer Vision (ECCV \u201918)."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2014.2298271"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447431"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2013.2256901"},{"key":"e_1_3_2_60_2","article-title":"DR2-Net: Deep residual reconstruction network for image compressive sensing","author":"Yao Hantao","year":"2017","unstructured":"Hantao Yao, Feng Dai, Dongming Zhang, Yike Ma, Shiliang Zhang, Yongdong Zhang, and Qi Tian. 2017. DR2-Net: Deep residual reconstruction network for image compressive sensing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR \u201917).","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR \u201917)."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2021.3091834"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.2967646"},{"key":"e_1_3_2_63_2","article-title":"ISTA-Net: Interpretable optimization-inspired deep network for image compressive sensing","author":"Zhang Jian","year":"2018","unstructured":"Jian Zhang and Bernard Ghanem. 2018. ISTA-Net: Interpretable optimization-inspired deep network for image compressive sensing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR \u201918). 1828\u20131837.","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR \u201918)."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2020.2977507"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2323127"},{"key":"e_1_3_2_66_2","article-title":"Spatially directional predictive coding for block-based compressive sensing of natural images","author":"Zhang Jian","year":"2013","unstructured":"Jian Zhang, Debin Zhao, and Feng Jiang. 2013. Spatially directional predictive coding for block-based compressive sensing of natural images. In Proceedings of the IEEE International Conference on Image Processing (ICIP \u201913). 1021\u20131025.","journal-title":"Proceedings of the IEEE International Conference on Image Processing (ICIP \u201913)."},{"key":"e_1_3_2_67_2","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1109\/DCC.2012.71","volume-title":"Proceedings of the Data Compression Conference (DCC \u201912)","author":"Zhang Jian","year":"2012","unstructured":"Jian Zhang, Debin Zhao, Chen Zhao, Ruiqin Xiong, Siwei Ma, and Wen Gao. 2012. Compressed sensing recovery via collaborative sparsity. In Proceedings of the Data Compression Conference (DCC \u201912). IEEE, 287\u2013296."},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2020.3044472"},{"key":"e_1_3_2_69_2","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1109\/DCC.2016.104","volume-title":"Proceedings of the 2016 Data Compression Conference (DCC \u201916)","author":"Zhao Chen","year":"2016","unstructured":"Chen Zhao, Jian Zhang, Siwei Ma, and Wen Gao. 2016. Nonconvex lp nuclear norm based ADMM framework for compressed sensing. In Proceedings of the 2016 Data Compression Conference (DCC \u201916). IEEE, 161\u2013170."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2018.2867067"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2019.2895840"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3649441","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3649441","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:21Z","timestamp":1750291401000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3649441"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,16]]},"references-count":70,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,7,31]]}},"alternative-id":["10.1145\/3649441"],"URL":"https:\/\/doi.org\/10.1145\/3649441","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,16]]},"assertion":[{"value":"2023-04-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-16","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}