{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T01:05:02Z","timestamp":1790816702993,"version":"4.1.0"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,7,22]],"date-time":"2021-07-22T00:00:00Z","timestamp":1626912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61772483 and 61931014"],"award-info":[{"award-number":["61772483 and 61931014"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>To reduce the redundancy among different color channels, e.g., YUV, previous methods usually adopt a linear model that tends to be oversimple for complex image content. We propose a neural-network-based method for cross-channel prediction in intra frame coding. The proposed network utilizes twofold cues, i.e., the neighboring reconstructed samples with all channels, and the co-located reconstructed samples with partial channels. Specifically, for YUV video coding, the neighboring samples with YUV are processed by several fully connected layers; the co-located samples with Y are processed by convolutional layers; and the proposed network fuses the twofold cues. We observe that the integration of twofold information is crucial to the performance of intra prediction of the chroma components. We have designed the network architecture to achieve a good balance between compression performance and computational efficiency. Moreover, we propose a transform domain loss for the training of the network. The transform domain loss helps obtain more compact representations of residues in the transform domain, leading to higher compression efficiency. The proposed method is plugged into HEVC and VVC test models to evaluate its effectiveness. Experimental results show that our method provides more accurate cross-channel intra prediction compared with previous methods. On top of HEVC, our method achieves on average 1.3%, 5.4%, and 3.8% BD-rate reductions for Y, Cb, and Cr on common test sequences, and on average 3.8%, 11.3%, and 9.0% BD-rate reductions for Y, Cb, and Cr on ultra-high-definition test sequences. On top of VVC, our method achieves on average 0.5%, 1.7%, and 1.3% BD-rate reductions for Y, Cb, and Cr on common test sequences.<\/jats:p>","DOI":"10.1145\/3434250","type":"journal-article","created":{"date-parts":[[2021,7,22]],"date-time":"2021-07-22T14:44:29Z","timestamp":1626965069000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Neural-Network-Based Cross-Channel Intra Prediction"],"prefix":"10.1145","volume":"17","author":[{"given":"Yue","family":"Li","sequence":"first","affiliation":[{"name":"University of Science and Technology of China, Hefei, Anhui, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Yi","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, Anhui, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong","family":"Liu","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, Anhui, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Li","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, Anhui, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhu","family":"Li","sequence":"additional","affiliation":[{"name":"University of Missouri\u2013Kansas City, Kansas City, MO"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Houqiang","family":"Li","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, Anhui, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,7,22]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Picture Coding Symposium (PCS\u201916)","author":"Ball\u00e9 Johannes","unstructured":"Johannes Ball\u00e9 , Valero Laparra , and Eero P. Simoncelli . 2016. End-to-end optimization of nonlinear transform codes for perceptual quality . In Picture Coding Symposium (PCS\u201916) . IEEE, 1\u20135. Johannes Ball\u00e9, Valero Laparra, and Eero P. Simoncelli. 2016. End-to-end optimization of nonlinear transform codes for perceptual quality. In Picture Coding Symposium (PCS\u201916). IEEE, 1\u20135."},{"key":"e_1_2_1_2_1","volume-title":"Simoncelli","author":"Ball\u00e9 Johannes","year":"2016","unstructured":"Johannes Ball\u00e9 , Valero Laparra , and Eero P . Simoncelli . 2016 . End-to-end optimized image compression. (2016). arXiv:1611.01704 http:\/\/arxiv.org\/abs\/1611.01704. Johannes Ball\u00e9, Valero Laparra, and Eero P. Simoncelli. 2016. End-to-end optimized image compression. (2016). arXiv:1611.01704 http:\/\/arxiv.org\/abs\/1611.01704."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.26.135"},{"key":"e_1_2_1_6_1","volume-title":"Technical Report JVET-L1010. JVET.","author":"Bossen Frank","year":"2018","unstructured":"Frank Bossen , Jill Boyce , X. Li , V. Seregin , and K. S\u00fchring . 2018 . JVET Common Test Conditions and Software Reference Configurations for SDR Video . Technical Report JVET-L1010. JVET. Frank Bossen, Jill Boyce, X. Li, V. Seregin, and K. S\u00fchring. 2018. JVET Common Test Conditions and Software Reference Configurations for SDR Video. Technical Report JVET-L1010. JVET."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/829566"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88690-7_10"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.55"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024190"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-51811-4_3"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.72"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/DCC.2013.10"},{"key":"e_1_2_1_15_1","volume-title":"International Conference on Artificial Intelligence and Statistics. 249\u2013256","author":"Glorot Xavier","year":"2010","unstructured":"Xavier Glorot and Yoshua Bengio . 2010 . Understanding the difficulty of training deep feedforward neural networks . In International Conference on Artificial Intelligence and Statistics. 249\u2013256 . Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In International Conference on Artificial Intelligence and Statistics. 249\u2013256."},{"key":"e_1_2_1_16_1","unstructured":"Marc G\u00f3rriz Saverio Blasi Alan F. Smeaton Noel E. O\u2019Connor and Marta Mrak. 2020. Chroma intra prediction with attention-based CNN architectures. (2020). arXiv:2006.15349 http:\/\/arxiv.org\/abs\/2006.15349.  Marc G\u00f3rriz Saverio Blasi Alan F. Smeaton Noel E. O\u2019Connor and Marta Mrak. 2020. Chroma intra prediction with attention-based CNN architectures. (2020). arXiv:2006.15349 http:\/\/arxiv.org\/abs\/2006.15349."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2393402"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/DCC.2019.00053"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2019.2920603"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299156"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101149.1101223"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925974"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654889"},{"key":"e_1_2_1_24_1","volume-title":"Technical Report JCTVC-B021. JCT-VC.","author":"Kim Jungsun","year":"2010","unstructured":"Jungsun Kim , S. Park , Younghee Choi , Y. Jeon , and B. Jeon . 2010 . New Intra Chroma Prediction Using Inter-channel Correlation . Technical Report JCTVC-B021. JCT-VC. Jungsun Kim, S. Park, Younghee Choi, Y. Jeon, and B. Jeon. 2010. New Intra Chroma Prediction Using Inter-channel Correlation. Technical Report JCTVC-B021. JCT-VC."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/2999134.2999257"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2221525"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/2318989.2319996"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_35"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015780"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2817044"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2018.8451396"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2017.2727682"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368405"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2601264"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8682846"},{"key":"e_1_2_1_36_1","volume-title":"Applications of Digital Image Processing XLI","volume":"10752","author":"Pfaff J.","unstructured":"J. Pfaff , P. Helle , D. Maniry , S. Kaltenstadler , W. Samek , H. Schwarz , D. Marpe , and T. Wiegand . 2018. Neural network based intra prediction for video coding . In Applications of Digital Image Processing XLI , Vol. 10752 . International Society for Optics and Photonics. J. Pfaff, P. Helle, D. Maniry, S. Kaltenstadler, W. Samek, H. Schwarz, D. Marpe, and T. Wiegand. 2018. Neural network based intra prediction for video coding. In Applications of Digital Image Processing XLI, Vol. 10752. International Society for Optics and Photonics."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2019.2945918"},{"key":"e_1_2_1_38_1","unstructured":"A. Segall V. Baroncini J. Boyce J. Chen and T. Suzuki. 2017. Joint Call for Proposals on Video Compression with Capability Beyond HEVC. Technical Report JVET-H1002. JVET.  A. Segall V. Baroncini J. Boyce J. Chen and T. Suzuki. 2017. Joint Call for Proposals on Video Compression with Capability Beyond HEVC. Technical Report JVET-H1002. JVET."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/VCIP.2017.8305104"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2771472"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2221191"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2019.2900908"},{"key":"e_1_2_1_43_1","unstructured":"Lucas Theis Wenzhe Shi Andrew Cunningham and Ferenc Husz\u00e1r. 2017. Lossy image compression with compressive autoencoders. (2017). arXiv:1703.00395 http:\/\/arxiv.org\/abs\/1703.00395.  Lucas Theis Wenzhe Shi Andrew Cunningham and Ferenc Husz\u00e1r. 2017. Lossy image compression with compressive autoencoders. (2017). arXiv:1703.00395 http:\/\/arxiv.org\/abs\/1703.00395."},{"key":"e_1_2_1_44_1","volume-title":"NTIRE 2017 challenge on single image super-resolution: Methods and results. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops\u201917)","author":"Timofte Radu","year":"2017","unstructured":"Radu Timofte , Eirikur Agustsson , Luc Van Gool , et\u00a0al. 2017 . NTIRE 2017 challenge on single image super-resolution: Methods and results. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops\u201917) . IEEE, 1110\u20131121. Radu Timofte, Eirikur Agustsson, Luc Van Gool, et\u00a0al. 2017. NTIRE 2017 challenge on single image super-resolution: Methods and results. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops\u201917). IEEE, 1110\u20131121."},{"key":"e_1_2_1_45_1","volume-title":"Damien Vincent, David Minnen, Shumeet Baluja, Michele Covell, and Rahul Sukthankar.","author":"Toderici George","year":"2015","unstructured":"George Toderici , Sean M. O\u2019Malley , Sung Jin Hwang , Damien Vincent, David Minnen, Shumeet Baluja, Michele Covell, and Rahul Sukthankar. 2015 . Variable rate image compression with recurrent neural networks. (2015). arXiv:1511.06085 http:\/\/arxiv.org\/abs\/1511.06085. George Toderici, Sean M. O\u2019Malley, Sung Jin Hwang, Damien Vincent, David Minnen, Shumeet Baluja, Michele Covell, and Rahul Sukthankar. 2015. Variable rate image compression with recurrent neural networks. (2015). arXiv:1511.06085 http:\/\/arxiv.org\/abs\/1511.06085."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.577"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2003.815165"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/2999134.2999173"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2018.2816932"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.75"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2015.2449659"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27413-8_47"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2830640"},{"key":"e_1_2_1_54_1","volume-title":"European Conference on Computer Vision (ECCV\u201916)","author":"Zhang Richard","unstructured":"Richard Zhang , Phillip Isola , and Alexei A. Efros . 2016. Colorful image colorization . In European Conference on Computer Vision (ECCV\u201916) . Springer, 649\u2013666. Richard Zhang, Phillip Isola, and Alexei A. Efros. 2016. Colorful image colorization. In European Conference on Computer Vision (ECCV\u201916). Springer, 649\u2013666."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2703114"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMEW.2016.7574735"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2775223"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2016.2598092"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2013.2288007"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCI.2016.2644865"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2019.2924591"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3434250","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3434250","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:35Z","timestamp":1750195475000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3434250"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,22]]},"references-count":59,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3434250"],"URL":"https:\/\/doi.org\/10.1145\/3434250","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,22]]},"assertion":[{"value":"2020-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}