{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T15:25:07Z","timestamp":1789572307912,"version":"build-2803163510"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2024,1,11]],"date-time":"2024-01-11T00:00:00Z","timestamp":1704931200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62271013, 62031013"],"award-info":[{"award-number":["62271013, 62031013"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100021171","name":"Guangdong Basic and Applied Basic Research Foundation","doi-asserted-by":"crossref","award":["2019A1515012031"],"award-info":[{"award-number":["2019A1515012031"]}],"id":[{"id":"10.13039\/501100021171","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100017607","name":"Shenzhen Fundamental Research Program","doi-asserted-by":"crossref","award":["GXWD20201231165807007-20200806163656003"],"award-info":[{"award-number":["GXWD20201231165807007-20200806163656003"]}],"id":[{"id":"10.13039\/501100017607","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shenzhen Science and Technology Program","award":["JCYJ20230807120808017"],"award-info":[{"award-number":["JCYJ20230807120808017"]}]},{"name":"CCF-Lenovo Blue Ocean Research Fund","award":["CCF-Lenovo OF 202208"],"award-info":[{"award-number":["CCF-Lenovo OF 202208"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2024,4,30]]},"abstract":"<jats:p>8K (7689\u00d74320) ultra-high definition (UHD) videos are growing popular with the improvement of human visual experience demand. Therefore, the compression of 8K UHD videos has become a top priority in the third-generation audio video coding standard (AVS3). However, as an important part of the coding standard promotion, the real-time hardware implementation for AVS3-based 8K UHD video intra coding is severely hindered, especially in the coding unit (CU) partition stage. To break through the limitation, this article proposes a divide-and-conquer-based rate-distortion-optimization-free (RDO-free) CU partitioning algorithm for efficient hardware implementation. Aimed at the complex CU partition in AVS3, we separately design a lightweight optimization for original partitioning rules to improve division efficiency and a decision tree-based RDO-free CU decision framework to eliminate the latency caused by the waiting for rate-distortion cost calculation in RDO strategy. Afterward, a divide-and-conquer-based hardware-friendly gradient difference calculating approach is devised to accelerate the learning feature extracting speed. To ensure that the proposed algorithm is sufficient to support the real-time CU partition for 8K videos, we also develop a hardware architecture based on FPGA. Experimental results illustrate that the software coding performance of our algorithm is significantly ahead of the efficient implementation uAVS3e for AVS3 and the reference software HM-16.20 for High Efficiency Video Coding (HEVC), even though there is 9.96% loss on BD-Rate Y. Considering its importance for the hardware implementation of AVS3-based 8K real-time encoder, the coding loss is acceptable. Moreover, the hardware simulation results on VU440 FPGA with Vivado 2019 show that our algorithm can support 61.12 frames per second (fps) CU partition for 8K UHD videos with only 0.00%, 0.00%, 1.01%, and 7.78% consumption of BRAM_18K, DSP48E, FF, and LUT, respectively. Additionally, with dual-path parallelism, 122.24 fps also can be implemented with controllable resource utilization, which achieves the state-of-the-art performance.<\/jats:p>","DOI":"10.1145\/3634705","type":"journal-article","created":{"date-parts":[[2023,11,27]],"date-time":"2023-11-27T16:02:17Z","timestamp":1701100937000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Divide-and-conquer-based RDO-free CU Partitioning for 8K Video Compression"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3187-2149","authenticated-orcid":false,"given":"Hang","family":"Yuan","sequence":"first","affiliation":[{"name":"School of Electronic and Computer Engineering, Peking University, and Peng Cheng Laboratory, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7429-5495","authenticated-orcid":false,"given":"Wei","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Electronic and Computer Engineering, Peking University, and Peng ChengLaboratory, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2731-5403","authenticated-orcid":false,"given":"Siwei","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Computer Science, Peking University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-7709-0602","authenticated-orcid":false,"given":"Yiqiang","family":"Yan","sequence":"additional","affiliation":[{"name":"Lenovo Group, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,1,11]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"FFmpeg. 2023. Retrieved from http:\/\/ffmpeg.org\/"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSD.2019.00037"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/358841.358850"},{"key":"e_1_3_1_5_2","unstructured":"G. Bj\u00f8ntegaard. 2001. Calculation of average PSNR differences between RD-curves. VCEG-M33 (2001). https:\/\/www.itu.int\/wftp3\/av-arch\/videosite\/0104_Aus\/VCEG-M33.doc"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2021.3101953"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICME51207.2021.9428331"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISCAS51556.2021.9401121"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2016.7552970"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/DCC47342.2020.00018"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/JETCAS.2016.2597698"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/SOCC46988.2019.1570548652"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2019.2934752"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3079231"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2745099"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBC.2018.2865647"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2015.2444671"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-14243-2_3"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3507970"},{"key":"e_1_3_1_20_2","unstructured":"International Telecommunication Union (ITU). 2008. Subjective video quality assessment methods for multimedia applications. https:\/\/www.itu.int\/rec\/T-REC-P.910-202207-S\/en"},{"key":"e_1_3_1_21_2","unstructured":"Audio Video Coding Standard Workgroup. 2018. AVS Proposal N2617: AVS3-P2 common test conditions v5.0. Retrieved from ftp:\/\/47.93.196.121\/Public\/avsdoc\/"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2019.2954749"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2019.8803421"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2016.2595264"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2021.3083447"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBC.2021.3073556"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.151"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2017.2777903"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2601264"},{"key":"e_1_3_1_30_2","unstructured":"HEVC Reference Model. 2022. HM-16.20. Retrieved from https:\/\/hevc.hhi.fraunhofer.de\/svn\/svn_HEVCSoftware\/tags\/HM-16.20\/"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.3042062"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2015.2428571"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2021.3108671"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2013.6490261"},{"key":"e_1_3_1_35_2","unstructured":"AVS3 Reference Software. 2022. HPM-10.0 software repository. Retrieved from ftp:\/\/47.93.196.121\/Public\/codec\/video_codec\/HPM"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2700629"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2010.2042645"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICME52920.2022.9859988"},{"key":"e_1_3_1_39_2","unstructured":"Peking University and Peng Cheng Laboratory. 2022. PP8KLite Dataset. Retrieved from https:\/\/openi.pcl.ac.cn\/OpenDatasets\/PP8KLite"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2014.2360924"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/PCS48520.2019.8954510"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICMEW53276.2021.9455944"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3049148"},{"key":"e_1_3_1_44_2","volume-title":"Ultrascale FPGA Product Selection Guide","year":"2022","unstructured":"Xilinx 2022. Ultrascale FPGA Product Selection Guide. Xilinx. Retrieved from: https:\/\/www.xilinx.com\/support\/documentation\/selection-guides\/ultrascale-fpga-product-selection-guide.pdf"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2015.2491018"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2014.2356795"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2291958"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2019.2904198"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2023.3312919"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3581783.3613465"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3503161.3548215"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICME51207.2021.9428275"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/DCC50243.2021.00060"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/PCS48520.2019.8954503"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2723238"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2015.2417498"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3321510"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2018.2878399"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2556941"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3634705","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3634705","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:35:49Z","timestamp":1750178149000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3634705"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,11]]},"references-count":58,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,4,30]]}},"alternative-id":["10.1145\/3634705"],"URL":"https:\/\/doi.org\/10.1145\/3634705","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,11]]},"assertion":[{"value":"2023-01-04","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-08","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-01-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}