{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,22]],"date-time":"2025-11-22T11:03:05Z","timestamp":1763809385309,"version":"3.41.0"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2015,2,5]],"date-time":"2015-02-05T00:00:00Z","timestamp":1423094400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Shanghai Rising-Star Program (11QA1402400) and Innovation Program (13ZZ069) of Shanghai Municipal Education Commission"},{"name":"National Natural Science Foundation of China","award":["60832003, 60902085, 61171084, 61172096, 61422111 and U1301257"],"award-info":[{"award-number":["60832003, 60902085, 61171084, 61172096, 61422111 and U1301257"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2015,2,5]]},"abstract":"<jats:p>3D High Efficiency Video Coding (3D-HEVC) is an extension of the HEVC standard for coding of multiview videos and depth maps. It inherits the same quadtree coding structure as HEVC for both components, which allows recursively splitting into four equal-sized coding units (CU). One of 11 different prediction modes is chosen to code a CU in inter-frames. Similar to the joint model of H.264\/AVC, the mode decision process in HM (reference software of HEVC) is performed using all the possible depth levels and prediction modes to find the one with the least rate distortion cost using a Lagrange multiplier. Furthermore, both motion estimation and disparity estimation need to be performed in the encoding process of 3D-HEVC. Those tools achieve high coding efficiency, but lead to a significant computational complexity. In this article, we propose a fast mode decision algorithm for 3D-HEVC. Since multiview videos and their associated depth maps represent the same scene, at the same time instant, their prediction modes are closely linked. Furthermore, the prediction information of a CU at the depth level X is strongly related to that of its parent CU at the depth level X-1 in the quadtree coding structure of HEVC since two corresponding CUs from two neighboring depth levels share similar video characteristics. The proposed algorithm jointly exploits the inter-view coding mode correlation, the inter-component (texture-depth) correlation and the inter-level correlation in the quadtree structure of 3D-HEVC. Experimental results show that our algorithm saves 66% encoder runtime on average with only a 0.2% BD-Rate increase on coded views and 1.3% BD-Rate increase on synthesized views.<\/jats:p>","DOI":"10.1145\/2700298","type":"journal-article","created":{"date-parts":[[2015,2,10]],"date-time":"2015-02-10T13:19:47Z","timestamp":1423574387000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications"],"prefix":"10.1145","volume":"11","author":[{"given":"Liquan","family":"Shen","sequence":"first","affiliation":[{"name":"Shanghai University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ping","family":"An","sequence":"additional","affiliation":[{"name":"Shanghai University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhaoyang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shanghai University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qianqian","family":"Hu","sequence":"additional","affiliation":[{"name":"Shanghai University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhengchuan","family":"Chen","sequence":"additional","affiliation":[{"name":"Tsinghua University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,2,5]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 13th VCEG-M33 Meeting.","author":"Bjontegaard G.","year":"2001","unstructured":"G. Bjontegaard . 2001 . Calculation of average PSNR difference between RD-curves . In Proceedings of the 13th VCEG-M33 Meeting. G. Bjontegaard. 2001. Calculation of average PSNR difference between RD-curves. In Proceedings of the 13th VCEG-M33 Meeting."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2223632"},{"key":"e_1_2_1_3_1","volume-title":"Da Silva Cruz","author":"Correa G.","year":"2013","unstructured":"G. Correa , P. Assuncao , L. Agostini , and L. A. Da Silva Cruz . 2013 . Complexity control of HEVC through quadtree depth estimation. In Proceedings of IEEE EUROCON. 81--86. G. Correa, P. Assuncao, L. Agostini, and L. A. Da Silva Cruz. 2013. Complexity control of HEVC through quadtree depth estimation. In Proceedings of IEEE EUROCON. 81--86."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1155\/2009\/258920"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2013.2266580"},{"volume-title":"Proceedings of the IEEE 11th International Conference on Image Processing. 3271--3274","author":"Grewatsch S.","key":"e_1_2_1_6_1","unstructured":"S. Grewatsch and E. Muller . 2004. Sharing of motion vectors in 3D video coding . In Proceedings of the IEEE 11th International Conference on Image Processing. 3271--3274 . S. Grewatsch and E. Muller. 2004. Sharing of motion vectors in 3D video coding. In Proceedings of the IEEE 11th International Conference on Image Processing. 3271--3274."},{"volume-title":"Proceedings of the IEEE International Conference on Multimedia and Expo Workshops. 1--4.","author":"Gu Z.","key":"e_1_2_1_7_1","unstructured":"Z. Gu , J. Zheng , N. Ling , and P. Zhang . 2013. Fast depth modeling mode selection for 3D HEVC depth intra coding . In Proceedings of the IEEE International Conference on Multimedia and Expo Workshops. 1--4. Z. Gu, J. Zheng, N. Ling, and P. Zhang. 2013. Fast depth modeling mode selection for 3D HEVC depth intra coding. In Proceedings of the IEEE International Conference on Multimedia and Expo Workshops. 1--4."},{"volume-title":"Applications and requirements on 3D video coding. ISO\/IECJTC1\/SC29\/WG11","key":"e_1_2_1_8_1","unstructured":"ISO-N11829. 2011. Applications and requirements on 3D video coding. ISO\/IECJTC1\/SC29\/WG11 . ISO-N11829. 2011. Applications and requirements on 3D video coding. ISO\/IECJTC1\/SC29\/WG11."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1671954.1671959"},{"volume-title":"Early termination of CU encoding to reduce HEVC complexity. ITU-T SG16 WP3 and ISO\/IEC JTC1\/SC29\/WG11","key":"e_1_2_1_10_1","unstructured":"JCTVC-F045. 2011. Early termination of CU encoding to reduce HEVC complexity. ITU-T SG16 WP3 and ISO\/IEC JTC1\/SC29\/WG11 . JCTVC-F045. 2011. Early termination of CU encoding to reduce HEVC complexity. ITU-T SG16 WP3 and ISO\/IEC JTC1\/SC29\/WG11."},{"volume-title":"Coding tree pruning based CU early termination. ITU-T SG16 WP3 and ISO\/IEC JTC1\/SC29\/WG11","key":"e_1_2_1_11_1","unstructured":"JCTVC-F092. 2011. Coding tree pruning based CU early termination. ITU-T SG16 WP3 and ISO\/IEC JTC1\/SC29\/WG11 . JCTVC-F092. 2011. Coding tree pruning based CU early termination. ITU-T SG16 WP3 and ISO\/IEC JTC1\/SC29\/WG11."},{"key":"e_1_2_1_12_1","unstructured":"JCT3V-A0044. 2012. Depth quadtree prediction for HTM. ITU-T SG 16 WP 3 and ISO\/IEC JTC 1\/SC 29\/WG 11.  JCT3V-A0044. 2012. Depth quadtree prediction for HTM. ITU-T SG 16 WP 3 and ISO\/IEC JTC 1\/SC 29\/WG 11."},{"volume-title":"Common test conditions of 3DV core experiments. ITU-T SG16 WP3 & ISO\/IECJTC1\/SC29\/WG11","key":"e_1_2_1_13_1","unstructured":"JCT3V-A1100. 2012. Common test conditions of 3DV core experiments. ITU-T SG16 WP3 & ISO\/IECJTC1\/SC29\/WG11 . JCT3V-A1100. 2012. Common test conditions of 3DV core experiments. ITU-T SG16 WP3 & ISO\/IECJTC1\/SC29\/WG11."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2010.2092614"},{"volume-title":"Proceedings of the Picture Coding Symposium. 449--452","author":"Kim J.","key":"e_1_2_1_15_1","unstructured":"J. Kim , J. Yang , K. Won , and B. Jeon . 2012. Early determination of mode decision for HEVC . In Proceedings of the Picture Coding Symposium. 449--452 . J. Kim, J. Yang, K. Won, and B. Jeon. 2012. Early determination of mode decision for HEVC. In Proceedings of the Picture Coding Symposium. 449--452."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2007.381750"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2011.2154730"},{"key":"e_1_2_1_18_1","article-title":"Depth coding based on depth-texture motion and structure similarities","volume":"10","author":"Lei J.","year":"2014","unstructured":"J. Lei , S. Li , C. Zhu , M. Sun , and C. Hou . 2014 . Depth coding based on depth-texture motion and structure similarities . IEEE Trans. Circuits System Video Technol. DOI : 10 .1109\/TCSVT.2014.2335471. 10.1109\/TCSVT.2014.2335471 J. Lei, S. Li, C. Zhu, M. Sun, and C. Hou. 2014. Depth coding based on depth-texture motion and structure similarities. IEEE Trans. Circuits System Video Technol. DOI: 10.1109\/TCSVT.2014.2335471.","journal-title":"IEEE Trans. Circuits System Video Technol. DOI"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBC.2011.2131510"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/DCC.2013.15"},{"volume-title":"Proceedings of the Picture Coding Symposium. 113--116","author":"Micallef B. W.","key":"e_1_2_1_21_1","unstructured":"B. W. Micallef , C. J. Debono , and R. A. Farrugia . 2012. Fast inter-mode decision in multi-view video plus depth coding . In Proceedings of the Picture Coding Symposium. 113--116 . B. W. Micallef, C. J. Debono, and R. A. Farrugia. 2012. Fast inter-mode decision in multi-view video plus depth coding. In Proceedings of the Picture Coding Symposium. 113--116."},{"key":"e_1_2_1_22_1","article-title":"Initialization, limitation and predictive coding of the depth and texture quadtree in 3D-HEVC","volume":"10","author":"Mora E.","year":"2014","unstructured":"E. Mora , J. Jung , M. Cagnazzo , and B. Pesquet-Popescu . 2014 . Initialization, limitation and predictive coding of the depth and texture quadtree in 3D-HEVC . IEEE Trans. Circ. Syst. Video Technol. DOI : 10 .1109\/TCSVT.2013.2283110 10.1109\/TCSVT.2013.2283110 E. Mora, J. Jung, M. Cagnazzo, and B. Pesquet-Popescu. 2014. Initialization, limitation and predictive coding of the depth and texture quadtree in 3D-HEVC. IEEE Trans. Circ. Syst. Video Technol. DOI: 10.1109\/TCSVT.2013.2283110","journal-title":"IEEE Trans. Circ. Syst. Video Technol. DOI"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2013.2264820"},{"key":"e_1_2_1_24_1","article-title":"View synthesis distortion estimation for AVC- and HEVC-compatible 3D video coding","volume":"10","author":"Oh B.","year":"2014","unstructured":"B. Oh and K. Oh . 2014 . View synthesis distortion estimation for AVC- and HEVC-compatible 3D video coding . IEEE Trans. Circ. Syst. Video Technol. DOI : 10 .1109\/TCSVT.2013.2290577 10.1109\/TCSVT.2013.2290577 B. Oh and K. Oh. 2014. View synthesis distortion estimation for AVC- and HEVC-compatible 3D video coding. IEEE Trans. Circ. Syst. Video Technol. DOI: 10.1109\/TCSVT.2013.2290577","journal-title":"IEEE Trans. Circ. Syst. Video Technol. DOI"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/11949534_90"},{"volume-title":"Proceedings of the European Signal Processing Conference. 1--5.","author":"Pourazad M. T.","key":"e_1_2_1_26_1","unstructured":"M. T. Pourazad , P. Nasiopoulos , and R. K. Ward . 2006. An H.264-based video encoding scheme for 3DTV . In Proceedings of the European Signal Processing Conference. 1--5. M. T. Pourazad, P. Nasiopoulos, and R. K. Ward. 2006. An H.264-based video encoding scheme for 3DTV. In Proceedings of the European Signal Processing Conference. 1--5."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2011.2130310"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2012.2231060"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2341927"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2014.2313892"},{"key":"e_1_2_1_31_1","first-page":"926","article-title":"Inter mode selection for depth map coding in 3D video","volume":"58","author":"Shen L.","year":"2012","unstructured":"L. Shen , Z. Zhang , and Z. Liu . 2012 . Inter mode selection for depth map coding in 3D video . IEEE Trans. Consumer Electron. 58 , 3, 926 -- 931 . L. Shen, Z. Zhang, and Z. Liu. 2012. Inter mode selection for depth map coding in 3D video. IEEE Trans. Consumer Electron. 58, 3, 926--931.","journal-title":"IEEE Trans. Consumer Electron."},{"key":"e_1_2_1_32_1","first-page":"1","article-title":"Report on generation of stereo video data base. Mobile3DTV","volume":"2","author":"Smolic A.","year":"2010","unstructured":"A. Smolic , G. Tech , and H. Brust . 2010 . Report on generation of stereo video data base. Mobile3DTV Tech. Rep. 2 , 1, 1 -- 15 . A. Smolic, G. Tech, and H. Brust. 2010. Report on generation of stereo video data base. Mobile3DTV Tech. Rep. 2, 1, 1--15.","journal-title":"Tech. Rep."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2221191"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/79.733497"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2012.4"},{"volume-title":"Proceedings of the IEEE International Symposium on Circuits and Systems. 2353--2356","author":"Tao S.","key":"e_1_2_1_36_1","unstructured":"S. Tao , Y. Chen , M. M. Hannuksela , Y. K. Wang , M. Gabbouj , and H. Li . 2009. Joint texture and depth map video coding based on the scalable extension of H.264\/AVC . In Proceedings of the IEEE International Symposium on Circuits and Systems. 2353--2356 . S. Tao, Y. Chen, M. M. Hannuksela, Y. K. Wang, M. Gabbouj, and H. Li. 2009. Joint texture and depth map video coding based on the scalable extension of H.264\/AVC. In Proceedings of the IEEE International Symposium on Circuits and Systems. 2353--2356."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2010.2092613"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2223013"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2291958"},{"volume-title":"Proceedings of the Picture Coding Symposium. 406--409","author":"Yan Y.","key":"e_1_2_1_40_1","unstructured":"Y. Yan , H. Li , and M. M. Hannuksela . 2013. Multiview-video-plus-depth coding and inter-component prediction in high-level-syntax extension of H.265\/HEVC . In Proceedings of the Picture Coding Symposium. 406--409 . Y. Yan, H. Li, and M. M. Hannuksela. 2013. Multiview-video-plus-depth coding and inter-component prediction in high-level-syntax extension of H.265\/HEVC. In Proceedings of the Picture Coding Symposium. 406--409."},{"volume-title":"Proceedings of the IEEE International Symposium on Circuits and Systems. 45--48","author":"Zhang H.","key":"e_1_2_1_41_1","unstructured":"H. Zhang and Z. Ma . 2013. Early termination schemes for fast intra mode decision in high efficiency video coding . In Proceedings of the IEEE International Symposium on Circuits and Systems. 45--48 . H. Zhang and Z. Ma. 2013. Early termination schemes for fast intra mode decision in high efficiency video coding. In Proceedings of the IEEE International Symposium on Circuits and Systems. 45--48."},{"volume-title":"Proceedings of the IEEE International Conference on Image Processing. 2865--2868","author":"Zhang J.","key":"e_1_2_1_42_1","unstructured":"J. Zhang , M. M. Hannuksela , and H. Li . 2010. Joint multiview video plus depth coding . In Proceedings of the IEEE International Conference on Image Processing. 2865--2868 . J. Zhang, M. M. Hannuksela, and H. Li. 2010. Joint multiview video plus depth coding. In Proceedings of the IEEE International Conference on Image Processing. 2865--2868."},{"volume-title":"Proceedings of the Conference on Visual Communications and Image Processing. 1--5.","author":"Zhang N.","key":"e_1_2_1_43_1","unstructured":"N. Zhang , Y. W. Chen , J. L. Lin , X. P. Fan , S. W. Ma , D. B. Zhao , and W. Gao . 2013. Improved disparity vector derivation in 3DHEVC . In Proceedings of the Conference on Visual Communications and Image Processing. 1--5. N. Zhang, Y. W. Chen, J. L. Lin, X. P. Fan, S. W. Ma, D. B. Zhao, and W. Gao. 2013. Improved disparity vector derivation in 3DHEVC. In Proceedings of the Conference on Visual Communications and Image Processing. 1--5."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2011.6131164"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2010.5506026"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2010.5606315"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2700298","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2700298","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:07:43Z","timestamp":1750223263000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2700298"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,2,5]]},"references-count":46,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2015,2,5]]}},"alternative-id":["10.1145\/2700298"],"URL":"https:\/\/doi.org\/10.1145\/2700298","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2015,2,5]]},"assertion":[{"value":"2014-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-02-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}