基于HEVC的三维视频编码关键技术述评
Review of key technology of 3D video coding based on HEVC
-
摘要: 综述了基于高效率视频编码HEVC (high efficiency video coding)标准的两种扩展,即MV-HEVC (high efficiency video coding based multiview)和3D-HEVC (high efficiency video coding based 3D video coding)的工作原理及其编码工具,分析了3D-HEVC模型的特点、编码模块与方法,并将3D-HEVC与MV-HEVC进行了性能对比.总结发现,由于3D-HEVC采用纹理视频加深度格式来合成虚拟视点,从而降低了大量的编码码率,可方便应用于3D电视、自由立体视点电视和3D数字电影等多种三维体验中.随着智能移动设备的发展,手持终端采用3D-HEVC支持多视点3D视频将会成为未来的研究趋势.Abstract: The operating principle and coding tools of two kinds of extension of HEVC (high efficiency video coding) standards including MV-HEVC (high efficiency video coding based multiview) and 3D-HEVC (high efficiency video coding based 3D video coding) were reviewed.The feature,coding modules and method of 3D-HEVC model were analyzed,and the performances between 3D-HEVC and MV-HEVC were compared.The conclusion showed that 3D-HEVC synthesized virtual view with the format of texture video plus depth,thus its bit rates would be reduced notably,so 3D-HEVC would be applied to many kinds of 3D experience like 3D TV,free viewpoint video and 3D digital movie. With the development of smart mobile devices,handheld terminal using 3D-HEVC to support multiview 3D video would become the research tendency in the future.
-
Key words:
- 3D video /
- high efficiency video coding (HEVC) /
- compression
-
-
[1]
Zhang Q,An P,Zhang Y,et al.Low complexity multiview video plus depth coding[J].IEEE Transactions Consumer Electronic,2011,57(4):1857.
-
[2]
Chen Y,Vetro A.Next-generation 3D formats with depth map support[J].IEEE MultiMedia,2014,21(2):90.
-
[3]
Müller K,Schwarz H,Marpe D,et al.3D high efficiency video coding for multi-view video and depth data[J].IEEE Transactions on Circuits and Systems for Video Technology,2013,22(9):3366.
-
[4]
Zhang Q,Tian L,Huang L,et al.Rendering distortion estimation model for 3D high efficiency depth coding[J].Math Probl Eng,2014,2014:1.
-
[5]
Ohm J,Sullivan G J,Schwarz H.Comparison of the coding efficiency of video coding standards-including high efficiency video coding (HEVC)[J].IEEE Transactions on Circuits and Systems for Video Technology,2012,22(12):1669.
-
[6]
Zhang Q,An P,Zhang Y,et al.Efficient depth map compression for view rendering in 3D video[J].Imaging Sci J,2013,61(4):385-395.
-
[7]
Zhang Q,Li N,Wu Q.Fast mode decision for 3D-HEVC depth intracoding[J].The Scientific World Journal,2014,2014:1.
-
[8]
Zhang Q,Li N,Gan Y.Effective early termination algorithm for depth map intra coding in 3D-HEVC[J].Electron Lett,2014,50(14):994.
-
[9]
Chen Y,Wang Y K,Ugur K,et al.The emerging MVC standard for 3D video services[J].EURASIP Journal on Advances in Signal Processing,2009,2009:1.
-
[10]
Vetro A,Wiegand T,Sullivan G J.Overview of the stereo and multiview video coding extensions of the H.264/AVC standard[J].Proc IEEE,2011,99(4):626.
-
[11]
Tech G,Wegner K,Chen Y,et al.MVHEVC draft text 5[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) Document JCT3V-E1004,Vienna:JCT-3V,2013.
-
[12]
Shen L,Zhang Z.Content-adaptive motion estimation algorithm for coarse-grain SVC[J].IEEE Transactions on Image Processing,2012,21(5):2582.
-
[13]
Wang H,Sam K,Chi-Wah K.An efficient mode decision algorithm for H.264/AVC encoding optimization[J].IEEE Transactions on Multimedia,2007,9(4):882.
-
[14]
Liu Z,Shen L,Zhang Z.An efficient intermode decision algorithm based on motion homogeneity for H.264/AVC[J].IEEE Transactions on Circuits and Systems for Video Technology,2009,19(1):128.
-
[15]
Shen L,Liu Z,Zhang X,et al.An effective CU size decision method for HEVC encoders[J].IEEE Transactions on Multimedia,2013,15(2):465.
-
[16]
Fang C,Chang Y ,Chung W.Fast Intra Mode Decision for HEVC Based on Direction Energy Distribution[R].Hsinchu:IEEE,2013:61-62.
-
[17]
Shen L,Liu Z,Zhang Z,et al.Fast inter mode decision using spatial property of motion field[J].IEEE Transactions on Multimedia,2008,10(6):1208.
-
[18]
Shen L,Zhang Z,An P.Fast CU size decision and mode decision algorithm for HEVC intra coding[J].IEEE Transactions on Consumer Electronics,2013,59(1):207.
-
[19]
Jongho K.Yoonsik C,Yong-Goo K.Fast coding unit size decision algorithm for intra coding in HEVC[R].Las Vegas:IEEE,2013:637-638.
-
[20]
Tech G,Wegner K,Chen Y,et al.3D-HEVC draft text 1[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 5th Meeting Document JCT3V-E1001,Vienna:JCT-3V,2013.
-
[21]
Zhang L,Tech G,Wegner K,et al.3D-HEVC test model 5[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 5th Meeting Document JCT3V-E1005,Vienna:JCT-3V,2013.
-
[22]
Schwarz H,Bartnik C,Bosse S,et al.Description of 3D video technology proposal by fraunhofer HHI (HEVC Compatible;Configuration A)[Z].ISO/IEC JTC 1/SC 29/WG 11(MPEG) document m22570,[s.n.]:[s.n.],2011.
-
[23]
Zhang L,Chen Y,Marta Karczewicz.Disparity vector based advanced inter-view prediction in 3D-HEVC[R].Beijing:IEEE,2013:1632-1635.
-
[24]
Kang J,Chen Y,Zhang L,et al.3D-CE5.h related:Improvements for disparity vector derivation[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 2nd Meeting Document JCT3VB0047,Shanghai:JCT-3V,2012.
-
[25]
Sung J,Koo M,Yea S.3D-CE5.h:Simplification of disparity vector derivation for HEVC-based 3D video coding[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 1st Meeting Document JCT3V-A0126,Stockholm:JCT-3V,2012.
-
[26]
Zhang L,Chen Y,Li X,et al.CE4:Advanced residual prediction for multiview coding[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 4th Meeting Document JCT3V-D0117,Incheon:JCT-3V,2013.
-
[27]
Liu H,Jung J,Sung J,et al.3D-CE2.h:Results of illumination compensation for inter-view prediction[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 2nd Meeting Document JCT3VB0045,Shanghai:JCT-3V,2012.
-
[28]
Gu Zhouye,Zheng Jianhua,Ling Nam,et al.Fast Depth Modeling Mode Selection for 3D HEVC Depth Intra Coding[R].San Jose:IEEE,2013:1-4.
-
[29]
Müller K,Merkle P,Tech G,et al.3D video coding with depth modeling modes and view synthesis optimization[R].Hollywood:IEEE,2012:1-4.
-
[30]
Heo J,Son E,and Yea S.3D-CE6.h:Region boundary chain coding for depth-map[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 1st Meeting Document JCT3V-A0070,Stockholm:JCT-3V,2012.
-
[31]
Jäger F.3D-CE6.h results on simplified depth coding with an optional depth lookup table[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 2nd Meeting Document JCT3V-B0036,Shanghai:JCT-3V,2012.
-
[32]
Chen Y W,Lin J L,Huang Y W,et al.3D-CE3.h results on removal of parsing dependency and picture buffers for motion parameter inheritance[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 3rd Meeting Document JCT3V-C0129,Geneva:JCT-3V,2013.
-
[33]
Yea S,Vetro A.View synthesis prediction for multiview video coding[J].Signal Processing:Image Communication,2009,24(1-2):89.
-
[34]
Tian D,Zou F,Vetro A.CE1.h:Backward view synthesis prediction using neighbouring blocks[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 3rd Meeting Document JCT3V-C0152,Geneva:JCT-3V,2013.
-
[35]
Tian D,Zou F,Vetro A.Backward View Synthesis Prediction for 3D-HEVC[R].Melbourne:IEEE,2013:1729-1733.
-
[36]
Rusanovskyy D,Mueller K,Vetro A.Common test conditions of 3DV core experiments[C]//Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) 5th Meeting Document JCT3V-E1100,Vienna:JCT-3V,2013.
-
[37]
Advanced Television Systems Committee(ATSC).3D-TV Terrestrial Broadcasting,Part 2-SCHC Using Real-Time Delivery[Z].Washington DC:[s.n.],2012.
-
[1]
计量
- PDF下载量: 227
- 文章访问数: 8293
- 引证文献数: 0