TY - GEN
T1 - Deep inter prediction via reference frame interpolation for blurry video coding
AU - Zhu, Zezhi
AU - Zhao, Lili
AU - Lin, Xuhu
AU - Guo, Xuezhou
AU - Chen, Jianwen
PY - 2021
Y1 - 2021
N2 - ![CDATA[In High Efficiency Video Coding (HEVC), inter prediction is an important module for removing temporal redundancy. The accuracy of inter prediction is much affected by the similarity between the current and reference frames. However, for blurry videos, the performance of inter coding will be degraded by varying motion blur, which is derived from camera shake or the acceleration of objects in the scene. To address this problem, we propose to synthesize additional reference frame via the frame interpolation network. The synthesized reference frame is added into reference picture lists to supply more credible reference candidate, and the searching mechanism for motion candidates is changed accordingly. In addition, to make our interpolation network more robust to various inputs with different compression artifacts, we establish a new blurry video database to train our network. With the well-trained frame interpolation network, compared with the reference software HM-16.9, the proposed method achieves on average 1.55% BD-rate reduction under random access (RA) configuration for blurry videos, and also obtains on average 0.75% BD-rate reduction for common test sequences.]]
AB - ![CDATA[In High Efficiency Video Coding (HEVC), inter prediction is an important module for removing temporal redundancy. The accuracy of inter prediction is much affected by the similarity between the current and reference frames. However, for blurry videos, the performance of inter coding will be degraded by varying motion blur, which is derived from camera shake or the acceleration of objects in the scene. To address this problem, we propose to synthesize additional reference frame via the frame interpolation network. The synthesized reference frame is added into reference picture lists to supply more credible reference candidate, and the searching mechanism for motion candidates is changed accordingly. In addition, to make our interpolation network more robust to various inputs with different compression artifacts, we establish a new blurry video database to train our network. With the well-trained frame interpolation network, compared with the reference software HM-16.9, the proposed method achieves on average 1.55% BD-rate reduction under random access (RA) configuration for blurry videos, and also obtains on average 0.75% BD-rate reduction for common test sequences.]]
UR - https://hdl.handle.net/1959.7/uws:67320
U2 - 10.1109/VCIP53242.2021.9675429
DO - 10.1109/VCIP53242.2021.9675429
M3 - Conference Paper
SN - 9781728185514
BT - Proceedings of the 2021 IEEE International Conference on Visual Communications and Image Processing (VCIP), December 5-8, 2021, Novotel Munich City, Germany
PB - IEEE
T2 - IEEE Visual Communications and Image Processing (Conference)
Y2 - 5 December 2021
ER -