Hybrid dual stream blender for wide baseline view synthesis

作者:

Highlights:

• Free navigation systems allow users to freely browse a scene by arbitrarily changing viewpoint.

• Missing viewpoints are usually synthesized exploiting the captured neighboring view.

• Free navigation of a scene requires warping some reference views to some desired target viewpoint and blending them to synthesize a virtual view.

• Preliminary view warping allows reducing the size of the convolutional kernels and thus the learnable parameters count.

• A residual encoder–decoder can be used for image blending with a Siamese encoder to further keep the parameters count low.

摘要

•Free navigation systems allow users to freely browse a scene by arbitrarily changing viewpoint.•Missing viewpoints are usually synthesized exploiting the captured neighboring view.•Free navigation of a scene requires warping some reference views to some desired target viewpoint and blending them to synthesize a virtual view.•Preliminary view warping allows reducing the size of the convolutional kernels and thus the learnable parameters count.•A residual encoder–decoder can be used for image blending with a Siamese encoder to further keep the parameters count low.

论文关键词:View synthesis,View blending,Convolutional Neural Network,Hole inpainting

论文评审过程:Received 4 December 2020, Revised 21 June 2021, Accepted 23 June 2021, Available online 30 June 2021, Version of Record 3 July 2021.

论文官网地址:https://doi.org/10.1016/j.image.2021.116366