A landmark-free approach for automatic, dense and robust correspondence of 3D faces

作者:

Highlights:

• We construct an automatic algorithm using high-entropy points instead of landmarks, and take both global and local features of faces into consideration for accurate semantic correspondence.

• We consider topological correspondence and propose a mesh correction algorithm to filter out non-uniform local deformations, and this helps the construction of a compact 3D face model.

• We leverage a prior model with shape and normal statistics to handle hard samples with outliers, noises and expressions. This benefits robustness of the correspondence process with supervised domain knowledge of faces.

摘要

•We construct an automatic algorithm using high-entropy points instead of landmarks, and take both global and local features of faces into consideration for accurate semantic correspondence.•We consider topological correspondence and propose a mesh correction algorithm to filter out non-uniform local deformations, and this helps the construction of a compact 3D face model.•We leverage a prior model with shape and normal statistics to handle hard samples with outliers, noises and expressions. This benefits robustness of the correspondence process with supervised domain knowledge of faces.

论文关键词:3D face,Dense correspondence,Non-rigid registration

论文评审过程:Received 9 October 2019, Revised 21 September 2021, Accepted 10 August 2022, Available online 21 August 2022, Version of Record 28 August 2022.

论文官网地址:https://doi.org/10.1016/j.patcog.2022.108971