GeoConv: Geodesic guided convolution for facial action unit recognition

作者：

Highlights：

• We propose a novel geodesic guided convolution (GeoConv), which can be applied to fine-grained face analysis tasks such as AU recognition.

• We propose an AU recognition network based on GeoConv. This is the first work of integrating 3D information into 2D convolution for AU recognition.

• Experiments verify the effectiveness of our approach and show that our method soundly outperforms the SOTA methods on BP4D and DISFA benchmarks.

摘要

•We propose a novel geodesic guided convolution (GeoConv), which can be applied to fine-grained face analysis tasks such as AU recognition.•We propose an AU recognition network based on GeoConv. This is the first work of integrating 3D information into 2D convolution for AU recognition.•Experiments verify the effectiveness of our approach and show that our method soundly outperforms the SOTA methods on BP4D and DISFA benchmarks.

论文关键词：Geodesic guided convolution,3D morphable face model,Facial action unit recognition,Emotion recognition

论文评审过程：Received 7 May 2021, Revised 19 July 2021, Accepted 25 September 2021, Available online 28 September 2021, Version of Record 10 October 2021.

论文官网地址：https://doi.org/10.1016/j.patcog.2021.108355