Normalized edge convolutional networks for skeleton-based hand gesture recognition

作者:

Highlights:

• We propose a novel edge-varying graph by dividing each neighborhood of the central node into three groups: physical neighbors, temporal neighbors and varying neighbors. The design trick design called a “black hole” is presented to enhance the performance of the graph.

• We conduct edge normalization within the central node's two-hop neighborhood, resulting in a novel normalized edge convolution operation.

• A novel sampling strategy called zig-zag sampling is proposed. The strategy is designed to maintain a graceful balance between intergroup and intragroup sampling priorities.

• Normalized edge convolutional networks are constructed for hand gesture recognition, and systematic experiments on publicly available datasets validate the robustness and superiority of our method.

摘要

•We propose a novel edge-varying graph by dividing each neighborhood of the central node into three groups: physical neighbors, temporal neighbors and varying neighbors. The design trick design called a “black hole” is presented to enhance the performance of the graph.•We conduct edge normalization within the central node's two-hop neighborhood, resulting in a novel normalized edge convolution operation.•A novel sampling strategy called zig-zag sampling is proposed. The strategy is designed to maintain a graceful balance between intergroup and intragroup sampling priorities.•Normalized edge convolutional networks are constructed for hand gesture recognition, and systematic experiments on publicly available datasets validate the robustness and superiority of our method.

论文关键词:Skeleton-based hand gesture recognition,Edge-varying graph,Normalized edge convolution,Zig-zag sampling strategy

论文评审过程:Received 12 April 2020, Revised 24 January 2021, Accepted 11 May 2021, Available online 24 May 2021, Version of Record 4 June 2021.

论文官网地址:https://doi.org/10.1016/j.patcog.2021.108044