Unified learning approach for egocentric hand gesture recognition and fingertip detection

作者：

Highlights：

• Unified approach to recognize egocentric hand gesture and detect fingertips.

• Binary output of learning network as visible fingers in a gesture.

• Introducing an ensemble of direct regression to predict fingertip position.

• Experiments on known database and real-life images along with VR application.

• Achieved highly accurate gesture classification and fingertip position.

摘要

•Unified approach to recognize egocentric hand gesture and detect fingertips.•Binary output of learning network as visible fingers in a gesture.•Introducing an ensemble of direct regression to predict fingertip position.•Experiments on known database and real-life images along with VR application.•Achieved highly accurate gesture classification and fingertip position.

论文关键词：Convolutional neural network,Fingertip detection,Gesture recognition,Human-computer interaction,Unified detection

论文评审过程：Received 30 December 2020, Revised 1 May 2021, Accepted 20 July 2021, Available online 22 July 2021, Version of Record 29 July 2021.

论文官网地址：https://doi.org/10.1016/j.patcog.2021.108200