Non-manual grammatical marker recognition based on multi-scale, spatio-temporal analysis of head pose and facial expressions

作者：

Highlights：

• Eyebrow gestures and periodic head movements convey linguistic information.

• We propose multi-scale approach for recognizing non-manual grammatical marker.

• We obtain high-level features from spatio-temporal analysis of non-manual events.

• We use two-stage CRFs to recognize events and partition them into phases.

• Experiments demonstrate superior improvements in ASL.

摘要

•Eyebrow gestures and periodic head movements convey linguistic information.•We propose multi-scale approach for recognizing non-manual grammatical marker.•We obtain high-level features from spatio-temporal analysis of non-manual events.•We use two-stage CRFs to recognize events and partition them into phases.•Experiments demonstrate superior improvements in ASL.

论文关键词：American Sign Language (ASL),Non-manual grammatical markers,Eyebrow height,Head gestures,Facial expressions,Conditional Random Field (CRF)

论文评审过程：Received 7 June 2013, Revised 26 December 2013, Accepted 21 February 2014, Available online 11 March 2014.

论文官网地址：https://doi.org/10.1016/j.imavis.2014.02.009