Recognising complex activities with histograms of relative tracklets
作者:
Highlights:
• We propose a method for activity recognition from video and accelerometer data.
• Visual accelerometer localization and tracking establishes cross-modal relations.
• RETLETS encode relative motion between tracked objects and local visual features.
• Recognition using various feature combinations is evaluated on the 50 Salads dataset.
• The method using RETLETS outperforms the state-of-the-art on this dataset.
摘要
•We propose a method for activity recognition from video and accelerometer data.•Visual accelerometer localization and tracking establishes cross-modal relations.•RETLETS encode relative motion between tracked objects and local visual features.•Recognition using various feature combinations is evaluated on the 50 Salads dataset.•The method using RETLETS outperforms the state-of-the-art on this dataset.
论文关键词:Activity recognition,Relative tracklets,Sensor fusion,Food preparation
论文评审过程:Received 10 March 2016, Revised 14 July 2016, Accepted 31 August 2016, Available online 1 September 2016, Version of Record 6 December 2016.
论文官网地址:https://doi.org/10.1016/j.cviu.2016.08.012