Cross-view classification by joint adversarial learning and class-specificity distribution

作者:

Highlights:

• A novel deep adversarial network is proposed for cross-view classification. In order to solve the scale-sensitive problem in existing methods, adversarial learning is used to get a robust view-consistent representation.

• We find that ℓ1,2-norm has an important role of characterizing class-specificity distribution in dimension space, which is not considered in the existing methods. Therefore, we apply it to learn latent representations which well characterize class structure.

• We integrate adversarial learning and class-specificity into a unified optimization framework. Thus, the learned view-consistent representations not only well encode discriminant information but also well characterize class structure in dimension space.

• Extensive experiments on several datasets are conducted to demonstrate the superiority of our method over state-of-the-art methods, and the ablation experiments prove the effectiveness of our contributions.

摘要

•A novel deep adversarial network is proposed for cross-view classification. In order to solve the scale-sensitive problem in existing methods, adversarial learning is used to get a robust view-consistent representation.•We find that ℓ1,2-norm has an important role of characterizing class-specificity distribution in dimension space, which is not considered in the existing methods. Therefore, we apply it to learn latent representations which well characterize class structure.•We integrate adversarial learning and class-specificity into a unified optimization framework. Thus, the learned view-consistent representations not only well encode discriminant information but also well characterize class structure in dimension space.•Extensive experiments on several datasets are conducted to demonstrate the superiority of our method over state-of-the-art methods, and the ablation experiments prove the effectiveness of our contributions.

论文关键词:Cross-view,View consistency,Class-specificity distribution,Adversarial learning

论文评审过程:Received 10 March 2020, Revised 18 July 2020, Accepted 6 September 2020, Available online 10 September 2020, Version of Record 15 September 2020.

论文官网地址:https://doi.org/10.1016/j.patcog.2020.107633