Sparse, collaborative, or nonnegative representation: Which helps pattern classification?

作者:

Highlights:

• We investigate the use of Nonnegative Representation (NR) for pattern classification. The idea is that given a query sample y, it should be the nonnegative coefficients over the homogeneous samples (i.e., samples from the same class with y) that determine the class label of y. Constraining the coding coefficients to be nonnegative can automatically boost the representation power of homogeneous samples while limiting the representation power of heterogeneous samples, making the representation sparse while discriminative.

• We propose a simple yet effective NR based Classifier (NRC) for pattern classification. The proposed NR model can be reformulated as a linear equalityconstrained problem with two variables, and solved under the alternating direction method of multipliers framework. Each variable can be solved efficiently in closed-form, and the convergence to the global optimum can be guaranteed.

• Extensive experiments on various visual classification datasets were performed to validate the performance of the proposed NR based classifier (NRC), and the results demonstrated that NRC is very efficient and effective, outperforming the previous representation based classifiers. Besides, with deep features as inputs, NRC also achieves state-of-the-art performance on various visual classification tasks.

摘要

•We investigate the use of Nonnegative Representation (NR) for pattern classification. The idea is that given a query sample y, it should be the nonnegative coefficients over the homogeneous samples (i.e., samples from the same class with y) that determine the class label of y. Constraining the coding coefficients to be nonnegative can automatically boost the representation power of homogeneous samples while limiting the representation power of heterogeneous samples, making the representation sparse while discriminative.•We propose a simple yet effective NR based Classifier (NRC) for pattern classification. The proposed NR model can be reformulated as a linear equalityconstrained problem with two variables, and solved under the alternating direction method of multipliers framework. Each variable can be solved efficiently in closed-form, and the convergence to the global optimum can be guaranteed.•Extensive experiments on various visual classification datasets were performed to validate the performance of the proposed NR based classifier (NRC), and the results demonstrated that NRC is very efficient and effective, outperforming the previous representation based classifiers. Besides, with deep features as inputs, NRC also achieves state-of-the-art performance on various visual classification tasks.

论文关键词:Pattern classification,Nonnegative representation,Collaborative representation,Sparse representation

论文评审过程:Received 12 June 2018, Revised 2 December 2018, Accepted 18 December 2018, Available online 19 December 2018, Version of Record 22 December 2018.

论文官网地址:https://doi.org/10.1016/j.patcog.2018.12.023