An apparent simplicity appearing in pattern classification problems

摘要

An apparent simplicity appearing in the classification problems is described in order to assert the importance of the feature selection. If we assume that the sample size is finite, then, by increasing the number of features used to describe each sample pattern, we can improve the interclass distinguishability. On the other hand, increasing the number of features reduces the generality of class descriptions. Therefore, the enhanced distinguishability may be an apparent simplicity appearing in the interclass structure. We illustrate theoretically and experimentally the existence of the trade-off between the interclass distinguishability and the generality of class descriptions.