Hyperconic Multilayer Perceptron

摘要

This paper introduces the design of the hyperconic multilayer perceptron (HC-MLP). Complex non-linear decision regions for classification purposes are generated by quadratic hyper-surfaces spawned by the hyperconic neurons in the hidden layer (for instance, spheres, ellipsoids, paraboloids, hyperboloids and degenerate conics). In order to generate quadratic hyper-surfaces, the hyperconic neurons’ transfer function includes the estimation of a quadratic polynomial. The proper assignment of decision regions to classes is achieved in the output layer by using spheres to determine whether a point is inside or outside the spherical region. The particle swarm optimization algorithm is used for training the HC-MLP. The learning of the HC-MLP selects the best conic surface that separates the data set vectors. For illustration purposes, two experiments are conducted using two distributions of synthetic data in order to show the advantages of HC-MLP when the patterns between classes are contiguous. Furthermore a comparison to the traditional multilayer perceptron is carried out to evaluate the complexity (in terms of the number of estimated patterns) and classification accuracy. HC-MLP is the principal component to implement a diagnosis system to detect faults in an induction motor and to implement an image segmentation system. The performance of HC-MLP is compared to other leading algorithms by using 4 databases commonly used in related literature.