Robust Support Vector Regression with Generalized Loss Function and Applications

摘要

The classical support vector machine (SVM) is sensitive to outliers. This paper proposes a robust support vector regression based on a generalized non-convex loss function with flexible slope and margin. The robust model is more flexible for regression estimation. Meanwhile, it has strong ability of suppressing the impact of outliers. The generalized loss function is neither convex nor differentiable. We approximate it by combining two differentiable Huber functions, and the resultant optimization problem is a difference of convex functions (d.c.) program. We develop a Newton algorithm to solve the robust model. The numerical experiments on benchmark datasets, financial time series datasets and document retrieval dataset confirm the robustness and effectiveness of the proposed method. It also reduces the downside risk in financial time series prediction, and significantly outperforms ranking SVM for performing real information retrieval tasks.