ISSN 1000-1239 CN 11-1777/TP

Journal of Computer Research and Development ›› 2015, Vol. 52 ›› Issue (3): 561-568.doi: 10.7544/issn1000-1239.2015.20131444

Previous Articles     Next Articles

Smooth CHKS Twin Support Vector Regression

Huang Huajuan1,2,3, Ding Shifei1,2, Shi Zhongzhi2   

  1. 1(School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, Jiangsu 221116); 2(Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190); 3(College of Information Science and Engineering, Guangxi University for Nationalities, Nanning 530006)
  • Online:2015-03-01

Abstract: Twin support vector regression (TSVR) was proposed recently as a novel regressor that tries to find a pair of nonparallel planes, i.e., ε insensitive down- and up- bounds, by solving two related SVM-type problems. However, it may incur suboptimal solution since its objective function is positive semi-definite and it is lack of complexity control. In order to address this shortcoming, smooth twin support vector regression (STSVR) is introduced using sigmoid function as smoothing technique to convert the original problems into unconstrained minimization, which can improve the training speed. However, its accuracy needs to be improved. In this paper, aiming at the low approximation ability of sigmoid function of STSVR, using CHKS (chen-harker-kanzow-smale) function which has better approximation ability as the smooth function, a new version of smooth TSVR called smooth CHKS twin support vector regression (SCTSVR) model is proposed. In SCTSVR, CHKS function is used to approximate the non-differential term of twin support vector regression. Then Newton-Armijo algorithm is used to solve the corresponding model. We have proved that SCTSVR is not only strictly convex, but also can meet the arbitrary order smooth performance. Meanwhile, the experimental results on several artificial and benchmark datasets show that SCTSVR has better regression performance than STSVR.

Key words: twin support vector regression, chen-harker-kanzow-smale (CHKS), smooth function, Newton-Armijo algorithm, strictly convex

CLC Number: