Advanced Search
    Liu Yong, Jiang Shali, Liao Shizhong. Approximate Gaussian Kernel for Large-Scale SVM[J]. Journal of Computer Research and Development, 2014, 51(10): 2171-2177. DOI: 10.7544/issn1000-1239.2014.20130825
    Citation: Liu Yong, Jiang Shali, Liao Shizhong. Approximate Gaussian Kernel for Large-Scale SVM[J]. Journal of Computer Research and Development, 2014, 51(10): 2171-2177. DOI: 10.7544/issn1000-1239.2014.20130825

    Approximate Gaussian Kernel for Large-Scale SVM

    • Training support vector machine (SVM) with nonlinear kernel functions on large-scale data is usually very time consuming. In contrast, there exist faster solvers to train the linear SVM. To utilize the computational efficiency of linear SVM without sacrificing the accuracy of nonlinear ones, in this paper, we present a method for solving large-scale nonlinear SVM based on an explicit description of an approximate Gaussian kernel. We first give the definition of the approximate Gaussian kernel, and establish the connection between approximate Gaussian kernel and Gaussian kernel, and also derive the error bound between these two kernel functions. Then, we present an explicit description of the reproducing kernel Hilbert space (RKHS) induced by the approximate Gaussian kernel. Thus, we can exactly depict the structure of the solutions of SVM, which can enhance the interpretability of the model and make us more deeply understand this method. Finally, we explicitly construct the feature mapping induced by the approximate Gaussian kernel, and use the mapped data as input of linear SVM. In this way, we can utilize existing efficient linear SVM to solve non-linear SVM on large-scale data. Experimental results show that the proposed method is efficient, and can achieve comparable classification accuracy to a normal nonlinear SVM.
    • loading

    Catalog

      Turn off MathJax
      Article Contents

      /

      DownLoad:  Full-Size Img  PowerPoint
      Return
      Return