Journal of Xidian University ›› 2021, Vol. 48 ›› Issue (6): 151-160.doi: 10.19665/j.issn1001-2400.2021.06.019

• Computer Science and Technology • Previous Articles     Next Articles

Application of least squares loss in the multi-view learning algorithm

LIU Yunrui(),ZHOU Shuisheng()   

  1. School of Mathematics and Statistics,Xidian University,Xi’an 710126,China
  • Received:2020-09-09 Online:2021-12-20 Published:2022-02-24
  • Contact: Shuisheng ZHOU E-mail:2642911588@qq.com;sszhou@mail.xidian.edu.cn

Abstract:

The SVM-2K model is a multi-view learning algorithm using nonsmooth hinge loss.However,the solution process of nonsmooth model is more complex.The LSSVM with smooth least squares loss is introduced as a classical support vector machine algorithm which is widely used in the scientific research field because of its simple calculation,fast operation speed and high precision.In order to improve the training speed of the model,the least square idea is introduced into the SVM-2K.First,the LSSVM-2K model which fully applies the least square loss is proposed.The least square loss is used to replace the hinge loss in the SVM-2K model.The quadratic programming method of the classical multi-view learning model can be replaced by solving the linear equations; second,in order to explore the influence of least squares loss on the SVM-2K model,two other models using least squares loss are proposed,LSSVM-2KI and LSSVM-2KII.In this paper,the new model and other multi-view learning models:SVM+ (which can be divided into SVM+A and SVM+B),MVMED,RMvLSTSVM and SVM-2K are applied to three sets of data sets:animal feature data set (AWA),UCI handwritten digits (Digits) and forest coverage area to test the effectiveness of the new model.Experimental results show that the three new models have a good classification performance.In addition,the LSSVM-2KI model has more advantages in classification accuracy.The LSSVM-2K model not only has a better classification accuracy,but also has great advantages in calculation speed.The LSSVM-2KII model lies between the two in classification effect and training time.

Key words: SVM-2K, least squares loss, hinge loss, multi-view learning

CLC Number: 

  • TP391