西安电子科技大学学报 ›› 2021, Vol. 48 ›› Issue (6): 151-160.doi: 10.19665/j.issn1001-2400.2021.06.019

• 计算机科学与技术 • 上一篇    下一篇

最小二乘损失在多视角学习中的应用

刘云瑞(),周水生()   

  1. 西安电子科技大学 数学与统计学院,陕西 西安 710126
  • 收稿日期:2020-09-09 出版日期:2021-12-20 发布日期:2022-02-24
  • 通讯作者: 周水生
  • 作者简介:刘云瑞(1994—),男,西安电子科技大学硕士研究生,E-mail: 2642911588@qq.com
  • 基金资助:
    国家自然科学基金(61772020)

Application of least squares loss in the multi-view learning algorithm

LIU Yunrui(),ZHOU Shuisheng()   

  1. School of Mathematics and Statistics,Xidian University,Xi’an 710126,China
  • Received:2020-09-09 Online:2021-12-20 Published:2022-02-24
  • Contact: Shuisheng ZHOU

摘要:

SVM-2K模型是一种采用了非光滑合页损失的多视角学习算法。由于非光滑模型的求解过程较为复杂,因此引入了光滑的最小二乘损失的最小二乘支持向量机作为一种经典的支持向量机算法。由于光滑的最小二乘损失的最小二乘支持向量机算法具有计算简单、运算速度快、精度高等优点,被广泛应用于科研领域。为了提高模型的训练速度,在SVM-2K模型中引入了最小二乘思想。首先,提出了完全应用最小二乘损失的LSSVM-2K模型,利用最小二乘损失替换SVM-2K模型中的合页损失,可通过求解线性方程组代替经典多视角学习模型的二次规划求解方法;其次,为探究最小二乘损失对SVM-2K模型的影响,提出了在另外两个部分应用最小二乘损失的模型——LSSVM-2KI和LSSVM-2KII。将新模型与其他多视角学习模型,如SVM+(可分为SVM+A和SVM+B)、MVMED、RMvLSTSVM和SVM-2K模型在同样条件下应用在动物特征数据集(AWA)、UCI手写数字集(Digits)和森林覆盖面积数据集上,以检验新模型的有效性。实验结果表明,3种新模型具有良好的分类表现。特别是LSSVM-2KI模型,在分类精度上更具优势;LSSVM-2K模型不仅在分类精度上效果较好,而且在计算速度上也具有较大的优势;LSSVM-2KII模型在分类效果和训练时间上介于两者之间。

关键词: SVM-2K模型, 最小二乘损失, 合页损失, 多视角学习

Abstract:

The SVM-2K model is a multi-view learning algorithm using nonsmooth hinge loss.However,the solution process of nonsmooth model is more complex.The LSSVM with smooth least squares loss is introduced as a classical support vector machine algorithm which is widely used in the scientific research field because of its simple calculation,fast operation speed and high precision.In order to improve the training speed of the model,the least square idea is introduced into the SVM-2K.First,the LSSVM-2K model which fully applies the least square loss is proposed.The least square loss is used to replace the hinge loss in the SVM-2K model.The quadratic programming method of the classical multi-view learning model can be replaced by solving the linear equations; second,in order to explore the influence of least squares loss on the SVM-2K model,two other models using least squares loss are proposed,LSSVM-2KI and LSSVM-2KII.In this paper,the new model and other multi-view learning models:SVM+ (which can be divided into SVM+A and SVM+B),MVMED,RMvLSTSVM and SVM-2K are applied to three sets of data sets:animal feature data set (AWA),UCI handwritten digits (Digits) and forest coverage area to test the effectiveness of the new model.Experimental results show that the three new models have a good classification performance.In addition,the LSSVM-2KI model has more advantages in classification accuracy.The LSSVM-2K model not only has a better classification accuracy,but also has great advantages in calculation speed.The LSSVM-2KII model lies between the two in classification effect and training time.

Key words: SVM-2K, least squares loss, hinge loss, multi-view learning

中图分类号: 

  • TP391