节点文献

基于最大散度差鉴别准则的自适应分类算法

Adaptive Classification Algorithm Based on Maximum Scatter Difference Discriminant Criterion

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 宋枫溪张大鹏杨静宇高秀梅

【Author】 SONG Feng-Xi (Shenzhen Graduate School,Harbin Institute of Technology,Shenzhen 518055) ZHANG David (Hong Kong Polytechnic University) YANG Jing-Yu (Nanjing University of Science and Technology,Nanjing 210094) GAO Xiu-Mei (Huaiyin Normal College,Huaiyin 223001)

【机构】 哈尔滨工业大学深圳研究生院香港理工大学南京理工大学淮阴师范学院 深圳 518055南京 210094淮阴 223001

【摘要】 首先证明了,当类内散布矩阵非奇异时,特定参数值c0下最大散度差的最优鉴别方向等同于Fisher最优鉴别方向;其次,给出了最大散度差分类算法的识别率随参数C变化的曲线.该曲线通常为一脉冲曲线.随着参数C的增大,识别率也逐渐增大.当参数C增大到c0时,识别率达到最大值.另外,以往的研究成果表明:当类内散布矩阵奇异时,最大散度差鉴别准则逐步逼近大间距线性投影准则.而且,随着参数C的不断增大,最大散度差分类算法的识别率也单调增大并最终稳定到大间距线性投影分类算法的识别率上.为此,我们提出了基于最大散度差鉴别准则的自适应分类算法.新算法可以根据训练样本的特性(类内散布矩阵是否奇异)自动选择恰当的参数C.在UCI机器学习数据库上的6个数据集以及AR人脸图像数据库上的测试结果表明,自适应最大散度差分类算法具有良好的分类性能.

【Abstract】 In this paper we first prove that the optimal discriminant direction of Maximum scatter difference(MSD)discriminant criterion with a certain value co is equivalent to the optimal Fisher discriminant direction.Second,sample recognition rate curves of MSD are illustrated.The recognition rate curve is usually a pulse curve when the within-class scatter matrix is nonsingnlar.With the increase of parameter C,the recognition rate of MSD also increases.The recognition rate of MSD achieves its maximum when C is equal to c0.In addition,former study showed that,when the within-class scatter matrix is singular,MSD criterion is approaching the large margin linear projection criterion as parameter C increases. Moreover,the recognition rate curve of MSD is non-decreasing.Thus,an adaptive classifica- tion algorithm based on maximum scatter difference discriminant criterion is proposed based on these facts.The new algorithm can tune parameter C automatically according to the characteristics of training samples.Experiment conducted on 6 datasets from UCI Machine Learning Repository and AR face database demonstrates that the adaptive classification algorithm for maximum scatter difference has good classification property.

【基金】 国家自然科学基金(60472060);江苏省高校自然科学研究指导性项目(04KJD520037)资助~~
  • 【文献出处】 自动化学报 ,Acta Automatica Sinica , 编辑部邮箱 ,2006年04期
  • 【分类号】TP301.6
  • 【被引频次】31
  • 【下载频次】383
节点文献中: 

本文链接的文献网络图示:

本文的引文网络