节点文献

投影寻踪学习网络分类及其应用

Projection Pursuit Learning Network for Classification and Its Applications

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 田铮刘亚莉肖华勇

【Author】 Tian Zheng Liu Yali Xiao Huayong Department of Applied Mathematics Northwestern Polytechnical University, Xi′an 710072

【机构】 西北工业大学!教授北京大学!硕士生西北工业大学!博士生

【摘要】 研究了用于分类的投影寻踪学习网络,给出了投影寻踪网络的学习机理,证明了基于Legendre 多项式投影寻踪学习的收敛性,并用投影寻踪学习网络较完满地解决了64 维三类目标的分类问题及冰雹云数据的分类问题。

【Abstract】 ANN (artificial neural network), when applied to classification of high dimensional data, suffers from the following two shortcomings: (1) convergence rate is low, and (2) it is apt to converge to a local minimum. We present a new network——projection pursuit learning network (PPLN) based on Legendre polynomial——to overcome these shortcomings. We propose the criterion function for PPLN as shown in eq.(3), where P m is the m th Lengendre polynomial, E is expectation. Using stochastic approximation method and lagranges′ method of multiplier, we get eq.(5), where the weight vector w is updated by eq.(9). Compared with BPL (backpropagation learning) which estimates all the weights simultaneously at each iteration, PPLN estimates the weights cyclically (neuron by neuron and layer by layer) at each iteration. BPL uses fixed nonlinear activations (usually sigmoidal) for hidden neurons, while PPLN uses Legendre polynomial to approximate the unknown nonlinear activations. At the end of section 1, we give the six steps for learning algorithm of PPLN. In section 2, after a lengthy derivation, we proved that the convergence rate of PPLN is O(n -1/2 ), where n is the number of nodes in the hidden layer of PPLN. Figs.3 through 5 give the classification of the same meteorologic data by Hebb learning method (Fig.3), nonlinear Hebb learning method (Fig.4) and PPLN (Fig.5) respectively. They show that both PPLN and nonlinear Hebb learning can achieve much better results than that of linear Hebb learning. But the computational overhead of PPLN is much smaller than nonlinear Hebb learning. Fig.6 gives the classification result of three targets from hundreds of 64 dimentionnal radar data by PPLN. It shows that PPLN is an effective network for classification.

  • 【文献出处】 西北工业大学学报 ,JOURNAL OF NORTHWESTERN POLYTECHNICAL UNIVERSITY , 编辑部邮箱 ,1999年04期
  • 【分类号】TP18
  • 【被引频次】4
  • 【下载频次】133
节点文献中: 

本文链接的文献网络图示:

本文的引文网络