节点文献
改进的非线性最小二乘算法训练多层前馈神经网络
Modified Nonlinear Least-Square Algorithm for Training Multilayer Feedforward Neural Networks
【摘要】 本文通过在普通非线性最小二乘算法的准则函数中加一个正则项,推导出一种改进的非线性最小二乘算法,包括算法的批处理形式和递推形式.使用该算法的递推形式训练多层前馈神经网络能克服病态、减少计算量和内存占用量.文中给出的仿真结果说明该算法具有比常用的BP算法更好的收敛性能.
【Abstract】 A modified nonlinear least-square algorithm is derived from the approach appending a regularization term to the conventional nonlinear least-square criterion,ineluding the batch and recursive versions. Training multilayer feed forward neural networks using its recursive algorithm,the storage and computational requirements are reduced,and also it can be applicable to the ill-conditioned cases. Simulation demonstrates the superior convergence performance of its recur sive algorithm compared with the back propagation routine
【关键词】 非线性最小二乘算法;
准则函数;
多层前馈神经网络;
正则化;
【Key words】 Nonlinear least-square algorithm; Criterion; Multilayer feedforward neural network; Regularization;
【Key words】 Nonlinear least-square algorithm; Criterion; Multilayer feedforward neural network; Regularization;
- 【文献出处】 电子学报 ,Acta Electronica Sinica , 编辑部邮箱 ,1997年01期
- 【分类号】TP183
- 【被引频次】15
- 【下载频次】150