节点文献
决策树算法的优化研究
Analysis and improved implementation of decision tree algorithms
【摘要】 针对决策树C4.5/5.0分类算法及改进的算法在创建决策树时训练误差率和校验误差率相对较高的缺点,提出一些改进策略,即利用属性相关性进行属性约简与度量以达到解决属性集合中的冗余属性,采用一定置信度值进行决策树的修剪,采用优化的Chi2算法更合理更准确地对连续属性进行离散化,基于改进策略设计并实现一个分类器,将改进的算法应用于Breast-cancer实例,实验结果证明改进的算法生成的决策树具有较高的分类正确率。
【Abstract】 In order to effectively deal with the problems that the training error and test error are comparatively high when decision tree is built based on C4.5 and C5.0 decision tree algorithms,three improved strategies are presented.The improved strategies are as follows:Attribute correlation that can not only remove irrelevant features,also can find redundant feature with high feature correlation,is to quantify the correlation between attribute and concept;pruning strategy adopts appropriate confidence to good purpose,then reduces the attribute number and the different value of each attribute assuring the feasibility and effectiveness of the decision tree;a variation of the Chi2 algorithm is proposed to perform attribute discretization and selection great exactly.The improved strategies are applied to the Breast-cancer data and the simulation validates their efficiency.Through experiment testing,the improved algorithm can construct the better accuracy of classification compared with the classical decision tree algorithms.
【Key words】 attribute correlation; attribute reduction; pruning strategy; discretization; Chi2 algorithm;
- 【文献出处】 计算机工程与应用 ,Computer Engineering and Applications , 编辑部邮箱 ,2010年13期
- 【分类号】TP18
- 【被引频次】24
- 【下载频次】390