【摘要】 针对传统的决策树分类算法不能有效解决海量数据挖掘的问题,结合并行处理模型MapReduce,研究基于粒计算的ID3决策树分类的并行化处理方法。基于信息粒的二进制表示来构建属性的二进制信息粒向量,给出数据集的二进制信息粒关联矩阵表示;基于二进制信息粒关联矩阵,提出属性的信息增益的计算方法,设计基于MapReduce的粒计算决策树并行分类算法。通过使用标准数据集和实际气象领域的雷电真实数据集进行测试,验证了该算法的有效性。更多还原

【Abstract】 Because the traditional decision tree algorithm fails to solve the mass data mining,combining with MapReduce,the parallel ID3 algorithm based on the granular computing(GrC)was studied.Based on binary representation of information granular,a binary vector of attribute was constructed,a binary information granule correlation matrix of dataset was also given.On the basis of this,a algorithm was proposed to compute information gain of attributes,and a decision tree method using granular computing was also proposed,which was a parallel classical algorithm based on MapReduce.UCI benchmark datasets and the real thunder data from meteorological bureau were used in the experiments to verify the effectiveness the presented algorithm.更多还原