节点文献

一种改进的CLIQUE算法及其并行化实现

Improved CLIQUE Algorithm and its Parallelization

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 林鹏陈曦龙鹏飞傅明

【Author】 LIN Peng;CHEN Xi;LONG Peng-fei;FU Ming;Hunan Provincial Key Laboratory of Intelligent Processing of Big Data on Transportation,Changsha University of Science and Technology;School of Computer and Communication Engineering,Changsha University of Science and Technology;

【通讯作者】 林鹏;

【机构】 长沙理工大学综合交通运输大数据智能处理湖南省重点实验室长沙理工大学计算机与通信工程学院

【摘要】 CLIQUE算法是一种高效的聚类算法,但其聚类结果存在锯齿边界的问题。而且随着数据规模和维度的增加,算法的效率受到极大影响。针对这些问题,提出一种改进的CLIQUE算法,算法首先使用边界修正方法和滑动网格方法,对稠密区域的边界和稀疏区域进行扫描,寻回被剪枝的稠密网格,提升网格划分的质量;然后实现了改进算法在MapReduce下的分布式并行化,并通过实验验证了算法的性能。实验结果表明,改进后的并行算法的聚类准确率提高了17%~26%,同时有效地减少了处理海量数据的运行时间,具有良好的扩展性。

【Abstract】 CLIQUE is an efficient algorithm. But its clustering result is defective with the serrated boundary.And with the increase of data size and dimension,the efficiency of the algorithm has been greatly affected. This paper proposes an improved CLIQUE algorithm.The algorithm firstly uses the boundary-correcting method and grid-sliding method to improve the quality of meshing by Scanning the dense area border and sparse area and then retrieving the pruned dense grid.Then the parallelization of the improved algorithm is achieved on top of MapReduce.A series of experiments are carried out and the clustering accuracy,processing time,speedup and scalability of the improved algorithm are tested.The result of experiments proves that the algorithm is improved 17% to 26% in accuracy.The parallel algorithm decreases the runtime effectively in massive data processing,which shows excellent attribute in scalability.

【基金】 国家自然科学基金资助项目(61772087);长沙理工大学研究生科研创新项目(CX2017SS20)
  • 【文献出处】 计算技术与自动化 ,Computing Technology and Automation , 编辑部邮箱 ,2018年04期
  • 【分类号】TP311.13
  • 【被引频次】5
  • 【下载频次】171
节点文献中: 

本文链接的文献网络图示:

本文的引文网络