节点文献

EFCS-Grid内基于P2P的分布聚类分析处理策略的研究

Study on Distributed Clustering Analysis Processing Strategy Based on P2P in EFCS-Grid

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 申德荣姜安琦王广奇杨柄恒于戈

【Author】 SHEN De-rong, JIANG An-qi, WANG Guang-qi, YANG Bing-heng, YU Ge (College of Information Science and Engineering, Northeastern University, Shenyang 110004, China)

【机构】 东北大学信息科学与工程学院东北大学信息科学与工程学院 辽宁沈阳110004辽宁沈阳110004

【摘要】 基于数据挖掘的数据可视化是将大数据量展示给用户的一种有效手段.在EFCS-Grid中,基于特定属性的k-平均聚类分析算法进行聚类分析,之后将聚类结果展示给用户.本文通过实验测试并分析了多用户下的采用服务器进行聚类分析的时间代价以及EFCS-Grid系统在不同压力情况下的数据处理的总时间代价,得出了聚类分析在系统的数据处理过程中占重要比重,并随着数据量和并发用户数的增加,系统的性能急剧下降.为此,本文结合P2P体系结构,提出了采用分布式聚类分析数据的处理策略,并将数据处理分为数据合成层和数据分析层.由数据合成层实现数据的整合,保证合成后的数据满足用户的模式需求,之后,在相同模式的基础上实现数据的一次聚类分析和二次聚类分析,达到了通过利用P2P的分布计算能力,缓解集中处理瓶颈和提高网格内数据处理的效率的目的.

【Abstract】 Data visualization by means of data mining is an effective method for presenting an amount of data to users. In EFCS-Grid, data are clustered by using k-mean based on given attributes, then to present the result to users. This paper tests and analyzes the time cost of data clustering analysis implementing at centralized server in case of multi-users, and the total time cost of data processing in EFCS-Grid in different conditions, and draw an conclusion that the time cost of data clustering analysis is more important in that of data process in EFCS-Grid, and the performance of the grid system will become lower greatly with the data amount processed increasing. Thus a distributed clustering analysis strategy is proposed by means of P2P structure, in which data integration layer and data clustering layer are included, the former one integrates the partial data into a complete schema on users demand,then to implement two times data clustering analysis to reach the purposes of easing the deficiency of centralized clustering analysis and improving the efficiency of data clustering by using the distributed computing capability of P2P structure.

【基金】 国家自然科学基金项目(60673139,60573090)资助;国家“八六三”项目(2003AA414210)资助
  • 【文献出处】 小型微型计算机系统 ,Journal of Chinese Computer Systems , 编辑部邮箱 ,2007年08期
  • 【分类号】TP311.13
  • 【下载频次】107
节点文献中: 

本文链接的文献网络图示:

本文的引文网络