节点文献
基于P2P的key-value存储系统关键技术研究
The Research on Key Technology of Key-Value Storage System Based on P2P
【作者】 杜磊;
【作者基本信息】 西安电子科技大学 , 软件工程, 2009, 硕士
【摘要】 随着Internet技术的飞速发展,互联网上日益增加的用户和分布广阔的数据,给分布式存储技术带来了新的挑战。另一方面,随着P2P计算模式的兴起、网络带宽的大幅增加和Internet端系统计算能力的迅速增强,原先被忽视的端系统成为一种宝贵的资源。如何充分利用这些端系统,在动态的P2P网络环境中构建大规模、高可扩展、高可靠、高性能的分布式存储系统,是近年来研究的热点之一。本文在研究和分析P2P结构化路由算法和典型分布式存储系统研究成果的基础上,描述了KVStore系统的整体框架,并对其中的路由模块和可靠性模块进行了设计和实现。由于在路由算法中存在网络波动,节点异构性等问题,对Kademlia路由算法进行了改进,给出使用超级节点技术来改进节点异构性问题,研究PNT路由表和可并发参数技术改进网络波动引起的网络延时等问题;针对P2P网络节点的动态性,采用数据存储可靠性算法,解决文件共享过程中容易出现的错误问题。并通过实验验证了算法的有效性。
【Abstract】 With the rapid development of Internet technology, the increasing user andmassive data bring the new challenge for the distributed storage technology. On theother hand, with the development of peer-to-peer computing paradigm, networkbandwidth and the capacity of Internet-based end-systems, the end-systems ignored inthe past becomes a valued computing resource. How to utilize the end-systemsresources to build a distributed storage system with large-scale, high scalability,reliability and performance in dynamic peer-to-peer network environment is a hotresearch topic in recently year.Based on systematically analyzing the relevant works on the P2P structured routingalgorithms and distributed storage systems, this dissertation analyzes the overallframework of the KVStore storage system, designs and implements the routing moduleand the reliability module. In order to resolve the problem in this routing algorithm,such as the Churn and the Heterogeneity in the network, the Kademlia routing algorithmhas been optimized. The supernode technology is used to make an improvement of theformer problem and PNT routing table and dynamic alpha parameter technology areused to solve the latter problem. With the dynamic of P2P network, this dissertation usesa data reliable storage algorithm to improve the correctly of a sharing file. It canefficiently decrease files that are fault and recover the sharing files. The dissertationfinally verifies the effectiveness of the algorithms through experiments.
【Key words】 Routing Algorithm; Churn; Heterogeneity; Data Reliable Storage Algorithm;
- 【网络出版投稿人】 西安电子科技大学 【网络出版年期】2011年 S1期
- 【分类号】TP333
- 【被引频次】1
- 【下载频次】84