【作者】 郝伟；

【导师】 王伟平； 唐敬雄；

【作者基本信息】 中南大学 ， 计算机技术， 2010， 硕士

【摘要】 面对着如今PB级甚至EB级的数据,传统的网络存储系统面临着巨大的挑战。首先是数据存储量的问题,传统的存储系统如NAS, SAN已不能支撑起越来越庞大的数据量。其次是数据的可靠性、可用性和安全性,存取速度与用户的需求之间的矛盾。最后,存储厂商提供的服务价格与用户很难达成一致。面对这些问题,本文针对湖南移动的网管数据存储需求,提出并构建了基于云的网络存储平台,并完成了相关性能的测试。本文在研究了云存储系统的特点,关键技术的基础上,对当前湖南移动网管系统存储现状进行了分析。借鉴云存储的设计理念,提出一种新的存储架构。该架构主要包括Redis存储系统、MongoDB集群和Cassandra集群,将不同性质的数据存储到对应的存储集群中。新的存储构架基本上解决了网管原系统把所有数据都存储在Mysql集群中所引发存储分散,效率低的问题。基于所设计的存储架构,本文通过三个开源的数据库程序安装调试,部署了网管集中存储平台,并对该平台的性能进行了测试,与原系统所使用的Memcached+Mysql存储模式进行了测试对比。从测试结果上看,本文所设计的集中存储平台在读写性能上较原有系统有明显提升。本文最后对平台实现过程中的研究与开发工作进行了总结,并进一步阐述了对该系统进行扩充与完善的一些后续工作。更多还原

【Abstract】 Today, facing of PB levels or even EB-class data, the traditional network storage systems face huge challenges. The first is the issue of data storage, traditional storage systems such as NAS, SAN can not sustain such a large amount of data.Second, it also can not guarantee data reliability, availability and security, and access speed to meet the needs of users.Finally, they do not provide sufficient low-cost storage services. Face with these problems, in order to deal with Hunan Mobile’s network management data storage needs, we propose and construct a cloud-base network storage system in this paper, and finishe the related performance test.We analyze the avantages and disadvantages of cloud storage systems, key technologies of this, and current storage problem in Hunan Mobile network management system.Based on the storage in the cloud, we propose a new storage architecture, The architecture includes Redis storage subsystem, MongoDB storage subsystem and Cassandra storage subsystems. We take the different types of data store in the different storage subsystem. This storage system is basically designed to solve the problem of scattered storage and inefficient which the original system brought, in the original system all data are stored in Mysql database.Based on the designed storage infrastructure, we use three open-source storage system to install and deploy the cloud-based storage system which designed in this paper, and we test the performance of this system.Particularly, we compared with the original system’s memcached and Mysql, from the test results, we can see that this cloud storage system designed have a marked improvement in read and write performance.In the end, this paper summarizes the research and development work of implementing the platform. And further elaborates on the future follow-ups of expansion and improvement on the system.更多还原