节点文献

基于网格的数据传输质量控制与数据分发

Quality Control of Data Transfer and Data Dispatch Based on Grid

【作者】 陈宝利

【导师】 庞丽萍;

【作者基本信息】 华中科技大学 , 计算机软件与理论, 2004, 硕士

【摘要】 目前的网格环境中,数据文件传输主要解决的问题是文件的可获取性及可控制共享性,还没有考虑传输过程中QoS(Quality of Service)控制的问题。“基于网格的数据传输质量控制与数据分发”研究目的是实现面向网格的带有质量描述的数据文件传输,按照应用的实时性要求提供数据资源的透明容错访问,并研究网格中数据分发的行为规律及算法。针对网格环境的多变性和以服务为中心的特征,在数据传输的研究中,本课题提出了数据的发布和汇聚两阶段式数据处理方式。为解决网格范围的命名冲突问题,提出了版本定位、名域定位的概念;为提供容错支持,基于严格一致多副本索引机制,实现数据文件的并行分片传输;为了增强对实际环境的适应性,提出了质量参数基于统计的动态调整策略。研究过程中还提出了网格范围的数据分发的概念、探讨了其分发算法,并对分发过程的应用场景之一——MPI(Message Passing Interface)消息日志系统进行了讨论和分析。本课题已经实现了模型系统,该系统吸收了研究中的相关理论及方法,实现了客户端扩展、索引服务、节点功能代理服务和文件服务。这四个模块在索引体系的指导和带宽控制体系的监督下,相互配合完成数据从分发到汇聚及质量参数调整的全过程。客户端扩展的数据传输管理为系统的应用带来相当的灵活性。数据的并行分片传输不仅提高了传输性能,也具有一定的传输容错性能。“数据传输质量控制” 的研究及其实现系统也是国内较早把目光着眼于软实时的网格文件传输控制并付诸实现系统。对该领域的研究具有一定的实用价值和理论的探索意义。

【Abstract】 Today’s Grid environment current focus all attention on data files’ securable ability and controllable share ability,without sufficient mention on quality control especially when transferring.The goal of “Real Time Information Processing Platform” is to research data transfer feature with QoS restricted, to supply transparent fault tolerant access of data file and to research data dispatch in grid environment.According to the dynamic feature and service centered infrastructure of grid, the two phase processing way is brought front. To solve the naming collision, locating by version and locating by namespace is introduced into the mechanism. To achieve fault tolerant, the uniform replica index mechanism is adopted as well as parallel stripped transfer. To increase the adaptability, a strategy of quality parameter’s dynamic adjustment is designed. Also the data scatter and it’s application scenery is studied and analyzed.This research has be realized a model system, which is realized by four modules: extended client, index service, node agent and file service. They are directed and managed by index mechanism, cooperate with each other to complete the data dispatch and gather and QoS adjustment.This system is also the first domestic system which pay attention on soft real time of data transfer in grid region, and it is also be realized. So it has determinate practical merit and groping meaning.

【关键词】 网格数据传输服务质量容错
【Key words】 GridData transferQoSFault-tolerant
  • 【分类号】TP393.09
  • 【下载频次】231
节点文献中: