节点文献
支持动态更新的网格数据传输技术研究
Research on Grid Data Transferring Technologies Supporting Dynamic Updating
【作者】 杨欢;
【导师】 黄林鹏;
【作者基本信息】 上海交通大学 , 计算机软件与理论, 2008, 硕士
【摘要】 数据密集型科学和工程应用常常需要在网格环境中传输海量的数据,数据传输的性能和灵活性是重要的指标。本文研究支持动态更新的网格数据传输技术,一方面提出两种数据传输方式,以提高网格数据传输的性能;另一方面研究网格数据传输中的动态更新技术,以提高网格数据传输的灵活性。具体说来,本文研究内容有如下几个方面:(1)本文提出了多副本带状数据传输方式。这种数据传输方式同时使用分布在网格中的同一数据的多个副本进行数据传输,并能屏蔽不同副本所在服务器支持的数据传输协议的差异和副本所在域的差异。实验证明这种数据传输方式能提高数据传输性能。(2)当网格应用程序使用多维数据时,查询和传输是两个基本操作。为了支持高效的查询操作,多维数据常常分块存储,这使得查询返回的数据为物理上不连续的数据,实验表明直接传输这种数据性能较低。本文研究了这个问题,并提出使用逻辑链接文件的方法解决此问题。通过将物理上不连续的数据虚拟链接为一个逻辑链接文件,并使用针对逻辑链接文件的数据传输方法,多维数据的传输性能得以提高。(3)任务关键型网格应用程序要求数据传输软件具备在线演化能力,即在数据传输过程不中断的情况下对软件进行动态更新。为满足上述需求,本文提出了一套动态更新实现方案,包括一套可动态更新软件构建规范Du-OSGi规范、一个动态更新框架Du-OSGi框架和一组动态更新工具集。将该套方案应用到网格数据传输中,可使得数据传输软件具备在线演化能力,并且更新过程中数据传输性能几乎不受影响。
【Abstract】 Data-intensive scientific and engineering applications require the transfer of large amount of data in grid, in which process the performance and efficiency are two important indicators. This thesis researches on grid data transferring and its dynamic updating technologies. On one hand, two data transferring approaches are proposed, both of which can enhance the transferring performance. On the other hand, dynamic updating of grid data transfer is researched and solution is proposed. The main contents of the thesis include the following:(1) This thesis proposes striped transferring approach based on multiple replicas, which performs data transferring by simultaneously using multiple replicas and shielding the protocol differences and domain differences among replicas. Experiments prove that the data transferring performance is enhanced while adopting the approach.(2) When grid applications operate on multidimensional data, query and transfer are two widely used operations. To support flexible query operation, a storage structure based on partition the multidimensional data is adopted. However, this will cause decrease of the transfer performance. This paper investigates this problem and proposes the logically linked file (LLF) approach to solve it. By virtually linking the qualified non-continuous data sets to a LLF and providing a specific transfer mechanism for LLF, the transfer performance is improved.(3) Mission-critical applications in grid require the online evolvement ability of the data transferring software, namely, the ability to dynamic update the software while the transfer is ongoing. This thesis proposes a solution to the problem, including a dynamic updatable software composing specification named the Du-OSGi Specification, a dynamic update framework named the Du-OSGi Framework, and a set of dynamic updating tools. After applying the solution to data transferring, the data transferring software acquires the online evolvement ability. Experiments show the data transferring performance will not be influenced by updating.
- 【网络出版投稿人】 上海交通大学 【网络出版年期】2008年 06期
- 【分类号】TN919.6
- 【被引频次】3
- 【下载频次】200