节点文献

一种灵活可扩展的跨洲际数据放置实验床

A Flexible and Scalable Intercontinental Testbed for Data Placement Research

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 魏光杨海龙栾钟治钱德沛

【Author】 Wei Guang;Yang Hailong;Luan Zhongzhi;Qian Depei;Sino-German Joint Software Institute, School of Computer Science & Engineering, Beihang University;School of Data and Computer Science, Sun Yat-Sen University;

【机构】 北京航空航天大学计算机学院中德软件联合研究所中山大学数据科学与计算机学院

【摘要】 随着大数据时代的到来,不同领域的科研人员往往需要跨科研机构甚至是跨国家地域的移动大规模科学数据,从而更好的共享科研数据并促成跨学科协同分析,加速观测数据向科学发现的转化。然而,现有的研究工作缺乏对广域网环境下影响数据放置性能、开销和资源消耗等因素的深入分析,这些因素包括数据集中文件的数量和大小分布、源和目的节点文件系统的性能特性、各节点间网络性能的波动以及IPv4/IPv6网络协议的可用性等。为了更好的研究广域网环境下影响科学数据放置性能的多种因素,本文在中美真实网络环境下搭建了一种灵活可扩展的跨洲际数据放置实验床,并将其作为基础设施开放给科研人员用于运行多种类型的数据放置实验。

【Abstract】 The emerging cloud computing and the era of big data promote researchers from different discipline to share large amount of scientific data across institutes and geological boundaries, in order to establish international collaborations acceleratingthe transition fromobservations to scientific discoveries. However, existing work lacks the understanding of various factors thataffect the performance, cost and resourceconsumption of data placement in the wide area network environment. These factors include the number and size of the files in the dataset, the characteristic of the filesystem on the source and destination nodes, the fluctuation of the network performance between the nodes, as well as the availability of IPv4/IPv6 network protocol. To better understand the factors that affect the performance of scientific data placement in wide area networkenvironment, we propose a flexible and scalable intercontinental testbed between China and USusing the real network, which is open to the researchers as a facility to conduct various data placement experiments.

【关键词】 数据放置洲际实验床
【Key words】 data placementIntercontinental testbed
【基金】 基金项目:基于洲际实验床的数据密集型应用中数据放置基本问题研究(61361126011)
  • 【文献出处】 科研信息化技术与应用 ,e-Science Technology & Application , 编辑部邮箱 ,2017年02期
  • 【分类号】TP399-C1
  • 【下载频次】26
节点文献中: 

本文链接的文献网络图示:

本文的引文网络