节点文献
分布式文件系统的流式数据预读
Streaming Data Readahead on Distributed File System
【摘要】 在分布式文件系统中,网络和磁盘往往是影响IO性能的主要因素.如何最大限度地挖掘网络和磁盘的性能潜力,长期以来一直都是非常活跃的研究课题.已有研究工作主要侧重于预取策略和数据的缓存策略,而未能将网络和服务器端磁盘I/O统一进行调度.提出并设计实现了一种流式预读方法,通过在客户端改变发送预读请求和接收预读数据的顺序,交错网络传输和磁盘访问,实现了延迟隐藏.测试表明,这种方法确实显著提高了顺序读性能.
【Abstract】 The IO process of Distributed File System includes network transmission and disk IO on server, which tend to be the bottlenecks that affect performance. How to explore the potential of network and disk performance has long been a subject of very active research. We design and implement a distribute file system BlueOcean, but we find that BlueOcean has not paralleled up to network and disk. So we have proposed and implemented a streaming data read-ahead method, which interleaves network transmission and disk IO and achieves a delay hiding. With experimental test, we found this method has actually improved system performance.
【Key words】 distribute file system; readahead; latency hiding; network transmission; disk IO;
- 【文献出处】 计算机研究与发展 ,Journal of Computer Research and Development , 编辑部邮箱 ,2012年S1期
- 【分类号】TP316.4
- 【被引频次】5
- 【下载频次】221