节点文献

基于图查询系统的图计算引擎

Graph processing engine based on graph query system

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 柯学翰陈榕

【Author】 KE Xuehan;CHEN Rong;Institute of Parallel and Distributed Systems, Software School, Shanghai Jiao Tong University;

【机构】 上海交通大学软件学院并行与分布式系统研究所

【摘要】 在目前的研究中,图查询和图计算系统是相互独立的,但在实际应用中两者通常是同时存在的。为解决相互独立的系统带来的存储空间浪费、数据一致性维护等问题,基于图查询系统设计了一种图计算引擎,使得在单一系统中支持查询和计算操作。通过为键值对存储增加图计算索引、基于拉取模式的数据更新等方式,有效地提高系统中数据遍历的性能和减少数据传输的成本,同时针对数据更新和负载均衡等方面提出了相关优化。实验表明,该图计算引擎能够达到与传统图计算系统PowerLyra和Gemini相近或比其更优的性能,且具有较好的可扩展性。

【Abstract】 Recently, graph query and graph processing are emphasis of graph-structured data research. However, independent graph system mismatched combining applications, which needed both query and processing. To avoid some issues brought by independent system, such as wasting resource and data inconsistency, a method that providing a graph processing engine based on graph query system was proposed, in order to support query and processing operation in a unified system. Through adding index for graph processing and applying pull-based graph propagation method to over locality issue, the performance of the computation and transmission was largely improved. Besides, some optimization approaches were put forward for message updating and work balanced. The experimental results show that the processing engine can provide close(reduced by no more than 1x) or even better(up to 20x) performance compared to specific graph processing systems(e.g., Gemini and Power Lyra) by leveraging new designs and optimizations, and also has good scalability.

【基金】 国家自然科学基金资助项目(No.61772335)~~
  • 【分类号】TP311.13
  • 【被引频次】2
  • 【下载频次】169
节点文献中: 

本文链接的文献网络图示:

本文的引文网络