节点文献
基于Storm的连续范围查询优化技术
Optimization techniques for continuous range query based on Storm
【摘要】 移动大数据环境下,传统基于位置服务LBS技术面临来自系统扩展性、性能等方面的挑战。首先针对LBS应用的特点,提出了基于Storm的查询框架。然后结合基于Storm的LBS查询框架,设计并实现了并行连续范围查询算法,优化查询性能。针对分布式环境中的一致性问题,设计使用基于ZooKeeper的分布式锁服务,保证查询结果的正确性。进一步,针对基于Storm并行连续范围查询算法中存在访问数据库开销较大的问题,提出了基于TimeCacheMap的缓存优化算法及两种缓存策略,减少了访问数据库的开销,提高了查询效率。
【Abstract】 In the era of mobile big data,traditional location based service(LBS)techniques face new challenges such as lack of system scalability and performance.We first propose a query framework based on Storm according to the characteristics of LBS applications.Then,we design continuous parallel range query algorithms based on Storm to optimize query performance.As for the consistency problem in the distributed environment,we design a distributed lock service based on ZooKeeper to guarantee the correctness of query results.Furthermore,we propose a cache-optimized algorithm based on TimeCacheMap and two caching strategies for the time-consuming problem of accessing database in the parallel continuous range query algorithm based on Storm,so as to reduce the overhead of accessing database and improve query efficiency.
【Key words】 Twitter Storm; continuous range query; parallel query processing; optimization technique;
- 【文献出处】 计算机工程与科学 ,Computer Engineering & Science , 编辑部邮箱 ,2017年01期
- 【分类号】TP311.13
- 【被引频次】2
- 【下载频次】110