节点文献

分布式消息中间件的设计与实现

Design and Implementation of the Distributed Message Middleware

【作者】 杨鹏

【导师】 胡贯荣;

【作者基本信息】 华中科技大学 , 计算机应用, 2016, 硕士

【摘要】 随着互联网的迅猛发展,各种业务架构也越来越来越复杂,基本上完成了从传统单一架构到分布式架构的转变,这导致系统的维护变得越来越困难,因此迫切的需要一个中间层将各个子系统有机的粘合在一起,使得各个子系统之间低耦合,让整个系统易于维护且方便扩充。设计并实现了一个基于发布-订阅模式的消息中间件,整个中间件由服务器和客户端组成,客户端提供了发送消息和接收消息的接口,服务器则负责消息的可靠传递以及保证消息处理的性能。为了保证消息处理性能,特别定制一个简单、精炼的消息结构,使用消息存储模块对其进行存储和访问;为了保证消息的可靠传递,服务器需要对消息进行持久化存储并且会将消息进行备份,此外为了保证整个系统的稳定性,需要考虑当服务器宕机时的恢复处理。依次介绍了消息管理模块、消息备份机制、网络框架以及为了保证系统可靠性的控制器机制。消息管理提供了消息构造、存储、读取接口,并且为了保证读写性能,还包括消息索引机制以及“零拷贝”传输的实现;消息备份机制提供了多个消息备份之间的一致性状态维护;针对客户端和服务器不同的使用场景,使用了不同的网络框架;控制器则提供了对整个系统中服务器的管理,包括服务器的宕机恢复以及负责对整个系统进行负载均衡。最后对系统进行了性能测试,即对系统发送、接收消息的吞吐量进行了测试。

【Abstract】 With the rapid development of the Internet, a variety of business architecture is increasingly more complex and basically completed the transition from the traditional single architecture to a distributed architecture, which causes more difficulty when maintaining the system. It is urgent to organize all subsystems effectively and reasonably by an intermediate layer subsystems, such that the system can have low coupling between all the subsystems and make the whole system to be maintained and expanded easily.Designs and implements a publish-subscribe model based message oriented middleware. The whole middleware consists of the server and the client, the client provides send and receive interface and the server is responsible for ensuring the reliable delivery and processing performance of message. To ensure the processing performance of message, the article specially customizes a simple and refined message structure, and stores and accesses the message by the storage module; In order to ensure the reliable delivery of message, the server will store message persistently and back up message. In addition in order to ensure the stability of the entire system, the recovery needs to be considered when server shuts down.Describes the message management module 、 message backup mechanism 、 the network framework and the controller mechanism which is aimed at ensuring the reliability of the system in sequence. The message management module provides a message construct, store, read interface, in order to ensure the read and write performance, it also implements an indexing mechanism and the "zero copy" transfer of message; The message backup mechanism maintains the consistent status between multiple backup copies; For the different scenarios of the client and the server, the system uses the different network frameworks; The controller provides the managementof all the servers in cluster, including failover strategy and load balancing of the entire system.Finally, the article tests the performance of the system, mainly tests the throughput of message sending and receiving function.

【关键词】 分布式消息中间件备份可靠性
【Key words】 DistributedMessage oriented middlewareBackupReliability
  • 【分类号】TP368.5;TP315
  • 【被引频次】9
  • 【下载频次】313
节点文献中: 

本文链接的文献网络图示:

本文的引文网络