【作者】 王旭；

【导师】 明冬萍； 司全玉；

【作者基本信息】 中国地质大学(北京) ， 工程硕士（专业学位）， 2022， 硕士

【摘要】 伴随着人们生活水平的逐步提高,人们对精神文化需求、对即时性、碎片化、高质量内容阅读的需求不断增加。在大众自媒体时代,人人皆是内容创作者,近些年用户生产内容(UGC)的规模呈惊人态势扩大并已远超专业媒体工作者生产内容(PGC)。并且随着UGC能力的提升和5G时代的到来,内容行业还会有更大发展。激增的用户量对系统负载能力发起极大的挑战,信息数据的爆炸式增长,迫切要求系统有对海量数据进行高性能存储、高效精准搜索以及数据分析的能力。传统单体式架构面对这些问题已凸显出缺陷,并伴随着业务需求不断增加,系统将变得越来越杂乱,难以实现水平扩展和维护。针对单体式架构暴露的以上问题,本论文展开研究基于微服务架构的内容创作平台的设计与实现,结合微服务架构特点完成系统微服务划分、各微服务独立开发和部署,实现了系统模块间解耦、提高了系统可扩展性,具备持续交付能力。本论文结合UML用例图对不同用户进行用例分析,详尽地对微服务各功能模块的具体功能进行介绍。根据系统需求分析,遵循设计原则完成系统总体架构设计和数据库设计。在实现上充分利用分布式技术,运用Spring Cloud框架所提供的相关组件,实现服务治理;利用Redis实现高速缓存服务;利用MongoDB、FastDFS、ElasticSearch解决海量数据的高性能存储和高效精准搜索问题;利用RabbitMQ实现异步解耦和延迟队列;通过使用Docker容器化技术完成大数据环境搭建,并实现Mysql到Hive的数据同步,使用Spark和ElasticSearch等实现用户画像分析。最后,按系统需求设计测试用例,掌握黑白盒测试、接口测试等测试方法并熟练运用Junit、Jemeter等工具完成系统全面的测试。系统设计中将大量软件工程学方法应用于实践,并集成诸多优秀技术组件对系统进行强化,目前已完成数次迭代更新,系统具备对外提供稳定且高效服务的能力,满足预期目标。更多还原

【Abstract】 With the gradual improvement of people’s living standards,people’s demand for spiritual and cultural needs,as well as for real-time,fragmented and high-quality content reading is increasing.In the era of mass we-media,everyone is a content creator.In recent years,the scale of user-generated content(UGC)has shown an amazing trend of expansion and has surpassed that of professional media workers(PGC).And with the enhancement of UGC capability and the arrival of 5G era,the content industry will have greater development.The surging number of users poses a great challenge to the system load capacity.The explosive growth of information data urgently requires the system to have the ability of high-performance storage,efficient and accurate search and data analysis of massive data.The traditional monolithic architecture has shown defects in the face of these problems,and with the increasing business requirements,the system will become more and more cluttered and difficult to achieve horizontal scaling and maintenance.With monomer type architecture exposed the problem above,this thesis launches the research based on the content of the micro service architecture creation platform,the design and implementation of combining with the characteristics of micro service architecture to complete the system services division,the micro service development and deployment of independent,realize the decoupling between modules,improve the system scalability,continuous delivery ability.This thesis combines UML use case diagram to analyze the use cases of different users,and introduces the specific functions of each functional module of micro-service in detail.According to the system requirement analysis,follow the design principles to complete the overall system architecture design and database design.In the implementation,we make full use of distributed technology and use relevant components provided by Spring Cloud framework to realize service governance.Using Redis to achieve cache service;Using MongoDB,FastDFS,ElasticSearch to solve the problem of high performance storage and efficient and accurate search of massive data;Use RabbitMQ for asynchronous decoupling and delay queuing;Docker container technology is used to complete the construction of big data environment,achieve data synchronization from Mysql to Hive,and use Spark and ElasticSearch to achieve user portrait analysis.Finally,design test cases according to system requirements,master black and white box test,interface test and other test methods,and skillfully use Junit,Jemeter and other tools to complete the comprehensive system test.In the system design,a large number of software engineering methods are applied to practice,and many excellent technical components are integrated to strengthen the system.At present,several iterations have been completed,and the system has the ability to provide stable and efficient services to meet the expected goals.更多还原