节点文献

突发事件案例及其舆情信息爬取、分类及语义检索研究

The Research of Emergency Case with Public Opinion Crawling,Classification and Semantic Retrieval

【作者】 刘宇

【导师】 王文俊; 马志华;

【作者基本信息】 天津大学 , 软件工程(专业学位), 2016, 硕士

【摘要】 当代突发事件的新闻报道和相关研究文章呈爆发式增长。面对海量的突发事件案例和舆情数据,为了挖掘突发事件特征及关联关系,本文提出了突发事件案例及其舆情本体模型,将爬取、分类、检索等工作抽象出模板,针对数据爬取、抽取、分类的可配置需求进行了建模、设计和实现,完成了以下工作:第一,提出了突发事件案例及其舆情本体模型。模型以ABC Ontology模型为上位本体,结合搜索引擎的爬取、抽取、分类等步骤,抽象出可配置模板,分别完成了案例及其舆情爬取可配置建模,案例抽取可配置建模,案例分类可配置建模。第二,提出了突发事件案例及其舆情处理与语义检索平台设计。针对突发事件案例及其舆情信息的特点与结构,设计出整体平台框架、信息处理流程与数据结构,并按照模块划分,分别对数据爬取模块、数据抽取模块、数据分类模块、案例入库模块和案例语义检索模块进行流程设计,数据结构设计与功能设计。第三,完成了突发事件案例及其舆情处理与语义检索平台实现,分别通过新华网RSS推送新闻的实例、中国应急分析网新闻专题实例、兰州大学案例库实例,从RSS推送新闻、新闻专题、案例库三个方面介绍平台的数据爬取过程、数据抽取过程、数据分类过程、案例入库过程和语义检索功能。本文构建了突发事件案例及其舆情信息本体模型以及数据爬取、抽取与分类的可配置模板,并完成平台实现。并且通过对不同数据源的平台实现验证了模型的通用性,为突发事件特征及关联关系挖掘提供了有效的平台支撑。

【Abstract】 Contemporary news reports and related research articles about emergencies are explosive growth.Facing the massive emergency cases and public opinion,in order to extract events attributes and mine events correlation,this paper presents a model of emergency case and its public opinion which abstract climb,classification,retrieval and other work to templates.The model,design and implementation of the configurable requirements of data crawling,extraction and classification are carried out.This paper finished the following work.First,this paper puts forward the emergency case and the public opinion ontology model.The model is based on the ABC ontology model as upper ontology,and combine the data crawling,extraction,classification in vertical search engines and abstract the configurable template,implements the configurable model of case and public opinion crawl,case extraction and case classification.Second,this paper propose a design scheme of the process of emergency case with public opinion and semantic retrieval platform.For the feature and structure of emergency case and public opinion,we devise an overall platform framework as well as the platform resource transfer and data structure.According to the module partition,we make a series of design like data flow design,data structure design and function design for data crawl module,data extraction module,data classification module,case library module and case semantic retrieval module respectively.Third,this paper implement process of emergency case with public opinion and semantic retrieval platform.By Xinhua net news RSS feeds example,China’s analysis emergency network news feature entity,instance of Lanzhou University case bank.We introduces the data crawl process,data extraction process,data classification process,case library and semantic retrieval functions of the platform from three aspects that is RSS feeds news,news features and case data base.This paper contribute the emergency case and public opinion model and implement configurable model of data crawling,data extraction and data classification.And we validate versatility of the model though the realization on different data sources,and provide an effective platform support for events attributes extracting and events correlation mining.

  • 【网络出版投稿人】 天津大学
  • 【网络出版年期】2017年 12期
节点文献中: 

本文链接的文献网络图示:

本文的引文网络