节点文献
基于Nutch的节能减排垂直搜索引擎设计与实现
Design and implementation of vertical search engine in field of energy-saving and emission-reduction based on Nutch
【摘要】 为提高搜索引擎检索节能减排领域信息的准确度,在研究垂直搜索引擎的设计思想和相关技术的基础上,利用Nutch开源框架设计实现节能减排垂直搜索引擎。采用网页模板技术对网页信息进行提取,利用改进的TF-IDF算法进行特征词表示,采用基于特征词的向量空间模型进行主题相关性判定,利用朴素贝叶斯分类算法对网页信息进行分类。实验结果表明,该搜索引擎可有效对节能减排的相关信息进行检索。
【Abstract】 To improve the accuracy of retrieving information in the field of energy-saving and emission-reduction of search engine.Nutch,an open source framework,was used to design and complete a vertical search engine in the field of energy-saving and emission-reduction on the basis of the design ideas and related technologies of vertical search engines.The web page template technology was used to extract web information and the improvement algorithm of the TF-IDF was used to represent the features,and the vector space model based on the key word was utilized to determine the topic relevance and the naive Bayes classifier to classify web information.The experimental result shows that the designed search engine can retrieve information related to energy-saving and emission-reduction effectively.
【Key words】 energy-saving and emission-reduction; vertical search engine; Nutch; vector space model; naive Bayes;
- 【文献出处】 计算机工程与设计 ,Computer Engineering and Design , 编辑部邮箱 ,2016年09期
- 【分类号】TP391.3
- 【被引频次】5
- 【下载频次】100