节点文献

中文搜索引擎的设计与实现

Design and Implement of the Chinese Search Engine

【作者】 刘佳

【导师】 韩秀玲;

【作者基本信息】 东华大学 , 电力电子与电气传动, 2008, 硕士

【摘要】 近年来随着互联网的发展以及现代的、廉价的图形用户界面和大容量存储设备的出现,信息检索领域已经发生了巨大的变化。没有人能够准确地知道在网络上到底有多少网页,大多数的估算都认为这个数字超出了100亿。要利用偌大数量的数据,目前唯一的方式,就是利用搜索引擎自动地组织这些数据。搜索引擎是对网络上的信息项进行表示、存储、组织和存取。利用搜索引擎能够查找数量庞大的网络信息,并可以迅速查到未知信息。搜索引擎是互联网信息检索技术的核心。目前,Internet上广泛使用的包括中文在内的搜索引擎已不下十几种,比如以Google为首的通用搜索引擎,和各类以行业来划分的垂直式的网络搜索工具。然而,中文搜索引擎与国外的同类产品相比却还存在着很多问题,如覆盖率低、查准率不高、检索精度差、更新速度慢、无法控制网络信息的动态变化、对信息内容难于控制和管理等。针对中文搜索引擎存在的问题,本文提出了对中文搜索引擎从系统检索对象和自身系统的设计结构进行优化等对策,尝试解决其中的查准率和检索精度的问题。文中详细地研究了通用型搜索引擎的基本结构和基本技术,并且以自行设计的Sirgin搜索引擎为基础,描述了中文搜索引擎的设计方法,其中重点阐述了搜索引擎内部数据结构的实现方式。在此基础上文章还给出了Sirgin搜索引擎所特有的CastClosed网页结构分析技术,和SpRank排序技术的实现方案和算法。

【Abstract】 In recent years, with the development and modernization of the Internet, and the emergence of low-cost graphical user interface and large-capacity storage devices, the field of information retrieval has undergone tremendous changes. No one can accurately know how many pages on the network, while estimates are saying that the figure can exceeded 10 billion. To make use of the huge amount of data, the only way is to use some web search engines to automatically organize the data.Search engines is made to achieve the goal of storage, organization and access of the information items on the network. Search engines can be used to locate a huge number of information on network as well as some unknown information can be quickly found.Internet search engine is the core of information retrieval technology. At present, the search engines that is widely used on the Internet, including the Chinese search engines, has no less than ten, such as Google, head of the general purpose search engine, and various types of vertical Web search tools based on industry classification. However, there are still a long distance between the Chinese search engine and its similar products abroad, such as low coverage, the not high correction rate, the bad accuracy of retrieval, slow updating, unable to controlling the dynamic changes of network information, and difficulity on control and management of the content.Because of these problems, this paper based on Chinese search engine presents some optimization strategy on the retrieval object and the design of its own struction to solve the low correction rate and the low accuracy problems.This article makes a study on the basic architecture and technology of the general-purpose search engine and gaves a detailed descriptionon on the design methodology of how to make a real Chinese search engine based on Sirgin. This article especially illustrates how to achieve the internal database system of a search engine as well as showing the implements and algorithms of Castclose and SpRank technology which Sirgin has as its own.

  • 【网络出版投稿人】 东华大学
  • 【网络出版年期】2008年 07期
  • 【分类号】TP391.3
  • 【被引频次】2
  • 【下载频次】463
节点文献中: 

本文链接的文献网络图示:

本文的引文网络