节点文献
智能化网页资源收集工具的设计与实现
Design and Implementation of Intellectual Internet Robot
【摘要】 随着互联网的普及和发展,网络上的信息资源越来越丰富,它需要高效智能的工具来完成信息资源的采集。介绍了智能化网页收集工具系统的实现方法,它把抓取器与超链分析器、文本自动分类器相结合,完成对用户要求领域的网页的收集.避免对用户不感兴趣领域的抓取。这样可以节省硬件、网络资源和提高资源采集效率。
【Abstract】 With the rapid expansion of Internet and the continuous increase of the amount of information on Web. It is desired to develop high efficiency and intelligence tools to collect it. This paper discusses the combination of the hyperlink analysis for the Web and text automatic classification with Web information discovery tool. The goal is to selectively seek out pages that are relevant to a pre-defined set of topics. The tool find the link that are likely to be most relevant for the Internet robot and avoids irrelevant regions of the Web. This leads to significant savings in network resource and keep tool more efficient.
【Key words】 Internet robot; Hyperlink analysis; Text automatic classification; Focused crawling;
- 【文献出处】 计算机工程 ,Computer Engineering , 编辑部邮箱 ,2004年04期
- 【分类号】TP393.092
- 【被引频次】5
- 【下载频次】151