【摘要】 为适应主题的动态性和完整性,本文提出了一种基于网络日志分析的混合策略主题爬虫。首先,它通过对网络日志的分析,一方面发现种子页面,有效扩充主题群落;另一方面挖掘用户兴趣,进一步精确描述主题。然后,爬虫从新种子集出发,结合用户兴趣,采用混合策略,对页面进行筛选。实验证明,该爬虫能够有效地采集更多的主题页面。更多还原

【Abstract】 This article provides a mixed strategy topic crawler which is based on network log analysis in order to adapt the dynamics and integrality of topic. Firstly, through network log analysis,new seeds are discovered to extend web community and users ’ interest is mined which makes the further description of the topic possible. In addition,according to the new seeds, with the application of the mixed strategy, the crawler filters the pages by referring to page user interest. Experiment results show that this system can fetch more topic pages efficiently.更多还原