【摘要】 分析了现今搜索引擎技术在民航主题Hidden-Web获取方面的缺陷,以此为鉴设计并实现了一个民航主题Hidden-Web爬虫。此爬虫使用主题分类等相关技术发现并抓取民航主题Hidden-Web所对应的前台Form,生成相应的Form库,然后利用启发式规则对Form库中的Form进行填写并搜集含有匹配结果的页面集。实验证明此爬虫的性能令人满意且对其它Hidden-Web的应用研究具有借鉴意义。更多还原

【Abstract】 In the paper it analyzed the limitation of search engines in acquisition of civil aviation-oriented Hidden-Web,and based on this designed and implemented a civil aviation-oriented Hidden-Web crawler.The crawler fetches and gets by using subject classification technology the foreground Forms which leads to the Hidden-Web,and builds relevant knowledge-database of Form,then it automatically fills the Forms in Form database using heuristic rules and searches page set with the matching outcomes.Experiments show that the crawler performs effectively and has the model significance to other Hidden-Web applied research.更多还原