节点文献
基于多重启发式规则的中文文本特征值提取方法
An Eigenvalue Extraction Method for Chinese Texts Using Multiple Heuristic Rules
【摘要】 本文根据中文文本的特点,以一种新的同义概念来替代传统的词为单位,并给出了同义概念之间权值的全新计算方法。我们不仅考虑了文本中词汇概率信息,还结合文本语义等多方面来提取文本特征值,从而提出了一种基于多重启发式规则的中文文本特征值提取方法,并给出了特征值提取模型和算法。通过与传统特征值提取方法的比较实验,证明本文中提出的特征值提取方法能有效地提高文本分类正确率,并达到了有效降低特征向量维数的目的。
【Abstract】 Based on the characteristics of Chinese texts, we propose a method of Chinese text eigenvalue extraction using multiple heuristic rules in this paper. The eigenvalues of texts are extracted according to many aspects. In the extraction we substitute the traditional word with a kind of new synonym conception as the units of eigenvalue and consider not only the appearance rates of words but also the semantic information in the text. And, the model and algorithm of eigenvalue extraction are provided in this paper. Finally, we present the results of experiments comparing with traditional extraction methods using the appearance rate of words in the text, which illustrates that the method of this paper improves the correctness rate of text categorization and reduces the dimensions effectively.
【Key words】 text categorization; eigenvalue extraction; natural language processing;
- 【文献出处】 计算机工程与科学 ,Computer Engineering & Science , 编辑部邮箱 ,2006年08期
- 【分类号】TP391.1
- 【被引频次】8
- 【下载频次】188