节点文献
基于KNN算法的文本自动分类方法研究——以学术期刊栏目自动归类为例
Research of Journals Manuscript Categorization Based on KNN Algorithm
【摘要】 本文将期刊目录中按照主题设置的有关栏目(常设主题栏目)看作不同的类别,应用改进的KNN算法对属于不同类别(栏目)的期刊论文进行自动归类(归栏)处理。在分析期刊常设主题栏目特征的基础之上,从建立自动分类所需的训练文本集、测试集及分类(归栏)效果评价等多个方面加以定义,利用Jensen-shannon散度计算文本间的相似度,按照栏目动态决定k值等方面对KNN算法的基本原理加以改进。该方法以论文标题、摘要和作者关键词构成的短小文本为分类对象,对期刊常设主题栏目的自动归类(归栏)处理取得77.25%的F测度值,可以针对短小文本以及训练文本数量有限的情况下开展有效的文本自动分类处理。
【Abstract】 Looking the regular subject columns of journals as categories,this work improves KNN algorithm so that it is suitable to categorize manuscript to proper columns to further review with expert in the field. Based on the feature of regular columns of academic journals,this work explains a way how to collect dataset from a journals as corpus; uses Jensen-Shannon Divergence to calculate similarity between documents which is constituted from title,abstract and author keywords; dynamically determine k value; defines evaluation method how to use published papers in the regular subject columns in past years. The results demonstrate a significant F1 score of 77.25%.
【Key words】 KNN algorithm Categorization Columns Jensen-Shannon divergence Dynamic k value;
- 【文献出处】 图书情报知识 ,Document,Information & Knowledge , 编辑部邮箱 ,2010年04期
- 【分类号】TP391.1
- 【被引频次】21
- 【下载频次】981