节点文献
布茨定律用于中文同频词规律的实证研究
Empirical Study on Applicability of Booth’s Law for the Law of Same Frequency Words in Chinese Text
【摘要】 布茨定律反映了英文文本同频词的分布规律,但布茨定律是否适用于中文文本很少有学者对其进行深入研究。为了探究布茨定律对于中文文本的适用性,揭示中文文本同频词的统计规律,对大量中文文本同频词进行统计研究,实验过程中注重了实验数据规模的选取和文本长度跨度的设计。实验得出:随着文本长度的增大,低频词的同频词数与不同词数的比值并非定值,而是逐渐减小;低频词的同频词数与不同词数的关系呈幂函数增长。另外,随着文本长度的增大,低频词的同频词数与频次为1的同频词数的比值也非定值,而是逐渐增大。上述结果与布茨所做英文的实验不一致,故得出结论:布茨定律不适用于中文文本。
【Abstract】 Booth’s lawreflects the rule of the same frequency words in English text. But there fewof scholars give some research of whether Booth’s lawcan fit Chinese text well. In order to explore the lawof Booth’s applicability of the Chinese text,discover the statistical rules of Chinese text with t frequency words,in this paper,a large number of Chinese text carried on the statistical study with frequency words,pay attention to the selection of the size of the experimental date in the process of the experiment and the design of the span length of the text. Experiments shows that along with the increase of length of the text,the low-frequency words of the ratio of different number of words is not a fixed value,but the decreases is gradually; The low-frequency words and the different function words are in growth. In addition,the ratio of the number of words occurringn times and words occurring once is not a fixed value,too,but increases gradually with the length of the article growth. The results are inconsistent with Booth’s experimental results on English text. So we give a conclusion that Booth’s lawdoesn’t fit Chinese text.
【Key words】 same frequency words Zipf’s law Booth’s lawlow-frequency words;
- 【文献出处】 情报杂志 ,Journal of Intelligence , 编辑部邮箱 ,2015年06期
- 【分类号】TP391.1
- 【被引频次】1
- 【下载频次】139