节点文献

基于双层隐马尔可夫模型的英文词性标注研究

Research on English Part-of-speech Tagging Based on Double-Layer Hidden Markov Model

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 赖威金忠

【Author】 LAI Wei;JIN Zhong;School of Computer Science and Engineering,Nanjing University of Science & Technology;Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education,Nanjing University of Science & Technology;

【机构】 南京理工大学计算机科学与工程学院南京理工大学高维信息智能感知与系统教育部重点实验室

【摘要】 论文在传统一阶隐马尔可夫模型的基础上,针对隐马尔可夫模型结构信息挖掘不全面的问题,提出了一种双层隐马尔可夫模型。双层隐马尔可夫模型在使用Baum-Welch算法的过程中将词性序列视为观测序列,通过Baum-Welch算法提取更多信息并最大化词性序列概率从而更加贴合实际情况,同时对Viterbi算法做了相应的改动。模型在Penn Treebank语料库和Groningen Meaning Bank语料库上进行10折交叉验证,并与传统一阶、二阶隐马尔可夫模型进行对比。结果表明双层隐马尔可夫模型相较传统一阶、二阶隐马尔可夫模型词性标注正确率更高。

【Abstract】 Based on the traditional first-order hidden Markov model,this paper proposes a double-layer hidden Markov model to solve the problem of incomplete structural information mining of hidden Markov model. In the process of using the Baum-Welch algorithm,the double-layer hidden Markov model regards the part-of-speech sequence as an observation sequence,and extracts more information and maximizes the probability of the part-of-speech sequence through the Baum-Welch algorithm,which is more suitable for the actual situation. made corresponding changes. The model is cross-validated with 10 folds on the Penn Treebank corpus and the Groningen Meaning Bank corpus,and compared with traditional first-order and second-order hidden Markov models. The results show that the double-layer hidden Markov model has a higher accuracy of part-of-speech tagging than the traditional first-order and second-order hidden Markov models.

  • 【文献出处】 计算机与数字工程 ,Computer & Digital Engineering , 编辑部邮箱 ,2025年05期
  • 【分类号】TP391.1;O211.62;H314
  • 【下载频次】15
节点文献中: 

本文链接的文献网络图示:

本文的引文网络