节点文献

知识增强的BERT短文本分类算法

Classification algorithm for short text based on knowledge enhanced BERT

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 傅薛林金红郑玮浩张奕陶小梅

【Author】 FU Xue-lin;JIN Hong;ZHENG Wei-hao;ZHANG Yi;TAO Xiao-mei;College of Information Science and Engineering, Guilin University of Technology;Guangxi Key Laboratory of Embedded Technology and Intelligent Information Processing,Guilin University of Technology;School of Computer Science and Engineering & School of Software, Guangxi Normal University;

【机构】 桂林理工大学信息科学与工程学院桂林理工大学广西嵌入式技术与智能系统重点实验室广西师范大学计算机科学与工程学院/软件学院

【摘要】 为解决短文本信息不全且缺乏领域知识导致关键信息难以充分挖掘而造成的深度学习模型分类性能不足等问题,提出一种知识增强的双向编码器表示转换器(BERT)短文本分类算法(KE-BERT)。提出一种建模短文本与领域知识的方法,通过知识图谱进行领域知识的引入;提出一种知识适配器,通过知识适配器在BERT的各个编码层之间进行知识增强。通过在公开的短文本数据集上,将KE-BERT与其它深度学习模型相比较,该模型的F1均值和准确率均值达到93.46%和91.26%,结果表明了所提模型性能表现良好。

【Abstract】 To solve the problem of poor classification performance of deep learning models caused by incomplete short text information and lack of domain knowledge, a knowledge enhanced bidirectional encoder representation from transformers(BERT) short text classification algorithm(KE-BERT) was proposed. A method of modeling short text and domain knowledge was proposed, and the domain knowledge was introduced by knowledge graph. A knowledge adapter was proposed to enhance knowledge between the encoding layers of BERT. By comparing KE-BERT with other deep learning models on the published short text dataset, the F1 mean and accuracy mean of this model reach 93.46% and 91.26%, indicating that the proposed model has good performance.

【基金】 国家自然科学基金青年科学基金项目(61906051);广西科技计划基金项目(2020GXNSFAA297255)
  • 【文献出处】 计算机工程与设计 ,Computer Engineering and Design , 编辑部邮箱 ,2024年07期
  • 【分类号】TP391.1
  • 【下载频次】103
节点文献中: 

本文链接的文献网络图示:

本文的引文网络