节点文献

融合目标端历史信息的篇章级神经机器翻译

Document-Level Neural Machine Translation with Target-Side Historical Information Fusion

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 王晓聪余正涛张元高盛祥赖华李英

【Author】 WANG Xiaocong;YU Zhengtao;ZHANG Yuan;GAO Shengxiang;LAI Hua;LI Ying;Faculty of Information Engineering and Automation, Kunming University of Science and Technology;Key Laboratory of Artificial Intelligence in Yunnan Province, Kunming University of Science and Technology;

【通讯作者】 余正涛;

【机构】 昆明理工大学信息工程与自动化学院昆明理工大学云南省人工智能重点实验室

【摘要】 现有的篇章级神经机器翻译方法难以有效挖掘目标端远距离的上下文信息,翻译的译文不连贯.为此,文中提出融合目标端历史信息的篇章级神经机器翻译方法.首先,通过多头自注意力机制,获得源语言的上下文表征和目标语言的上文表征.然后,使用线性偏置注意力机制,动态地将历史信息注入当前目标语言表征.最后,通过融合源语言表征和经过增强后的目标语言上下文表征获得较优的篇章译文.在多个数据集上的实验表明,文中方法性能较优,在解码过程中融合通过循环机制建模的长序列信息,可有效提升篇章译文的连贯性和完整性.

【Abstract】 Existing document-level neural machine translation methods struggle to effectively capture long-distance contextual information on the target side, resulting in incoherent translations. To address this issue, a method for document-level neural machine translation with target-side historical information fusion is proposed. First, the contextual representations of the source language are derived via a multi-head self-attention mechanism. Second, the preceding context representations of the target language are obtained using another multi-head self-attention mechanism. Next, an attention with linear biases is employed to dynamically inject the historical information into the current target language representation. Finally, a higher-quality translation is obtained by integrating the source language representation with the enhanced preceding context representation of the target language. Experimental results on multiple datasets demonstrate that the performance of the proposed method is superior. Moreover, the proposed method effectively improves the coherence and completeness of document-level translations through incorporating long-sequence information modeled by recurrent mechanisms during decoding.

【基金】 国家自然科学基金项目(No.U23A20388,62366027,U21B2027,62166023);云南省基础研究计划重大项目(No.202401BC070021);云南省科技重大专项项目(No.202302AD080003);云南省基础研究计划项目(No.202301AT070471)资助~~
  • 【文献出处】 模式识别与人工智能 ,Pattern Recognition and Artificial Intelligence , 编辑部邮箱 ,2025年05期
  • 【分类号】TP391.2
  • 【下载频次】28
节点文献中: 

本文链接的文献网络图示:

本文的引文网络