节点文献

基于BiLSTM的低资源老挝语文本正则化任务

A low-resource Lao text regularization task based on BiLSTM

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 王剑姜林王琳钦余正涛张松高盛祥

【Author】 WANG Jian;JIANG Lin;WANG Lin-qin;YU Zheng-tao;ZHANG Song;GAO Sheng-xiang;Faculty of Information Engineering and Automation, Kunming University of Science and Technology;Yunnan Key Laboratory of Artificial Intelligence, Kunming University of Science and Technology;

【通讯作者】 余正涛;

【机构】 昆明理工大学信息工程与自动化学院昆明理工大学云南省人工智能重点实验室

【摘要】 文本正则化TN是语音合成文本前端分析任务中必不可少的工作,老挝语的文本正则化是将老挝语文本中不可读的词NSW转化为可以口头表达的词SFW。目前文本正则化任务尚未在老挝语中开展,主要面临训练数据难获取、部分不可读词存在歧义的问题。针对以上问题,构建了老挝语文本正则化任务的语料,并将老挝语文本正则化任务当作序列标注任务,使用神经网络结合上下文语境预测存在歧义的不可读的老挝语文本,增加自注意力机制加深序列字符间的关系,探究了不同策略引入预训练语言模型的效果,融合各自注意力机制的BiLSTM模型在测试集上达到67.59%的准确率。

【Abstract】 Text normalization(TN) is an indispensable work in the front-end analysis task of speech synthesis text. Lao text normalization is to convert non-standard words(NSW) in Lao text into spoken-form words(SFW). At present, the task of text normalization has not yet been carried out in Lao, which mainly faces the problems of difficult acquisition of training data, diversified language expression and text regularization with ambiguity. A text normalization task in Lao is carried out. This task is completed as a sequence tagging task, and neural networks are used to predict NSW with ambiguity in combination with context. The corpus of the Lao text normalization task is constructed, the model results is predicted through the neural network, the self-attention mechanism is increased to deepen the relationship between the sequence characters, and different strategies are explored to introduce the pre-trained language model. An accuracy of 67.59% is achieved on the test set.

【基金】 国家自然科学基金(61732005,U21B2027,61761026,61972186,61762056);国家重点研发计划(2019QY1802,2019QY1801,2019QY1800);云南省高科技人才项目(201606,202105AC160018);云南省重大科技专项计划(202002AD080001-5,202103AA080015);云南省基础研究计划(202001AS070014,2018FB104)
  • 【文献出处】 计算机工程与科学 ,Computer Engineering & Science , 编辑部邮箱 ,2023年07期
  • 【分类号】TP391.1;TP183
  • 【下载频次】55
节点文献中: 

本文链接的文献网络图示:

本文的引文网络