【作者】 韩梅；

【导师】 李卫君；

【作者基本信息】 辽宁师范大学 ， 基础心理学， 2021， 硕士

【摘要】 重读作为言语加工过程中重要的韵律特征,主要反映了一个特定音节、单词或短语在某种韵律结构中的相对突出,在言语加工过程中扮演着重要作用。探索重读加工的内在机制对于理解言语加工全过程具有重要意义。音乐和语言在声学、句法结构和意义表达等方面具有诸多相似性,长期的音乐训练能够影响个体对语言的感知和语义理解。其次,在口语表达中,个体不仅通过听觉通道强调关键信息,也使用视觉线索(比如节拍手势)吸引个体的注意力,促进语言的感知和理解。本研究拟使用ERP和f MRI脑成像技术,探究在口语理解过程中音乐训练和节拍手势对重读加工影响的认知机制。研究一以汉语单句为实验材料,使用ERP技术和词汇探测任务,考察音乐组和对照组加工句内和句末对比重读和信息重读时的认知神经过程。结果发现,不论在句内还是句末,音乐组和对照组在加工信息重读相较对比重读在600-900 ms时间窗诱发了更正的晚期正效应。这表明即使实验任务并未引导听者的注意指向韵律信息,音乐组和对照组仍能准确感知和区分不同类型的重读信息;该晚期正效应可能反映了听者投入更多认知资源对信息重读进行再分析。句末位置,在300-500 ms仅音乐组对信息重读和对比重读的加工出现显著差异。该结果表明在句末音乐组能更早知觉到不同类型的重读信息,音乐训练可以影响听者对不同类型重读信息的加工过程。综上,实验一的结果表明音乐训练能够跨领域影响听者加工口语中的重读信息,并且这一过程受到重读所在位置的调节。研究二仍以汉语单句作为实验材料,将重读(重读、非重读)与手势(节拍手势、控制手势和无手势)结合,使用f MRI技术和词汇探测任务,探究伴有不同手势重读时大脑激活差异。结果发现,与基线相比,节拍手势重读在左侧颞中回(MTG)、左侧后部颞上沟(p STS)、侧枕叶皮层(LOC)有显著的激活,控制手势重读相比无手势重读则没有显著激活任何脑区。同时发现,节拍手势非重读和控制手势非重读相比基线条件在双侧颞中回(MTG)、双侧枕叶皮层(LOC)、右侧颞下回(ITG)、右侧枕下回(IOG)有显著的激活。此外,节拍手势重读相比无手势重读激活了左侧后部颞上沟(p STS)、左侧顶下小叶(IPL)、左侧侧枕叶皮层(LOC)、左侧颞下回(ITG),而控制手势重读相比无手势重读则激活了右侧顶下小叶(IPL)、右侧侧枕叶皮层(LOC)、右侧颞下回(ITG)。该结果扩展了以往的手势-言语整合研究的结果,节拍手势和控制手势虽然都能够引起听者的关注,但是只有节拍手势与重读在颞上回/沟(STS/G)进行了整合。这表明节拍手势不同于无意义的手势运动,它在言语感知过程中扮演者独特的作用。更多还原

【Abstract】 As an important prosodic feature in speech processing,pitch accent mainly reflects the relative prominence of a specific syllable,word or phrase in a certain prosodic structure,and it plays an important role in speech processing.Exploring the internal mechanism of accentuation processing is very important for understanding the process of speech processing.Both music and language are highly structured symbol systems.They have many similarities in acoustics,syntactic structure,and meaning expression.Long-term music training can affect the individual’s perception of language and semantic understanding.Secondly,in oral communication,individuals not only emphasize critical information through auditory channels,but also use visual channels(such as beat gestures).Researchers believe that beat gesture can attract individual’s attention and promote language perception and understanding.This study intends to use ERP and f MRI to explore the cognitive mechanism of the influence of music training and beat gestures on accent processing in the process of oral comprehension.Experiment 1 used Chinese single sentences as experimental materials,using ERP technology and vocabulary detection tasks,to investigate the cognitive neural processes of the music group and the control group when processing sentences and at the end of sentences contrast accent and information accent.The results showed that,no matter in the sentence or at the end of the sentence,the music group and the control group induced a corrected late positive effect in the 600-900 ms time window in the processing information accentuation compared with the contrast accentuation.This indicates that even if the experimental task does not direct the listener’s attention to the rhythmic information,the music group and the control group can still accurately perceive and distinguish different types of accented information;this late positive effect may reflect that the listener invests more cognitive resources on the information accent for reanalysis.Experiment 2 still uses Chinese single sentences,combining Accent(Accent,un-accent)with gestures(beat gestures,groomming gestures,and no gestures),using f MRI technology and vocabulary detection tasks to explore the differences in brain activation when reading with different gestures condition.The results found that compared with baseline,beat gesture has significant activation in the left middle temporal gyrus(MTG),left posterior superior temporal sulcus(p STS),and lateral Occipital Cortex(LOC),but groomming gestures and no gestures do not.At the same time,it was found that compared with baseline conditions,the un-accent with beat gestures or the groomming gestures were compared with baseline conditions in bilateral middle temporal gyrus(MTG),bilateral occipital cortex(LOC),right inferior temporal gyrus(ITG),and right inferior occipital gyrus(IOG)has significant activation.In addition,Accent with beat gesture activates the left posterior superior temporal sulcus(p STS),left inferior parietal lobule(IPL),left lateral occipital cortex(LOC),and left inferior temporal gyrus(ITG)compared to Accent with no gesture.But groomming gesture activates the right inferior parietal lobule(IPL),the right lateral occipital cortex(LOC),and the right inferior temporal gyrus(ITG)compared with no gesture.更多还原