【作者】 张萌；

【导师】 张加万；

【作者基本信息】 天津大学 ， 软件工程， 2021， 硕士

【摘要】 中国古琴又名七弦琴,于2003年被联合国教科文组织批准为“人类口头和非物质文化遗产代表作”。然而,记谱体系复杂、音乐属性以静为主、乐器价格高昂等因素一方面让古琴在当代众多乐器中成为一个特殊的存在,一方面又让它在当代社会发展与传播的过程中遇到瓶颈。近现代以来,古琴逐渐成为了难以触及的遥远艺术。随着科技的进步,人机交互技术在推广和教学古琴方面有了一些探索,但在更自然的交互设计、降低学习门槛和激发学习兴趣等方面尚有欠缺。为了更好地推广古琴,本文进行了用户问卷调研,总结并分析了古琴推广中面临的主要问题,提出了下述两个基于动态手势交互技术的古琴虚拟演奏方案。针对人们因没有途径接触古琴等原因而无法对古琴产生兴趣的问题,本文提出了一个基于混合现实技术的虚拟古琴演奏的方案,使得使用者能在没有实体古琴的情况下体验自由演奏。该研究使用动态手势识别算法实现了手势交互的功能,基于三维模型搭建了混合现实场景,采集了真实古琴的声音,从而实现模拟古琴的虚拟演奏。用户实验的结果表明,该方案能提供良好的用户体验,且能够激发用户对古琴艺术的兴趣。针对人们因认为琴谱复杂难学等原因而不愿学习古琴的问题,本文提出了一个基于增强现实技术的古琴琴谱演奏的方案。其中包括有知识教学、琴音欣赏和减字谱演奏三部分内容,旨在帮助使用者循序渐进地熟悉古琴和学习古琴。本研究将古琴的减字谱图像处理后为之设计了自然的可视化界面,使得使用者能跟随减字谱可视化的引导无师自通地演奏一首曲目。用户实验的结果表明,该研究不仅能激发用户对古琴的兴趣,还能增强他们学习古琴的信心。本文的主要贡献在于进行了古琴虚拟演奏研究,将手势交互技术与虚拟乐器结合,使用户无需掌握任何背景知识也无需接触到古琴实体就能够体验到生动有趣的古琴演奏体验,拉近了古琴艺术与人们的距离。本研究为将人机交互方法和技术用于推广传统文化提供了有效案例,有助于拓宽人机交互的应用范围。更多还原

【Abstract】 The Chinese guqin,also known as the seven-stringed zither,was approved by UNESCO as a Masterpiece of the Oral and Intangible Cultural Heritage of Humanity in 2003.However,the complex notation system and the predominantly static nature of the music have made the guqin a unique and independent instrument among contemporary instruments,while making it a bottleneck in the development and dissemination of the instrument in contemporary society.In modern times,the art of the guqin has gradually become an untouchable and distant art.With the advancement of technology,human-computer interaction technology has been explored in promoting and teaching the guqin.However,these research efforts are still lacking in terms of more natural interaction design,lowering the barriers to learning and stimulating interest in learning.In order to better promote the guqin,a user questionnaire survey was conducted for this paper.After summarizing and analyzing the main problems faced in the promotion of the guqin,this paper proposes the following two solutions for virtual performance of the guqin based on dynamic gesture interaction technology.To address the problem that people are unable to develop an interest in the guqin for reasons such as lack of access to it,this paper proposes a solution for virtual guqin performance based on mixed reality technology,enabling users to experience free performance without a physical guqin.The research uses dynamic gesture recognition algorithms to achieve gesture interaction.In addition,the study builds a mixed reality scenario based on a 3D model and captures the sound of a real guqin.The virtual performance of the simulated guqin was finally realized.The results of the user experiments show that the solution provides a good user experience and can stimulate the interest of users in the art of guqin.In response to the problem that people are reluctant to learn the guqin due to the perceived complexity and difficulty of the score,this paper proposes an augmented reality-based solution for playing the guqin score.It consists of three parts: knowledge teaching,music appreciation and performance of the subtractive score,and aims tohelp users become familiar with the guqin and learn it in a step-by-step manner.The study has designed a natural visualization interface for the visualization of the reduced score of the guqin,enabling the user to follow the visualization of the reduced score and play a piece of music without any difficulty.The results of the user experiments show that the study not only stimulates users’ interest in the guqin,but also increases their confidence in learning the instrument.The main contribution is that this paper conducts a study on the virtual performance of the guqin.This study combines gestural interaction techniques with virtual musical instruments,enabling users to experience a lively and interesting guqin performance experience without any background knowledge or physical access to the guqin,bringing the art of guqin closer to people.The research provides an effective case study for the use of HCI methods and technologies to promote traditional culture,and helps to broaden the scope of HCI applications.更多还原