【作者】 刘敏；

【导师】 薛延学； 曲国福；

【作者基本信息】 西安理工大学 ， 轻工技术与工程（专业学位）， 2017， 硕士

【摘要】 儿童出版物作为儿童认知世界的第一个启蒙工具,在儿童成长认知阶段有着不可替代的地位。在科技迅速发展的今天,传统纸质出版物的信息传递方式已经不能满足儿童的心理需求。移动增强现实(简称移动AR)技术的出现为传统纸质媒体注入了新的活力,它通过移动终端的显示屏实时的将虚拟信息与出版物的纸面内容融合呈现,打破以往静态被动的阅读方式,将阅读体验与儿童的听觉、触觉等感官建立起紧密的联系,大大提高他们的阅读兴趣和认知能力,为孩子的童年带来更多想象空间和可能性。因此,研究能得到儿童高度认知的儿童电子出版物有着十分重要的学术价值和现实意义。儿童出版物的AR设计和开发涉及三维建模技术、图像及音视频处理技术、虚实融合技术、跟踪注册技术和人机交互技术等多种技术的融合,开发成本高且开发难度大。因此本文深入研究基于Unity 3D和Vuforia结合的AR应用开发流程,降低AR出版物的开发难度和开发成本。在此基础上,针对市场上大多数AR儿童出版物存在的仅仅能带给儿童视觉上的增强呈现、交互方式单一枯燥的问题,深入研究基于视觉交互、触觉交互以及听觉交互的移动AR技术,为AR儿童出版物提供多种交互方式,带给儿童更加完整的阅读感受和体验。具体研究内容如下:(1)深入研究出版物AR应用开发中涉及的关键技术及实现原理。详尽透彻的分析了基于Maya的三维建模技术、基于Unity 3D的虚实融合技术和基于Vuforia的跟踪注册技术,在此基础上完成基于Unity 3D+Vuforia的AR应用系统架构和开发流程的探索。使传统出版物能够快速简单的拥有AR的呈现形态,大大降低开发难度和开发成本。(2)基于视觉交互的AR技术的研究中包括基于标识图片的交互技术、基于涂色类儿童读物的视觉交互技术和基于虚拟漫游的交互技术。在基于标识图片的交互技术中打破了传统AR应用使用单张标识图交互的方式,研究实现了基于多张标识图的交互方式;探索出涂色类儿童读物AR的开发流程;在基于虚拟漫游的交互技术中,将基于CardBoard的沉浸式交互技术与移动AR技术结合,带给儿童颠覆性的视觉交互体验。(3)基于触觉互动的AR技术在研究中包括基于触摸屏触控的交互技术、基于二维自然手势的交互技术和基于虚拟按钮点击的交互技术。在基于二维自然手势的交互技术中重点研究二维自然手势识别算法,并通过实验验证了本文识别算法的有效性,并且探索出儿童更喜欢绘制流线型手势;深入研究了基于虚拟按钮点击交互技术的原理和开发流程,并通过实验验证了虚拟按钮需要分布在特征点丰富的位置才能有很好的成功点击率。(4)基于听觉交互的AR技术包括Unity中的音频控制技术和基于语音识别的交互技术。在深入研究儿童语音特点和语音识别原理的基础上,实现了一个小词汇量、特定人语音识别系统,并实验验证了系统的可用性和局限性。(5)基于本课题的研究成果,设计开发了一个儿童出版物AR系统。针对涂色类儿童出版物、识图类儿童出版物和卡片类儿童出版物设计开发了各自的AR应用。验证了使用上述研究成果能够使AR儿童出版物真正成为集视觉、听觉、触觉、感受于一体的综合性多媒体书籍,为儿童出版物的AR开发者和设计者提供新的设计思路。更多还原

【Abstract】 As children’s first enlightening tool to cognize the world,children’s publications occupy an irreplaceable position in their cognitive growth stage.With the fast development of technology currently,the information transmitting methods of traditional paper publication can no longer satisfy children’s psychological needs.The emergency of the Mobile Augmented Reality(abbreviated as AR)technology invigorate the traditional paper media.This technology can present the real-time combination of virtual information and publishing paper content by the display screen of mobile terminal,replacing the traditional static passive reading mode,and establish a close connection between reading experience and children’s sensory(such as auditory,tactile,et al),bringing more room for imagination and possibilities in their childhood.Hence,researching children’s electronic publications,which are highly admitted by children,is of very important academic value and practical significance.AR designing and development of children’s publications involve the combination of the three-dimensional modeling technology,the processing technology of image and audio/video,the technology fusing virtual and reality,the tracking registering technology,human-computer interaction technology,et al,and the cost and difficulty of development is high.Therefore,in this thesis,the application-development process based on the combination of Unity 3D and Vuforia and decreasing the difficulty and developing cost of AR publication is studied in depth.Based on these,according to the existing problems of most AR publications,for instance,only bringing visual enhancing presentation for children,the single and boring of interaction mode,ignoring the multi-sense interaction problems(such as touch and auditory,et al),this thesis studies further the AR technology which is based on the visual interaction,touch interaction and auditory interaction,aiming at bringing more complete reading feeling and experience for children.The detailed research contents are as follows:(1)The related key technology and principles of the application and development realizing in AR publication are studied in depth.The three-dimensional modeling technology based on Maya,the fusing technology of virtual and reality based on Unity 3D and the tracking registering technology based on Vuforia are comprehensively analyzed.Exploring the application systematic framework and development progress are completed based on these.Traditional publication can possess the presentation appearance of AR simply and fast,and the difficulty and cost of developing are reduced significantly.(2)The research of the AR technology which is based on visual interaction includes the interaction technology based on logo image,the visual interaction technology based on painted children’s reading materials and the interaction technology based on virtual roaming.In the interaction technology based on logo image,the traditional mode of using single logo image to interact in AR technology is broken,the interaction mode based on multiple logo images is achieved.The development process of painted children’s reading materials is explored.In the interaction technology based on virtual roaming,the immersion interaction technology based on CardBoard and the AR technology are combined to give children subversive visual interaction experience.(3)The AR technology research based on touch interaction include the interaction technology based on touch control on touch screen,the interaction technology based on two-dimensional natural gestures and the interaction technology based on virtual bottom clicking.The research of the interaction technology based on two-dimensional natural gestures focuses on two-dimensional natural gesture recognition algorithm,besides the effectiveness of the recognition algorithm and the fact that children prefer linear gestures are verified.The principle and development progress based on virtual bottom clicking interaction technology are studied further,and it is proven that the virtual bottoms need to be distributed in positions of abundant feature points in order to obtain excellent successful clicking rate.(4)The AR technology based on auditory sense interaction includes the audio controlling technology in Unity and the interaction technology based on voice recognition.Based on the in-depth study of children’s phonetic features and phonetic recognition principles,a system of small vocabulary and specific person’s phonetic recognition is achieved,and the applicability and limitations of the system are verified by experiments.(5)The research achievements above of the AR technology are applied to the AR development of children’s publication through living examples.The respective AR system of painted,image recognizing and card category children’s reading materials is completed.It is verified that applying the above technologies to make AR children’s publications become comprehensive multi-media books gathering vision,auditory,touching sense,feeling together,providing new interaction ideas for developers and designers of AR children’s publications can be practical.更多还原