节点文献

自治数据库系统的理论与方法研究

Research on the Autonomic Database Systems: Theories and Approaches

【作者】 胡天磊

【导师】 董金祥; 陈刚;

【作者基本信息】 浙江大学 , 计算机科学与技术, 2006, 博士

【摘要】 随着互联网和信息技术的发展,数据库系统变得越来越复杂,其数据存储规模越来越庞大,管理数据库系统也变得越来越昂贵和繁琐。自治数据库系统能够自动、主动地对自身进行管理,降低了人为数据库管理的复杂度,从而降低人力成本和系统故障时带来的额外成本。因此,数据库自治技术对于提高数据库系统在关键应用中的应用能力,降低数据库系统的总体拥有成本,减少硬件、软件的投资浪费等都具有非常重要的意义。本文主要研究自治数据库系统的各种理论、技术及其实现。 本文首先全面介绍了自治计算和自治数据库领域的一系列相关技术,并分析了这些领域主要的研究内容、研究方法和部分商用系统的发展现状,同时指出了已有技术的缺点和不足,从而引出了本文的研究。 通过对数据库的“人为”管理行为的分析和模式提取,本文给出了数据库管理的相关概念,并提出了一个用于解决数据库自治问题的通用元结构——可管理自治数据库元素(Manageable Autonomic Database Element,MADE),该元素分为六个组件和一个自治知识库,可以用来描述任何数据库自治功能。本文应用MADE重点研究了物理数据库自动设计,自适应数据库安全管理,以及自适应并行数据库负载均衡等三类数据库自治功能。 本文研究了集成B+树索引、垂直分区和属性压缩等三类物理数据库特征的自动设计技术。在对该问题进行形式化定义的基础上,提出了用于解决该问题的可管理自治数据库元素——PD-MADE。着重研究了该框架中,基于“类似”SQL语句分类和“类似”事务聚类的工作负载分析技术、基于规则的物理特征生成技术、配置占用空问和工作负载代价估计技术以及基于贪婪算法和群进化算法的最优配置搜索技术等四类关键技术。 针对自适应数据库安全管理,本文定义了动态、静态安全威胁以及安全策略等概念,并认为任何安全策略都具有两面性,在解决部分安全威胁的同时,将增加其他某些安全威胁发生的可能性和严重性。据此,定义了自适应数据库安全管理问题,并应用可管理自治数据库元素SM-MADE来解决此问题。研究了SM-MADE中的入侵检测、安全策略选择和安全策略等问题,并重点研究了基于事务特征抽取和事务向量分类的

【Abstract】 As Internet and information technology develops, database systems are getting more and more complicated, and data scale in the database system is getting larger and larger. It results in increasing cost and complexity to manage a database system. Autonomic database systems can automatically and actively manage themselves to reduce the complexity of database management. The employment of autonomic database systems can also decrease the manpower cost and extra cost brought by system failure. Therefor, autonomic database techniques are vital for database systems in critical applications, and these techniques can vastly reduce the total cost of ownership (TCO) and lessen the waste of hardware and software investment. This thesis mainly focuses on the theories, techniques and implementations of autonomic database system.First, related areas of autonomic computing and autonomic database systems are thoroughly investigated. Current research issues, methodologies and commercial applications in these areas are analyzed. Major problems of current techniques are identified, which arouse following research in this thesis.Based on analysis and pattern extraction of the artificial database management process by DBAs, concepts related with database management are defined. The manageable autonomic database element (MADE), an universal meta-structure with six components and a knowledge base, is introduced to support solving database self-managing problems. In this thesis, MADE is used to study three kinds of autonomic features in database system: automatic physical database design, adaptive database security management, and adaptive load balancing in parallel database system.Automatic physical database design techniques for integratively designing b+trees, vertical partitions and attribute compression are studied. Based on the formalization of the automatic physical database design problem, the PD-MADE, one kind of MADE, is proposed to solve the problem. Four key techniques in PD-MADE are mainly investigated:workload analysis based on SQL classification and transaction clustering, rule-based physical feature generation, cost estimation for data volume and workload processing, and optimal configuration search based on greedy algorithms and swarm evolution algorithms.For adaptive database security management, concepts of dynamic threats, static threats and security policies are defined. It is deemed that security policies are two-faced, i.e. each security policy will settle some threats, but simultaneously increase the probability and severity of some other threats. Based on these concepts, the adaptive security management problem is defined, and SM-MADE, another MADE, is proposed to solve the problem. Intrusion detection, security policy selection and security policies are covered, and database intrusion detection techniques based on extraction of transaction features and categorization of transaction vectors is studied in detail.An autonomic parallel database architecture is proposed, and two kinds of load balancing problems, the data migration problem and the parallel join problem, are introduced. The LB-MADE, a MADE for solving the load balancing problems, is studied, and mainly concentrates on the node selection and execution techniques of data migration and parallel join process.Based on above studies in this thesis, we implement three kinds of experiment systems: the OSCAR physical database advisor, an OSCAR database intrusion detection prototype, and a prototype of autonomic parallel database middleware. Experiments’ results on these systems validate the autonomic database architecture, the manageable autonomic database element, and three kinds of specified autonomic techniques proposed in this thesis.

  • 【网络出版投稿人】 浙江大学
  • 【网络出版年期】2006年 09期
节点文献中: