节点文献
油田数据质量监督与控制模型研究
Research on Oilfield Data Quality Supervision and Control Model
【作者】 张磊;
【导师】 袁满;
【作者基本信息】 大庆石油学院 , 计算机应用技术, 2010, 硕士
【摘要】 随着信息应用的深入,油田企业信息化水平的提高,各种数据源源不断地汇集到数据库中,这些数据中存在的质量问题已经成为信息化应用中的头等大事。只有质量水平高的数据才能在生产管理、企业决策中发挥应有的作用,用户才会敢用、愿用,数据才能真正的为企业服务。为解决数据质量问题,各种管理手段、技术手段和数据质量管理体系不断被应用在数据采集和应用过程中。本文以需要管理和维护的油田各类数据为基础,依照数据质量管理工作的实际需求,对数据质量问题进行了划分,同时,通过研究现有的数据质量评价方法,提出了更符合实际应用的加权评价算法。在对元数据和数据质量定义、划分、评价理论研究的基础上,提出了基于元数据的数据质量规则库,并在此基础上,构建了数据质量检查和评价体系,对系统中存在的质量问题进行检查、评价和错误汇总。通过对数据质量的检查和评价过程,可以系统地掌握数据管理现状与数据质量现状,衡量数据的有效性,分析数据在使用过程中的影响程度,分析影响数据质量的关键因素,进一步完善油田开发数据质量控制体系,从而达到提高数据质量的目的。同时,为了实现全面的数据质量管理,本文以数据质量检查、评价体系为核心,构建了一套从数据采集到数据应用的数据质量管理系统。项目在研究过程中提交了相关文档,并进行了成果的试运行。使用开发的系统对油田开发生产数据库中部分表进行了数据质量检查和评价,得到的结果表明,该系统能够实现对油田数据全面的质量监管和控制,清理后的数据能够满足需要。
【Abstract】 With the in-depth information application, growing in oilfield enterprise information, a variety of data are steady flowing into the database. These quality problems that exist in data have become a top priority in application of information technology. Only the high quality data can play its due role in production management and corporate decision making, which users will dare and would like to use. Data can be really used for business services. To solve data quality problems, a variety of management methods, techniques and data quality management system are continuously being used in data collection and application process.In this paper, it is based on all types of data which need to be managed and maintained in oilfield. According to the actual need of data quality management, data quality problems have been divided. At the same time, through the study of the existing data quality evaluation methods, a weighted evaluation algorithm which is more in line with the practical application is proposed. After researching of metadata and data quality definition, classification and evaluation theory, a data quality rule database which based on metadata is proposed. On this basis, we build a data quality inspection and evaluation system to inspect, evaluate the problems that exist in the system and to summarize errors. Through inspection and evaluation process, we can systematically control the status of data management and of data quality, measure the validity of data, analyze the impact of data when it is being used, analyze the key factors affecting the quality of data and further improve data quality control system in oilfield so as to achieve the purpose of improving data quality. Meanwhile, in order to achieve comprehensive data quality management, this paper considers data quality checks and evaluation system as the core and constructs a set of data quality management system from data collection to data applications.This project submits the relevant documents in the course of the study and carries out the outcome of the trial run. Results obtained by performing inspecting and evaluating of parts of the database tables under the using of the developed system show that the system is able to achieve a comprehensive quality of data supervision and control. The data can meet their needs after cleaning.
【Key words】 metadata; data quality; quality evaluation; quality management;