节点文献
综合录井仪数据迁移及转换接口技术研究
Research on Interface Technology of Data Migration and Transform for Comprehensive Logging Instrument
【作者】 张欣欣;
【导师】 戴永寿;
【作者基本信息】 中国石油大学 , 信号与信息处理, 2008, 硕士
【摘要】 目前综合录井数据大部分保存在综合录井仪自身配带的Access、SQL Server等数据库中,数据格式不统一,数据项不全面,数据相互之间不能共享,使的这些宝贵的数据得不到充分的利用。因此,结合目前已有的数据迁移转换技术,设计一个综合录井仪数据迁移转换接口是十分必要的,将目前来源离散且格式多样的录井数据进行标准化处理,再将这些经过标准化处理的规范数据迁移到一个综合数据库中,为给研究部门和管理部门提供标准确的数据信息,实现数据共享打基础。本接口的设计是基于中间件技术和XML(eXtensible Markup Language,可扩展标记语言)技术的,采用中间件技术实现数据迁移,不仅能屏蔽掉底层综合录井仪的异构性,实现用户对数据库的透明操作,还可以使接口具有良好的可扩展性。采用XML技术进行数据转换,不仅因为XML的开放性、可扩展性及XSLT(eXtensible Stylesheet Language for Transformations,扩展样式转换语言)对数据格式转换功能,是转换油田复杂数据源所需要的特点,更重要的是因为WITSML(Wellsite Information Transfer Standard Markup Language)是基于XML的井场信息传输标准标记语言,并且日益成为钻井数据传输和保存的标准语言。本接口由三个相对独立且相互关联的部分组成,即数据查询模块、数据转换模块和数据加载模块。其中数据查询模块负责实现用户对各录井仪异构数据库的透明访问,选择需要迁移的数据库内容;数据转换负责将选中的需迁移数据从数据库中抽取出来,并将其转换成统一的XML文档呈现给用户;数据加载模块负责将XML文档中的信息加载到目标数据库中去。最后,通过实现Access数据库和SQL Server数据库中的数据到Oracle数据库的迁移,验证了数据迁移转换接口方案的可行性。
【Abstract】 Recently, most comprehensive logging data are stored in their own databases such as Access, SQL Server and so on. The data formats of these logging data are not unified and the data can not be shared with each other, so they are not utilized fully. It is very necessary to design a comprehensive logging Data Migration Interface, which can combine the currently available data migration and conversion technology. By this interface, we can standardize the comprehensive logging data firstly which are discrete in sources and variety in formats, and then transfer these standardization datum into an integrated database. The purpose of interface designing is to provide the standard data for the research department and management, and lay the foundation for data sharing.The interface design is based on middleware technology and XML (eXtensible Markup Language) technology. We use middleware technology to realize data transfer. This technology can not only suppress complexity and heterogeneity of comprehensive logging, but also make interface a good scalability. The use of XML technology to realize data transform have two reasons. The first is because XML has many features such as opening, expansibility, data conversation function by XSLT and so on, which is precisely required by oil complex data. The second reason is more important, because WITSML is an XML-based market information transmission Well Standard markup language, and it is increasingly becoming the standard language on drilling data transmission and preservation.The interface is made up of three both independent and interrelated components. There are data query module, data conversion module and data load module. Data query module will be responsible for the realization that logging instrument databases are visited by users transparently and select database which content need to be transfered. Data conversion module will be responsible for extracting data content from database which are selected, and then transforming them into a unified XML documents which will be presented to the user. Data load modules will be responsible for loading the data which are in XML documents to the target database. In the last section of paper, the feasibility of the interface is proved through an examination that realizing data migration from Access and SQL Server database to Oracle database.
【Key words】 Comprehensive logging instrument; Data migrate; Middleware; Data transform; XML;