基于大数据平台的元数据管理相关研究
时间:2018-07-19 21:10 来源:毕业论文 作者:毕业论文 点击:次
| 摘要如今高效的数据数据仓库的建立决定了企业能够存储并管理海量的数据以及其数据的质量，而数据质量的属性又在其中起到了至关重要的作用，这使得企业及公司逐步意识到元数据以及元数据管理及其在企业数据管理中应用的实际意义。本课题以江苏华大天益电力科技有限公司用电采集系统数据仓库项目的建设为契机，从数据仓库及大数据平台建设的企业级实际应用出发，在对元数据及元数据属性的研究和实践上，寻求一种高效且可视性强的元数据管理方式。本文首先阐述了大数据发展的现状，并介绍了华大天益用电采集大数据平台的背景和平台设计。之后，本文还论述了元数据的相关知识。另外，本文重点元数据管理在企业级开发中的重要应用的基础知识，即数据字典、数据血缘分析和数据特征。在上述三点的基础上，重点阐述了基于其的两项技术--数据检索和数据地图，并结合其在企业开发中的具体应用，介绍了用电采集主数据平台对于现阶段主流技术的应用以及相应的原因。本文最后基于江苏华大天益电力科技有限公司用电采集系统主数据平台的建立，结合前文所提及的大数据平台及元数据管理相关基础知识和工程运用，较详细地阐述了主数据平台的理论基础、设计思路和构造过程。25890 毕业论文关键词 数据仓库 元数据 元数据管理 Title Meta-Data management based on big data platform Abstract Today, the establishment of efficient data warehouse determines the companies to store and manage vast amounts of data and the quality of their data, and data quality attributes and in which played a crucial role, which allows businesses and companies gradually realized metadata as well as metadata management and its practical significance in enterprise data management applications. The big problem in Jiangsu Tianyi Electric Co., Ltd. power collection system data warehouse project as an opportunity to practice from the enterprise data warehouse and big data platform, and in the study of metadata and metadata attributes and In practice, seeking an efficient and high visibility of metadata management. This paper describes the status of development of big data, and describes the benefits of electricity Mandarin day gathering background and platform design of large data platform. Thereafter, the paper also discusses the relevant knowledge of metadata. In addition, the article focuses on the basics of important metadata management applications in enterprise development, that is the data dictionary, data analysis and data lineage feature. On the basis of the above three, focusing on the two based on their technical - data retrieval and data maps, and combined with its specific application in the enterprise development, it introduces the electricity collecting primary data for this stage of mainstream technology platform application and the reasons therefor. Finally, the big day benefit the establishment of Jiangsu Power Technology Co., Ltd. electric acquisition system based on primary data platform, combined with the previously mentioned big data platform and metadata management basic knowledge and engineering application, the more detailed description of the main data platform theoretical foundation, design ideas and construction processes. Keywords data-warehouse meta-data meta-data management目 次 目 次. I 1 引言1 1.1 课题研究背景 1 1.2 现阶段研究现状.. 1 1.3 课题主要研究内容. 2 2 项目背景知识..3 2.1 用电采集大数据平台 3 2.1.1 项目背景.. 3 2.1.2 项目框架设计 3 2.1.3 项目系统设计 4 2.2 元数据相关..6 2.2.1 元数据定义. 6 2.2.2 元数据分类. 6 (责任编辑：qin) |