No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

FusionInsight HD 6.5.0 Product Description 02

Rate and give feedback:
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
Metadata

Metadata

Basic Principle

Function

Metadata Management (MDM) provides metadata extraction capabilities for FusionInsight HD data warehouse components (Hive and HBase), and allows users to label each metadata for data analysis, search, and other extended functions.

Principle

MDM extracts metadata from Hive and HBase in the FusionInsight HD system and dumps the metadata. By using the FusionInsight Manager framework installation process, MDM obtains the Hive and HBase connection mode and valid access authentication, and finally obtains the metadata from the Hive and HBase databases.

Figure 2-62 Logical architecture of MDM

The MDM working principle is as follows:

  1. MDM obtains the Hadoop cluster basic information from Manager. The basic information includes HBase RegionServer node deployment information and information about DBService that saves Hive metadata.
  2. According to the information obtained by 1, MDM extracts metadata from Hive and HBase and saves the metadata in DBService. You can log in to the FusionInsight HD system from a client and view the metadata.
  3. Upload the extracted metadata to a third-party metadata management system by using an external FTP server. The uploaded metadata can be used to support higher-level metadata management.

Relationship with Components

Relationship Between HBase and MetaData

By using the FusionInsight Manager framework installation process, Metadata Management (MDM) obtains the HBase connection mode and valid access authentication, and finally obtains the metadata from the HBase database.

Relationship Between Hive and MetaData

By using the FusionInsight Manager framework installation process, MDM obtains the Hive connection mode and valid access authentication, and finally obtains the metadata from the Hive database.

Relationship Between DBService and MetaData

MDM stores the metadata obtained from Hive and HBase in DBService, provides the metadata backup and restoration functions by using DBService, and extracts the metadata to external systems by using external FTP servers.

Download
Updated: 2019-05-17

Document ID: EDOC1100074548

Views: 3278

Downloads: 36

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next