MapReduce Service (MRS) 3.5.1-LTS Usage Guide (for Huawei Cloud Stack 8.5.1) 03
Unified Metadata Management
LakeFormation service is an enterprise-level one-stop data lake construction service. It provides visualized GUIs and APIs for unified management of data lake metadata and is compatible with Hive metadata models and Ranger permission models, enabling users to easily and efficiently build data lakes and operation services and accelerating the release of service data value.
LakeFormation uses underlying resources to implement cross-AZ deployment, high reliability, auto scaling, unified metadata management, association between metadata and file directories, and interconnection with multiple compute engines.
LakeFormation can interconnect with MapReduce Service (MRS) to enable multiple services and clusters to use unified metadata, maximizing data sharing, avoiding unnecessary data copies, and maximizing the value of service data.
Operation |
Function |
|---|---|
Instance |
LakeFormation provides different types of instances to meet customers' requirements on performance and costs in different scenarios. |
Instance management |
LakeFormation provides basic functions such as instance creation, overview, and deletion, helping you easily manage instances and accelerate the planning and deployment of services carried by the data lake. |
Metadata management |
LakeFormation provides life cycle management functions, such as creating, modifying, deleting, and viewing catalogs, databases, and tables of data lake metadata. It helps you easily initialize and operate a data lake, centrally manage all metadata of LakeFormation instances, and accelerate the planning and deployment of services carried by the data lake. |
Data Permissions Management |
LakeFormation allows you to authorize, cancel, and view data resources such as catalogs, databases, and tables. Helps you implement convenient and unified data permission management for the data lake. |
Access management |
LakeFormation provides unified access management capabilities. You can create an access client to establish a network connection stream for a specified client environment. In addition, you can view information such as the access IP address and access domain name in the client details for other cloud services to access LakeFormation instances. |
LakeFormation Advantages
- Being compatible with the Hive metadata model, the SDK client supports easy and fast interconnection between compute engines and LakeFormation.
- The API for querying permissions is compatible with the Ranger permission model.