No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

FusionInsight HD 6.5.0 Product Description 02

Rate and give feedback :
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
Hue

Hue

Basic Principle

Function

Hue provides a graphical web user interface (WebUI) for FusionInsight HD applications. Hue supports components including Hadoop distributed file system (HDFS), Hive, YARN/MapReduce, Oozie, Solr, ZooKeeper. On the WebUI provided by Hue, you can perform the following operations on the components:

  • HDFS: View files or directories, create files or directories, manage files or directories, delete files or directories, upload files, manually configure HDFS directory storage policies, and configure dynamic storage policies.
  • Hive: Edit and execute Hibernate Query Language (HQL) statements, and add, delete, modify, and query databases, tables, and views using MetaStore.
    NOTE:

    If Internet Explorer is used to access the Hue page to run HiveSQL, the running fails because the browser has functional problems. You are advised to use other browsers, such as Google Chrome 21 and later versions.

  • MapReduce: View the MapReduce tasks that are being executed and complete in the cluster, including viewing their status, start time and end time, and run logs.
  • Oozie: Provides the Oozie job manager function for users to use Oozie in GUI mode.
  • Solr: Supports the applications that based on Solr search and provides visualized data views.
  • ZooKeeper: Provides the ZooKeeper browser function for users to use ZooKeeper in GUI mode.
Structure

Hue, adopting the MTV (Model-Template-View) design, is a web application program running on Django Python. (Django Python is a web application framework that uses open-source codes.)

Hue consists of Supervisor Process and WebServer. Supervisor Process is the core Hue process that implements application process management.

Supervisor Process and WebServer interact with WebServer applications through the THRIFT/REST interface, as shown in Figure 2-48.

Figure 2-48 Hue architecture

Table 2-11 describes the functions of each module shown in Figure 2-48.

Table 2-11 Hue modules

Module

Description

Supervisor Process

Manages processes of WebServer applications, such as starting, stopping, and monitoring the processes.

Hue WebServer

Provides the following functions through the Django Python web framework:

  • Deploys applications.
  • Provides a graphical WebUI.
  • Connects to databases to store persistent data of applications.

Relationship with Components

Figure 2-49 shows interaction between Hue and hadoop clusters.

Figure 2-49 Hue and Hadoop clusters
Table 2-12 Interaction between Hue and Hadoop clusters

Component

Description

HDFS

HDFS provides REST interfaces to interact with Hue to query and operate HDFS files.

Hive

Hive provides THRIFT interfaces to interact with Hue to execute Hive SQL statements and query table metadata.

YARN/MapReduce

MapReduce provides REST interfaces to interact with Hue to query Yarn job information.

Oozie

Oozie provides REST interfaces to interact with Hue to create workflows, coordinators, and bundles, and manage and monitor tasks.

Solr

Solr provides REST interfaces to interact with Hue to define indexes and search information.

Zookeeper

ZooKeeper provides REST interfaces to interact with Hue to query ZooKeeper node information.

Interaction between Hue and the HDFS

Hue packages a user request into interface data, sends the request to the HDFS through REST interfaces, and displays execution results on the WebUI.

Interaction between Hue and Hive

A user edits HQL statements on the Hue WebUI. Then Hue submits the HQL statements to the Hive server through the THRIFT interface and displays execution results on the WebUI.

Interaction between Hue and MapReduce

A user goes to the Hue WebUI and sets the filter criteria on the UI. The UI sends the parameters to the background. Then Hue invokes the REST interfaces provided by MapReduce (MR1/MR2-YARN) to obtain task running status, start time and end time, run logs, and other information.

Interaction between Hue and Oozie

A graphical workflow, coordinator, and bundle editor are provided. Hue invokes the REST interfaces of Oozie to create, modify, delete, submit, and monitor workflows, coordinators, and bundles.

Interaction between Hue and Solr

In the Hue WebUI, screening parameters are set using GUI controls. The parameter settings are sent to the Hue server. The Hue server invokes the REST interface of Solr and transmits the results returned by Solr in JSON mode to the Hue WebUI. The Hue WebUI then displays the results using icons and controls.

Interaction between Hue and Zookeeper

ZooKeeper node information is displayed. Hue invokes the REST interfaces of ZooKeeper to obtain the node information.

Download
Updated: 2019-05-17

Document ID: EDOC1100074548

Views: 3153

Downloads: 36

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next