No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

FusionInsight HD 6.5.0 Administrator Guide 02

Rate and give feedback :
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
Managing Resources

Managing Resources

Add a Resource Pool

Scenario

This section describes how to logically divide Yarn cluster nodes to combine multiple NodeManagers into a Yarn resource pool on FusionInsight HD. Each NodeManager belongs to one resource pool only. The Administrator can create a customized resource pool on FusionInsight Manager and add hosts that are not added to other customized resource pools to the newly created resource pool.

The system contains a Default resource pool by default. All NodeManagers that are not added to customized resource pools belong to this resource pool.

Prerequisites

You have logged in to FusionInsight Manager.

Procedure
  1. Log in to FusionInsight Manager.
  2. Choose Tenant Resources > Resource Pool.
  3. Click Add Resource Pool.
  4. In Add Resource Pool, set the properties of the resource pool.

    • Name: Enter the name of the resource pool. The resource pool name consists of 1 to 50 characters, including digits, letters, or underscores (_), but cannot start with an underscore (_). The name of the newly created resource pool cannot be Default.
    • Resource: In the host list on the left, select the name of a specified host and click to add the selected host to the resource pool. Only hosts in the current cluster can be selected. The host list of a resource pool can be left blank.
      NOTE:

      You can select the Resource based on the host name, CPU, memory, operating system and platform type.

  5. Click OK to save the settings.

    After the resource pool is created, the system administrator can view the name, type, and members of the resource pool in the resource pool list. Hosts that are added to the customized resource pool are no longer members of the Default resource pool.

Modifying a Resource Pool

Scenario

If hosts in the resource pool need to be adjusted based on service requirements, administrators can modify members in the existing resource pool on FusionInsight Manager.

Prerequisites

You have logged in to FusionInsight Manager.

Procedure
  1. Log in to FusionInsight Manager.
  2. Choose Tenant Resources > Resource Pool.
  3. Locate the row that contains the specified resource pool in the resource pool list, and click Edit in the Operation column.
  4. In Edit Resource Pool, modify Hosts.

    • Adding a host: In the host list on the left, select the name of a specified host and click to add the selected host to the resource pool.
    • Deleting a host: In the host list on the left, select the name of a specified host and click to delete the selected host from the resource pool. The host list of a resource pool can be left blank.

  5. Click OK to save the settings.

Deleting a Resource Pool

Scenario

This section describes how to delete an existing resource pool on FusionInsight Manager.

Prerequisites
  • Any queue in the cluster cannot use the resource pool to be deleted as its default resource pool; therefore, cancel the default resource pool before deleting a resource pool. For details, see Configuring a Queue.
  • Additionally, any queue in the cluster is not allowed to configure the resource distribution policy in the resource pool to be deleted; therefore, clear the policy before deleting a resource pool. For details, see Clearing Queue Configurations.
Procedure
  1. Log in to FusionInsight Manager.
  2. Choose Tenant Resources > Resource Pool.
  3. Locate the row that contains the specified resource pool in the resource pool list, and click Delete in the Operation column.
  4. In the window that is displayed, click OK.

Configuring a Queue

Scenario

The administrator can modify queue configuration of a specific tenant on FusionInsight Manager based on service requirements.

Prerequisites

Tenants who use the Capacity scheduler have been added.

Procedure
  1. Log in to FusionInsight Manager.
  2. Choose Tenant Resources > Dynamic Resource Plan.

    By default, the Resource Distribution Policy tab page is displayed.

  3. Click the Queue Configuration tab.
  4. In the tenant queue table, click Modify in the Operation column of the specific tenant queue.

    NOTE:
    • You can also open the queue modification page as follows: Click the target tenant in the tenant list on the left of the Tenant Resources Management tab page. In the window that is displayed, click Resource. On the page that is displayed, click behind the Queue Configuration (queue name).
    • One queue can be bound to only one non-Default resource pool. A newly added resource pool can be bound to only one queue, which serves as the default resource pool of the queue.
    Table 9-10 Queue configuration parameters

    Parameter

    Description

    Tenant Resources Name (Queue)

    Tenant name and queue name.

    Maximum Application

    Specifies the maximum number of applications.

    Maximum AM Resource Percent

    Specifies the maximum percentage of resources that can be used to run the application master in a cluster.

    Minimum User Limit Percent(%)

    Specifies the minimum resource assurance (percentage) of a user. The resources for each user in a queue are limited at any time. If application programs of multiple users are running at the same time in a queue, the resource usage of each user fluctuates between the minimum value and the maximum value. The minimum value is determined by the number of running application programs, while the maximum value is determined by this parameter.

    For example, assume that this parameter is set to 25. If two users submit application programs to the queue, each user can use a maximum of 50% resources; if three users submit application programs to the queue, each user can use a maximum of 33% resources; if four users submit application programs to the queue, each user can use a maximum of 25% resources.

    User Limit Factor

    Specifies the maximum user resource usage limit factor. The maximum user resource usage percentage can be obtained by multiplying the actual resource usage percent of the current tenant in the cluster with this factor.

    Status

    Specifies the current status of a resource plan. Running indicates that the resource plan is running. Stopped indicates that the resource plan is stopped.

    Default Resource Pool

    Specifies the resource pool used by a queue. The default value is Default. If you want to change the resource pool, configure the queue capacity first. For details, see Configuring the Queue Capacity Policy of a Resource Pool.

  5. Click OK. The queue configuration is complete.

Configuring the Queue Capacity Policy of a Resource Pool

Scenario

After a resource pool is added, the capacity policy of available resources needs to be configured for Yarn task queues to ensure proper task running in the resource pool. Each queue can be configured with the queue capacity policy of one resource pool only.

Administrators can View queues in any resource pool and configure the queue capacity policy. After the queue policies are configured, Yarn task queues are associated with resource pools.

Prerequisites

Queues are added, this is, tenants associated to compute resources are created.

Procedure
  1. Log in to FusionInsight Manager.
  2. Choose Tenant Resources > Dynamic Resource Plan.

    By default, the Resource Distribution Policy tab page is displayed.

  3. In Resource Pool, select the specified resource pool. For example, Default.
  4. Locate the specified queue in the Resource Allocation table, and click Modify in the Operation column.
  5. In Modify Resource Allocation, configure the resource capacity policy of the task queue in the resource pool.

    • Resource Capacity (%): specifies the computing resource usage percent of the current tenant.
    • Maximum Resource Capacity (%): specifies the maximum computing resource usage percent of the current tenant.

  6. Click OK to save the settings.

    NOTE:

    To cancel the resource capacity policy of the task queue in the resource pool, delete the resource capacity value and save the setting. Then the queue is disassociated with the resource pool. Change the default resource pool of the queue to another resource pool. For details, see Configuring a Queue.

Clearing Queue Configurations

Scenario

The system administrator can clear queue configurations on FusionInsight Manager if a queue does not need resources from a resource pool or a resource pool needs to be disassociated from a queue. Clearing queue configurations means that the resource capacity policy of a queue in the resource pool is canceled.

Prerequisites

If a queue is to be unbound from a resource pool, you have ensured that the resource pool is not the default resource pool of the queue. For details, see Configuring a Queue.

Procedure
  1. Log in to FusionInsight Manager portal.
  2. Choose Tenant Resources > Dynamic Resource Plan
  3. In Resource Pool, select the specified resource pool.
  4. Locate the row that contains the specified queue in Resource Allocation and click Clear in the Operation column.
  5. In Clear Queue Configuration, click OK to clear the queue configurations in the current resource pool.
Download
Updated: 2019-05-17

Document ID: EDOC1100074522

Views: 5872

Downloads: 12

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next