No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

FusionInsight HD 6.5.0 Administrator Guide 02

Rate and give feedback:
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
Managing Resources

Managing Resources

Add a Resource Pool

Scenario

This section describes how to logically divide Yarn cluster nodes to combine multiple NodeManagers into a Yarn resource pool on FusionInsight HD. Each NodeManager belongs to one resource pool only. The Administrator can create a customized resource pool on FusionInsight Manager and add hosts that are not added to other customized resource pools to the newly created resource pool.

The system contains a Default resource pool by default. All NodeManagers that are not added to customized resource pools belong to this resource pool.

Prerequisites

You have logged in to FusionInsight Manager.

Procedure
  1. Log in to FusionInsight Manager.
  2. Choose Tenant Resources > Resource Pool.
  3. Click Add Resource Pool.
  4. In Add Resource Pool, set the properties of the resource pool.

    • Name: Enter the name of the resource pool. The resource pool name consists of 1 to 50 characters, including digits, letters, or underscores (_), but cannot start with an underscore (_). The name of the newly created resource pool cannot be Default.
    • Resource: In the host list on the left, select the name of a specified host and click to add the selected host to the resource pool. Only hosts in the current cluster can be selected. The host list of a resource pool can be left blank.
      NOTE:

      You can select the Resource based on the host name, CPU, memory, operating system and platform type.

  5. Click OK to save the settings.

    After the resource pool is created, the system administrator can view the name, type, and members of the resource pool in the resource pool list. Hosts that are added to the customized resource pool are no longer members of the Default resource pool.

Modifying a Resource Pool

Scenario

If hosts in the resource pool need to be adjusted based on service requirements, administrators can modify members in the existing resource pool on FusionInsight Manager.

Prerequisites

You have logged in to FusionInsight Manager.

Procedure
  1. Log in to FusionInsight Manager.
  2. Choose Tenant Resources > Resource Pool.
  3. Locate the row that contains the specified resource pool in the resource pool list, and click Edit in the Operation column.
  4. In Edit Resource Pool, modify Hosts.

    • Adding a host: In the host list on the left, select the name of a specified host and click to add the selected host to the resource pool.
    • Deleting a host: In the host list on the left, select the name of a specified host and click to delete the selected host from the resource pool. The host list of a resource pool can be left blank.

  5. Click OK to save the settings.

Deleting a Resource Pool

Scenario

This section describes how to delete an existing resource pool on FusionInsight Manager.

Prerequisites
  • Any queue in the cluster cannot use the resource pool to be deleted as its default resource pool; therefore, cancel the default resource pool before deleting a resource pool. For details, see Configuring a Queue.
  • Additionally, any queue in the cluster is not allowed to configure the resource distribution policy in the resource pool to be deleted; therefore, clear the policy before deleting a resource pool. For details, see Clearing Queue Configurations.
Procedure
  1. Log in to FusionInsight Manager.
  2. Choose Tenant Resources > Resource Pool.
  3. Locate the row that contains the specified resource pool in the resource pool list, and click Delete in the Operation column.
  4. In the window that is displayed, click OK.

Configuring a Queue

Scenario

The administrator can modify queue configuration of a specific tenant on FusionInsight Manager based on service requirements.

Prerequisites

Tenants who use the Superior scheduler have been added.

Procedure
  1. On FusionInsight Manager, click Tenant Resources.
  2. Click the Dynamic Resource Plan tab.
  3. Click the Queue Configuration tab.
  4. In the tenant queue table, click Modify in the Operation column of the specific tenant queue.

    NOTE:
    • You can also open the queue modification page as follows: Click the target tenant in the tenant list on the left of the Tenant Resources Management tab page. In the window that is displayed, click Resource. On the page that is displayed, click behind Queue Configuration (queue name).
    • One queue can be bound to only one non-default resource pool.
    Table 9-14 Queue configuration parameters

    Parameter

    Description

    Max Master Shares(%)

    Indicates the maximum percentage of resources occupied by all ApplicationMasters in the current queue.

    Max Allocated vCores

    Indicates the maximum number of cores allocated to a Yarn container in the current queue.

    Max Allocated Memory(MB)

    Indicates the maximum memory allocated to a Yarn container in the current queue.

    Max Running Apps(%)

    Indicates the maximum number of tasks supported by the current queue at one time. The default value is -1, which indicates that the number of tasks that can be executed concurrently in the queue is not restricted (same meaning as the parameter value left blank). Value 0 indicates that no task can be executed. The value ranges from -1 to 2147483647.

    Max Running Apps per User

    Indicates the maximum number of tasks allowed for a user in the current queue at one time. The default value is -1, which indicates that the number of tasks that can be executed concurrently in the queue is not restricted (same meaning as the parameter value left blank). Value 0 indicates that no task can be executed. The value ranges from -1 to 2147483647.

    Max Pending Apps

    Indicates the maximum number of tasks that can be suspended in the current queue at one time. The default value is -1, which indicates that the number of tasks that can be suspended concurrently in the queue is not restricted (same meaning as the parameter value left blank). Value 0 indicates that no task can be suspended. The value ranges from -1 to 2147483647.

    Resource Allocation Rule

    Indicates the rule for allocating resources to different tasks of a user. The rule can be FIFO or FAIR. If a user submits multiple tasks in the current queue and the rule is FIFO, the tasks are executed one by one in sequential order; if the rule is FAIR, resources are evenly allocated to all tasks.

    Default Resource Label

    Indicates that tasks are executed on a node with a specified resource label.

    Active

    ACTIVE: indicates that the current queue can receive and execute tasks.

    INACTIVE: indicates that the current queue can receive but cannot execute tasks. Tasks submitted to the queue are suspended.

    Open

    OPEN: indicates that the current queue is opened.

    CLOSED: indicates that the current queue is closed. Tasks submitted to the queue are rejected.

  5. Click OK. The queue configuration is complete.

Configuring the Queue Capacity Policy of a Resource Pool

Scenario

After a resource pool is added, capacity policies of available resources need to be configured for Yarn task queues to ensure the proper running of tasks in the resource pool.

This section describes how to configure the queue policy on FusionInsight Manager. Tenant queues with the Superior scheduler can use resources in different resource pools.

Prerequisites
  • You have logged in to FusionInsight Manager.
  • You have added a resource pool.
  • The task queue is not associated with resource pools of other queues except the default resource pool.
Procedure
  1. On FusionInsight Manager, click Tenant Resources.
  2. Click the Dynamic Resource Plan tab.
  3. Click the Resource Distribution Policy tab, the default value is Default.
  4. In Resource Pool, select the specified resource pool.
  5. Locate the specified queue in Resource Allocation, and click Modify in the Operation column.
  6. On the Resource Configuration Policy tab page in Modify Resource Allocation, configure the resource allocation policy for the task queue in the resource pool.

    • Weight: indicates the resources that a tenant can obtain. Its initial value is the same as the minimum resource percentage.
    • Minimum Resource: indicates the minimum resources that a tenant can obtain.
    • Maximum Resource: indicates the maximum resources that a tenant can obtain.
    • Reserved Resource: indicates the resources that are reserved for a tenant and cannot be shared by other tenants.

  7. On the User Policy tab page in Modify Resource Allocation, configure the user policy.

    NOTE:

    defaultUser(built-in) indicates that the policy specified by defaultUser is used if a user does not specify a policy. The default policy cannot be deleted.

    • Click Add User Policy to add a user policy.
      • Username: indicates the user name.
      • Weight: indicates the resources that a user can obtain.
      • Max vCores: indicates the maximum number of virtual cores that a user can obtain.
      • Max Memory(MB): indicates the maximum memory that a user can obtain.
    • Click Modify in the Operation column to modify a user policy.
    • Click Clear in the Operation column to delete a user policy.

  8. Click OK to save the configuration.

Clearing Queue Configurations

Scenario

The system administrator can clear queue configurations on FusionInsight Manager if a queue does not need resources from a resource pool or a resource pool needs to be disassociated from a queue. Clearing queue configurations means that the resource capacity policy of a queue in the resource pool is canceled.

Prerequisites

If a queue is to be unbound from a resource pool, you have ensured that the resource pool is not the default resource pool of the queue. For details, see Configuring a Queue.

Procedure
  1. Log in to FusionInsight Manager portal.
  2. Choose Tenant Resources > Dynamic Resource Plan
  3. In Resource Pool, select the specified resource pool.
  4. Locate the row that contains the specified queue in Resource Allocation and click Clear in the Operation column.
  5. In Clear Queue Configuration, click OK to clear the queue configurations in the current resource pool.
Download
Updated: 2019-05-17

Document ID: EDOC1100074522

Views: 6181

Downloads: 12

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next