HUAWEI CLOUD Stack 8.1.1 O&M Guide 09
Resource Monitoring Reference
Installing UVP VMTools or Agent
UVP VMTools or Agent allows you to query the internal information, ensuring that the performance data is displayed completely.
- For details about how to install UVP VMTools on an ECS (in the FusionSphere OpenStack resource pool), see "Computing Service" > "Elastic Cloud Server (ECS)" > "Installing or Upgrading UVP VMTools for an Existing ECS" in HUAWEI CLOUD Stack 8.1.1 Resource Provisioning Guide.
- For details about how to install Agent on an ECS (in the IaaS OpenStack resource pool), see HCS Online Help Center > Cloud Eye > Server Monitoring > Installing and Configuring the Agent on a Linux ECS or BMS > Installing the Agent (Linux).
- For details about how to install UVP VMTools on an ECS (in the FusionCompute resource pool), see "Operation and Maintenance" > "Service Management" > "Service Management in Single-Hypervisor Scenarios" > "Virtual Machine Management" > "Tools Management" > "Installing Tools" in FusionCompute Product Documentation.
- For details about how to install UVP VMTools on an ECS (in a FusionManager resource pool), see "Operation and Maintenance" > "Service Management" > "Service Management in Single-Hypervisor Scenarios" > "Virtual Machine Management" > "Tools Management" > "Installing the Tools" in FusionSphere Virtualization Suite 6.5.0 Product Documentation.
Installing the Monitoring Agent on the BMS
With the monitoring Agent installed on a BMS, the system automatically collects monitoring metrics, such as the CPU, memory, disk, and bandwidth usage of a BMS, showing you the status of your BMS.
Install the monitoring Agent by following the operations provided in section "Monitoring Metrics" in Bare Metal Server (BMS) 8.1.1 User Guide (for HUAWEI CLOUD Stack 8.1.1) of Bare Metal Server (BMS) Usage Guide (for HUAWEI CLOUD Stack 8.1.1).
Using the OBS Log Metric Monitoring Function
Prerequisites
- You have obtained the number of OBS cluster nodes in the current environment. For details, see Obtaining the Number of OBS Cluster Nodes in the Current Environment.
- You have logged in to ManageOne Maintenance Portal.
Procedure
- Check the number of OBS cluster nodes allowed for the ManageOne VM management scale in the current environment by referring to Table 3-235.Table 3-235 Number of OBS cluster nodes allowed for ManageOne management scales
ManageOne Deployment Mode
VM Management Scale
OBS Cluster Nodes
Number of Slots for OBS Log Analysis
Number of Available Slots
15 nodes
500~2000
Not supported
Not supported
Not supported
2000~5000
6
14
26
5000~10000
9
15
26
10000~30000
12
25
58
30000~100000
15
30
55
12 nodes
500~2000
Not supported
Not supported
Not supported
2000~5000
3
14
10
5000~10000
6
14
10
10000~30000
8
15
10
- Check whether the number of OBS cluster nodes in the current environment is greater than the number of OBS cluster nodes obtained in Step 1 in the current environment.
- If yes, obtain the minimum management scale corresponding to the actual number of OBS cluster nodes by referring to Table 3-235, expand the ManageOne VM management scale in the current environment to this scale based on HUAWEI CLOUD Stack 8.1.1 Capacity Expansion Guide, and go to Step 3.
- If no, go to Step 3.
- If ManageOne is deployed on 12 nodes, add Flink compute resources by following Adding Flink Compute Resources.
- Enable the log metric monitoring function.
- Choose System > System Integration from the main menu.
- In the navigation pane, choose Data Channel.
- Enter LogMetricConfig in the search box in the upper right corner of the page and click
.
- Click the LogMetricConfig group name. The View Configuration dialog box is displayed.
- Check whether the value of isSupportLogMetric is true.
- If yes, the log metric monitoring function has been enabled. Go to Step 5.
- If no, click Cancel to close the View Configuration dialog box.
- Click Modify in the Operation column of the LogMetricConfig group.
- In the displayed dialog box, click OK.
- In the Modify Configuration dialog box, change the value of isSupportLogMetric to true.
- Click OK.
- View monitoring data of OBS log metrics.
After the log metric monitoring function is enabled, log metric data is not reported immediately. You need to wait for about 30 minutes.
- Choose Monitor > Resource Monitoring from the main menu.
- Choose System Resources in the navigation pane and click the Cloud Service tab to switch to the cloud service monitoring list.
- Enter OBS in the search box above the cloud service monitoring list.
- After the search is successful, click the OBS cloud service name. The OBS cloud service overview page is displayed.
- In the navigation pane, choose Basic Information > Monitoring.
- Select the OBS root node in the service tree and view the Business Metric page on the right.
- Check whether values are displayed in the chart below.
- If yes, the OBS log metric monitoring function is enabled successfully.
- If no, contact technical support for assistance.
Obtaining the Number of OBS Cluster Nodes in the Current Environment
- Choose Resource Topology > Resource Management from the main menu.
- In the navigation pane, choose Resource List.
- Click the System Resources tab on the All Resources or Resource Pools tab page.
- Select Cloud Service > Microservice Instance for Resources.
- In the resource list, set Name to osc_ to search for resources.
- Calculate the number of search records whose names start with osc_, that is, the number of OBS cluster nodes in the current environment.
Checking the Total and Used Physical Memory of MODataPipelineService Nodes
- Use a browser to log in to ManageOne Deployment Portal.
URL: https://{Floating IP address of ManageOne Deployment Portal}:31945, for example, https://192.168.0.1:31945
Default username: admin
- Choose Maintenance > Operation and Maintenance Management > Panoramic Monitoring from the main menu of ManageOne Deployment Portal.
- In the navigation pane, choose Service Monitoring.
- Click
in the upper left corner of the page and choose ManageOne.
- Click the Processes tab.
- Enter MODataPipelineService in the search box in the upper left corner and press Enter.
- In the search result, view the node names of all MODataPipelineService processes.
- In the navigation pane, choose Node Monitoring.
- In the search box in the upper left corner, enter the node name queried in Step 7 and press Enter.
- In the search result, view the total and used physical memory of each node.
Adding Flink Compute Resources
The OBS log analysis function consumes a large number of Flink compute resources. Therefore, before enabling the log metric monitoring function, you need to scale out Flink clusters in the current environment.
ManageOne Deployment Mode |
VM Management Scale |
Number of Slots to Be Added for OBS Log Analysis |
Memory to Be Added for a New Slot |
Memory to Be Added for OBS Log Analysis |
Default Number of Slots for a Node |
Max Number of Slots That Can Be Added for Each Node |
---|---|---|---|---|---|---|
15 nodes |
2000~5000 |
N/A |
150 MB |
N/A |
16 |
4 |
5000~10000 |
N/A |
150 MB |
N/A |
16 |
5 |
|
10000~30000 |
N/A |
150 MB |
N/A |
16 |
5 |
|
30000~100000 |
N/A |
150 MB |
N/A |
16 |
5 |
|
12 nodes |
2000~5000 |
4 |
150 MB |
600 MB |
16 |
4 |
5000~10000 |
4 |
150 MB |
600 MB |
16 |
5 |
|
10000~30000 |
5 |
150 MB |
750 MB |
16 |
8 |
- Check whether the number of slots to be added in the current environment is greater than the maximum number of slots that can be added.
- The number of slots to be added in the current environment is a value in the Number of Slots to Be Added for OBS Log Analysis column in Table 3-236.
- For 12 nodes, the maximum number of slots that can be added is twice a value in the Maximum Number of Slots That Can Be Added for a Single Node column in Table 3-236.
- If yes, expand the ManageOne VM management scale in the current environment to the next scale by referring to Table 3-236, and then go to Step 2.
If the management scale of ManageOne VMs before scale-out is 10,000 to 30,000 in 12-node mode, the next scale is 30,000 to 100,000 in 15-node mode.
- If no, go to Step 2.
- Calculate the total memory after slots are added (Used physical memory + Memory to be added).Check whether the calculated total memory exceeds 80% of the total VM memory.
- Obtain the total VM memory and used physical memory from Checking the Total and Used Physical Memory of MODataPipelineService Nodes.
- Memory to be added indicates a value in the Memory to Be Added for OBS Log Analysis column in Table 3-236.
- If yes, expand the ManageOne VM management scale in the current environment to the next scale by referring to Table 3-236, and then go to Step 3.
If the management scale of ManageOne VMs before scale-out is 10,000 to 30,000 in 12-node mode, the next scale is 30,000 to 100,000 in 15-node mode.
- If no, go to Step 3.
- Modify the configuration file of the node where MODataPipelineService is deployed.
- Use PuTTY to log in to a node where MODataPipelineService is deployed, as the sopuser user over SSH.
- Run the following command to switch to the root user:
sudo su root
- Run the following command to go to the directory where the target file is stored:
cd /opt/oss/Product/apps/MODataPipelineService/flink-1.11.3/conf
- Run the vi command to open the flink-conf.yaml file and modify the following items:
- taskmanager.numberOfTaskSlots: Change the value to the total number of slots after slots are added.
- taskmanager.memory.task.heap.size: Change the value to the total memory calculated in Step 2.
- After modification, press Esc to exit the editing mode and enter :wq! to save the settings.
- Restart MODataPipelineService on the current node.
sudo -uossadm /opt/oss/manager/agent/bin/ipmc_adm -cmd restartapp -app MODataPipelineService
- Repeat Step 3 and Step 4 on other nodes where MODataPipelineService is deployed.