No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

OceanStor 9000 V100R001C01 Planning Guide 07

Rate and give feedback :
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
Deployment Solution Description

Deployment Solution Description

Hardware Configuration

Figure 4-14 shows the typical configuration of a Capacity node cabinet.
  • For example, in a high-performance computing project, 26 Capacity node are used. Considering the quantities, bearing capacity, and energy consumption of nodes in each cabinet, one base cabinet and four expansion cabinets are deployed.
  • One pair of CE6800 switches are provided for each of the front-end and back-end networks. The CE6800 switches used for the back-end network are installed in the base cabinet by default, and those for the front-end network are installed in the first expansion cabinet. The CE5800 switch used for cluster management network is deployed in the base cabinet by default.
  • Five Capacity node are installed in the base cabinet from bottom to up. The RH2285 server is optional. It is used as a report server if the statistical report function is required.
  • Five Capacity node installed in expansion cabinet 1 from bottom to up. Two CE6800 switches are used for the front-end service network of the cluster.
  • Five Capacity node are installed in expansion cabinets 2 and 3 from bottom to up, and six Capacity node are installed in expansion cabinet 4 from bottom to up.
Figure 4-14  Capacity node cabinet configuration

Node Ports

Figure 4-15 shows the ports for networking on a node.

Figure 4-15  Network ports

Table 4-11 describes the use of network ports on a node when both the front-end and back-end networks are 10GE.

Table 4-11  Node port usage

Port Name

Port Type

Network

Description

A0-0 and B3-0

10GE optical port

Back-end storage network

Connect to the CE6800 switches. A back-end storage network IP address is configured for each of the two ports.

A0-1 and B3-1

10GE optical port

Front-end service network

Connect to the 10GE switch of the front-end service network. A front-end storage network IP address is configured for each of the two ports.

NIC0

GE electrical port

Management network

The first three nodes of the OceanStor 9000 cluster provide management network ports.

You do not need to assign IP addresses independently for the ports because the management IP address set for the cluster floats among the ports.

IPMI

FE electrical port

Management network

Connects to the CE5800 switch. A management and maintenance network IP address is configured for the port.

Networking Solution

Figure 4-16 shows the networking solution. OceanStor 9000 provides two pairs of CE6800 switches for the front-end service and back-end storage networks, as well as a CE5800 switch for the management network.
Figure 4-16  Networking diagram

Port allocation of back-end storage network switches

Figure 4-17 shows port allocation on the two CE6800 switches used for the back-end storage network.

Figure 4-17  Port allocation of back-end storage network switches

  • Downstream ports

    The downstream ports of each CE6800 switch connect to the back-end ports of each node in sequence based on the port number.

    • Switch CE6800-1 connects to port A0-0 of each node.
    • Switch CE6800-2 connects to port B3-0 of each node.
  • Stacking ports

    The two CE6800 switches connect to each other using stacking ports. Comply with the following rules when using stacking ports:

    • When the number of nodes is not larger than 16, use two ports for stacking switches.
    • When the number of nodes is larger than 16 but not larger than 24, use three ports for stacking switches.
    • When the number of nodes is larger than 24 but not larger than 40, use four ports for stacking switches.
  • Reserved ports

    Reserved ports are free ports. To prevent adverse impact on other ports, you are advised to run shutdown to shut down the reserved ports. For details about the shutdown command, refer to the switch manual.

  • ETH management network ports

    ETH ports are used for switch management. The two ports connect to the CE5800 switch.

NOTE:

SFP+ high-speed cables are used for interconnecting devices in the same cabinet, whereas optical fibers support cross-cabinet device connection.

Port layout on the front-end service network switches (multiple subsets not required)

Figure 4-18 shows port layout on the CE6800 switches used for the front-end service network when it does not require multiple subnets.

Figure 4-18  Port layout on the CE6800 switches used for the front-end service network

  • Downstream ports

    The downstream ports of each CE6800 switch connect to the front-end ports of each node in sequence based on the port number. The switches also provide upstream expansion ports to connect to the front-end service network.

    • Switch CE6800-1 connects to port A0-1 of each node and provides eight ports as upstream expansion ports to connect to the front-end service network.
    • Switch CE6800-2 connects to port B3-1 of each node and provides eight ports as upstream expansion ports to connect to the front-end service network.
    • Switches CE6800-1 and CE6800-2 provide 16 upstream ports, which are bonded as Eth-trunk1 to connect to the front-end service network.
  • Stacking ports

    The two CE6800 switches connect to each other using stacking ports. Comply with the following rules when using stacking ports:

    • When the number of nodes is not larger than 16, use two ports for stacking switches.
    • When the number of nodes is larger than 16 but not larger than 24, use three ports for stacking switches.
    • When the number of nodes is larger than 24 but not larger than 40, use four ports for stacking switches.
  • Reserved ports

    Reserved ports are free ports. To prevent adverse impact on other ports, you are advised to run shutdown to shut down the reserved ports. For details about the shutdown command, refer to the switch manual.

  • ETH management network ports

    ETH ports are used for switch management. The two ports connect to the CE5800 switch.

NOTE:

Regarding the connection between front-end ports of nodes and switches, SFP+ high-speed cables are used for interconnecting devices in the same cabinet, whereas optical fibers support cross-cabinet device connection.

Port layout on front-end service network switches (multiple subsets required)

Figure 4-19 shows port allocation of the CE6800 switches used for the front-end service network when it requires multiple subnets.

Figure 4-19  Port layout on the CE6800 switches used for the front-end service network

For example, in a high-performance computing project, 26 nodes are divided into two subnets. Nodes 1 to 13 belong to subnet 1, and nodes 14 to 26 belong to subnet 2.

  • Downstream and expansion ports of subnet 1

    The subnet 1 downstream ports of each CE6800 switch connect to the front ports of each node in sequence based on the port number. The switches also provide upstream expansion ports to connect to the front-end subnet 1.

    • The CE6800-1 switch connects to port A0-1 of nodes 1 to 13 and provides four ports as upstream expansion ports to connect to front-end subnet 1.
    • The CE6800-2 switch connects to port B3-1 of nodes 1 to 13 and provides four ports as upstream expansion ports to connect to front-end subnet 1.
    • The CE6800-1 and CE6800-2 switches provide 8 upstream ports, which are bonded as Eth-trunk1 to connect to front-end subnet 1.
  • Downstream and expansion ports of subnet 2

    The subnet 2 downstream ports of each CE6800 switch connect to the front ports of nodes 14 to 26 in sequence based on the port number. The switches also provide upstream expansion ports to connect to front-end subnet 2.

    • The CE6800-1 switch connects to port A0-1 of nodes 14 to 26 and provides four ports as upstream expansion ports to connect to front-end subnet 2.
    • The CE6800-2 switch connects to port B3-1 of nodes 14 to 26 and provides four ports as upstream expansion ports to connect to front-end subnet 2.
    • The CE6800-1 and CE6800-2 switches provide 8 upstream ports, which are bonded as Eth-trunk1 to connect to front-end subnet 2.
  • Stack ports

    The two CE6800 switches connect to each other using stack ports. Comply with the following rules when using stack ports:

    • When the number of nodes is not larger than 16, use two ports for stacking switches.
    • When the number of nodes is larger than 16 but not larger than 24, use three ports for stacking switches.
    • When the number of nodes is larger than 24 but not larger than 32, use four ports for stacking switches.
  • Reserved ports

    Reserved ports are free ports for use by customers. To prevent adverse impact on other ports, you are advised to run shutdown to shut down the reserved ports. For details about the shutdown command, refer to the switch manual.

  • ETH management network ports

    ETH ports are used for switch management. The two ports connect to the CE5800 switch.

NOTE:

Regarding the connection between front-end ports of nodes and switches, SFP+ high-speed cables are used for interconnecting devices in the same cabinet, whereas optical fibers support cross-cabinet device connection.

Port allocation of the management network switch

Figure 4-20 shows the port allocation of the CE5800 switch.

Figure 4-20  Port layout of the CE5800 switch
  • IPMI downstream ports

    The downstream ports of the CE5800 switch connect to the IPMI of each node in sequence based on the port number.

  • Downstream NIC0 ports

    The three NIC0 ports connect to the first three nodes (nodes 01 to 03 in the base cabinet) of the OceanStor 9000 cluster in sequence.

  • 10GE switch management ports

    The four 10GE switch management ports connect to the front ETH management ports of the four CE6800 switches.

  • Upstream ports

    The two upstream ports connect to the customer's management and maintenance network.

  • Reserved ports

    Reserved ports are free ports. To prevent adverse impact on working ports, you are advised to run shutdown to shut down the reserved ports. For details about the shutdown command, refer to the switch manual.

Download
Updated: 2018-10-27

Document ID: EDOC1000042140

Views: 7895

Downloads: 122

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next