Connecting Signal Cables for a TaiShan 2280 V2 12-Slot Node or TaiShan 5280 V2 36-Slot Node
This section describes how to connect a node to a switch in a 25GE network.
Prerequisites
- Information about the current network and associated ports has been obtained.
For details about networking and port connection, see FusionStorage OBS Planning Guide of the desired version.
- Required components have been installed in the cabinet.
- PGND cables and power cables have been connected to the components in the cabinet.
- All required tools have been prepared, containing cable ties, diagonal pliers, ESD gloves or an ESD wrist strap, optical fibers, and network cables.
Context
TaiShan 2280 V2 12-slot nodes and TaiShan 5280 V2 36-slot nodes are applicable to FusionStorage OBS 7.0.1 and later versions.
TaiShan 2280 V2 12-Slot Node
Figure 10-25 shows the network ports of a storage node.
- When the storage/control plane uses the 10GE network, one 4-port PCIe card is configured for the storage node.
- When the storage/control plane uses the 25GE network, two 4-port PCIe cards are configured for the storage node.
- The management plane can independently use the NIC network port as the management network port, or share the SLOT physical network port with the service plane. An independent VLAN is configured for each plane. This section describes the storage node ports used when the management plane independently uses network port NIC as the management network port.
Table 10-25 describes storage node ports used when the service plane and storage/control plane use the 10GE network.
Port |
Type |
Access Network Plane |
Description |
---|---|---|---|
SLOT4-0 and SLOT4-1 |
10GE optical port |
Storage/Control plane |
The ports are shared by the storage plane and control plane and connected to the back-end switch. The two ports form a logical bond port, which is configured with a storage VLAN and a control VLAN. |
SLOT4-2 and SLOT4-3 |
10GE optical port |
Service plane |
The ports are connected to the front-end switch, and form a logical bond port. |
NIC1-1 |
GE port |
Management plane |
The port is connected to the management switch. |
Mgmt |
GE port |
BMC plane |
The port is connected to the BMC switch. |
Table 10-26 describes storage node ports used when the service plane and storage/control plane use the 25GE network.
Port |
Type |
Access Network Plane |
Description |
---|---|---|---|
SLOT4-0 and SLOT3-0 |
25GE optical port |
Storage/Control plane |
The ports are shared by the storage plane and control plane and connected to the back-end switch. The two ports form a logical bond port, which is configured with a storage VLAN and a control VLAN. |
SLOT4-1 and SLOT3-1 |
25GE optical port |
Service plane |
The ports are connected to the front-end switch, and form a logical bond port. |
NIC1-1 |
GE port |
Management plane |
The port is connected to the management switch. |
Mgmt |
GE port |
BMC plane |
The port is connected to the BMC switch. |
TaiShan 5280 V2 36-Slot Node
Figure 10-26 shows the network ports of a storage node.
- When the storage/control plane uses the 10GE network, one 4-port PCIe card is configured for the storage node.
- When the storage/control plane uses the 25GE network, two 4-port PCIe cards are configured for the storage node.
- The management plane can independently use the NIC network port as the management network port, or share the SLOT physical network port with the service plane. An independent VLAN is configured for each plane. This section describes the storage node ports used when the management plane independently uses network port NIC as the management network port.
Table 10-27 describes storage node ports used when the service plane and storage/control plane use the 10GE network.
Port |
Type |
Access Network Plane |
Description |
---|---|---|---|
SLOT4-0 and SLOT4-1 |
10GE optical port |
Storage/Control plane |
The ports are shared by the storage plane and control plane and connected to the back-end switch. The two ports form a logical bond port, which is configured with a storage VLAN and a control VLAN. |
SLOT4-2 and SLOT4-3 |
10GE optical port |
Service plane |
The ports are connected to the front-end switch, and form a logical bond port. |
NIC1-1 |
GE port |
Management plane |
The port is connected to the management switch. |
Mgmt |
GE port |
BMC plane |
The port is connected to the BMC switch. |
Table 10-28 describes storage node ports used when the service plane and storage/control plane use the 25GE network.
Port |
Type |
Access Network Plane |
Description |
---|---|---|---|
SLOT4-0 and SLOT3-0 |
25GE optical port |
Storage/Control plane |
The ports are shared by the storage plane and control plane and connected to the back-end switch. The two ports form a logical bond port, which is configured with a storage VLAN and a control VLAN. |
SLOT4-1 and SLOT3-1 |
25GE optical port |
Service plane |
The ports are connected to the front-end switch, and form a logical bond port. |
NIC1-1 |
GE port |
Management plane |
The port is connected to the management switch. |
Mgmt |
GE port |
BMC plane |
The port is connected to the BMC switch. |
Ports on Switches for Networking
The following uses six storage nodes as an example to describe the physical connection rules of switches.
Figure 10-27 shows an example of planning ports on a 48-port CE6865 switch (25GE switch, CE6800 for short), and Table 10-29 describes port usage.
Port Type |
Number |
Port Name |
Description |
---|---|---|---|
25GE optical ports |
1 to 12 |
Storage and compute ports |
Each CE6800 switch uses twelve 25GE ports to sequentially connect to each node.
|
13 to 48 |
Reserved ports |
Reserved ports are the ports reserved for future use. To prevent adverse impact on other ports, you are advised to run the shutdown command to disable all reserved ports. For details about the shutdown command, refer to related switch documentation. |
|
100GE optical ports |
1 and 2 |
Stack ports |
Two CE6800 switches are stacked using two 100GE ports. |
3 to 6 |
Reserved ports |
Reserved ports are the ports reserved for future use. To prevent adverse impact on other ports, you are advised to run the shutdown command to disable all reserved ports. For details about the shutdown command, refer to related switch documentation. |
|
— |
— |
ETH management network ports |
Used to manage switches. The two ports connect to the BMC/management network switch (CE5855). |
Figure 10-28 shows an example of planning ports on a 48-port CE5855 switch (GE switch, CE5800 for short), and Table 10-30 describes port usage.
Port Type |
Number |
Port Name |
Description |
---|---|---|---|
10/100/1000BASE-T Ethernet ports |
1 to 6 |
NIC1 ports |
The CE5800 switch connects to the NIC1 port of each node through 6 Ethernet ports. |
7 to 45 |
Reserved ports |
Reserved ports are the ports reserved for future use. To prevent adverse impact on other ports, you are advised to run the shutdown command to disable all reserved ports. For details about the shutdown command, refer to related switch documentation. |
|
46 to 48 |
Switch management ports |
Switch management ports connect to the ETH management network ports on the front of the two CE6800 switches. |
|
1 and 2 |
Upstream aggregation ports |
Each CE5800 switch connects to upstream aggregation switches through two Ethernet ports. |
- If the number of planned nodes does not exceed the specifications of a single cabinet, use a single cabinet. In this case, two 25GE switches are deployed in the same cabinet. Each node is connected to two 25GE switches in the base cabinet through optical fibers and optical modules.
- If the number of planned nodes exceeds the specifications of a single cabinet, use multiple cabinets. In this case, one 25GE switch is deployed in a base cabinet, and the other 25GE switch in an expansion cabinet. Each node is connected to the 25GE switch in the local cabinet and that in the other cabinet through optical fibers and optical modules.
Procedure
- Wear an ESD wrist strap or ESD gloves.
- Determine port numbers of the node and signal cable connection modes.
- Obtain the required types of cables and label them.
- Optional: Install a pluggable optical module.
- Wear an ESD wrist strap or ESD gloves to prevent damaging ESD-sensitive optical modules.
- Do not reversely insert optical modules. If an optical module cannot be inserted into an optical port, do not force it in. In this case, turn it over and try again.
- Do not remove dust-proof caps from optical connectors before connecting optical fibers to optical modules.
- Take out an optical module from its ESD bag and verify that the optical module is intact.
- Insert the optical module into an optical port on the subcard until it snaps into place and then raise the handle to lock it up, as shown in Figure 10-29.
When the locking reed of the optical module makes a "click" sound, the optical module is installed correctly.
- Connect cables according to the attached labels.
After connecting cables to the devices, reserve adequate cable slack for ease of operation on other FRUs.
- Lay out the cables along the mounting bars neatly, use cable ties to bind them, and trim off the excess of cable ties using diagonal pliers.
Example
In the example shown in Figure 10-30, three storage nodes are deployed.