Configuring Interoperation Between CE Series Switches and Servers Using Mellanox ConnectX Ethernet Adapter Network Adapters (IEEE 802.3ad Mode)
Applicable Products and Versions
This example applies to CE series switches of V100R001C00SPC200 or later versions.
Networking Requirements
As shown in Figure 2-6, a server uses a network adapter group consisting of two Mellanox ConnectX Ethernet Adapter network adapters that connect to different interfaces of SwitchA. It is required that link aggregation be configured on links between the CE series switch and server to improve the interface bandwidth and the links load balance service traffic.
Configuration Roadmap
- Create an Eth-Trunk on the CE series switch and configure the Eth-Trunk to work in static LACP mode to improve the interface bandwidth and reliability.
- Configure the network adapter group to work in dynamic link aggregation (IEEE 802.3ad) mode to improve the link reliability and interface bandwidth and implement link load balancing.
The load balancing mode applies to scenarios in which a server connects to a switch or a stack system.
Procedure
- Configure an Eth-Trunk and a VLAN on the CE series switch.
<HUAWEI> system-view [~HUAWEI] sysname SwitchA [*HUAWEI] commit [~SwitchA] vlan batch 2 //Create VLAN 2. [*SwitchA] interface eth-trunk 1 [*SwitchA-Eth-Trunk1] mode lacp-static //Configure the Eth-Trunk to work in static LACP mode. [*SwitchA-Eth-Trunk1] trunkport 10ge 1/0/1 to 1/0/2 //Add the two interfaces connected to the server to the Eth-Trunk. [*SwitchA-Eth-Trunk1] port default vlan 2 [*SwitchA-Eth-Trunk1] commit
When a 40GE interface on the CE-L36LQ-EG card is connected to an interface on a Mellanox network adapter using a passive QSFP+ high-speed cable, the two interfaces may fail to go Up due to different 40GBASE-CR4 negotiation mechanisms used on the interfaces. In this case, disable the auto-negotiation function on the 40GE interface so that the two interfaces can go Up and communicate properly.
- Configure a network adapter group on the server.
- Choose Start > Control Panel > Network and Sharing Center. Click Change adapter settings. The Network Connections page is displayed.
- Right-click a network adapter to be added to the network adapter group, and click Properties. The Mellanox ConnectX-3 Ethernet Adapter Properties window is displayed.
- Click the LBFO tab page and click Create in the lower left corner to create a network adapter group.
- Enter the network adapter group name, for example, TX, in the Bundle Name text box. In the Bundle Type drop-down list box, choose Dynamic Link Aggregation (802.3ad), select network adapters to be added to the network adapter group, and click Commit to complete the network adapter group configuration.
- Choose Start > Control Panel > Network and Sharing Center. Click Change adapter settings. The Network Connections page is displayed. Right-click the created network adapter group, and click Properties.
- Click the Network tab page and double-click Internet Protocol Version 4 (TCP/IPv4) to configure the IP address of the network adapter group.
- In the Internet Protocol Version 4 (TCP/IPv4) Properties window, select an IP address obtaining mode, and click OK.
Checking the Configuration
- Run the display eth-trunk [ trunk-id ] command in any view to check the Eth-Trunk status. Check whether the Eth-Trunk status is normal based on key information in Table 2-12.
<HUAWEI> display eth-trunk 1 Eth-Trunk1's state information is: Local: LAG ID: 1 Working Mode: Dynamic Preempt Delay: Disabled Hash Arithmetic: profile default System Priority: 32768 System ID: 04f9-388d-e681 Least Active-linknumber: 1 Max Active-linknumber: 8 Operating Status: up Number Of Up Ports In Trunk: 2 Timeout Period: Slow -------------------------------------------------------------------------------- ActorPortName Status PortType PortPri PortNo PortKey PortState Weight 10GE1/0/1 Selected 10GE 32768 1 321 10100010 1 10GE1/0/2 Selected 10GE 32768 2 321 10100010 1
Table 2-12 Eth-Trunk statusCheck Item
Normal State
Working Mode
Dynamic.
Operating Status
up: indicates that the Eth-Trunk is Up.
Number Of Up Ports In Trunk
Number of Up member interfaces in the Eth-Trunk. If the value is the same as the number of member interfaces, the Eth-Trunk is normal.
Status
Selected: indicates that the member interface is selected as an active interface.
Weight
Weight of the member interface. If all member interfaces have the same weight, the Eth-Trunk is normal.
- On the CE switch, ping the IP address of the server in the user view. The ping succeeds.
Check properties of the created network adapter group TX. On the Network Connections page, right-click the created network adapter group, and click Properties. In the window that is displayed, click Config, and click the Settings tab page. Check the network adapter group status based on information in Table 2-13.