No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

FusionStorage V100R006C20 File Storage Service Software Installation Guide 05

Rate and give feedback:
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
Configure Subnet Management for Switches on the Back-End Storage Network

Configure Subnet Management for Switches on the Back-End Storage Network

This section describes how to configure subnet management for IB switches on a back-end storage network.

Context

To configure IB switches on the front-end service network (which can be performed after software installation), follow instructions in Follow-Up Procedure. Customers are responsible for enabling subnet management of IB switches on the front-end service network.

Procedure

  1. Log in to switch SX6018-1 through the console port separately.

    56 Gbit/s switches: Access http://www.mellanox.com/page/products_dyn?product_family=150&mtag=sx6015_sx6018, and see HW User Manual from Related Documents.

  2. Run the enable command to enter the Privilege mode.
  3. Run the configure terminal command to enter the configuration page.
  4. Run the show ib sm command to check whether the subnet management of IB switches is enabled.

    Perf-IB-02 [standalone: master] (config) # show ib sm
    enable
    • If the value is enable, go to 6.
    • If the value is disable, go to 5.

  5. Run the ib sm command to enable subnet management.

    #Enable subnet management.
    switch (config)# ib sm
    #Save configuration settings.
    switch (config)# write memory
    #Exit the configuration.
    switch (config)# exit

  6. Repeat 1 to 5 to complete the subnet management configuration of the SX6018-2 switch.

Follow-Up Procedure

After software deployment is complete, customers need to enable the subnet manager (opensm) of IB switches on the front-end service network. Then, clients can access the front-end service network.

NOTE:

You can perform the following operations on one client. To ensure system reliability, you can also perform the following operations on multiple clients one by one. After you perform configurations on multiple clients, if the primary subnet manager is faulty, other subnet managers can ensure smooth network communication.

  1. Run sminfo on the client to check whether opensm is enabled.

    If the output similar to the following is displayed, opensm is not enabled. Go to the next step.

    [root@IBClient-09 ~]# sminfo
    sminfo: iberror: failed: query

    If the output similar to the following is displayed, opensm is enabled. Go to 4.

    [root@IBClient-09 ~]# sminfo 
    sminfo: sm lid 42 sm guid 0x2c90300a5b1e2, activity count 104580 priority 0 state 3 SMINFO_MASTER
  2. Run ibstat and record Port GUID of the port whose status is LinkUp.

    [root@IBClient-09]# ibstat
    CA 'mlx4_0'
    	CA type: MT4099
    	Number of ports: 2
    	Firmware version: 2.30.8000
    	Hardware version: 0
    	Node GUID: 0x0002c90300a5b1e0
    	System image GUID: 0x0002c90300a5b1e3
    	Port 1:
    		State: Down
    		Physical state: Polling
    		Rate: 10
    		Base lid: 0
    		LMC: 0
    		SM lid: 0
    		Capability mask: 0x02514868
    		Port GUID: 0x0002c90300a5b1e1
    		Link layer: InfiniBand
    	Port 2:
    		State: Active
    		Physical state: LinkUp
    		Rate: 40
    		Base lid: 42
    		LMC: 0
    		SM lid: 42
    		Capability mask: 0x0251486a
    		Port GUID: 0x0002c90300a5b1e2
    		Link layer: InfiniBand
  3. Run opensm -B -g Port GUID to enable opensm. Then run ps x |grep opensm to confirm that opensm has been enabled.

    [root@IBClient-09]# opensm -B -g 0x0002c90300a5b1e2
    -------------------------------------------------
    OpenSM 3.3.13.MLNX_20130110_cd124d3
    Command Line Arguments:
     Daemon mode
     Guid <0x2c90300a5b1e2>
     Log File: /var/log/opensm.log
    -------------------------------------------------
    [root@IBClient-09]# ps x |grep opensm
    13145 ?        Sl     0:00 opensm -B -g 0x0002c90300a5b1e2
    13164 pts/1    S+     0:00 grep opensm
  4. Check whether IPoIB has been enabled for an IB port.

    In the following example, the client uses port ib0 to communicate with FusionStorage. Run the following command:

    [root@IBClient-09]# cat /sys/class/net/ib0/mode 
    Datagram

    If Datagram is displayed, IPoIB is not enabled. Go to the next step. If connected is displayed, IPoIB is enabled, and no further operation is required.

  5. Run the /etc/infiniband/openib.conf command to check whether the openib.conf file exists on the client.
    • If yes:
      1. Check whether the value of SET_IPOIB_CM is yes. If the value is not yes, change it to yes.
        # Enable IPoIB Connected Mode 
        SET_IPOIB_CM=yes
      2. Enable IPoIB of the IB port.

        In the following example, the client uses port ib0 to communicate with FusionStorage. Run the following command:

        [root@IBClient-09]# ifconfig ib0 down
        [root@IBClient-09]# echo connected > /sys/class/net/ib0/mode
        [root@IBClient-09]# cat /sys/class/net/ib0/mode
        connected
    • If no:
      1. Run the cd /etc/rc.d command to go to the directory.
      2. Run the vim ibmode.sh command to create a file and enter the following contents:
        #!/bin/bash
        echo connected >/sys/class/net/ib0/mode
      3. Run the chmod +x ibmode.sh command to add execution permissions to the ibmode.sh file.
      4. Run the vim rc.local command and add /etc/rc.d/ibmode.sh to the end of the file.
      5. Run the chmod +x rc.local command to add execution permissions to the rc.local file, and run the ll command to confirm the permissions of the rc.local file.
      6. Run the cat /sys/class/net/ib0/mode and ensure that the command output is connected.
Translation
Download
Updated: 2019-03-28

Document ID: EDOC1100016650

Views: 7741

Downloads: 8

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next