S5720交换机接口丢包

发布时间:  2017-04-05 浏览次数:  536 下载次数:  0
问题描述

1.1 问题涉及的设备及版本

设备类型

版本

补丁

S5720EI

v200r007c00spc500

v200r007sph001.pat

1.2  网络拓朴

1.3 现网问题描述

某广电使用的是S5720交换机,在晚上7-9点之间存在网络丢包,接口下discard报文较多,影响用户的体验

处理过程
1)根据反馈的信息查看交换机部分端口出方向有discard记录,该discard计数只统计拥塞丢包计数,是拥塞丢包产生的历史记录。
GigabitEthernet0/0/7 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:22
Port Mode: COMMON FIBER, Transceiver: 1000_BASE_LX_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : NORMAL, Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 284269128 bits/sec, 25714 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-05 13:11:59
Output peak rate 998104712 bits/sec, Record time: 2016-01-15 19:15:13

Input:  84877 packets, 7129668 bytes
  Unicast:                          0,  Multicast:                           0
  Broadcast:                    84877,  Jumbo:                               0
  Discard:                          0,  Pause:                               0
  Frames:                           0

  Total Error:                      0
  CRC:                              0,  Giants:                              0
  Jabbers:                          0,  Fragments:                           0
  Runts:                            0,  DropEvents:                          0
  Alignments:                       0,  Symbols:                             0
  Ignoreds:                         0

Output:  28103409661 packets, 38834081334392 bytes
  Unicast:                28099766010,  Multicast:                      606540
  Broadcast:                  3037111,  Jumbo:                               0
  Discard:                      93171,  Pause:                               0

  Total Error:                      0
  Collisions:                       0,  ExcessiveCollisions:                 0
  Late Collisions:                  0,  Deferreds:                           0
  Buffers Purged:                   0  

    Input bandwidth utilization threshold : 90.00%
    Output bandwidth utilization threshold: 90.00%
    Input bandwidth utilization  :    0%
Output bandwidth utilization : 28.43%
….
GigabitEthernet0/0/25 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMBO AUTO
Current Work Mode: COPPER
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 297581464 bits/sec, 26918 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-06 02:01:09
Output peak rate 999570528 bits/sec, Record time: 2016-01-14 21:21:08

Input:  84862 packets, 7128408 bytes
  Unicast:                          0,  Multicast:                           0
  Broadcast:                    84862,  Jumbo:                               0
  Discard:                          0,  Pause:                               0
  Frames:                           0

  Total Error:                      0
  CRC:                              0,  Giants:                              0
  Jabbers:                          0,  Fragments:                           0
  Runts:                            0,  DropEvents:                          0
  Alignments:                       0,  Symbols:                             0
  Ignoreds:                         0

Output:  30425713358 packets, 42043478059501 bytes
  Unicast:                30422069545,  Multicast:                      606575
  Broadcast:                  3037238,  Jumbo:                               0
  Discard:                      89282,  Pause:                               0

  Total Error:                      0
  Collisions:                       0,  ExcessiveCollisions:                 0
  Late Collisions:                  0,  Deferreds:                           0
  Buffers Purged:                   0  

    Input bandwidth utilization threshold : 90.00%
    Output bandwidth utilization threshold: 90.00%
    Input bandwidth utilization  :    0%
    Output bandwidth utilization : 29.76%

2)查看设备上各端口的业务流量,UP的GE端口数16个,有5个端口出方向秒级peak速率超过900M(分别为973.79Mbits,998.1Mbits,932Mbits,999.57Mbits,915.7Mbits), 3个端口出方向秒级peak速率超过800M,1个端口出方向秒级peak速率超过700M,3个端口出方向秒级peak速率超过600M,4个端口出方向秒级peak速率超过500M华为UP的10G端口数2个,入方向秒级peak速率分别为5.4Gbits,4.9Gbit。可以看出设备上多个端口存在流量突发,由于突发流量超过设备的缓存能力,所以出现拥塞丢包。
GigabitEthernet0/0/5 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:22
Port Mode: COMMON FIBER, Transceiver: 1000_BASE_LX_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : NORMAL, Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 136098008 bits/sec, 12312 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-05 13:47:34
Output peak rate 694006480 bits/sec, Record time: 2016-01-11 17:17:02
GigabitEthernet0/0/6 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:22
Port Mode: COMMON FIBER, Transceiver: 1000_BASE_LX_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : NORMAL, Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 216588808 bits/sec, 19592 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-05 13:47:34
Output peak rate 973794360 bits/sec, Record time: 2016-01-12 22:06:11
GigabitEthernet0/0/7 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:22
Port Mode: COMMON FIBER, Transceiver: 1000_BASE_LX_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : NORMAL, Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 284269128 bits/sec, 25714 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-05 13:11:59
Output peak rate 998104712 bits/sec, Record time: 2016-01-15 19:15:13
GigabitEthernet0/0/8 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:22
Port Mode: COMMON FIBER, Transceiver: 1000_BASE_LX_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : NORMAL, Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 135798640 bits/sec, 12285 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-06 11:59:23
Output peak rate 817584648 bits/sec, Record time: 2016-01-05 22:08:39
GigabitEthernet0/0/9 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:22
Port Mode: COMMON FIBER, Transceiver: 1000_BASE_LX_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : NORMAL, Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 17277232 bits/sec, 1565 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-06 10:58:03
Output peak rate 713547800 bits/sec, Record time: 2016-01-05 09:24:50
GigabitEthernet0/0/10 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:22
Port Mode: COMMON FIBER, Transceiver: 1000_BASE_LX_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : NORMAL, Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 77147616 bits/sec, 6980 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-06 21:52:41
Output peak rate 658848968 bits/sec, Record time: 2016-01-05 09:24:59
GigabitEthernet0/0/19 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMMON COPPER, Transceiver: 1000_BASE_T_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 64204696 bits/sec, 5809 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-06 09:22:22
Output peak rate 552556768 bits/sec, Record time: 2016-01-11 17:19:45
GigabitEthernet0/0/20 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMMON COPPER, Transceiver: 1000_BASE_T_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 67032080 bits/sec, 6065 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-07 16:14:07
Output peak rate 566303328 bits/sec, Record time: 2016-01-11 17:17:02
GigabitEthernet0/0/21 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMMON COPPER, Transceiver: 1000_BASE_T_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 149382248 bits/sec, 13513 packets/sec
Input peak rate 2528 bits/sec, Record time: 2016-01-18 09:58:44
Output peak rate 932056616 bits/sec, Record time: 2016-01-08 21:56:58
GigabitEthernet0/0/22 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMMON COPPER, Transceiver: 1000_BASE_T_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 104462832 bits/sec, 9450 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-07 03:20:58
Output peak rate 577942696 bits/sec, Record time: 2016-01-11 17:17:01
GigabitEthernet0/0/23 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMMON COPPER, Transceiver: 1000_BASE_T_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 16840456 bits/sec, 1525 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-07 22:49:53
Output peak rate 524797648 bits/sec, Record time: 2016-01-11 17:17:01
GigabitEthernet0/0/24 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMMON COPPER, Transceiver: 1000_BASE_T_SFP
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 75580352 bits/sec, 6838 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-05 15:22:43
Output peak rate 621910832 bits/sec, Record time: 2016-01-11 17:17:02
GigabitEthernet0/0/25 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMBO AUTO
Current Work Mode: COPPER
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 297581464 bits/sec, 26918 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-06 02:01:09
Output peak rate 999570528 bits/sec, Record time: 2016-01-14 21:21:08
GigabitEthernet0/0/26 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMBO AUTO
Current Work Mode: COPPER
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 57637280 bits/sec, 5215 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-06 16:06:43
Output peak rate 887524232 bits/sec, Record time: 2016-01-07 21:06:36
GigabitEthernet0/0/27 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMBO AUTO
Current Work Mode: COPPER
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 155161680 bits/sec, 14036 packets/sec
Input peak rate 1344 bits/sec, Record time: 2016-01-05 18:04:45
Output peak rate 915729272 bits/sec, Record time: 2016-01-14 22:07:41
GigabitEthernet0/0/28 current state : UP
Line protocol current state : UP 
Description:
Switch Port, Link-type : access(configured), 
PVID :  120, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMBO AUTO
Current Work Mode: COPPER
Speed : 1000,   Loopback: NONE
Duplex: FULL,   Negotiation: ENABLE
Mdi   : AUTO,   Flow-control: DISABLE
Last 300 seconds input rate 40 bits/sec, 0 packets/sec
Last 300 seconds output rate 155836656 bits/sec, 14097 packets/sec
Input peak rate 23680 bits/sec, Record time: 2016-01-18 16:31:31
Output peak rate 856319280 bits/sec, Record time: 2016-01-05 09:24:48

UP的10G端口
XGigabitEthernet0/0/1 current state : UP
Line protocol current state : UP 
Description:TO_XIHU7604X_1/2/0/20_OTN
Switch Port, Link-type : trunk(configured), 
PVID :    1, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMMON FIBER, Transceiver: 10GBASE_LR_SFP
Speed : 10000,  Loopback: NONE
Duplex: FULL,   Negotiation: DISABLE
Mdi   : NORMAL, Flow-control: DISABLE
Last 300 seconds input rate 1023603464 bits/sec, 92334 packets/sec
Last 300 seconds output rate 20664 bits/sec, 7 packets/sec
Input peak rate 5426367120 bits/sec, Record time: 2016-01-08 21:56:58
Output peak rate 582688 bits/sec, Record time: 2016-01-20 14:13:07

XGigabitEthernet0/0/2 current state : UP
Line protocol current state : UP 
Description:TO_XIHU7604X_2/2/0/20_Fiber
Switch Port, Link-type : trunk(configured), 
PVID :    1, TPID : 8100(Hex), The Maximum Frame Length is 9216
IP Sending Frames' Format is PKTFMT_ETHNT_2, Hardware address is 4482-e5d2-b050
Current system time: 2016-01-20 14:13:23
Port Mode: COMMON FIBER, Transceiver: 10GBASE_LR_SFP
Speed : 10000,  Loopback: NONE
Duplex: FULL,   Negotiation: DISABLE
Mdi   : NORMAL, Flow-control: DISABLE
Last 300 seconds input rate 993144648 bits/sec, 89574 packets/sec
Last 300 seconds output rate 360 bits/sec, 0 packets/sec
Input peak rate 4929441984 bits/sec, Record time: 2016-01-17 17:39:08
Output peak rate 5400 bits/sec, Record time: 2016-01-05 09:24:19

综上,由于网络中业务量比较大,突发流量超过设备的缓存能力,所以出现拥塞丢包。
根因

经定位分析是由于网络中业务流量突发太大导致设备上端口出现了拥塞丢包。

解决方案

(1)配置突发增强模式缓解,如果突发量很大,不能最终解决,只能减轻少丢包

interface GigabitEthernet x/0/x

 qos burst-mode enhanced

(2)配置QOS保证高优先级业务不影响,只丢弃低优先级业务;

(3)与对端设备Eth-trunk互连(需要对端支持Eth-trunk),将两个端口加入Eth-trunk,把流量分担到两个端口上。

END