Recommended Troubleshooting Roadmap for APs' Failures to Go Online
Checking AP Information
CLI: display ap { all | ap-group ap-group }
Function: This command is used to query the IP address and status of an AP. Pay attention to whether the AP can obtain an IP address and whether the AP status is normal.
AP State |
Description |
Handling Suggestion |
|---|---|---|
commit-failed (cmtfa) |
WLAN service configurations fail to be delivered to an AP after the AP goes online on an AC. After the AP goes online on the AC, WLAN service configurations are performed for the AP. If the link between the AP and AC fails or the peer end has no response, the AC will fail to deliver WLAN service configurations to the AP. |
Check network connectivity between the AC and AP. For details, see The Network Between the AP and AC Fails. |
committing (cmt) |
WLAN service configurations are being delivered to an AP after the AP goes online on an AC. After the AP goes online on the AC, WLAN service configurations are being delivered to the AP. During this process, the AP is in committing state. |
This is a normal state, and no action is required. |
config (cfg) |
WLAN service configurations are being delivered to an AP when the AP is going online on an AC. After the AP establishes a link with the AC, WLAN service configurations are delivered to the AP. During this process, the AP is in config state. |
This is a normal state, and no action is required. |
config-failed (cfgfa) |
WLAN service configurations fail to be delivered to an AP when the AP is going online on an AC. After the AP establishes a link with the AC, WLAN service configurations are delivered to the AP. If the configuration delivery fails due to various reasons (such as link failure), the AP enters the config-failed state. |
If the AC fails to deliver the initial configuration, rectify the fault by referring to An AP Fails to Initialize the Configuration. |
download (dload) |
An AP is in upgrade state. When the AP is performing an upgrade, it enters the download state. |
When the AP upgrade is complete, check the AP state. If the upgrade fails, rectify the fault by referring to The AP Upgrade Fails. |
fault |
An AP fails to go online. |
Check the reason for the AP's failure to go online. For details, see Checking Reasons for APs' Failures to Go Online. |
idle |
It is the initialization state of an AP before it establishes a link with the AC for the first time. |
The possible causes and the corresponding handling methods for this state are as follows:
|
name-conflicted (namec) |
The name of an AP conflicts with that of an existing AP. The name of an AP conflicts with the name of another AP on the same AC. |
Run the ap-rename ap-id ap-id new-name ap-new-name command to change the AP name. |
normal (nor) |
An AP is working properly. The AP successfully goes online on the AC. |
This is a normal state, and no action is required. |
standby (stdby) |
An AP is in normal state on the standby AC. In the HSB, dual-link cold backup, or N+1 backup scenario, if the link between the active and standby ACs is established properly, the AP is in standby state on the standby AC and in normal state on the active AC. |
This is a normal state, and no action is required. |
ver-mismatch (vmiss) |
The versions of the AP and AC do not match. |
|
countryCode-mismatch (cmiss) |
The country codes of the AP and AC do not match. The AP does not support the country code configured on the AC. |
The AP does not support the country code. Upgrade the AP or modify the country code configuration on the AC. |
type-mismatch (tmiss) |
The AP type does not match that configured on the AC. The AP type configured on the AC does not match the actual AP type. |
Change the AP type configured on the AC. |
unauth |
An AP fails to be authenticated. |
Run the display ap unauthorized record command to query APs that fail to be authenticated. Run the ap-confirm command to confirm these APs and allow them to go online. |
Checking Reasons for APs' Failures to Go Online
CLI: display ap online-fail record
Function: This command is used to query the reason for AP's failures to go online so that you can take measures accordingly.
Table 9-2 lists some reasons for AP's failures to go online.
Reason Why an AP Fails to Go Online |
Handling Suggestion |
|---|---|
Insufficient license resources. |
See The Number of APs Connected to the AC Exceeds the Maximum. |
The AP is not in the SN whitelist. |
Run the ap whitelist sn ap-sn1 [ to ap-sn2 ] command to add the AP to the SN whitelist or run the ap-confirm command to enable the AP to pass authentication. |
The AP is not in the MAC whitelist. |
Run the ap whitelist mac ap-mac1 [ to ap-mac2 ] command to add the AP to the MAC whitelist or run the ap-confirm command to enable the AP to pass authentication. |
The AP is added to the AP blacklist. |
See An AP Is Blacklisted. |
The MAC address and SN of the AP do not match. |
See The MAC Address and SN of an AP Specified on the AC Are Inconsistent with Those of the AP. |
DTLS negotiation for CAPWAP tunnel setup fails. |
|
DTLS negotiation failed, because of negotiation timeout or inconsistent PSKs on two ends. |
|
CAPWAP tunnel negotiation fails. |
For details, see The Network Between the AP and AC Fails. |
APs cannot go online during data backup. |
Wait until the backup is complete. |
The upgrade fails. |
For details, see The AP Upgrade Fails. |
The CAPWAP tunnel fails to be established. |
For details, see The Network Between the AP and AC Fails. |
The configuration fails to be delivered. |
The AC will attempt to deliver the configurations again. If the failure persists, rectify the fault by referring to The Network Between the AP and AC Fails. |
The versions of the AP and AC do not match. |
|
The AC does not support the AP type. |
Replace the AP with one supported by the AC or change the AC version to one that supports the AP. |
Unsupported AP type, AC version may need to be upgraded. |
|
The AP name conflicts. |
Run the ap-rename command to change the AP name. |
The number of central APs reaches the upper limit. |
See The Number of APs Connected to the AC Exceeds the Maximum. |
The number of common APs reaches the upper limit. |
See The Number of APs Connected to the AC Exceeds the Maximum. |
The CAPWAP sensitive-info PSK is different on the two ends of the CAPWAP tunnel. |
|
The CAPWAP integrity-check PSK is different on the two ends of the CAPWAP tunnel. |
|
The AC license is not active. |
Activate the AC license. |
Too many APs go online concurrently, leading to a failure to create sufficient DBSS interfaces. |
No action is required. The AP will attempt to go online again. |
The country codes of the AP and AC are inconsistent, and the country code of the AP is locked. |
The country code of some AP models cannot be modified. For example, an AP model with the suffix -US is used only in the United States, and its country code is fixed as US. Configure the country code on the AC to be the same as that on the AP. |
Reset for the AC mode switching. |
No action is required. |
Full-Process Tracing
CLI: trace enable brief and trace object mac-address ap-mac-address
Function: These commands are used to diagnose the service process of the AP. Pay attention to whether there are exceptions in the printed information.
The process for an AP to go online involves various phases, including IP address allocation, discovery, join, configuration delivery, and configuration update. If the AP fails to go online, you can locate the fault through full-process tracing. By comparing the printed information with the normal process, you can determine the phase when the fault occurs and then troubleshoot the fault accordingly.
[AC] trace enable brief [AC] trace object mac-address acf9-703e-90a0 [BTRACE][2020/03/12 15:36:01][768][DHCPPRO][acf9-703e-90a0]:Receive DHCP DISCOVER message.orgif:GE0/0/3 srcif:Vlanif400 L3if:Vlanif400 DstIf:GE0/0/3 srcmac:acf9-703e-90a0 dstmac:ffff-ffff-ffff vsi:- vlan:400/0 srcip:0.0.0.0 dstip:255.255.255.255 VPN:- src-port:68 dst-port:67 msgtype:BOOT-REQUEST dhcp msgtype:DHCP DISCOVER bflag:uc chaddr:acf9-703e-90a0 ciaddr:0.0.0.0 reqip:0.0.0.0 giaddr:0.0.0.0 serverid:0.0.0.0 yiaddr:0.0.0.0 xid:0x166d4ae3 [BTRACE][2020/03/12 15:36:01][768][DHCPS][acf9-703e-90a0]:DHCP Server is enable.(interface:Vlanif400). [BTRACE][2020/03/12 15:36:01][768][DHCPS][acf9-703e-90a0]:Gateway=192.168.1.1, mask=255.255.255.0. [BTRACE][2020/03/12 15:36:01][768][DHCPS][acf9-703e-90a0]:Get pool Vlanif400 by gateway 192.168.1.1 and vrf 0. [BTRACE][2020/03/12 15:36:01][768][DHCPS][acf9-703e-90a0]:New session hash node(mac:acf9-703e-90a0 Xid=376261347) [BTRACE][2020/03/12 15:36:01][768][DHCPS][acf9-703e-90a0]:Discover session create(Xid=376261347 mac:acf9-703e-90a0) [BTRACE][2020/03/12 15:36:01][768][DHCPS][acf9-703e-90a0]:Get pool Vlanif400 by gateway 192.168.1.1 and vrf 0. [BTRACE][2020/03/12 15:36:01][768][DHCPS][acf9-703e-90a0]:Proc Request IP ACK.(MsgType = 773, MsgType = 1, usPool = 0, ERRcode = 10, IPAlloc = 192.168.1.176, SessionStatus = 0) [BTRACE][2020/03/12 15:36:01][768][DHCPS][acf9-703e-90a0]:Send DHCP OFFER packet.(Chaddr=acf9-703e-90a0, Offer IP=192.168.1.176). [BTRACE][2020/03/12 15:36:01][768][DHCPPRO][acf9-703e-90a0]:Receive DHCP OFFER message.orgif: srcif: L3if: DstIf:GE0/0/3 srcmac:084f-0a6d-0df2 dstmac:acf9-703e-90a0 vsi:- vlan:400/0 srcip:192.168.1.1 dstip:192.168.1.176 VPN:- src-port:67 dst-port:68 msgtype:BOOT-REPLY dhcp msgtype:DHCP OFFER bflag:uc chaddr:acf9-703e-90a0 ciaddr:0.0.0.0 reqip:0.0.0.0 giaddr:0.0.0.0 serverid:192.168.1.1 yiaddr:192.168.1.176 xid:0x166d4ae3 [BTRACE][2020/03/12 15:36:01][768][DHCPPRO][acf9-703e-90a0]:Receive DHCP REQUEST message.orgif:GE0/0/3 srcif:Vlanif400 L3if:Vlanif400 DstIf:GE0/0/3 srcmac:acf9-703e-90a0 dstmac:ffff-ffff-ffff vsi:- vlan:400/0 srcip:0.0.0.0 dstip:255.255.255.255 VPN:- src-port:68 dst-port:67 msgtype:BOOT-REQUEST dhcp msgtype:DHCP REQUEST bflag:uc chaddr:acf9-703e-90a0 ciaddr:0.0.0.0 reqip:192.168.1.176 giaddr:0.0.0.0 [BTRACE][2020/03/12 15:36:01][768][DHCPS][acf9-703e-90a0]:Send DHCP ACK packet.(Chaddr=acf9-703e-90a0, Offer IP=192.168.1.176). [BTRACE][2020/03/12 15:36:01][768][DHCPPRO][acf9-703e-90a0]:Receive DHCP ACK message.orgif: srcif: L3if: DstIf:GE0/0/3 srcmac:084f-0a6d-0df2 dstmac:acf9-703e-90a0 vsi:- vlan:400/0 srcip:192.168.1.1 dstip:192.168.1.176 VPN:- src-port:67 dst-port:68 msgtype:BOOT-REPLY dhcp msgtype:DHCP ACK bflag:uc chaddr:acf9-703e-90a0 ciaddr:0.0.0.0 reqip:0.0.0.0 giaddr:0.0.0.0 serverid:192.168.1.1 yiaddr:192.168.1.176 xid:0x166d4ae3 [BTRACE][2020/03/12 15:36:12][256][WLAN_AC][acf9-703e-90a0]:[Process:1][CAPWAP] Process discovery request message. [BTRACE][2020/03/12 15:36:12][256][WLAN_AC][acf9-703e-90a0]:[Process:1][CAPWAP] Send discovery response successfully. MAC: acf9-703e-90a0 [BTRACE][2020/03/12 15:36:17][512][WLAN_AC][acf9-703e-90a0]:[Process:2][CAPWAP] Create Link Success, Link[3] Sip[192.168.1.176] SrcUdpPort[58138] Vpn[-1]. [BTRACE][2020/03/12 15:36:17][512][WLAN_AC][acf9-703e-90a0]:[Process:2][CAPWAP] Process join request message. MAC: acf9-703e-90a0 [BTRACE][2020/03/12 15:36:17][512][WLAN_AC][acf9-703e-90a0]:[Process:2][CAPWAP] Send join response successfully. MAC: acf9-703e-90a0 [BTRACE][2020/03/12 15:36:17][512][WLAN_AC][acf9-703e-90a0]:[Process:2][CAPWAP] Process config status request message. MAC: acf9-703e-90a0 [BTRACE][2020/03/12 15:36:17][512][WLAN_AC][acf9-703e-90a0]:[Process:2][CAPWAP] Send configuation state response successfully. MAC: acf9-703e-90a0 [BTRACE][2020/03/12 15:36:17][512][WLAN_AC][acf9-703e-90a0]:[Process:2][CAPWAP] Process change state event request message and status id CONFIGURE. MAC: acf9-703e-90a0 [BTRACE][2020/03/12 15:36:17][512][WLAN_AC][acf9-703e-90a0]:[Process:2][CAPWAP] Send change state event response successfully. MAC: acf9-703e-90a0 [BTRACE][2020/03/12 15:36:17][512][WLAN_AC][acf9-703e-90a0]:[Process:2][CAPWAP] FSM DataLinkEnterinRun, Dlink[3] CLink[3] Mac[acf9-703e-90a0] DevId[1] [BTRACE][2020/03/12 15:36:17][512][WLAN_AC][acf9-703e-90a0]:[Process:2][CAPWAP] CtrlLink[3] enterin run. MAC: acf9-703e-90a0 [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WDEV] AP:1 CONFIG phase-0 Func-0xacb8accc TimeOut-300000 IsDAp-0 Ret-0x0 IsNeedCfg-0 [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WDEV] AP:1 CONFIG notify next phase result-0x0 [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WDEV] AP:1 CONFIG phase-1 Func-0xabf7f150 TimeOut-300000 IsDAp-0 Ret-0x0 IsNeedCfg-1 [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WDEV] AP:1 CONFIG phase-2 Func-0xac0d570c TimeOut-300000 IsDAp-0 Ret-0x0 IsNeedCfg-1 [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WDEV] AP:1 CONFIG pass phase3 Ret 0x0 [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WDEV] AP:1 CONFIG phase-4 Func-0xabc66570 TimeOut-300000 IsDAp-0 Ret-0x0 IsNeedCfg-1 [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] receive commit start response, begin to config ap tree. [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] SET AP object 0x0001ffff ac Ret 0x0 CfgFlag 1 [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] SET Radio object 0x000100ff ac Ret 0x0 CfgFlag 1 [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] SET Radio object 0x000101ff ac Ret 0x0 CfgFlag 1 [BTRACE][2020/03/12 15:36:18][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] SET AP object 0x0001ffff ap ret ok ProcRet 0 [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] SET Radio object 0x000100ff ap ret ok ProcRet 0 [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] SET Radio object 0x000101ff ap ret ok ProcRet 0 [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] WMP cfg success over [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] pdt-cfg-phase-0 Func-0xabc5c168 Ret 0x0 TimeOut 60000 [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP:1 cmt result 0 [Cur 0 - Notify 0] [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] pdt phase-0 notify cmt success [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] pdt-cfg-phase-1 Func-0xabc5c1b0 Ret 0x0 TimeOut 30000 [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP:1 cmt result 0 [Cur 0 - Notify 0] [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] pdt phase-1 notify cmt success [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] pdt commit over [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[Process:2]RTRecePktProc Link[3]Type[0]Msg[514828]Que[1]SN[50]Len[4]Ret[0]Mac[acf9-703e-90a0] [BTRACE][2020/03/12 15:36:19][512][WLAN_AC][acf9-703e-90a0]:[WCFG] AP[1] receive commit-end response
