VLAN Wireless Network stops respond to broadcast requests after some time

This thread has been locked for further replies. You can start a new thread to share your ideas or ask questions.
12

VLAN Wireless Network stops respond to broadcast requests after some time

This thread has been locked for further replies. You can start a new thread to share your ideas or ask questions.
VLAN Wireless Network stops respond to broadcast requests after some time
VLAN Wireless Network stops respond to broadcast requests after some time
2020-12-03 13:17:16 - last edited 2020-12-04 11:36:47
Model: EAP225  
Hardware Version: V3
Firmware Version: 2.20.1 Build 20200630 Rel. 41064

Greetings 👋

 

Setup:

 

Router: Zyxel Keenetic

Switch: Umanaged TP-Link TL-SG1016D

Controller: Self-hosted Omada Controller v4.2.4

AP: TP-Link EAP 225 v3

 

2 subnets on Router: 

 

- Home Network (default, 192.168.1.0/26, VLAN 1, VLAN Acess 4 Port)

- IOT Network (192.168.2.0/25, VLAN 10, VLAN Trunk 4 Port)

 

2 wireless networks on Omada Controller:

 

- Home Network. 2.4 GHz + 5 GHz, WPA2/3, Rate Control, default VLAN (no configured VLAN).

- IOT Network. No SSID broadcast, 2.4 GHz, WPA2, No Rate Control, VLAN 10)

 

Devices connected to IOT Network via AP(s):

 

- Multiple ESP8266

- Smart Bulbs

- Multiple Air Conditioners (AC)

 

Issue

 

After some time (4-30 hours), all devices connected to WiFi IOT network stop respond on brodcast requests. Confirmed via running wireshark on router. 

 

- ARP. No response.

- mDNS. No response.

- ICMP (ping). Response if source has mac address in ARP table.

 

Broadcast packets between devices inside IOT subnet connected via switch go without any problems.

 

Did try:

 

- Source Device <-> AP Wifi "IOT Network"

- Source Device <-> Switch

- Source Device <-> AP WiFi "Home Network" (devices don't respond to router ARP packets as well)

 

Example (Wireshark dump):

 

on 192.168.2.27 running `ping 192.168.2.10`

 

 

Curious thing is router (192.168.2.1) did respond on ARP from AC (192.168.2.10).

 

What doesn't help:

 

- Reboot switch.

- Reboot router.

- Connect AP directly to router.

 

What helps for short time in some cases:

 

- Reconnect unavailable devices.
- Reboot unavailable devices.

 

What helps:

 

- Reboot AP(s).

 

 

Topology

 

 

 

Any ideas?

  0      
  0      
#1
Options
12 Reply
Re:VLAN Wireless Network stops respond to broadcast requests after some time
2020-12-04 11:21:58

Dear @khmm12,

 

After some time (4-30 hours), all devices connected to WiFi IOT network stop respond on brodcast requests. Confirmed via running wireshark on router. 

 

 

Did you configure any advanced features such as Fast Roaming, Airtime Fairness, Band Steering on the Omada Controller?

 

If yes, please try to disable the advanced feature for checking.

>> Omada EAP Firmware Trial Available Here << *Try filtering posts on each forum by Label of [Early Access]*
  0  
  0  
#2
Options
Re:VLAN Wireless Network stops respond to broadcast requests after some time
2020-12-04 11:43:28

@Fae 

 

Did you configure any advanced features such as Fast Roaming, Airtime Fairness, Band Steering on the Omada Controller?

 

If yes, please try to disable the advanced feature for checking.

 

Yes, all of them were enabled.

 

I also disabled WMM, U-APSD; and even Rate Limit Control on Home Network. 

 

Let's see how will go. I completely have no idea what can cause the behaviour.

  0  
  0  
#3
Options
Re:VLAN Wireless Network stops respond to broadcast requests after some time
2020-12-16 08:31:59 - last edited 2020-12-17 10:36:04

@Fae ðŸ‘‹

 

The WiFi network "fell apart" 7.5 hours after turning on back "Rate Control" for "Home Network". 

 

5 days since the last configuration changes. At 11:31 I enabled "Rate Control". At 18:59 the monitoring notified me about an incident.

 

The same time I noticed dropped packets:

 

I see ARP packets from wired connected devices, but nothing from wireless connected.
 

 

Backlog:

 

- 04.12. Turn off all advanced features.

- 06.12. No issues yet. Turn on: WMM and U-APSD.

- 08.12. No issues yet. AP upgraded to v5.0.0. Turn on: Band Steering.

- 10.12. No issues yet. Turn on: Airtime Fairness. 

- 15.12 11:31. No issues so far. Turn on: Rate Control for "Home Network".

- 15.12 18:59. IOT Network degraded.

- 15.12 19:23. Turn off: Rate Control

- 15.12 19:27. It didn't help. Reboot the AP.

- 15.12 19:29. IOT Networks works.

- 16.12 11:29. No issues yet.

 

  0  
  0  
#4
Options
Re:VLAN Wireless Network stops respond to broadcast requests after some time
2020-12-18 10:33:46

Dear @khmm12,

 

Backlog: 

- 04.12. Turn off all advanced features.

- 06.12. No issues yet. Turn on: WMM and U-APSD.

- 08.12. No issues yet. AP upgraded to v5.0.0. Turn on: Band Steering.

- 10.12. No issues yet. Turn on: Airtime Fairness. 

- 15.12 11:31. No issues so far. Turn on: Rate Control for "Home Network".

- 15.12 18:59. IOT Network degraded.

- 15.12 19:23. Turn off: Rate Control

- 15.12 19:27. It didn't help. Reboot the AP.

- 15.12 19:29. IOT Networks works.

- 16.12 11:29. No issues yet.

 

May I know the purpose of configuring the Rate Control and how you configured it?

 

Did you upgrade the Omada Controller to 4.2.8?

>> Omada EAP Firmware Trial Available Here << *Try filtering posts on each forum by Label of [Early Access]*
  0  
  0  
#5
Options
Re:VLAN Wireless Network stops respond to broadcast requests after some time
2020-12-18 13:08:50 - last edited 2020-12-18 13:12:07

@Fae 

 

May I know the purpose of configuring the Rate Control and how you configured it?

 

To avoid slow clients on Home Network 5 GHz. But yes, in my case it's definitely overengineering.

 

But I still have no idea, why rate limit on a wireless network for a different frequency crashes another one.

 

 

 

Did you upgrade the Omada Controller to 4.2.8?

 

Yes, on 2020-12-14T18:28:12+03:00

 

BTW without rate control no incidents so far ðŸ™‚

  0  
  0  
#6
Options
Re:VLAN Wireless Network stops respond to broadcast requests after some time
2020-12-21 09:10:33 - last edited 2020-12-21 09:20:24

21.12.2020 10:29 (Europe/Moscow). The network degraded again 😕.

 

On 19.12.2020 I added one more AP (EAP-235 Wall) and enabled Fast Roaming + Force-Disassociation. 

 


  0  
  0  
#7
Options
Re:VLAN Wireless Network stops respond to broadcast requests after some time
2020-12-24 02:41:33

Yesterday it did happen again. Fast roaming was disabled. It becomes more weird.

  0  
  0  
#8
Options
Re:VLAN Wireless Network stops respond to broadcast requests after some time
2020-12-24 06:07:45

Dear @khmm12,

 

Yesterday it did happen again. Fast roaming was disabled. It becomes more weird.

 

Was the Rate Control or Airtime Fairness enabled before it happened again yesterday?

 

Please ensure the EAP225 is running with the latest firmware published on 9 Dec.

And you may just disable all advanced features and keep it for checking.

>> Omada EAP Firmware Trial Available Here << *Try filtering posts on each forum by Label of [Early Access]*
  0  
  0  
#9
Options
Re:VLAN Wireless Network stops respond to broadcast requests after some time
2021-02-15 16:44:29

@khmm12 

 

Hi,

 

I've the same setup as you but only with 1 one AP and today i experienced the same behavior, for no apparent reason i lost the ability to print from wifi, after same debug i noticed that the clients connected to the same SSID weren't able to discover the printer (No ARP response, mDNS from the printer), but with an PC on the lan i was able to ping the printer, even after flushing the arp table from the pc was able to discover the printer, but despite having arp responses i wasn't getting mDNS traffic from the printer, rebooted the printer same behavior, after restarting the AP arp/mDNS started to work for the printer for all the clients(WLAN/LAN).

 

I'm using the latest AP firmware (5.0.0) and WLC version 4.2.11

 

 

  1  
  1  
#10
Options
Re:VLAN Wireless Network stops respond to broadcast requests after some time
2021-02-16 07:48:54 - last edited 2021-02-16 07:51:44

@Fae 

 

Fae wrote

Dear @khmm12,

 

Yesterday it did happen again. Fast roaming was disabled. It becomes more weird.

 

Was the Rate Control or Airtime Fairness enabled before it happened again yesterday?

 

Please ensure the EAP225 is running with the latest firmware published on 9 Dec.

And you may just disable all advanced features and keep it for checking.

 

Yes, seems it was related to Airtime Fairness. Without AF it works more stable for 1 month. Same thing in the statistics, I don't see the dropped packets peak anymore.

 

It looks like a FW/HW bug 

  0  
  0  
#11
Options