Boot loop: when QoS enabled (attempting to limit VAP)?

Post new topic   Reply to topic    DD-WRT Forum Index -> Broadcom SoC based Hardware
Goto page 1, 2, 3  Next
Author Message
ZenInTexas
DD-WRT Novice


Joined: 11 Aug 2020
Posts: 47

PostPosted: Wed Jul 13, 2022 21:09    Post subject: Boot loop: when QoS enabled (attempting to limit VAP)? Reply with quote
Router/Version: Linksys EA6700/V1(CFE with 32k Fix)
File/Kernel: cli wget & write linksys-ea6700-webflash.bin
Previous/Reset: r49418/Yes
Mode/Status: WAN Disabled, WAP, router, wl0 enabled, VAP wl0.1(assigned to bridge br1), br1 unbridged & isolated, wl1 disabled, dnsmasq (VAP DHCP & DNS), firewall disabled in GUI, iptable commands for br1 NAT, QoS to limit br1
Issues/Errors: Yes, boot loop

I have hesitated to report an issue. I had to take some time to try and isolate the issue rather than just say it's a kernel-panic loop. After upgrading and configuring my setup, the box enters a boot loop. I recover by resetting.

I have narrowed it down to the QoS settings: QoS setup for the LAN & WLAN side(since WAN is disabled). The only item is the interface VAP bridge br1 (which is assigned wl0.1). I set WAN throttling levels at 0(since WAN is disabled), I set the QoS LAN values to 500k. Clicking save & apply is fine, it's rebooting after the QoS changes that the symptom appears. Sometimes I get the CFE Mini browser page, sometimes I get nothing, I have been pinging it and watching TTL=100 for a few seconds then unreachable, then TTL=64 for a few seconds, before the router reboots. If I am fast enough I can load the DD-WRT index page before it reboots. It never recovers from this loop, I have to reset and start the config from scratch (or from the previous saved config before the QoS change).

FYI, I stated this investigation because while upgrading my spare EA6400 with r49418, I encountered a boot loop. The previous version installed on the EA6400 & EA6700 was from early 2021. Such a big jump had me at a disadvantage as far as being able to specify what exactly the issue was. I was not sure if it was hardware related, my poor DD-WRT config skills, or firmware. I was only able to confirm and narrow down the issue with the EA6700 a few hours ago. I would love to supply logs, but I am not setup right now with serial port connection.

If someone could guide me on how to save syslogs to external storage when a boot loop occurs, I would appreciate it.

I hope this helps - I assume you will need more information, please ask and I will try to provide it.

On @@the-joker's advice, I have started a new thread for this issue.

I assume this issue may have been before r49418, but I can't specify a tighter range. I upgraded from an early 2021 version.

I posted the original info to the wrong thread.https://forum.dd-wrt.com/phpBB2/viewtopic.php?t=329060&sid=1ae472d051286734be6754a314415fe3 I should have posted to forum thread: new build r49467



EA6700 r49467.png
 Description:
Northstar EA6700 running r49467 without QoS enabled
 Filesize:  108.96 KB
 Viewed:  2413 Time(s)

EA6700 r49467.png



July 13 2022 syslog (QoS not enabled).txt
 Description:
syslog of stable working r49467, but QoS not enabled

Download
 Filename:  July 13 2022 syslog (QoS not enabled).txt
 Filesize:  18.84 KB
 Downloaded:  52 Time(s)



Last edited by ZenInTexas on Fri Jul 22, 2022 18:56; edited 11 times in total
Sponsor
ZenInTexas
DD-WRT Novice


Joined: 11 Aug 2020
Posts: 47

PostPosted: Wed Jul 13, 2022 21:14    Post subject: Config Reply with quote
Config:

I have gone back and forth between using VAP wl0.1 on it's own bridge and unbridged. So, wl0.1 with or without br1 does not seem to make a difference as far as the boot loop goes.

Also, I have enabled and disabled wl1 and that does not make a difference as far as the boot loop goes. Currently wl1 is disabled to make troubleshooting simpler.

DD-WRT GUI config for "WAN" is disabled, but the actual WAN port is assigned the switch's vlan2 and by default assigned to br0.



WAN port on vlan2.png
 Description:
 Filesize:  24.92 KB
 Viewed:  2412 Time(s)

WAN port on vlan2.png



VAP br1 assiged wl0.1.png
 Description:
 Filesize:  36.05 KB
 Viewed:  2412 Time(s)

VAP br1 assiged wl0.1.png



WAN Disabled.png
 Description:
 Filesize:  6.06 KB
 Viewed:  2412 Time(s)

WAN Disabled.png




Last edited by ZenInTexas on Thu Jul 14, 2022 0:31; edited 1 time in total
ZenInTexas
DD-WRT Novice


Joined: 11 Aug 2020
Posts: 47

PostPosted: Wed Jul 13, 2022 21:23    Post subject: Reply with quote
QoS is disabled currently and r49467 is stable in this configuration. If I enable QoS, click save and then click apply, the box seems fine.

The problem is after I enable QoS on VAP br1(or wl0.1 if unbridged), if I ever reboot, the box enters a boot loop. And the only way to recover is to reset nvram (somehow, either thru the CFE Mini or reset button, either way allows me to start configuring dd-wrt from the start again)



QoS Enabled.png
 Description:
QoS enabled, not stable on reboot
 Filesize:  48.29 KB
 Viewed:  2410 Time(s)

QoS Enabled.png



QoS disabled.png
 Description:
Stable on reboot
 Filesize:  6.87 KB
 Viewed:  2410 Time(s)

QoS disabled.png




Last edited by ZenInTexas on Thu Jul 14, 2022 0:32; edited 1 time in total
ZenInTexas
DD-WRT Novice


Joined: 11 Aug 2020
Posts: 47

PostPosted: Wed Jul 13, 2022 21:42    Post subject: Reply with quote
Since this is an issue dealing with a boot loop on a Linksys/Cisco Northstar, I know the question about the CFE nvram 32k issue may be asked.

Hopefully the attached screenshots answer that question.



nvram size without QoS enabled (far above 32k).png
 Description:
r49467 is stable on boot with nvram above 32k, but without QoS enabled.
 Filesize:  48.39 KB
 Viewed:  2407 Time(s)

nvram size without QoS enabled (far above 32k).png



nvram search for triple 00.png
 Description:
 Filesize:  48.25 KB
 Viewed:  2407 Time(s)

nvram search for triple 00.png


ZenInTexas
DD-WRT Novice


Joined: 11 Aug 2020
Posts: 47

PostPosted: Wed Jul 13, 2022 22:01    Post subject: Reply with quote
I know there has been recent changes to 5GHz and some concern about that. To simplify debugging, I have disabled wl1(aka 5GHz).

I have read that about the recent concerns regarding CTF. To simplify debugging, I have disabled the engines. However, I am not sure why it seems like they are still running. See syslog(attached to the 1st post), which shows related messages.

Also, syslog(attached to the 1st post) shows that the NAS service is running, but from the GUI I think I have disabled it.



GUI shows nas should be disabled (I think).png
 Description:
 Filesize:  33.55 KB
 Viewed:  2406 Time(s)

GUI shows nas should be disabled (I think).png



FYI, Engine should be disabled (but syslog shows CTL messages).png
 Description:
 Filesize:  12.98 KB
 Viewed:  2406 Time(s)

FYI, Engine should be disabled (but syslog shows CTL messages).png



wl1 aka 5Ghz disabled.png
 Description:
 Filesize:  44.34 KB
 Viewed:  2406 Time(s)

wl1 aka 5Ghz disabled.png


ZenInTexas
DD-WRT Novice


Joined: 11 Aug 2020
Posts: 47

PostPosted: Wed Jul 13, 2022 22:49    Post subject: Reply with quote
stp sfe ctf disabled in nvram


sfe ctf stp disabled.png
 Description:
 Filesize:  25.33 KB
 Viewed:  2356 Time(s)

sfe ctf stp disabled.png




Last edited by ZenInTexas on Thu Jul 14, 2022 1:32; edited 2 times in total
ZenInTexas
DD-WRT Novice


Joined: 11 Aug 2020
Posts: 47

PostPosted: Wed Jul 13, 2022 22:53    Post subject: Reply with quote
Empty

Last edited by ZenInTexas on Thu Jul 14, 2022 1:53; edited 2 times in total
ZenInTexas
DD-WRT Novice


Joined: 11 Aug 2020
Posts: 47

PostPosted: Wed Jul 13, 2022 23:29    Post subject: Reply with quote
DD-WRT SPI firewall disabled in GUI. iptable commands added via Command->firewall(see attached) I have gone back and froth with having wl0.1 bridged and unbridged, my comments need updating.

As a workaround to get VAP working, I added commands "sleep 10;stopservice nas;stopservice wlconf;startservice wlconf;startservice nas" in firewall commands (per @the-joker).

Based on new information, I removed the VAP workaround commands 2 weeks, when I installed r49418(from an early 2021 version, which had the issue with VAP).



GUI firewall disabled.png
 Description:
 Filesize:  34.09 KB
 Viewed:  2394 Time(s)

GUI firewall disabled.png



July 13 2022 firewall.txt
 Description:
iptables commands in "Firewall" commands. NOTE: I have gone back and froth with wl0.1 bridged and unbridged, comments need updating

Download
 Filename:  July 13 2022 firewall.txt
 Filesize:  3.59 KB
 Downloaded:  50 Time(s)



Last edited by ZenInTexas on Thu Jul 14, 2022 0:21; edited 1 time in total
native_tx
DD-WRT User


Joined: 26 Feb 2014
Posts: 169
Location: Texas

PostPosted: Sat Jul 16, 2022 16:17    Post subject: Reply with quote
Perhaps avoiding this configuration is the problem using a vap with qos port selected "lan & wlan", the dd-wrt quality of service wiki states to use a bridge configuration and that maybe the reason you had these regression issues with qos setup with a vap?

The other issues with the EA6400 may need it's own thread or try another build.

Regards
ZenInTexas
DD-WRT Novice


Joined: 11 Aug 2020
Posts: 47

PostPosted: Sat Jul 16, 2022 19:00    Post subject: Reply with quote
native_tx wrote:
Perhaps avoiding this configuration is the problem using a vap with qos port selected "lan & wlan", the dd-wrt quality of service wiki states to use a bridge configuration and that maybe the reason you had these regression issues with qos setup with a vap?


That's a fair point about the QoS wiki. In a previous post, I posted the QoS config - QoS Enabled.png. It does show this configuration is attempting to do QoS on bridge br1. I did add bridge br1 and assign VAP wl0.1 to it. And when I enabled QoS, on the QoS page, I selected only br1 to be limited to LAN of 500kBits - saving & applying is fine; rebooting results in a boot loop.
native_tx
DD-WRT User


Joined: 26 Feb 2014
Posts: 169
Location: Texas

PostPosted: Sun Jul 17, 2022 0:20    Post subject: Reply with quote
Yes I seen your config but as mentioned "client or repeater bridge modes" are supported, using a wap configured br1-vap , no inbound limited stated maybe the reason your having problems.

As an experiment could you try one of the configuration stated in the wiki?

I'll see if this works on my end later this evening on another router I have.

By the way do you have a main router with dd-wrt flashed? If so use qos on to limit your wap, create a vap on the main dd-wrt router to limit the vap if you would like as well.

Edited: I used my old F7D4302 to flash dd-wrt on, I did run into some issues with the r49467 no lan dhcp worked, static ip or wifi would connect this build was flaky for me and so I flashed the r49492 this build allow me to continue to configure station bridge? either way it work to but no vap would work and this part is documented I believe? I continued to check if qos would work with the connection port set to "lan & wlan" no boot loop after rebooting but qos didn't work.

The wiki is correct but having BRIDGED in caps I kinda thought repeater/client but knowing vap may not work in either configuration didn't register until later my apologies on that but I didn't run into a boot loop.

Is the EA6700 hardwired to another dd-wrt router or no?

regards
ZenInTexas
DD-WRT Novice


Joined: 11 Aug 2020
Posts: 47

PostPosted: Sun Jul 17, 2022 6:30    Post subject: Reply with quote
native_tx wrote:
As an experiment could you try one of the configuration stated in the wiki?


I will; I think you have a good point. It would be good to know if QoS still works as "documented" or if there is some other underlying issue.

native_tx wrote:
By the way do you have a main router with dd-wrt flashed? If so use qos on to limit your wap, create a vap on the main dd-wrt router to limit the vap if you would like as well.


I have a main router with an older version of dd-wrt. It's CPU usage is a bit high because it is running the VPN for the entire network. I really hate messing with the main router; any problems take everything offline. I have another eBay router(with a better CPU) that will show up soon. When it shows up, I will try out QoS on the main router replacement with a VPN and see how it works.

native_tx wrote:
...either way it work to but no vap would work and this part is documented I believe? I continued to check if qos would work with the connection port set to "lan & wlan" no boot loop after rebooting but qos didn't work.


Thanks for testing it. I really appreciate the fact you tried it. I went back to using an unbridged VAP today. I have gone back and forth with the VAP being bridged and unbridged. Besides the QoS issue, I have not yet gotten the firewall/start up script to use iptables 100% correctly for a bridged VAP. I have a client that I use to test what's open: ports, DNS, DHCP, subnet access, etc. So, I am back to using the VAP in a non-bridged setup with an iptables config that does work 100% correctly; at least until I get more time to mess with iptables.

Thanks again for the feed back on not seeing a boot loop; that is very valuable information.

native_tx wrote:
Is the EA6700 hardwired to another dd-wrt router or no?


I am beginning to think the configuration I would like is just not possible right now.

Time for TomorrowLand 2022; the virtual version
native_tx
DD-WRT User


Joined: 26 Feb 2014
Posts: 169
Location: Texas

PostPosted: Sun Jul 17, 2022 17:34    Post subject: Reply with quote
I've done testing in the past using a vap but it was done on a main router running dd-wrt and not on a wap config, from time to time I do find qos on dd-wrt may have problems loading leading to a broken inbound qos but not a boot loop on the main router that qos is configured it maybe possible that additional unnecesary configs were done on your router that could've lead to this but I would have to have to setup a wap with dd-wrt and setup the vap on the current build r49492 later using an arm router instead of mips.

Depending on the build your running and updates to openvpn it would probably be advisable to upgrade be sure to create a backup both written(copy/paste) and in dd-wrt format for the current build but don't use the backup for the upgraded build manually input(copy/paste)perhaps someone else may give other instructions on if this is necessary or not? when upgrading or upgrading is necessary?

Best regards
the-joker
DD-WRT Developer/Maintainer


Joined: 31 Jul 2021
Posts: 2146
Location: All over YOUR webs

PostPosted: Sun Jul 17, 2022 18:20    Post subject: Reply with quote
Sorry, just been too busy and missed this thread entirely, just didnt show up on my radar.

I'm not entirely sure what the issues are with CTF/SFE (some people have raised issues but its hard to get to the bottom without any indicators on any provided evidence like logs etc), I dont use CTF personally as I dont need it, My ISP speed is 100Mbps down and 10Mbps up, but SFE is enabled on mine, doesn't seem to give me any troubles.

CTF and CTF & FA will by design break port forwarding and QoS, because they are both by definition bypassing all this traffic shaping and other rules in order to do their job.

CTF (is software NAT acceleration) only supports adaptive QoS, while CTF & FA (rather the FA part which is hardware acceleration) doest support any QoS.

OK that said, when you enable CTF & FA it needs two reboots, the first loads the modules the second enables the onboard chip that handles the HW acceleration for FA. proper initialization is required, so I hope this isn't what the boot loops are that you noticed. I may have missed your detailed explanation.

Ill try and read though thread with more attention, now I have to go feed myself and my cats, before they feed on me.

You could try enable verbose userspace messages (hidden by default) with nvram set console_debug=1 && nvram commit && reboot and see if your logs help get any more info
When you're done just do nvram unset console_debug && nvram commit && reboot, else your logs are just filled.

It may or not help.

Until then... food time.

_________________
Saving your retinas from the burn!🔥
DD-WRT Inspired themes for routers
DD-WRT Inspired themes for the phpBB Forum
DD-WRT Inspired themes for the SVN Trac & FTP site
Join in for a chat @ #style_it_themes_public:matrix.org or #style_it_themes:discord

DD-WRT UI Themes Bug Reporting and Discussion thread

Router: ANus RT-AC68U E1 (recognized as C1)
kernel-panic69
DD-WRT Guru


Joined: 08 May 2018
Posts: 14102
Location: Texas, USA

PostPosted: Sun Jul 17, 2022 18:42    Post subject: Reply with quote
Neither SFE (Fast-classifier from QCA) nor CTF/CTF+FA function together with QoS in DD-WRT. Before CTF was re-introduced along with FA, SFE and QoS could *not* be enabled at the same time because they cannot coexist. SFE does essentially the same thing as CTF.
_________________
"Life is but a fleeting moment, a vapor that vanishes quickly; All is vanity"
Contribute To DD-WRT
Pogo - A minimal level of ability is expected and needed...
DD-WRT Releases 2023 (PolitePol)
DD-WRT Releases 2023 (RSS Everything)

----------------------
Linux User #377467 counter.li.org / linuxcounter.net
Goto page 1, 2, 3  Next Display posts from previous:    Page 1 of 3
Post new topic   Reply to topic    DD-WRT Forum Index -> Broadcom SoC based Hardware All times are GMT

Navigation

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You can attach files in this forum
You can download files in this forum