Modify

Opened 5 years ago

Last modified 4 years ago

#12199 reopened defect

ath5k causes page allocation failure on AR5312

Reported by: duvi Owned by: developers
Priority: high Milestone: Barrier Breaker 14.07
Component: base system Version: Trunk
Keywords: ath5k memory usage Cc:

Description

I've been trying to use monthly builds starting with r28395 'till latest r33315, all of them end with the same result after a while on AR5312 devices (Sparklan / Alfa WX-7800A).

Sooner or later, usually after some days / a week of uptime, the device becomes unresponsive (can't ping, login with ssh, get snmp info).
If I leave the device in this state for some days, it usually comes back again to life (without restarting itself), and continues working as if nothing had happened.

Then I can see that dmesg is full of swapper: page allocation failure. order:0, mode:0x20 messages (log attached).

I've tried reducing memory usage (turning off snmp, turning off 5 GHz radio), but sooner or later this happens anyway.

There are no problems like this using madwifi on these devices.

The network and wireless configs:

root@OpenWrt:~# cat /etc/config/network

config 'interface' 'loopback'
        option 'ifname' 'lo'
        option 'proto' 'static'
        option 'ipaddr' '127.0.0.1'
        option 'netmask' '255.0.0.0'

config 'interface' 'lan'
        option 'ifname' 'eth0'
        option 'proto' 'static'
        option 'ipaddr' '192.168.1.34'
        option 'netmask' '255.255.255.0'
        option 'gateway' '192.168.1.1'
        option 'dns' '192.168.1.1'
        option 'accept_ra' '1'

config 'interface' 'vlan21'
        option 'ifname' 'eth0.21'
        option 'type' 'bridge'
        option 'proto' 'none'
        option 'auto' '1'

config 'interface' 'wan'
        option 'ifname' 'eth1'
        option 'proto' 'dhcp'
        option 'auto' '0'

root@OpenWrt:~# cat /etc/config/wireless
config wifi-device  radio0
        option disabled 0
        option type     mac80211
        option channel  44
        option macaddr  00:c0:ca:19:fd:a5
        option hwmode   11a
        option diversity 0
        option rxantenna 2
        option txantenna 2

config wifi-iface
        option device   radio0
        option network  vlan21
        option mode     ap
        option ssid     Public
        option encryption none

config wifi-device  radio1
        option disabled 0
        option type     mac80211
        option channel  6
        option macaddr  00:c0:ca:19:fd:a6
        option hwmode   11g
        option diversity 0
        option rxantenna 1
        option txantenna 1

config wifi-iface
        option device   radio1
        option network  vlan21
        option mode     ap
        option ssid     Public
        option encryption none

Attachments (2)

dmesg.log (13.0 KB) - added by duvi 5 years ago.
dmesg_rb433uah.log (45.0 KB) - added by duvi 5 years ago.

Download all attachments as: .zip

Change History (22)

Changed 5 years ago by duvi

comment:1 Changed 5 years ago by duvi

Just wanted to let you know, recent builds seem to work much better.
I have devices running
r33618 for 15 days,
r33725 for 9 days
without any page allocation errors.

I'll keep on testing further.

However, same devices with same config and packages using ath5k have ~1MB free ram, while with madwifi they have ~2.5-3 MB free ram.

Is it possible to make some improvements in overall memory usage on ath5k?

comment:2 Changed 5 years ago by duvi

I have not experienced any memory allocation errors in the recent builds for a longer time now; I think it's fine to close this ticket.
I'll reopen if the memory allocation errors show up again.

comment:3 Changed 5 years ago by jow

  • Resolution set to fixed
  • Status changed from new to closed

comment:4 Changed 5 years ago by duvi

  • Resolution fixed deleted
  • Status changed from closed to reopened

I'm sorry but I have to reopen the ticket, page allocation failure has showed up after 30-40 days of uptime on devices running r33618 and r33933.

I've been monitoring memory, traffic and connected stations, and the graphs show nothing special at the time when page allocation failures start to happen.

http://www.duvinet.hu/memory.png
http://www.duvinet.hu/traffic.png
http://www.duvinet.hu/stations.png

comment:5 Changed 5 years ago by duvi

The device has been out for 3 days, than it can back as if nothing had happened.

Now dmesg gives a hostapd page allocation failure repeating every 3.7 seconds:

[255007.700000] hostapd: page allocation failure: order:0, mode:0x20
[255007.700000] Call Trace:[<80252ac4>] 0x80252ac4
[255007.700000] [<80252ac4>] 0x80252ac4
[255007.700000] [<800963c8>] 0x800963c8
[255007.700000] [<80098a94>] 0x80098a94
[255007.700000] [<80253c6c>] 0x80253c6c
[255007.700000] [<80189e30>] 0x80189e30
[255007.700000] [<800bd524>] 0x800bd524
[255007.700000] [<801c28dc>] 0x801c28dc
[255007.700000] [<8024122c>] 0x8024122c
[255007.700000] [<80241338>] 0x80241338
[255007.700000] [<8024169c>] 0x8024169c
[255007.700000] [<80241618>] 0x80241618
[255007.700000] [<8005f594>] 0x8005f594
[255007.700000] [<800594fc>] 0x800594fc
[255007.700000] [<80059bf8>] 0x80059bf8
[255007.700000] [<80255b78>] 0x80255b78
[255007.700000] [<80059e60>] 0x80059e60
[255007.700000] [<80072b54>] 0x80072b54
[255007.700000] [<80059fdc>] 0x80059fdc
[255007.700000] [<8023f1d8>] 0x8023f1d8
[255007.700000] [<800d1598>] 0x800d1598
[255007.700000] [<800d1cec>] 0x800d1cec
[255007.700000] [<801b58f8>] 0x801b58f8
[255007.700000] [<801b49f8>] 0x801b49f8
[255007.700000] [<800d1694>] 0x800d1694
[255007.700000] [<800d17f8>] 0x800d17f8
[255007.700000] [<800d17f8>] 0x800d17f8
[255007.700000] [<800d17f8>] 0x800d17f8
[255007.700000] [<800d17f8>] 0x800d17f8
[255007.700000] [<800d17f8>] 0x800d17f8
[255007.700000] [<800d17f8>] 0x800d17f8
[255007.700000] [<800d17f8>] 0x800d17f8
[255007.700000] [<800d17f8>] 0x800d17f8
[255007.700000] [<8004a6e0>] 0x8004a6e0
[255007.700000] [<802427b0>] 0x802427b0
[255007.700000] [<802427b0>] 0x802427b0
[255007.700000] [<8048ec28>] 0x8048ec28
[255007.700000] [<801c6438>] 0x801c6438
[255007.700000] [<800776e0>] 0x800776e0
[255007.700000] [<801c69b8>] 0x801c69b8
[255007.700000] [<801e9538>] 0x801e9538
[255007.700000] [<8008b01c>] 0x8008b01c
[255007.700000] [<801b8c8c>] 0x801b8c8c
[255007.700000] [<8008a6fc>] 0x8008a6fc
[255007.700000] [<800d20d0>] 0x800d20d0
[255007.700000] [<800cdfb8>] 0x800cdfb8
[255007.700000] [<800ce2a4>] 0x800ce2a4
[255007.700000] [<8018ea00>] 0x8018ea00
[255007.700000] [<800d19dc>] 0x800d19dc
[255007.700000] [<800d2250>] 0x800d2250
[255007.700000] [<800be504>] 0x800be504
[255007.700000] [<80058e28>] 0x80058e28
[255007.700000] [<8004a830>] 0x8004a830
[255007.700000] [<800be520>] 0x800be520
[255007.700000]
[255007.700000] Mem-Info:
[255007.700000] Normal per-cpu:
[255007.700000] CPU    0: hi:    0, btch:   1 usd:   0
[255007.700000] active_anon:420 inactive_anon:12 isolated_anon:0
[255007.700000]  active_file:396 inactive_file:349 isolated_file:0
[255007.700000]  unevictable:0 dirty:0 writeback:0 unstable:0
[255007.700000]  free:48 slab_reclaimable:202 slab_unreclaimable:1244
[255007.700000]  mapped:417 shmem:19 pagetables:48 bounce:0
[255007.700000] Normal free:192kB min:508kB low:632kB high:760kB active_anon:1680kB inactive_anon:48kB active_file:1584kB inactive_file:1396kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:16256kB mlocked:0kB dirty:0kB writeback:0kB mapped:1668kB shmem:76kB slab_reclaimable:808kB slab_unreclaimable:4976kB kernel_stack:264kB pagetables:192kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[255007.700000] lowmem_reserve[]: 0 0
[255007.700000] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 192kB
[255007.700000] 764 total pagecache pages
[255007.700000] 4096 pages RAM
[255007.700000] 782 pages reserved
[255007.700000] 1204 pages shared
[255007.700000] 2660 pages non-shared

This is driving me (and the users) crazy.. what should I do to help?
Thanks!

comment:6 Changed 5 years ago by nbd

please check if r34603/r34604 fixes the issue

comment:7 Changed 5 years ago by duvi

Building and will test asap.
Testing may take a while, last time it took 30-40 days before the page allocation errors first happened.
Thank you!

comment:8 Changed 5 years ago by duvi

At first sight it seems worse than before ):
Updated 6 devices this morning, by now 2 of them have already passed out.

I'll wait a while hoping that they'll come back, and I can see something in the log.

comment:9 Changed 5 years ago by duvi

Is it possible, that this changeset made it worse, and I should revert it, or is it simply bad luck, that these hangups happened so quick, and we have to look for the fix somewhere else?

comment:10 Changed 5 years ago by nbd

I don't see any way how this change could have made it worse. Probably bad luck.

comment:11 Changed 5 years ago by duvi

One of the 2 dead units has just come back to life with the same good old page allocation error flood in dmesg:

[277127.440000] swapper: page allocation failure: order:0, mode:0x20
[277127.440000] Call Trace:[<80253294>] 0x80253294
[277127.440000] [<80253294>] 0x80253294
[277127.440000] [<800963d8>] 0x800963d8
[277127.440000] [<80098aa4>] 0x80098aa4
[277127.440000] [<801d5528>] 0x801d5528
[277127.440000] [<8025443c>] 0x8025443c
[277127.440000] [<80189e30>] 0x80189e30
[277127.440000] [<800bd534>] 0x800bd534
[277127.440000] [<80353a0c>] 0x80353a0c
[277127.440000] [<801c30ac>] 0x801c30ac
[277127.440000] [<802419fc>] 0x802419fc
[277127.440000] [<80354ec8>] 0x80354ec8
[277127.440000] [<80241b08>] 0x80241b08
[277127.440000] [<80350d88>] 0x80350d88
[277127.440000] [<80241e6c>] 0x80241e6c
[277127.440000] [<80355198>] 0x80355198
[277127.440000] [<80241de8>] 0x80241de8
[277127.440000] [<8005f594>] 0x8005f594
[277127.440000] [<800594fc>] 0x800594fc
[277127.440000] [<80059bf8>] 0x80059bf8
[277127.440000] [<80059e60>] 0x80059e60
[277127.440000] [<8008fccc>] 0x8008fccc
[277127.440000] [<8005a0ac>] 0x8005a0ac
[277127.440000] [<800431c4>] 0x800431c4
[277127.440000] [<800433e0>] 0x800433e0
[277127.440000] [<8007b280>] 0x8007b280
[277127.440000] [<80044d68>] 0x80044d68
[277127.440000] [<80043400>] 0x80043400
[277127.440000] [<802ac8f8>] 0x802ac8f8
[277127.440000] [<802cacc8>] 0x802cacc8
[277127.440000] [<802ac0dc>] 0x802ac0dc
[277127.440000]
[277127.440000] Mem-Info:
[277127.440000] Normal per-cpu:
[277127.440000] CPU    0: hi:    0, btch:   1 usd:   0
[277127.440000] active_anon:425 inactive_anon:12 isolated_anon:0
[277127.440000]  active_file:444 inactive_file:361 isolated_file:0
[277127.440000]  unevictable:0 dirty:0 writeback:0 unstable:0
[277127.440000]  free:48 slab_reclaimable:197 slab_unreclaimable:1181
[277127.440000]  mapped:415 shmem:19 pagetables:45 bounce:0
[277127.440000] Normal free:192kB min:508kB low:632kB high:760kB active_anon:1700kB inactive_anon:48kB active_file:1776kB inactive_file:1444kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:16256kB mlocked:0kB dirty:0kB writeback:0kB mapped:1660kB shmem:76kB slab_reclaimable:788kB slab_unreclaimable:4724kB kernel_stack:264kB pagetables:180kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[277127.440000] lowmem_reserve[]: 0 0
[277127.440000] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 192kB
[277127.440000] 824 total pagecache pages
[277127.440000] 4096 pages RAM
[277127.440000] 782 pages reserved
[277127.440000] 1209 pages shared
[277127.440000] 2648 pages non-shared

I've rebuilt the images with symbol table information based on r34640, thus the log should be more informative, if the allocation error happens next time.

comment:12 Changed 5 years ago by duvi

I don't know if that helps, but according to my graphs there were 6 stations connected to the ap when it passed out 3 days ago.
Logread shows the disconnection of these 6 devices right after the allocation errors stop (17:23:49):

...
Dec 14 17:23:49 OpenWrt kern.warn kernel: [277127.440000] 1209 pages shared
Dec 14 17:23:49 OpenWrt kern.warn kernel: [277127.440000] 2648 pages non-shared
Dec 14 17:23:49 OpenWrt daemon.info hostapd: wlan1: STA cc:af:78:8b:71:ea IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Dec 14 17:23:49 OpenWrt daemon.info hostapd: wlan1: STA 08:ed:b9:f8:54:6d IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Dec 14 17:23:49 OpenWrt daemon.info hostapd: wlan1: STA c0:18:85:11:29:2d IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Dec 14 17:23:49 OpenWrt daemon.info hostapd: wlan1: STA 9c:b7:0d:07:67:60 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Dec 14 17:23:49 OpenWrt daemon.info hostapd: wlan1: STA 6c:a7:80:49:2e:64 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Dec 14 17:23:49 OpenWrt daemon.info hostapd: wlan1: STA dc:85:de:03:d6:30 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Dec 14 17:36:55 OpenWrt daemon.info hostapd: wlan1: STA a0:f4:50:5c:ae:fd IEEE 802.11: authenticated
Dec 14 17:36:55 OpenWrt daemon.info hostapd: wlan1: STA a0:f4:50:5c:ae:fd IEEE 802.11: associated (aid 1)
Dec 14 17:36:55 OpenWrt daemon.info hostapd: wlan1: STA a0:f4:50:5c:ae:fd RADIUS: starting accounting session 00000024-00000026
...

After that, stations start to reconnect happily as if nothing had happened (17:36:55).

Could it be that the memory leak is not in the wireless driver, but in hostapd?

comment:13 Changed 5 years ago by duvi

Strange thing just happened. For 30-40 days, all 6 APs have been running without any page allocation error. However, last hour, 2 of them have passed out within only 10 minutes.
The brings me to the assumption, that what if the error is triggered by a specific device? It kills the first one, the reassociates to another (their wireless signal overlaps, so this is possible), and soon it also kills that one.

However, after 16 minutes of being on the other side, the second AP came back to life, leaving this in the log:

Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] ksoftirqd/0: page allocation failure: order:0, mode:0x20
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] Call Trace:
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<80255474>] dump_stack+0x8/0x34
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<800983d8>] warn_alloc_failed+0xf0/0x114
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<8009aaa4>] __alloc_pages_nodemask+0x5b0/0x610
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<80256630>] cache_alloc_refill+0x2b8/0x670
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<800bf594>] kmem_cache_alloc+0x84/0xf4
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<801c529c>] __alloc_skb+0x50/0x140
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<80243bec>] fdb_notify+0x3c/0x10c
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<80243cf8>] fdb_delete+0x3c/0x58
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<8024405c>] br_fdb_cleanup+0x84/0xf4
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<8005f954>] run_timer_softirq+0x188/0x258
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<80059fb8>] __do_softirq+0xb8/0x184
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<8005a114>] run_ksoftirqd+0x90/0x140
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<8006f044>] kthread+0x88/0x90
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] [<80044e60>] kernel_thread_helper+0x10/0x18
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000]
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] Mem-Info:
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] Normal per-cpu:
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] CPU    0: hi:    0, btch:   1 usd:   0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] active_anon:419 inactive_anon:12 isolated_anon:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000]  active_file:367 inactive_file:321 isolated_file:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000]  unevictable:0 dirty:0 writeback:0 unstable:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000]  free:48 slab_reclaimable:204 slab_unreclaimable:1251
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000]  mapped:398 shmem:19 pagetables:44 bounce:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] Normal free:192kB min:508kB low:632kB high:760kB active_anon:1676kB inactive_anon:48kB active_file:1468kB inactive_file:1284kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:16256kB mlocked:0kB dirty:0kB writeback:0kB mapped:1592kB shmem:76kB slab_reclaimable:816kB slab_unreclaimable:5004kB kernel_stack:264kB pagetables:176kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] lowmem_reserve[]: 0 0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 192kB
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] 707 total pagecache pages
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] 4096 pages RAM
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] 822 pages reserved
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] 1180 pages shared
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634303.900000] 2648 pages non-shared
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] ksoftirqd/0: page allocation failure: order:0, mode:0x20
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] Call Trace:
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<80255474>] dump_stack+0x8/0x34
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<800983d8>] warn_alloc_failed+0xf0/0x114
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<8009aaa4>] __alloc_pages_nodemask+0x5b0/0x610
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<80256630>] cache_alloc_refill+0x2b8/0x670
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<800bf594>] kmem_cache_alloc+0x84/0xf4
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<801c529c>] __alloc_skb+0x50/0x140
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<80243bec>] fdb_notify+0x3c/0x10c
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<80243cf8>] fdb_delete+0x3c/0x58
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<8024405c>] br_fdb_cleanup+0x84/0xf4
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<8005f954>] run_timer_softirq+0x188/0x258
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<80059fb8>] __do_softirq+0xb8/0x184
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<8005a114>] run_ksoftirqd+0x90/0x140
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<8006f044>] kthread+0x88/0x90
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] [<80044e60>] kernel_thread_helper+0x10/0x18
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000]
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] Mem-Info:
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] Normal per-cpu:
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] CPU    0: hi:    0, btch:   1 usd:   0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] active_anon:419 inactive_anon:12 isolated_anon:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000]  active_file:367 inactive_file:321 isolated_file:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000]  unevictable:0 dirty:0 writeback:0 unstable:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000]  free:48 slab_reclaimable:204 slab_unreclaimable:1251
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000]  mapped:398 shmem:19 pagetables:44 bounce:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] Normal free:192kB min:508kB low:632kB high:760kB active_anon:1676kB inactive_anon:48kB active_file:1468kB inactive_file:1284kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:16256kB mlocked:0kB dirty:0kB writeback:0kB mapped:1592kB shmem:76kB slab_reclaimable:816kB slab_unreclaimable:5004kB kernel_stack:264kB pagetables:176kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] lowmem_reserve[]: 0 0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 192kB
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] 707 total pagecache pages
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] 4096 pages RAM
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] 822 pages reserved
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] 1180 pages shared
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634306.160000] 2648 pages non-shared
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] ksoftirqd/0: page allocation failure: order:0, mode:0x20
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] Call Trace:
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<80255474>] dump_stack+0x8/0x34
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<800983d8>] warn_alloc_failed+0xf0/0x114
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<8009aaa4>] __alloc_pages_nodemask+0x5b0/0x610
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<80256630>] cache_alloc_refill+0x2b8/0x670
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<800bf594>] kmem_cache_alloc+0x84/0xf4
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<801c529c>] __alloc_skb+0x50/0x140
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<80243bec>] fdb_notify+0x3c/0x10c
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<80243cf8>] fdb_delete+0x3c/0x58
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<8024405c>] br_fdb_cleanup+0x84/0xf4
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<8005f954>] run_timer_softirq+0x188/0x258
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<80059fb8>] __do_softirq+0xb8/0x184
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<8005a114>] run_ksoftirqd+0x90/0x140
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<8006f044>] kthread+0x88/0x90
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] [<80044e60>] kernel_thread_helper+0x10/0x18
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000]
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] Mem-Info:
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] Normal per-cpu:
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] CPU    0: hi:    0, btch:   1 usd:   0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] active_anon:419 inactive_anon:12 isolated_anon:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000]  active_file:367 inactive_file:321 isolated_file:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000]  unevictable:0 dirty:0 writeback:0 unstable:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000]  free:48 slab_reclaimable:204 slab_unreclaimable:1251
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000]  mapped:398 shmem:19 pagetables:44 bounce:0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] Normal free:192kB min:508kB low:632kB high:760kB active_anon:1676kB inactive_anon:48kB active_file:1468kB inactive_file:1284kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:16256kB mlocked:0kB dirty:0kB writeback:0kB mapped:1592kB shmem:76kB slab_reclaimable:816kB slab_unreclaimable:5004kB kernel_stack:264kB pagetables:176kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] lowmem_reserve[]: 0 0
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 192kB
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] 707 total pagecache pages
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] 4096 pages RAM
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] 822 pages reserved
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] 1180 pages shared
Jan 17 22:57:21 OpenWrt kern.warn kernel: [2634308.420000] 2648 pages non-shared
Jan 17 22:57:22 OpenWrt daemon.info hostapd: wlan0: STA 00:21:5d:95:75:82 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 17 22:57:22 OpenWrt daemon.info hostapd: wlan1: STA 9c:b7:0d:af:a8:82 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 17 22:57:22 OpenWrt daemon.info hostapd: wlan1: STA 00:26:c6:69:79:ca IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 17 22:57:22 OpenWrt daemon.info hostapd: wlan1: STA 00:25:56:21:fa:ca IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 17 22:57:22 OpenWrt daemon.info hostapd: wlan1: STA 00:1b:77:73:2f:0f IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 17 22:57:22 OpenWrt daemon.info hostapd: wlan1: STA dc:85:de:03:d6:30 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 17 22:57:22 OpenWrt daemon.info hostapd: wlan1: STA 4c:0f:6e:4d:da:f2 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 17 22:57:22 OpenWrt daemon.info hostapd: wlan1: STA 9c:b7:0d:07:67:60 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 17 22:57:55 OpenWrt daemon.info hostapd: wlan1: STA 00:26:c6:69:79:ca IEEE 802.11: authenticated
Jan 17 22:57:55 OpenWrt daemon.info hostapd: wlan1: STA 00:26:c6:69:79:ca IEEE 802.11: associated (aid 1)
Jan 17 22:57:55 OpenWrt daemon.info hostapd: wlan1: STA 00:26:c6:69:79:ca RADIUS: starting accounting session 00000024-000007EF
Jan 17 22:59:26 OpenWrt daemon.info hostapd: wlan1: STA 4c:0f:6e:4d:da:f2 IEEE 802.11: authenticated
Jan 17 22:59:26 OpenWrt daemon.info hostapd: wlan1: STA 4c:0f:6e:4d:da:f2 IEEE 802.11: associated (aid 2)
Jan 17 22:59:26 OpenWrt daemon.info hostapd: wlan1: STA 4c:0f:6e:4d:da:f2 RADIUS: starting accounting session 00000024-000007F0

Seeing that all the log entries about the page allocation error have the same timestamp in logread, brings me to another assumption. What if the device runs out of memory, because it's memory is filled by writing the log about running out of memory? (: I know this may sound a little strange, but it could be possible. And still, something has to trigger the "first" memory allocation error.

I'll copy the log from the other AP as soon as it revives.

comment:14 Changed 5 years ago by duvi

And here comes the other one. Luckily it didn't take days now for the devices to return.

Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] ksoftirqd/0: page allocation failure: order:0, mode:0x20
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] Call Trace:
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<80255474>] dump_stack+0x8/0x34
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<800983d8>] warn_alloc_failed+0xf0/0x114
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<8009aaa4>] __alloc_pages_nodemask+0x5b0/0x610
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<80256630>] cache_alloc_refill+0x2b8/0x670
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<800bf594>] kmem_cache_alloc+0x84/0xf4
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<801c529c>] __alloc_skb+0x50/0x140
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<80243bec>] fdb_notify+0x3c/0x10c
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<80243cf8>] fdb_delete+0x3c/0x58
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<8024405c>] br_fdb_cleanup+0x84/0xf4
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<8005f954>] run_timer_softirq+0x188/0x258
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<80059fb8>] __do_softirq+0xb8/0x184
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<8005a114>] run_ksoftirqd+0x90/0x140
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<8006f044>] kthread+0x88/0x90
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] [<80044e60>] kernel_thread_helper+0x10/0x18
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000]
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] Mem-Info:
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] Normal per-cpu:
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] CPU    0: hi:    0, btch:   1 usd:   0
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] active_anon:429 inactive_anon:8 isolated_anon:0
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000]  active_file:392 inactive_file:281 isolated_file:0
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000]  unevictable:0 dirty:0 writeback:0 unstable:0
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000]  free:48 slab_reclaimable:204 slab_unreclaimable:1256
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000]  mapped:322 shmem:19 pagetables:48 bounce:0
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] Normal free:192kB min:508kB low:632kB high:760kB active_anon:1716kB inactive_anon:32kB active_file:1568kB inactive_file:1124kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:16256kB mlocked:0kB dirty:0kB writeback:0kB mapped:1288kB shmem:76kB slab_reclaimable:816kB slab_unreclaimable:5024kB kernel_stack:264kB pagetables:192kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] lowmem_reserve[]: 0 0
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 192kB
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] 692 total pagecache pages
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] 4096 pages RAM
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] 822 pages reserved
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] 1099 pages shared
Jan 18 09:55:59 OpenWrt kern.warn kernel: [3058487.070000] 2722 pages non-shared
Jan 18 09:55:59 OpenWrt daemon.info hostapd: wlan1: STA dc:85:de:03:d6:30 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 18 09:55:59 OpenWrt daemon.info hostapd: wlan1: STA 9c:b7:0d:07:67:60 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 18 09:55:59 OpenWrt daemon.info hostapd: wlan0: STA 00:26:c6:69:79:ca IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 18 09:55:59 OpenWrt daemon.info hostapd: wlan1: STA 00:25:56:21:fa:ca IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 18 09:55:59 OpenWrt daemon.info hostapd: wlan1: STA 88:53:d4:27:70:41 IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)
Jan 18 09:55:59 OpenWrt daemon.info hostapd: wlan1: STA 00:16:44:d9:39:6a IEEE 802.11: deauthenticated due to inactivity (timer DEAUTH/REMOVE)

Do you have a clue what may be causing these?

comment:15 Changed 5 years ago by reddog@…

At first, you can try this:
Index: include/image.mk
===================================================================
--- include/image.mk (Revision 35298)
+++ include/image.mk (Arbeitskopie)
@@ -42,10 +42,10 @@

JFFS2OPTS += -x lzma

endif

-SQUASHFS_BLOCKSIZE := 256k
+SQUASHFS_BLOCKSIZE := 64k

SQUASHFSOPT := -b $(SQUASHFS_BLOCKSIZE)
SQUASHFSCOMP := gzip

-LZMA_XZ_OPTIONS := -Xpreset 9 -Xe -Xlc 0 -Xlp 2 -Xpb 2
+LZMA_XZ_OPTIONS := -Xpreset 1

ifeq ($(CONFIG_SQUASHFS_LZMA),y)

SQUASHFSCOMP := lzma $(LZMA_XZ_OPTIONS)

endif

And then, there are a lot of kernel-config options you can optimize.. E.g. the squashfs cache parameters.. But the OpenWRT guys enabled a lot of things you don't need or don't have.. Disabling this saves kernel-size and so a lot of memory..

Changed 5 years ago by duvi

comment:16 Changed 5 years ago by duvi

Look what I just found on an RB433UAH with 128 MB of RAM.
r34640, 2 wireless cards installed, one uses ath5k, one uses ath9k.

I think this can be related somehow.
However, 128 MB of RAM should be more than enough for wireless, so there has to be a leak somewhere still.

Please see full dmesg log attached.

[1724007.920000] swapper: page allocation failure: order:0, mode:0x20
[1724007.920000] Call Trace:
[1724007.920000] [<8027292c>] dump_stack+0x8/0x34
[1724007.920000] [<800b36f0>] warn_alloc_failed+0xe8/0x10c
[1724007.920000] [<800b5a20>] __alloc_pages_nodemask+0x5c4/0x624
[1724007.920000] [<801de338>] __netdev_alloc_frag+0x54/0x12c
[1724007.920000] [<801e1b28>] __netdev_alloc_skb+0x5c/0x110
[1724007.920000] [<87ba80b8>] ath_rxbuf_alloc+0x30/0x98 [ath]
[1724007.920000] [<87026bbc>] ath_rx_tasklet+0x914/0x10e4 [ath9k]
[1724007.920000] [<87025210>] ath9k_tasklet+0x114/0x170 [ath9k]
[1724007.920000] [<80079860>] tasklet_action+0x74/0xc4
[1724007.920000] [<80078ff8>] __do_softirq+0xb4/0x188
[1724007.920000] [<80079228>] do_softirq+0x48/0x68
[1724007.920000] [<8007945c>] irq_exit+0x4c/0x78
[1724007.920000] [<800630ec>] ret_from_irq+0x0/0x4
[1724007.920000] [<800632e0>] r4k_wait+0x20/0x40
[1724007.920000] [<80064db4>] cpu_idle+0x30/0x60
[1724007.920000] [<8030a8f4>] start_kernel+0x370/0x390
[1724007.920000] 
[1724007.920000] Mem-Info:
[1724007.920000] Normal per-cpu:
[1724007.920000] CPU    0: hi:   42, btch:   7 usd:  39
[1724007.920000] active_anon:3491 inactive_anon:209 isolated_anon:0
[1724007.920000]  active_file:10117 inactive_file:13012 isolated_file:0
[1724007.920000]  unevictable:0 dirty:32 writeback:0 unstable:0
[1724007.920000]  free:134 slab_reclaimable:1416 slab_unreclaimable:1267
[1724007.920000]  mapped:2055 shmem:1500 pagetables:105 bounce:0
[1724007.920000] Normal free:536kB min:1440kB low:1800kB high:2160kB active_anon:13964kB inactive_anon:836kB active_file:40468kB inactive_file:52048kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:130048kB mlocked:0kB dirty:128kB writeback:0kB mapped:8220kB shmem:6000kB slab_reclaimable:5664kB slab_unreclaimable:5068kB kernel_stack:424kB pagetables:420kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[1724007.920000] lowmem_reserve[]: 0 0
[1724007.920000] Normal: 0*4kB 1*8kB 1*16kB 0*32kB 4*64kB 0*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 536kB
[1724007.920000] 24631 total pagecache pages
[1724007.920000] 0 pages in swap cache
[1724007.920000] Swap cache stats: add 0, delete 0, find 0/0
[1724007.920000] Free swap  = 0kB
[1724007.920000] Total swap = 0kB
[1724007.920000] 32768 pages RAM
[1724007.920000] 1122 pages reserved
[1724007.920000] 26100 pages shared
[1724007.920000] 8329 pages non-shared
[1724008.140000] ath: skbuff alloc of size 1926 failed
[1724008.140000] swapper: page allocation failure: order:0, mode:0x20
[1724008.140000] Call Trace:
[1724008.140000] [<8027292c>] dump_stack+0x8/0x34
[1724008.140000] [<800b36f0>] warn_alloc_failed+0xe8/0x10c
[1724008.140000] [<800b5a20>] __alloc_pages_nodemask+0x5c4/0x624
[1724008.140000] [<801de338>] __netdev_alloc_frag+0x54/0x12c
[1724008.140000] [<801e1b28>] __netdev_alloc_skb+0x5c/0x110
[1724008.140000] [<87ba80b8>] ath_rxbuf_alloc+0x30/0x98 [ath]
[1724008.140000] [<87026bbc>] ath_rx_tasklet+0x914/0x10e4 [ath9k]
[1724008.140000] [<87025210>] ath9k_tasklet+0x114/0x170 [ath9k]
[1724008.140000] [<80079860>] tasklet_action+0x74/0xc4
[1724008.140000] [<80078ff8>] __do_softirq+0xb4/0x188
[1724008.140000] [<80079228>] do_softirq+0x48/0x68
[1724008.140000] [<8007945c>] irq_exit+0x4c/0x78
[1724008.140000] [<800630ec>] ret_from_irq+0x0/0x4
[1724008.140000] [<800632e0>] r4k_wait+0x20/0x40
[1724008.140000] [<80064db4>] cpu_idle+0x30/0x60
[1724008.140000] [<8030a8f4>] start_kernel+0x370/0x390
[1724008.140000] 
[1724008.140000] Mem-Info:
[1724008.140000] Normal per-cpu:
[1724008.140000] CPU    0: hi:   42, btch:   7 usd:  39
[1724008.140000] active_anon:3491 inactive_anon:209 isolated_anon:0
[1724008.140000]  active_file:10117 inactive_file:13012 isolated_file:0
[1724008.140000]  unevictable:0 dirty:32 writeback:0 unstable:0
[1724008.140000]  free:134 slab_reclaimable:1416 slab_unreclaimable:1267
[1724008.140000]  mapped:2055 shmem:1500 pagetables:105 bounce:0
[1724008.140000] Normal free:536kB min:1440kB low:1800kB high:2160kB active_anon:13964kB inactive_anon:836kB active_file:40468kB inactive_file:52048kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:130048kB mlocked:0kB dirty:128kB writeback:0kB mapped:8220kB shmem:6000kB slab_reclaimable:5664kB slab_unreclaimable:5068kB kernel_stack:424kB pagetables:420kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[1724008.140000] lowmem_reserve[]: 0 0
[1724008.140000] Normal: 0*4kB 1*8kB 1*16kB 0*32kB 4*64kB 0*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 536kB
[1724008.140000] 24631 total pagecache pages
[1724008.140000] 0 pages in swap cache
[1724008.140000] Swap cache stats: add 0, delete 0, find 0/0
[1724008.140000] Free swap  = 0kB
[1724008.140000] Total swap = 0kB
[1724008.140000] 32768 pages RAM
[1724008.140000] 1122 pages reserved
[1724008.140000] 26100 pages shared
[1724008.140000] 8329 pages non-shared

......cutted repeating events......

[1724009.940000] ath: skbuff alloc of size 1926 failed
[1724009.940000] swapper: page allocation failure: order:0, mode:0x20
[1724009.940000] Call Trace:
[1724009.940000] [<8027292c>] dump_stack+0x8/0x34
[1724009.940000] [<800b36f0>] warn_alloc_failed+0xe8/0x10c
[1724009.940000] [<800b5a20>] __alloc_pages_nodemask+0x5c4/0x624
[1724009.940000] [<801de338>] __netdev_alloc_frag+0x54/0x12c
[1724009.940000] [<801e1b28>] __netdev_alloc_skb+0x5c/0x110
[1724009.940000] [<87ba80b8>] ath_rxbuf_alloc+0x30/0x98 [ath]
[1724009.940000] [<87026bbc>] ath_rx_tasklet+0x914/0x10e4 [ath9k]
[1724009.940000] [<87025210>] ath9k_tasklet+0x114/0x170 [ath9k]
[1724009.940000] [<80079860>] tasklet_action+0x74/0xc4
[1724009.940000] [<80078ff8>] __do_softirq+0xb4/0x188
[1724009.940000] [<80079228>] do_softirq+0x48/0x68
[1724009.940000] [<8007945c>] irq_exit+0x4c/0x78
[1724009.940000] [<800630ec>] ret_from_irq+0x0/0x4
[1724009.940000] [<800632e0>] r4k_wait+0x20/0x40
[1724009.940000] [<80064db4>] cpu_idle+0x30/0x60
[1724009.940000] [<8030a8f4>] start_kernel+0x370/0x390
[1724009.940000] 
[1724009.940000] Mem-Info:
[1724009.940000] Normal per-cpu:
[1724009.940000] CPU    0: hi:   42, btch:   7 usd:  39
[1724009.940000] active_anon:3491 inactive_anon:209 isolated_anon:0
[1724009.940000]  active_file:10117 inactive_file:13012 isolated_file:0
[1724009.940000]  unevictable:0 dirty:32 writeback:0 unstable:0
[1724009.940000]  free:134 slab_reclaimable:1416 slab_unreclaimable:1267
[1724009.940000]  mapped:2055 shmem:1500 pagetables:105 bounce:0
[1724009.940000] Normal free:536kB min:1440kB low:1800kB high:2160kB active_anon:13964kB inactive_anon:836kB active_file:40468kB inactive_file:52048kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:130048kB mlocked:0kB dirty:128kB writeback:0kB mapped:8220kB shmem:6000kB slab_reclaimable:5664kB slab_unreclaimable:5068kB kernel_stack:424kB pagetables:420kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[1724009.940000] lowmem_reserve[]: 0 0
[1724009.940000] Normal: 0*4kB 1*8kB 1*16kB 0*32kB 4*64kB 0*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 536kB
[1724009.940000] 24631 total pagecache pages
[1724009.940000] 0 pages in swap cache
[1724009.940000] Swap cache stats: add 0, delete 0, find 0/0
[1724009.940000] Free swap  = 0kB
[1724009.940000] Total swap = 0kB
[1724009.940000] 32768 pages RAM
[1724009.940000] 1122 pages reserved
[1724009.940000] 26100 pages shared
[1724009.940000] 8329 pages non-shared
[1724010.160000] ath: skbuff alloc of size 1926 failed
[1724010.170000] ath: skbuff alloc of size 1926 failed
[1724010.170000] ath: skbuff alloc of size 1926 failed
[1724010.180000] ath: skbuff alloc of size 1926 failed
[1724010.180000] ath: skbuff alloc of size 1926 failed
[1724010.190000] ath: skbuff alloc of size 1926 failed
[1724010.190000] ath: skbuff alloc of size 1926 failed
[1724010.200000] ath: skbuff alloc of size 1926 failed
[1724010.200000] ath: skbuff alloc of size 1926 failed
[1724010.210000] ath: skbuff alloc of size 1926 failed
[1724010.210000] ath: skbuff alloc of size 1926 failed
[1724010.220000] ath: skbuff alloc of size 1926 failed
[1724010.220000] ath: skbuff alloc of size 1926 failed
[1724010.230000] ath: skbuff alloc of size 1926 failed
[1724010.230000] ath: skbuff alloc of size 1926 failed
[1724010.240000] ath: skbuff alloc of size 1926 failed
[1724010.240000] ath: skbuff alloc of size 1926 failed
[1724010.250000] ath: skbuff alloc of size 1926 failed
[1724010.250000] ath: skbuff alloc of size 1926 failed
[1724010.260000] ath: skbuff alloc of size 1926 failed
[1724010.260000] ath: skbuff alloc of size 1926 failed
[1724010.270000] ath: skbuff alloc of size 1926 failed
[1724010.270000] ath: skbuff alloc of size 1926 failed
[1724010.280000] ath: skbuff alloc of size 1926 failed
[1724010.280000] ath: skbuff alloc of size 1926 failed
[1724010.290000] ath: skbuff alloc of size 1926 failed
[1724010.290000] ath: skbuff alloc of size 1926 failed
[1724010.300000] ath: skbuff alloc of size 1926 failed
[1724010.300000] ath: skbuff alloc of size 1926 failed
[1724010.310000] ath: skbuff alloc of size 1926 failed
[1724010.310000] ath: skbuff alloc of size 1926 failed
[1724010.310000] ath: skbuff alloc of size 1926 failed
[1724010.320000] ath: skbuff alloc of size 1926 failed
[1724010.330000] ath: skbuff alloc of size 2368 failed
[1724010.330000] ath5k: phy0: can't alloc skbuff of size 2368
[1724010.340000] ath: skbuff alloc of size 2368 failed
[1724010.340000] ath5k: phy0: can't alloc skbuff of size 2368
[1724010.350000] ath: skbuff alloc of size 2368 failed
[1724010.350000] ath5k: phy0: can't alloc skbuff of size 2368
[1724010.360000] ath: skbuff alloc of size 2368 failed
[1724010.360000] ath5k: phy0: can't alloc skbuff of size 2368
[1724010.370000] ath: skbuff alloc of size 2368 failed
[1724010.370000] ath5k: phy0: can't alloc skbuff of size 2368
[1724010.380000] ath: skbuff alloc of size 2368 failed
[1724010.380000] ath5k: phy0: can't alloc skbuff of size 2368
[1724010.390000] ath: skbuff alloc of size 2368 failed
[1724010.390000] ath5k: phy0: can't alloc skbuff of size 2368
[1724010.400000] ath: skbuff alloc of size 2368 failed
[1724010.410000] ath5k: phy0: can't alloc skbuff of size 2368
[1724010.410000] ath: skbuff alloc of size 2368 failed
[1724010.420000] ath5k: phy0: can't alloc skbuff of size 2368
[1724010.420000] ath: skbuff alloc of size 2368 failed
[1724010.430000] ath5k: phy0: can't alloc skbuff of size 2368
[1724010.430000] ath: skbuff alloc of size 2368 failed
[1724010.440000] ath: skbuff alloc of size 2368 failed
[1724010.440000] ath: skbuff alloc of size 2368 failed
[1724010.450000] ath: skbuff alloc of size 2368 failed
[1724010.450000] ath: skbuff alloc of size 2368 failed
[1724010.460000] ath: skbuff alloc of size 2368 failed
[1724010.460000] ath: skbuff alloc of size 2368 failed
[1724010.470000] ath: skbuff alloc of size 2368 failed
[1724010.470000] ath: skbuff alloc of size 2368 failed
[1724010.480000] ath: skbuff alloc of size 2368 failed
[1724010.480000] ath: skbuff alloc of size 2368 failed
[1724010.480000] ath: skbuff alloc of size 2368 failed
[1724010.490000] ath: skbuff alloc of size 2368 failed
[1724010.490000] ath: skbuff alloc of size 2368 failed
[1724010.500000] ath: skbuff alloc of size 2368 failed
[1724010.500000] ath: skbuff alloc of size 2368 failed
[1724010.510000] ath: skbuff alloc of size 2368 failed
[1724010.510000] ath: skbuff alloc of size 2368 failed
[1724010.520000] ath: skbuff alloc of size 2368 failed
[1724010.520000] ath: skbuff alloc of size 2368 failed
[1724010.530000] ath: skbuff alloc of size 2368 failed
[1724010.530000] ath: skbuff alloc of size 2368 failed
[1724010.540000] ath: skbuff alloc of size 2368 failed
[1724010.540000] ath: skbuff alloc of size 2368 failed
[1724010.550000] ath: skbuff alloc of size 2368 failed
[1724010.550000] ath: skbuff alloc of size 2368 failed
[1724010.560000] ath: skbuff alloc of size 2368 failed
[1724010.560000] ath: skbuff alloc of size 2368 failed
[1724010.570000] ath: skbuff alloc of size 2368 failed

comment:17 Changed 5 years ago by nbd

please try latest trunk

comment:18 Changed 5 years ago by reddog@…

Could you please tell us, which commit may resolve this issue?

comment:19 Changed 5 years ago by duvi

Tested recently with r36545, still the same.
It also seems much worse since the switch to Linux 3.8

comment:20 Changed 4 years ago by jow

  • Milestone changed from Attitude Adjustment 12.09 to Barrier Breaker 14.07

Milestone Attitude Adjustment 12.09 deleted

Add Comment

Modify Ticket

Action
as reopened .
Author


E-mail address and user name can be saved in the Preferences.

 
Note: See TracTickets for help on using tickets.