Modify

Opened 21 months ago

Last modified 20 months ago

#22426 new defect

Reboot constantly | SQUAHFS error: Unable to read metadata cache entry

Reported by: gazambuja Owned by: developers
Priority: highest Milestone: Designated Driver (Trunk)
Component: base system Version: Trunk
Keywords: Cc:

Description

I have a lot of routers with r49114, now, after 15 days aprox, some of this routers (about 20), start to reboot constantly (not finish any reboot cicle).... I get one of this and connect on serial port, here is the log:

# TPLink CPE210
Press CTRL+B to enter SafeLoader: 1cated memory for elf s227 bytes)[?25hnWrt kernel loader fo9XXX
Copyrdone!
Starti2 22:03:51 0] bootcons  0.000000] Kernel com board=CPE5o,64k(patio64k(product(firmware) console=ttyS0,115200 000000] PID hash tabl256 (order: -2, 1024 bytes)
[    0.000000] Dentry cache hash table entries: 8192 (order: 3, 32768 bytes)
[    0.000000] Inode-cache hash table entries: 4096 (order: 2, 16384 bytes)
[    0.000000] Writing ErrCtl register=00000000
[    0.000000] Readback ErrCtl register=00000000
[    0915K kernel code, 143K rwdata, 708K rodata, 256K init, 200K bss, 5244K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] NR_IRQS:83
[    0.000000] Clocks: CPU:560.000MHz, DDR:450.000MHz, AHB:225.000MHz, Ref:40.000MHz
[    0.000000] clocksouribrating d table entrorder: 0, 2989] Mount entries: : 0, 4096 b[    0.36   0.369676] TCP estabable entrieonfigured (der: 0, 409tocol family 1
[    0.409499] futex hash table entries: 256 (order: -1, 3072 bytes)
[    0.434203] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.440391] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME) (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[    0.453253] io scheduler ne_baud = 25] bootconso13] m25p80 Creating 8 M000000000000-0x000000020000 : "u-boot"
[    0.553418] 0x0000040000 : "product-info"
[    0.566238] 0x000000040000-0x0000001c0000 : "kernel"
[    0.572168] 0x0000001c0000-0x0000007c0000 : "rootfs029] mtd: device 4 (rootfs) set to be root filesystem
[    0.583880] 1 squashfs-split partitions found on MTD device rootfs
[    0.590175] 0x000000750000-0x0000007c0000 : "rootfs_data"
[   0x0000007c0000-0x0000007f0000 : "config"
[    0.602489] 0x0000007f0000-0x000000800000 : "AR[    0.608110] 0x0000 : "firmware"
[    0.634837] libphy: ag71xx_mdio: probed
[    1.230364] ag71xx-mdio.1: Found an AR934X built-in switch
[ ] eth0: Atheros AG71xx at 0xba000000, irq 5, mode:GMII
81199] NET: Registered protocol family 10
Update your ilter if yo.
[    1.ge firewalling registered
[    1.311479] 8Q VLAN Suppolesystem) readonly on d memory: 256K (80410000 - 80450000)
[    2[    3.54 - preinit -
ess the [f] key and hit [enter] to enter failsafe mode
Press the [1], [2], [3] or [4] key and hit [enter] to select the debug level
5] mount_rookmods from internal overlay
[    7.8: notice: (367) jffs2_complete bu subsystem, 1 of xdatum) found.
[    7.838344] block: attempting to load /tmp/jffs_cfg/upper/etc/config/fstab
[    7.849359] bligured
[    7.895008] jffs2: notice: (363) jffs2_build_xattr_subsystem: complete building xattr subsystem, 1 of xdatum (1 unchecked, 0 orphan) and 1 of xref (0 dead, 0 orphan) found.
[    8.091311] block: attempting to load /tmp/jffs_cfg/upper/etc/config/fstab
[    8.1018xtroot: not
929] mount_ring to jffs2 overlay
3017] procd:  9.237591]his console.
t device chirect actionading moduled from Linu3-gc8fdf68
 by backpor 13.021553]
(946 bucket
[   13.1987ric driver version 2.4[   13.407084] ieee8340 Rev:2 mem=0xb810000DRCONF(NETDice eth0.2 entered promiscuous mod06037] devicred promiscuous mode
[   23DEV_UP): br-guest: lin[   26.538472] Removing MTD device #5 (rootfs_data) with use count 1
[   26.646679] blk_update_request: I/O error, dev mtdblock4, sector 236
[   26.653279] blk_update_request: I/O error, dev mtdblock4, sector 238
[   26.659785] blk_update_request: I/O error, dev mtdblock4, sector 240
[   26.666268] blerror, dev mte_request: I/O error,squashfs_read_data failed to read block 0x1d7740 83b18818 00000008 800a629c 83a434c8 803f2983 80393628 00000135
	  803a4aa4 83b1dd14 803f1140 800a48ac 0000000 00000000 0000 00000000 00000000
	  ...
[   26.889527] Call Trace:
[   26.8072070>] sho0/0x84
[   26.896462] [<80081658>] warn_slowpath_common+0xa0/0xd0
[   26.901768] [<8008170c>] warn_slowpath_null+0x18/0x24
[   26.906899] [<80092464>] __queue_work+0xb8/0x254
[   26.911590] [<80092644>] queue_work_on+0x44/0x6c
[   26.916277] [<80189bc4>] __blk_run_queue+0x44/0x64
[   26.921136] [<8060878>] ret_from_kernel_thread+0x14/0x1c
[ 27.008408]  failed to x3be52
[   27.015729] SQUASHFS error: squS error: Unache entry ta cache entry [584f8a]
[   27.0: reading bFS error: Unable to read metadata cache entry [584f8a]
[   27.103719] SQUASHFS error: read_indexes: reading block [584f8a:1UASHFS errontry [584f817071] SQUAHFS error: Unable to read metadata cache entry [584f8a]
[   27.143794] SQUASHFS error: read_indexes: reading block [584f8a:16ef]
[   27.150356] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27.157155] SQUASHFS error: read_indexes: reading block [584f8a:16ef]
[   27.163715] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27.170524] SQUASHFS error: read_indexes: reading block [584f8a:16ef]
[   27.177065] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27.183869] SQUASHFS error: read_indexes: reading block [584f8a:16ef]
[   27.190426] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27.197221] SQUASHFS error: read_indexes: reading block [584f8a:16ef]
[   27.203780] SQUASHF 27.230500]7.237296] SQUASHFS erroexes: readi4f8a:16ef]
[   27.243858] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27.250666] SQUASHFS error: read_indexes: reading block [584f8a:16ef]
[   27.257210] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27.2irectory bloUnable to read directory block [58953e:1293]
[   27.326899] SQUASHFS error: squashfs_read_data failed to read b

pen user-config failed.
llocated memory for elf segment ok: addr: 0x80060000, size 0x13daeb
Loading .text @ 0xs)
ompressing Sta.0 r49114) ) #1 Sat Apr 2 22:03:51 UTC 2016
[    0.000000] bootconsole [early0] enabled
[    0.000000] CPU0 revision is: 0001974c (MIPS 74Kc)
[    0.000000] SoC: Atheros AR9344 rev ermined physical RAM m.000000] Inund or empty - disablch node
[ anges
[   00000000000000-0x0000000003ffffff]
[    0.000000] Initmem setup node 0 [mem 0x000000000000000003ffffff]
[    0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32 bytes.
[    0.000000] Primary data cache 32kB, 4-way, VIPT, cache aliaslists in Zoobility grouping on. 0] Kernel uct-info)roe) console,jffs2 noin
[    0.0UB: HWalign000] Clocks: CPU:560.000MHz, DDR:450.000MHz, AHB:225.000MHz, Ref:fffff max_cycles: 0xfolution 3ns, wraps ev382ns
[    0.008261] Calibrating delay loop... 278.93 BogoMIPS (lpj=1394688)
[    0.081010] pid_max: default: 32768 minimum: 301
[    0.086030] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.092989] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.103418] clocksour mask: 0xffffffff max_cycles: 0x 1911260446114985] NET: Registered protocol family 16
 CPE210/220/510/520
[    0.358554] Switched to clocksource MIPS
[    0.364001] NET: Registered protocol family 2
[    0.369651] TCP established hash table entries: 1024 (order: 0, 4096 bytes)
[    0.376994] TCP bind hash table entries: 1024 (order: 0, 4096 bytes)
[    0.383785] TCP:  (established 1024 bi    0.390572] UDP hash table entries: 256 (order: 0, 4096 bytes)
[    0.396719] UDP-Lite hash table entries: 256 (order: 0, 4096 [    0.403708] NET: R[    2009/01/31) jffs2: ver[    0.rootfs) setfound on MTD device roo0000-0x000000800000 : "ART"
[    0-0x0000007c0000 : "firmware"
4805] libphy: ag71xx_mdtheros AG71egistered prring via arur scripts to load br_netfilter if you need this.
[    pport v1.8
43] Freeing unused kernel memory: 00 - 80450000)
[    2.464892] init: - watchdogit -
[    4.18 ADDRCONF(NEom read wit entropy available
e [1], [2], [3] or [4]  [enter] to select the debug level internal ofs2: notice:: complete tum (1 unchecked, 0 orphan) and 1 ead, 0 orphan) found.
[    7.843323] block: attempting to load /tmp/jffs_cfg/upper/etc/config/fstab
[    7.854272] block: extroot: not configured
: notice: (complete building xattr subsystem,644] Mirror/les backported from Lin4.4-rc5-191
[   12.987t generated.0 (946 buckets, 3784 m[   23.176813] IPv6: ADDRCONF(NETDEV_UP): eth0: link r, dev mtdblt_connbytes xt_comment xt_TCPMSS xt_REDIRECT 000
	  00000000 80450000 000000000000 00000000 00000000
	  00000000 00000000 00000000 00000000 00000000 00000000 00000000 Call Trace:
[   26.946743] [<80072070>] show_stack+0x50/0x84
[   26.951180] [<80081658>] warn_slowpath_common+0xa0/0xd0
[   26.956487] [<8008170c>] warn_slowpath_null+0x18/0x24
[   26.961620] [<80092464>] __queue_work+0xb8/0x254
[   26.966308] [<80092644>] queue_work_on+0x44/0x6c
[   26.971002] [<80189bc4>] __blk_run_queue+0x44/0x64
[   26.975872] [<8018d6fc>] blk_queue_bio+0x210/0x234
[   26.980738] [<8018b768>] generic_make_request+0x84/0xc4
[   26.986044] [<8018b844>] submit_bio+0x9c/0x148
[   26.990560] [<8012c61c>] _submit_bh+0x1a0/0x1d8
[   26.995160] [<8012cc44>] ll_rw_block+0xf0/0x130
[   26.999788] [<80155700>] squashfs_read_data+0x4ec/0x6dc
[   27.005089] [<80159490>] squashfs_readpage_block+0x2e8/0x470
[   27.010838] [<801571c8>] squashfs_readpage+0x598/0x688
[   27.016071] [<800ce808>] filemap_fault+0x3b4/0x45c
[   27.020947] [<800e81b0>] __do_fault+0x3c/0xa8
[   27.025375] [<800eb064>] handle_mm_fault+0x300/0xb5c
[   27.030425] [<80076dd0>] __do_page_fault+0x130/0x450
[   27.035466] [<80060820>] ret_from_exception+0x0/0x10
[   27.040519] [<80064e70>] __bzero+0x14/0x164
[   27.044775] [<80140ca8>] padzero+0x4c/0x64
[   2701417c4>] l7.054081] [0x8c/0x1c4
 [<80104cccr+0x8c/0x1c4
[   27.069735] [<8010604c>] do_execveat_common+0x3f8/0x5a0
[   27.075032] 
[   27.076548] ---[ end trace b8718055c65dc84a ]---
[   27.084516] SQUASHFS error: squashfs_read_data failed to read block 0x584f8a
[   27.091708] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27.0985or: Unable to read meta111897] SQUASHFS error: read_indexes: reading 27.125254]27.145156]  metadata cache entry [] SQUASHFS error: read_f]
[   27.171879] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27.17FS error: read_indexes:16ef]
[   27.185232]
[   27.198FS error: Un   27.20539_indexes: reading block [584f8a:16ef]
[   27.211957] SQUASHFS error: Unable tota cache entry [584f8a]
[   27.218766] SQUASHFS error: read_indexes: reading block [584f8etadata cache entry [584f8a]
[   27.232120] SQUASHFS errFS error: Ucache entryeading block [584f8a:16ef]
[   27.252037] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27.258842] SQUASHFS error: read_indexes: reading block [584f8a:16ef]
[   27.265391] SQUASHFS 
[   27.285565] SQUASHFS error: read_indexes: reading block [584f8a:16ef]
[   27.292125] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27ASHFS error: read_indexes: reading block [584f8a:16ef]
75] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[  SQUASHFS error: read_indexes: reading block [584f8a:16ef]
[   27.318847] SQUASHFS error: Unable to read metadata cache entry [584f8a]
[   27.325640] SQUASHFS error: read_indexes: reading blle to read metadata cache entry [586a90]
[   27.346225] SQUASHFS error: Unable to read directory block [586a90:1e13]
[   27.353115] SQUASHFS error: Unable to read metadata cache entry [586a90]
[   27.359934] SQU: Unable to read directory block [586a90:19f3]
[   27.366758] SQUAS63]
[   27.400738] SQUASHFS error: Unable to read metadata cache entry [586a90]
[   27.407546] SQUASHFS error: Unable to read directory block [586a90:1e13]
[   27.429206]  entry [586r: Unable to read directory block [586a90:1863]
[   27.446868] SQUASHFS error: Unable to read metadata cache entry [586a90]
[   27.453752] SQUASHFS error: Unable to read directorest: I/O ere_request: I/O error, dquashfs_reaQUASHFS error: Unable to read page, block ae4a6, size 1f5b8
[   27.508936] SQUASHFS error: Unable to read fragment cache entry [ae4a6]
[   27.515640] SQUASHFS error: Unable to read page, block ae4a6, size 1f5b8
[   27.522469] SQUASHFS error: Unable to read fragment cache entry [ae4a6]
[   27.529186] SQUASHFS error: Unable to read page, block ae4a6, size 1f5b8
[   27.555640] reboot: Restarting system

I have some TPLink WDR3500 and at least 2 TpLink CPE210 with this problem.

I reset this routers and all work fine.... until some days (10 to 15 days) after and all happen again.

You knew if this is resolved in some revision after that revision (from april 2)?
I used ImageBuilder with this revision to make my onw bin.

I try to reset some of this routers, reboot every 2 minutes to test if happend again and cant reproduce in lab :(

Any other test to make?

# TPLink WDR3500
....
[   24.687561] device eth0 entered promiscuous mode
[   24.763067] IPv6: ADDRCONF(NETDEV_UP): br-lan: link is not ready
[   24.887045] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   24.913384] IPv6: ADDRCONF(NETDEV_UP): br-guest: link is not ready
[   25.239087] Removing MTD device #3 (rootfs_data) with use count 1
[   25.279296] blk_update_request: I/O error, dev mtdblock2, sector 8768
[   25.285863] blk_update_request: I/O error, dev mtdblock2, sector 8770
[   25.292460] blk_update_request: I/O error, dev mtdblock2, sector 8772
[   25.299028] blk_update_request: I/O error, dev mtdblock2, sector 8774
[   25.305571] blk_update_request: I/O error, dev mtdblock2, sector 8776
[   25.312135] blk_update_request: I/O error, dev mtdblock2, sector 8778
[   25.318681] blk_update_request: I/O error, dev mtdblock2, sector 8780
[   25.325238] blk_update_request: I/O error, dev mtdblock2, sector 8782
[   25.331809] blk_update_request: I/O error, dev mtdblock2, sector 8784
[   25.338350] blk_update_request: I/O error, dev mtdblock2, sector 8786
[   25.345716] SQUASHFS error: squashfs_read_data failed to read block 0x44830a
[   25.596968] SQUASHFS error: squashfs_read_data failed to read block 0x44830a
[   25.604233] SQUASHFS error: squashfs_read_data failed to read block 0x5e052e
[   25.611418] SQUASHFS error: Unable to read metadata cache entry [5e052e]
[   25.618217] SQUASHFS error: Unable to read directory block [5e052e:1843]
[   25.625433] SQUASHFS error: Unable to read metadata cache entry [5e052e]
[   25.632270] SQUASHFS error: Unable to read directory block [5e052e:1843]
[   25.643178] reboot: Restarting system

Attachments (0)

Change History (2)

comment:1 Changed 20 months ago by anonymous

Is something filling your flash and after 12-15days there is no free space left anymore? I am on r49296 and my WNDR3800 runs fine since 27 days now.

comment:2 Changed 20 months ago by gazambuja

I dont think this are the problem... I have others routers with the same version and more traffic without problem.... How I can be sure? df command show 37% space left in /

Add Comment

Modify Ticket

Action
as new .
Author


E-mail address and user name can be saved in the Preferences.

 
Note: See TracTickets for help on using tickets.