+ Y5 \& C$ B5 K) ?+ c, x3 z
Jan 14 04:06:25 localhost kernel: [9821120.248545] ------------[ cut here ]------------
- j% Z9 l; y% `% Y( ^Jan 14 04:06:25 localhost kernel: [9821120.248573] WARNING: CPU: 2 PID: 13942 at fs/dcache.c:362 d_shrink_del+0x2c/0x6e()
2 }2 _! X- n, M1 I) WJan 14 04:06:25 localhost kernel: [9821120.248584] Modules linked in: deflate ctr twofish_generic twofish_x86_64_3way twofish_x86_64 twofish_common camellia_generic serpent_sse2_x86_64 ablk_helper cryptd glue_helper lrw serpent_generic xts gf128mul blowfish_ge
; d4 f" r/ H. O, P) j! Y: rneric blowfish_x86_64 blowfish_common cast5_generic cast_common des_generic cbc xcbc rmd160 sha512_generic sha256_generic crypto_null xfrm_user xfrm4_tunnel tunnel4 ipcomp xfrm_ipcomp esp4 ah4 af_key xfrm_algo 8021q mrp garp stp llc cls_u32 sch_htb xt_nat xt_LOG xt_comm
* H; z3 Z' K" l; R2 i; G( zent nf_conntrack_netlink iptable_nat nf_nat_ipv4 ip6table_filter ip6table_raw ip6_tables iptable_filter nf_conntrack_ipv4 nf_defrag_ipv4 xt_CT nfnetlink_cthelper nfnetlink iptable_raw nf_nat_pptp nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_h323 nf_conntrack_h323 nf_# ]& \% v! l5 y& v
nat_sip nf_conntrack_sip nf_nat_proto_gre nf_nat_tftp nf_nat_ftp nf_nat nf_conntrack_tftp nf_conntrack_ftp nf_conntrack cpufreq_userspace cpufreq_stats cpufreq_powersave cpufreq_ondemand cpufreq_conservative ipv6 fuse i2c_piix4 i2
% Q4 l+ y" M5 S' |4 E2 aJan 14 04:06:25 localhost kernel: [9821120.249030] CPU: 2 PID: 13942 Comm: sh Not tainted 3.13.11-1-amd64-vyos #18 ~5 M M: c( t9 L% q- F- a0 O
Jan 14 04:06:25 localhost kernel: [9821120.249043] Hardware name: Alcatel-Lucent ACCS NFV r1.0 HA, BIOS 0.5.1 01/01/20112 V9 N: x9 v8 W, v$ r
Jan 14 04:06:25 localhost kernel: [9821120.249054] 0000000000000000 ffffffff814f58a3 ffffffff813eb0b1 0000000000000000
\3 s' i% n6 a; K: C2 N- x* [( cJan 14 04:06:25 localhost kernel: [9821120.249125] ffffffff8104a614 ffff880215609380 ffffffff81133665 ffffffff813edfd2# k L* N; u1 d
Jan 14 04:06:25 localhost kernel: [9821120.249143] ffff880080cc66c0 ffff880080cc6718 ffff880231b1dce0 ffff880231b1dca0/ \1 G* @* O+ j# H) A
Jan 14 04:06:25 localhost kernel: [9821120.249161] Call Trace:0 ^2 X) K3 \7 N" n$ k
Jan 14 04:06:25 localhost kernel: [9821120.249183] [<ffffffff813eb0b1>] ? dump_stack+0x41/0x58
( B! }. o4 i: J; W s/ f8 aJan 14 04:06:25 localhost kernel: [9821120.249208] [<ffffffff8104a614>] ? warn_slowpath_common+0x79/0x92# t* U+ h! B) k7 j; G
Jan 14 04:06:25 localhost kernel: [9821120.249230] [<ffffffff81133665>] ? d_shrink_del+0x2c/0x6e; p; r4 |: Y7 J* r) ?. z0 u
Jan 14 04:06:25 localhost kernel: [9821120.249250] [<ffffffff813edfd2>] ? _raw_spin_unlock+0x5/0x6% B3 @1 Z9 C& ]+ ?. I
Jan 14 04:06:25 localhost kernel: [9821120.249273] [<ffffffff81133665>] ? d_shrink_del+0x2c/0x6e0 d2 N4 T" `# t# W: ?# N Z& X9 P/ d
Jan 14 04:06:25 localhost kernel: [9821120.249295] [<ffffffff81134667>] ? shrink_dentry_list+0x51/0xc6& K: N9 e3 I: `. x! E: Y v
Jan 14 04:06:25 localhost kernel: [9821120.249315] [<ffffffff813edfd2>] ? _raw_spin_unlock+0x5/0x6
6 @2 ?% w2 K, [6 S' ]' b6 c/ X* y1 MJan 14 04:06:25 localhost kernel: [9821120.249339] [<ffffffff811347a5>] ? shrinJan 14 03:30:34 localhost kernel: [ 0.000000] Linux version 3.13.11-1-amd64-vyos (jenkins@squeeze64devel) (gcc version 4.4.5 (Debian 4.4.5-8) ) #1 SMP Wed Aug 12 02:08:05 UTC 20150 t6 Q' Z, D. w( [" ^# T C7 H5 y) ^1 q
Jan 14 03:30:34 localhost kernel: [ 0.000000] ACPI: RSDP 00000000000f70d0 000014 (v00 BOCHS )
$ W; X- D! G8 l8 ]Jan 14 03:30:34 localhost kernel: [ 0.000000] ACPI: RSDT 00000000bffff70a 00002C (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001)
4 o$ T# d7 m2 R& e* h$ QJan 14 03:30:34 localhost kernel: [ 0.000000] ACPI: FACP 00000000bffff606 000074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001)+ ?. q7 ]; t* t- u2 F4 e) o: ?4 C
Jan 14 03:30:34 localhost kernel: [ 0.000000] ACPI: DSDT 00000000bfffe040 0015C6 (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001)
7 j" l# H4 C1 r. [% SJan 14 03:30:34 localhost kernel: [ 0.000000] ACPI: FACS 00000000bfffe000 0000402 T% i. u6 U2 X! L) v
Jan 14 03:30:34 localhost kernel: [ 0.000000] ACPI: APIC 00000000bffff67a 000090 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001)1 [; l) P& A/ Y( A
Jan 14 03:30:34 localhost kernel: [ 0.000000] Zone ranges:/ W0 H5 X' _6 j+ ?$ T7 k+ ~
Jan 14 03:30:34 localhost kernel: [ 0.000000] DMA [mem 0x00001000-0x00ffffff]
1 u6 e! } I$ @0 w0 LJan 14 03:30:34 localhost kernel: [ 0.000000] DMA32 [mem 0x01000000-0xffffffff]; }$ L/ J; U+ |- s% T
Jan 14 03:30:34 localhost kernel: [ 0.000000] Normal [mem 0x100000000-0x23fffffff]8 \; } e. b! P) |# y2 q9 Y8 {
Jan 14 03:30:34 localhost kernel: [ 0.000000] Movable zone start for each node
7 [ ~# T5 F2 Y5 [2 N2 L- hJan 14 03:30:34 localhost kernel: [ 0.000000] Early memory node ranges8 Q& R$ j3 d7 G$ N6 i, |
Jan 14 03:30:34 localhost kernel: [ 0.000000] node 0: [mem 0x00001000-0x0009efff]5 Y1 m8 E$ M9 F8 O) m- z2 v
Jan 14 03:30:34 localhost kernel: [ 0.000000] node 0: [mem 0x00100000-0xbfff9fff]: ]4 |, O% }, R4 o
Jan 14 03:30:34 localhost kernel: [ 0.000000] node 0: [mem 0x100000000-0x23fffffff]
( D5 S! r) G7 pJan 14 03:30:34 localhost kernel: [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 20642580 J; ^ Q$ L9 w! M
Jan 14 03:30:34 localhost kernel: [ 0.000000] Policy zone: Normal
. l0 B& S5 R% X( j# EJan 14 03:30:34 localhost kernel: [ 0.000000] Kernel command line: BOOT_IMAGE=/boot/1.1.7/vmlinuz boot=live quiet vyatta-union=/boot/1.1.7 console=ttyS0,9600 console=tty0; O" g+ S: |2 f, ^/ ?
Jan 14 03:30:34 localhost kernel: [ 0.000000] Memory: 8167636K/8388192K available (4043K kernel code, 594K rwdata, 1652K rodata, 976K init, 700K bss, 220556K reserved)- Z3 w) R; J+ R d
Jan 14 03:30:34 localhost kernel: [ 0.040964] ACPI: All ACPI Tables successfully acquired5 L5 s/ r5 e6 M
Jan 14 03:30:34 localhost kernel: [ 0.050000] Failed to access perfctr msr (MSR c1 is 0)! R, Z' c0 u! u/ J( R
Jan 14 03:30:34 localhost kernel: [ 0.142534] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20131115/hwxface-580)7 q* q: i4 l/ J; x" u: a) a
Jan 14 03:30:34 localhost kernel: [ 0.142541] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20131115/hwxface-580)
0 M! t4 Q- o9 U& oJan 14 03:30:34 localhost kernel: [ 0.142545] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S3_] (20131115/hwxface-580)
- q O5 O4 E9 f$ a1 \* wJan 14 03:30:34 localhost kernel: [ 0.142549] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S4_] (20131115/hwxface-580)
3 L- E! r4 L# s( C( QJan 14 03:30:34 localhost kernel: [ 0.150892] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge." T( x7 {2 O/ g# B3 s/ V
Jan 14 03:30:34 localhost kernel: [ 0.443990] ACPI: Enabled 3 GPEs in block 00 to 0F& Q2 j/ |: p0 A8 H9 O
Jan 14 03:30:34 localhost kernel: [ 0.444104] SCSI subsystem initialized
( I9 ?; I; H' ^Jan 14 03:30:34 localhost kernel: [ 0.532368] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11; v" i! X' S: m) ]! n6 ?
Jan 14 03:30:34 localhost kernel: [ 1.028215] type=2000 audit(1578972622.313:1): initialized
; t$ W' t, Z: o4 FJan 14 03:30:34 localhost kernel: [ 1.029615] bounce pool size: 64 pages
) _- J; l+ B' O- C) J9 }- S2 k5 OJan 14 03:30:34 localhost kernel: [ 1.138358] Key type dns_resolver registered
6 B4 }# _; e5 k F+ fJan 14 03:30:34 localhost kernel: [ 1.244013] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10
# }5 r; \6 `+ yJan 14 03:30:34 localhost kernel: [ 1.357808] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
# G9 x+ G' \, T7 fJan 14 03:30:34 localhost kernel: [ 2.040051] raid6: sse2x1 4639 MB/s5 p/ g) m2 B* P1 u
Jan 14 03:30:34 localhost kernel: [ 2.210027] raid6: sse2x2 6362 MB/s
5 `/ ~6 F" m$ b+ ]9 b7 `; C' \Jan 14 03:30:34 localhost kernel: [ 2.380032] raid6: sse2x4 7357 MB/s" V z% J; k! G1 ^
Jan 14 03:30:34 localhost kernel: [ 2.380037] raid6: using algorithm sse2x4 (7357 MB/s)
$ T. S( ~* [9 L7 \/ qJan 14 03:30:34 localhost kernel: [ 2.380040] raid6: using intx1 recovery algorithm7 z9 w' b2 {+ B
Jan 14 03:30:34 localhost kernel: [ 8.178340] EXT4-fs (vda1): warning: checktime reached, running e2fsck is recommended
, x, p5 Z3 ?5 W. N6 I# H; C; IJan 14 03:30:34 localhost kernel: [ 9.087041] random: debconf-communi urandom read with 25 bits of entropy available
8 W2 Z1 V% s4 C5 P4 zJan 14 03:30:34 localhost kernel: [ 10.625650] platform microcode: Direct firmware load failed with error -2
% ?4 u4 {0 L1 ~- WJan 14 03:30:34 localhost kernel: [ 10.625654] platform microcode: Falling back to user helper Z! C# }5 `8 x5 A* e
Jan 14 03:30:34 localhost kernel: [ 10.652304] platform microcode: Direct firmware load failed with error -2
$ j/ Z% B6 Y/ S' A, _+ E4 w) BJan 14 03:30:34 localhost kernel: [ 10.652309] platform microcode: Falling back to user helper
# y; X0 P( q" F. R0 ~Jan 14 03:30:34 localhost kernel: [ 10.661767] platform microcode: Direct firmware load failed with error -27 G* o- s. {+ `) ~% k/ }) s
Jan 14 03:30:34 localhost kernel: [ 10.661771] platform microcode: Falling back to user helper
8 Q, m% X" g; D2 |Jan 14 03:30:34 localhost kernel: [ 10.669655] platform microcode: Direct firmware load failed with error -2
$ \. l! Z' ^% R0 ?( x; vJan 14 03:30:34 localhost kernel: [ 10.669658] platform microcode: Falling back to user helper. @" u$ u# t7 A t
Jan 14 03:30:34 localhost nrpe[2151]: Starting up daemon
, ]& W; C' E/ v, E: \Jan 14 03:30:34 localhost nrpe[2151]: Network server bind failure (99: Cannot assign requested address)3 H# Z( C4 R8 w$ Z
Jan 14 03:30:34 localhost zebra[2157]: Zebra 0.99.20.1 starting: vty@06 E; c5 t; J$ t
Jan 14 03:30:34 localhost ripd[2168]: RIPd 0.99.20.1 starting: vty@0
; i7 p7 y2 l. a! a8 wJan 14 03:30:34 localhost ripngd[2170]: RIPNGd 0.99.20.1 starting: vty@0
% o5 q* A5 Q G f) JJan 14 03:30:34 localhost ospfd[2172]: OSPFd 0.99.20.1 starting: vty@0
( }6 q3 ]' |$ b8 SJan 14 03:30:34 localhost ospf6d[2174]: OSPF6d (Quagga-0.99.20.1 ospf6d-0.9.7r) starts: vty@0
3 M4 |2 @. e0 nJan 14 03:30:34 localhost bgpd[2176]: BGPd 0.99.20.1 starting: vty@0, bgp@<all>:179$ _: g8 ~. B, B2 C7 y' ^& \
Jan 14 03:30:37 localhost zebra[2157]: interface eth0 index 2 changed <UP,BROADCAST,RUNNING,MULTICAST>.3 g: M( S; F% q
Jan 14 03:30:38 localhost kernel: [ 17.283749] sshd (2567): /proc/2567/oom_adj is deprecated, please use /proc/2567/oom_score_adj instead.
# [! v* D6 A: i+ b# g8 y# n
8 W2 r1 i+ B, Z7 ]4 S( q5 n
, Y1 S% c& d. f f- W, S! A( ]
% y* |: A3 [/ S# f现象：
% t8 v/ `9 J5 y1 Q3 S8 u三个措施。' g& @& D% J& u' p% c: u1 U
1、增大内存$ n$ Q6 m1 X, X* L" F1 x
从12GB增大到16GB。
+ M# }. a+ ` ~/ o3 b; n d; hvirsh setmaxmem vgfsxxx 16GB --config
( Y* w, p& S" Q$ _. [运行启动后
( t7 c. ?' B' u; V, Fvirsh setmem vgfsxxx 16GB0 j( H* o8 g4 d, p8 y
这个没有用，跑了几次测试后，仍然掉服务。 2、调整lwfsd的服务优先级% L! d0 w! R' q! R: A
设置lwfsd的服务优先级为“-17”
& K/ f. p0 g. C" X: S1 g jPID=`ps | grep lwfs | grep -v grep | awk '{print $1}'`
# b$ U: D, U! R" A+ Becho -17 > /proc/$PID/oom_adj
: |: w I: M$ ?( T; Becho -17 > /proc/$PID/task/$PID/oom_adj# p, k" X; N6 n. K
这个好像有用。 3、修改内存分配策略. h+ K) f1 G( I% X4 X# ?
并且echo "2" >/proc/sys/vm/overcommit_memory，使得分配内存时，必须存在足够的空间用于映射。$ _: v9 }' { s* B( z: o
这个好像也有一定的用处。再跑跑试试。 & Y) G8 z Z0 m; W" S7 |" R3 A# E
|
发表于 2020-1-15 09:00:03