易陆发现互联网技术论坛

 找回密码
 开始注册
查看: 724|回复: 2
收起左侧

kernel:watchdog: BUG: soft lockup - CPU#4 stuck for 21s!

[复制链接]
发表于 2022-6-10 19:51:08 | 显示全部楼层 |阅读模式

马上注册,结交更多好友,享用更多功能,让你轻松玩转社区。

您需要 登录 才可以下载或查看,没有账号?开始注册

x
kernel:watchdog: BUG: soft lockup - CPU#4 stuck for 21s!
* c1 d2 R' W$ ?% }2 e. [Jun 10 19:44:22 compute01 kernel: EDAC MC1: 32353 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
1 Z; _+ L* l( c! p6 v/ cJun 10 19:44:23 compute01 kernel: EDAC MC1: 1539 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
6 e4 _7 a7 I. s/ gJun 10 19:44:24 compute01 kernel: EDAC MC1: 32267 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
% |  ]$ M( B8 o5 c& C. K6 ~) |Jun 10 19:44:25 compute01 kernel: EDAC MC1: 32271 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
/ A' B' X' T% t' S- h4 OJun 10 19:44:26 compute01 kernel: EDAC MC1: 32324 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)$ M9 t) F9 b' E  R: j
Jun 10 19:44:27 compute01 kernel: EDAC MC1: 1306 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
4 r6 y4 S& g8 f( U+ q. ~Jun 10 19:44:28 compute01 kernel: EDAC MC1: 31262 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)5 A& N8 X" N- ~5 T  Q7 ]4 j0 S
Jun 10 19:44:29 compute01 kernel: EDAC MC1: 1303 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
4 U8 H  I; @+ ]/ H* GJun 10 19:44:30 compute01 kernel: EDAC MC1: 31738 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)$ b5 P# }4 W7 e: u8 D
Jun 10 19:44:31 compute01 kernel: EDAC MC1: 32400 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
% W% r6 r/ a) z0 xJun 10 19:44:32 compute01 kernel: EDAC MC1: 1754 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
: C; y$ H1 L5 hJun 10 19:44:33 compute01 kernel: EDAC MC1: 32213 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0), R+ O5 S" I3 C( C  Q+ d
Jun 10 19:44:34 compute01 kernel: EDAC MC1: 32034 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
* G0 k( d. d3 J# D2 iJun 10 19:44:35 compute01 kernel: EDAC MC1: 32453 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
) O- d' f2 X/ J' e  h) \/ T" Y: t
7 P$ I) l, C! N7 G' e
$ P7 p8 Y( H9 Y5 G) _6 h( JHow to solve EDAC DIMM CE Error$ More /var/log/messageJul 21 08:54:32 customerkernel: EDAC MC1: 5486 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:33 customerkernel: EDAC MC1: 11480 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:34 customerkernel: EDAC MC1: 11330 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:35 customerkernel: EDAC MC1: 6584 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:36 customerkernel: EDAC MC1: 27428 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:37 customerkernel: EDAC MC1: 30113 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:38 customerkernel: EDAC MC1: 4453 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:39 ​​customerkernel: EDAC MC1: 6269 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:40 customer kernel: EDAC MC1: 15720 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1 page: 0x0offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:41 customerkernel: EDAC MC1: 16107 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Analysis and solution:, T# |! o7 q) c" P9 Y5 W3 A
This is [EDAC (Error Detection AndCorrection] (https://www.kernel.org/doc/Documentation/edac.txt) logs.8 N, E3 D% Y! x& }* `! x
CE Error Correctable Error is referred to, in addition to UE (Uncorrectable Error)% K" s) Y- B8 [9 W+ B$ [: p' t
According to the above documents, identify errors DIMM:; D9 Z/ a; Q: a& Q
[root @ the Customer log] # grep "[0-9]" / SYS / Devices / System / EDAC / MC / MC * / csrow * / * CH _ce_count/ Sys / devices / system / edac / mc / mc0 / csrow0 / ch0_ce_count: 0/ Sys / devices / system / edac / mc / mc0 / csrow0 / ch1_ce_count: 0/ Sys / devices / system / edac / mc / mc0 / csrow0 / ch2_ce_count: 0/ Sys / devices / system / edac / mc / mc0 / csrow1 / ch0_ce_count: 0/ Sys / devices / system / edac / mc / mc0 / csrow1 / ch1_ce_count: 0/ Sys / devices / system / edac / mc / mc0 / csrow1 / ch2_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow0 / ch0_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow0 / ch1_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow0 / ch2_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow1 / ch0_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow1 / ch1_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow1 / ch2_ce_count: 554836518Found errors in /mc1/csrow1/ch2, according to the chart:; O: O- j$ _1 v
       Channel 0 Channel 1===================================csrow0 | DIMM_A0 | DIMM_B0 |csrow1 | DIMM_A0 | DIMM_B0 |======================================================================csrow2 | DIMM_A1 | DIMM_B1 |csrow3 | DIMM_A1 | DIMM_B1 |===================================From dmidecode info:
. Z6 t  u5 O& c+ m" g  ][Root @ customer log] # dmidecode -t memory | grep 'Locator: DIMM'       Locator: DIMM_D0       Locator: DIMM_D1       Locator: DIMM_E0       Locator: DIMM_E1       Locator: DIMM_F0       Locator: DIMM_F1       Locator: DIMM_A0       Locator: DIMM_A1       Locator: DIMM_B0       Locator: DIMM_B1       Locator: DIMM_C0       Locator: DIMM_C1From server console to find the memory info:

5 {9 X+ S' g2 C# y- K                               
登录/注册后可看大图
. c5 C* e2 X  J$ K" J
Memory slot on the motherboard of distribution:
1 y8 Q5 y  A% r1 ^$ J
                               
登录/注册后可看大图

# @* ], {3 V8 G- J2 `4 lCombined error log: kernel: EDAC MC1: 16107 CE error on CPU # 1Channel #2_DIMM # ​​1 (channel: 2slot: 1 DIMM_F1 memory slots should be a problem.. [; B! n1 g, H% ?5 T+ W
Solution: Finally, what we need to do is to replace F1 memory slot, after the system reboot the memory issue is no longer happening.
; R9 w- K! ]6 L( q
 楼主| 发表于 2022-6-10 19:55:29 | 显示全部楼层
跑大量高负载程序,造成cpu soft lockup。5 h& ~+ I7 C; \. h, F4 y
Soft lockup就是内核软死锁,这个bug没有让系统彻底死机,但是若干个进程(或者kernel thread)被锁死在了某个状态(一般在内核区域),很多情况下这个是由于内核锁的使用的问题。
( M2 E7 U* Z, \! V0 [9 J! R" o解决办法:1 }: f  a# c) s0 f( [  I

+ w8 B6 ~$ ?  w7 c+ T/ ^/ c% C  Z#!/bin/bash% g9 j% u6 ^  y7 Z
#修改阈值为30,写入文件
& r! I, m8 c& E- l) recho 30 > /proc/sys/kernel/watchdog_thresh
2 @% f: |3 l7 O" J( T6 p! `$ @. C#修改阈值为30,临时生效
% M. k' W  W5 U- Jsysctl -w kernel.watchdog_thresh=30% ?+ E: z: A' @  U2 i0 J: _

0 c$ W4 Z- D0 Q7 y  C, r#修改阈值为30,写入启动文件2 `% N; o2 X4 C" a" G
grep 'watchdog_thresh' /etc/sysctl.conf7 M3 o. w/ B0 P+ b5 y" w
if [ $? -ne 0 ]; then
+ O* W. p( T  U( ^        echo "kernel.watchdog_thresh=30" >> /etc/sysctl.conf
! ?9 c$ A4 N  _else% r: Y: s( d8 x" `& j4 X) s
        echo "正常"
" Y) e, J/ Q' Ofi) `5 ~1 e: `$ R$ l' \) A* B, }
 楼主| 发表于 2022-6-10 21:30:15 | 显示全部楼层
[root@compute01 ~]# grep [0-9] /sys/devices/system/edac/mc/mc*/csrow*/ch*_ce_count
  g6 u, R& Z; }# e$ V/sys/devices/system/edac/mc/mc0/csrow0/ch0_ce_count:0
# U2 t& J7 x4 x6 k) j/sys/devices/system/edac/mc/mc0/csrow0/ch1_ce_count:02 w5 a8 c' r$ \5 I( e7 R
/sys/devices/system/edac/mc/mc0/csrow0/ch2_ce_count:0/ x; I' d, [# y) @, E% X; G/ S
/sys/devices/system/edac/mc/mc1/csrow0/ch0_ce_count:0+ L% s; v! q" i3 Q2 ^0 C, E
/sys/devices/system/edac/mc/mc1/csrow0/ch1_ce_count:176451434
8 ^1 z1 |2 Q4 N0 }1 j4 y/sys/devices/system/edac/mc/mc1/csrow0/ch2_ce_count:0( A! X. s9 d: Q0 J! D% G- W
[root@compute01 ~]# cd /var/log/
7 x. \+ D& o. }0 [[root@compute01 log]# grep [0-9] /sys/devices/system/edac/mc/mc*/csrow*/ch*_ce_count
& f5 s5 \9 N. P, p5 T/sys/devices/system/edac/mc/mc0/csrow0/ch0_ce_count:0( U0 F7 ?% N) @
/sys/devices/system/edac/mc/mc0/csrow0/ch1_ce_count:0# _+ @' T. q* D8 E* S/ `
/sys/devices/system/edac/mc/mc0/csrow0/ch2_ce_count:0
: X" Z" {, H1 \( D1 u3 X/sys/devices/system/edac/mc/mc1/csrow0/ch0_ce_count:08 ?& U; H4 F9 H; z' `1 E$ ~
/sys/devices/system/edac/mc/mc1/csrow0/ch1_ce_count:176582143
0 d4 t$ `/ @) L3 E; X/ D: I/sys/devices/system/edac/mc/mc1/csrow0/ch2_ce_count:0
2 j! V& R6 X' V& j0 |6 f- Y3 Z4 k& R2 h1 l$ g' D: ~

% t: J6 o6 z1 g& l8 z9 ]: A[root@compute01 log]# dmesg|grep -i error
9 m7 m, R2 S( f* J2 Q[15469.396093] core: [Hardware Error]: Machine check events logged
1 x9 s5 A' ~2 A2 k# c+ Z: k[15469.397553] EDAC MC1: 628 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)7 y( f8 ~" h3 Z# @
[15470.420162] EDAC MC1: 338 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
* ?/ H' o% V/ |' z[15471.444203] EDAC MC1: 916 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)4 {: n5 a6 Q! |7 `( f
[15472.404252] EDAC MC1: 31437 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
& w( F  }0 m4 M[15473.428264] EDAC MC1: 628 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0); }. N. J# a' k0 M
[15474.388309] EDAC MC1: 632 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0): L- T+ a+ j$ {
[15475.412425] EDAC MC1: 31414 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)1 [4 M: j# J7 ]. W. u
[15476.436453] EDAC MC1: 900 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)2 S3 J* j: T/ l& G) w1 K
[15477.396476] EDAC MC1: 31373 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0), _# f: @* R3 Y
[15478.420523] EDAC MC1: 669 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)  O4 B4 M( s6 V" w7 S1 I0 _6 Y
[15479.444574] EDAC MC1: 612 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
" Q5 V8 o: A4 X$ s6 d! x5 H/ g[15480.404592] EDAC MC1: 31720 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)( R. s6 |4 \1 F8 g& q
[15481.428631] EDAC MC1: 737 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)+ E, I) [& l  S* D+ z' ^  i
[15482.388697] EDAC MC1: 438 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
: H+ y1 _8 o% k$ L5 x[15483.412732] EDAC MC1: 31431 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
/ t: W5 I" Q( w% I* ]1 y[15484.436806] EDAC MC1: 1150 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)  N1 K$ t: F( }
[15485.396805] EDAC MC1: 787 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)/ {" ^4 O6 w  I
[15486.420854] EDAC MC1: 31724 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
( ?' K4 i! f3 D# w" T; ^, }[15487.444923] EDAC MC1: 486 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
& J$ {( j  q/ K; o5 e: D[15488.528020] EDAC MC1: 31286 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)+ e8 m' N" n; W$ X" r% Z
[15489.428983] EDAC MC1: 595 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
& r7 E/ A; v- o0 }  I0 v[15490.389063] EDAC MC1: 482 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
5 D9 {$ g& g1 V4 q& _! \0 b[15491.413089] EDAC MC1: 800 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)9 n* X( r4 F1 i' d, s4 h" Q
[15492.437122] EDAC MC1: 31383 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
+ C4 ^& m& f4 r0 z- X' w[15493.397162] EDAC MC1: 626 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)! F+ B6 ?# e8 R7 w
[15494.421250] EDAC MC1: 475 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0); O. a9 C, C# S. A
[15495.445313] EDAC MC1: 31371 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
/ [7 F( E  k) ]$ j[15496.405299] EDAC MC1: 599 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)" h( E0 L; F9 Y' }1 y
[15497.429336] EDAC MC1: 498 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)$ J& C" J- I7 m1 |+ j- l+ Z
[15498.389388] EDAC MC1: 556 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
) L5 _8 ]9 G3 w- b+ ?[15499.413452] EDAC MC1: 31286 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)% ~2 o) n" v8 q6 q- y" D
[15500.437527] EDAC MC1: 562 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
: H3 u: {/ r" Y# q9 I$ V[15501.397514] EDAC MC1: 809 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
1 b/ R5 I9 q1 K: k[15502.421630] EDAC MC1: 31237 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
/ E# K5 u. E. l7 q6 W[15503.445669] EDAC MC1: 565 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
) t( @9 s, r! T6 {9 }( N[15504.405665] EDAC MC1: 836 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)1 k$ `: y$ K7 p- u$ L. W: ~. h  K# J2 R
[15505.429756] EDAC MC1: 32290 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0): |# f" |+ R) j4 V+ `
[15506.389773] EDAC MC1: 31703 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0), z/ |! {' P2 Z9 g1 A" D$ u
[15507.413826] EDAC MC1: 673 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0); i8 s3 o% z& Y" D. q6 _
[15508.437879] EDAC MC1: 811 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)  ~3 ]" _- v7 f
[15509.397883] EDAC MC1: 477 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
0 A9 }) @( i. Y% W[15510.421954] EDAC MC1: 31283 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
! Q# r$ L3 K" `[15511.446016] EDAC MC1: 505 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
, O+ n: M2 q+ a; y[15512.406017] EDAC MC1: 527 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
* d- k% O) _! T% d' {[15513.430072] EDAC MC1: 31324 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
$ N6 s3 b/ X4 v3 D+ H5 ~& @[15514.390136] EDAC MC1: 606 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)+ A4 U" l6 w( j
[15515.414179] EDAC MC1: 550 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)# T& c$ q6 k) H. z% ~: }0 \$ O+ w2 m
[15516.438248] EDAC MC1: 31641 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)! t& v; `- X! s& C) `
[15517.398265] EDAC MC1: 457 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
( K" N7 D$ }( |3 @) k4 a" j[15518.422311] EDAC MC1: 506 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
+ h4 J1 d8 O( r$ n7 k# A% n+ p[15519.446347] EDAC MC1: 520 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)( Q' t0 H& G" ]6 t( a4 b, E
[15520.406412] EDAC MC1: 31330 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)- a# b" W& W9 l4 c/ q/ [* S: G; x" [
[15521.430431] EDAC MC1: 821 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
' r1 q1 Y% n8 [& ^[15522.390507] EDAC MC1: 483 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)) s( P0 ]1 B, W; n# ~% T
[15523.414534] EDAC MC1: 31316 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)/ ]- Z& P- j( h- \
" u: m) p3 [8 Y, V* S% Q
[root@compute01 log]# dmidecode -t memory |grep 'Locator'
- \# A$ a7 o" W Locator: P1-1A
! w& j: k: O; Y3 m3 z# u; z Bank Locator: BANK0
  z  l8 n: K6 K Locator: P1-1B
, T3 V: u8 \3 _  y: `$ V# D, l9 C Bank Locator: BANK18 u5 V4 O6 q/ U) ^
Locator: P1-2A- h0 F% ~# N$ ?6 q5 K
Bank Locator: BANK2
% x8 x3 @" F  R# m3 L Locator: P1-2B
2 ]' J6 f( c- f* { Bank Locator: BANK3
* j  M. b4 r4 Y" ^) Z Locator: P1-3A, j' a& i5 J* j3 c( |( }
Bank Locator: BANK4* h" Z- {( _, d6 \
Locator: P1-3B+ L% N3 O% [! J) _1 A: l- N5 P
Bank Locator: BANK59 [/ t; ~! k. }& I0 P
Locator: P2-1A
. L# U. i9 W/ z# f% n Bank Locator: BANK6  Z" q. v. N  V* z8 Y. f
Locator: P2-1B+ t2 }- D4 G& _& h- w2 V, U
Bank Locator: BANK7, g5 T. R( t& ~2 ^
Locator: P2-2A
8 `1 _( J: {, E4 g; t Bank Locator: BANK86 P7 O" F+ m3 A: X) L9 A
Locator: P2-2B
( v/ i2 A+ r6 g7 Q Bank Locator: BANK9$ V; P9 u( m3 G% ^; h1 k
Locator: P2-3A' y2 @/ j+ _+ g5 R+ O
Bank Locator: BANK10
- c2 i/ `( i4 h9 i* b8 s Locator: P2-3B
. N# N' p4 |9 N* _& }0 i Bank Locator: BANK11
# s) c8 M- ^& p- f. Q& E: W# ?4 Y7 @* b

, B) y0 t$ X! k6 ]1 E0 y4 K
您需要登录后才可以回帖 登录 | 开始注册

本版积分规则

关闭

站长推荐上一条 /4 下一条

北京云银创陇科技有限公司以云计算运维,代码开发

QQ|返回首页|Archiver|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )点击这里给我发消息

GMT+8, 2026-4-9 00:04 , Processed in 0.063008 second(s), 23 queries .

Powered by Discuz! X3.4 Licensed

© 2012-2025 Discuz! Team.

快速回复 返回顶部 返回列表