找回密码
 注册
查看: 727|回复: 2

kernel:watchdog: BUG: soft lockup - CPU#4 stuck for 21s!

[复制链接]

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
发表于 2022-6-10 19:51:08 | 显示全部楼层 |阅读模式
kernel:watchdog: BUG: soft lockup - CPU#4 stuck for 21s!. s% g) g. G1 f2 d  g  {" X
Jun 10 19:44:22 compute01 kernel: EDAC MC1: 32353 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
/ w, K( r! |  WJun 10 19:44:23 compute01 kernel: EDAC MC1: 1539 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)1 l9 y6 c) v/ k. x6 L0 ?
Jun 10 19:44:24 compute01 kernel: EDAC MC1: 32267 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)4 x2 b* J1 k3 N1 ]
Jun 10 19:44:25 compute01 kernel: EDAC MC1: 32271 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
; b* F2 n8 m! E; Y% `  u1 q( kJun 10 19:44:26 compute01 kernel: EDAC MC1: 32324 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)5 q% t9 @: T) ]" B
Jun 10 19:44:27 compute01 kernel: EDAC MC1: 1306 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)5 P, }3 \' g; h' ]) R
Jun 10 19:44:28 compute01 kernel: EDAC MC1: 31262 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)- r8 M( K4 |2 s1 |2 n  k
Jun 10 19:44:29 compute01 kernel: EDAC MC1: 1303 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
2 ?$ C0 M4 |% h2 z5 v& \Jun 10 19:44:30 compute01 kernel: EDAC MC1: 31738 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
" Y7 r% ?8 T7 d, \8 E7 b" KJun 10 19:44:31 compute01 kernel: EDAC MC1: 32400 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)5 D  b% T# k' L) a  C8 r
Jun 10 19:44:32 compute01 kernel: EDAC MC1: 1754 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)+ h, _9 g/ X. i3 _( [. t: y
Jun 10 19:44:33 compute01 kernel: EDAC MC1: 32213 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)6 c: W  ^/ k/ V' l9 ?
Jun 10 19:44:34 compute01 kernel: EDAC MC1: 32034 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0); r  K* p7 z+ N$ m# N. D
Jun 10 19:44:35 compute01 kernel: EDAC MC1: 32453 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0). m2 J& x" H" x7 n' ~  B, }1 |, B

# A8 ]; `2 }; j9 t% k  W. C  t3 u
0 z9 U" ~* i" U1 ~& ~How to solve EDAC DIMM CE Error$ More /var/log/messageJul 21 08:54:32 customerkernel: EDAC MC1: 5486 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:33 customerkernel: EDAC MC1: 11480 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:34 customerkernel: EDAC MC1: 11330 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:35 customerkernel: EDAC MC1: 6584 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:36 customerkernel: EDAC MC1: 27428 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:37 customerkernel: EDAC MC1: 30113 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:38 customerkernel: EDAC MC1: 4453 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:39 ​​customerkernel: EDAC MC1: 6269 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:40 customer kernel: EDAC MC1: 15720 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1 page: 0x0offset: 0x0 grain: 8 syndrome: 0x0)Jul 21 08:54:41 customerkernel: EDAC MC1: 16107 CE error on CPU # 1Channel # 2_DIMM # ​​1 (channel: 2 slot: 1page: 0x0 offset: 0x0 grain: 8 syndrome: 0x0)Analysis and solution:
+ B/ G8 _) E( U6 U* I/ K- l2 tThis is [EDAC (Error Detection AndCorrection] (https://www.kernel.org/doc/Documentation/edac.txt) logs.
. z. _9 @6 ]: v  {CE Error Correctable Error is referred to, in addition to UE (Uncorrectable Error)' a' ?5 E& t4 B$ J) [3 G
According to the above documents, identify errors DIMM:
8 j2 ~# l- u5 a; h$ l[root @ the Customer log] # grep "[0-9]" / SYS / Devices / System / EDAC / MC / MC * / csrow * / * CH _ce_count/ Sys / devices / system / edac / mc / mc0 / csrow0 / ch0_ce_count: 0/ Sys / devices / system / edac / mc / mc0 / csrow0 / ch1_ce_count: 0/ Sys / devices / system / edac / mc / mc0 / csrow0 / ch2_ce_count: 0/ Sys / devices / system / edac / mc / mc0 / csrow1 / ch0_ce_count: 0/ Sys / devices / system / edac / mc / mc0 / csrow1 / ch1_ce_count: 0/ Sys / devices / system / edac / mc / mc0 / csrow1 / ch2_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow0 / ch0_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow0 / ch1_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow0 / ch2_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow1 / ch0_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow1 / ch1_ce_count: 0/ Sys / devices / system / edac / mc / mc1 / csrow1 / ch2_ce_count: 554836518Found errors in /mc1/csrow1/ch2, according to the chart:! n8 {( z! B3 Q( ^; l
       Channel 0 Channel 1===================================csrow0 | DIMM_A0 | DIMM_B0 |csrow1 | DIMM_A0 | DIMM_B0 |======================================================================csrow2 | DIMM_A1 | DIMM_B1 |csrow3 | DIMM_A1 | DIMM_B1 |===================================From dmidecode info:
1 p4 {- [6 \9 ^2 Y[Root @ customer log] # dmidecode -t memory | grep 'Locator: DIMM'       Locator: DIMM_D0       Locator: DIMM_D1       Locator: DIMM_E0       Locator: DIMM_E1       Locator: DIMM_F0       Locator: DIMM_F1       Locator: DIMM_A0       Locator: DIMM_A1       Locator: DIMM_B0       Locator: DIMM_B1       Locator: DIMM_C0       Locator: DIMM_C1From server console to find the memory info:
+ V. M+ ~8 x' s6 v1 ]+ }Memory slot on the motherboard of distribution: * h" f! i$ b5 p: V9 U6 V
Combined error log: kernel: EDAC MC1: 16107 CE error on CPU # 1Channel #2_DIMM # ​​1 (channel: 2slot: 1 DIMM_F1 memory slots should be a problem.
( @7 h# n! g% S' b1 M1 W8 g- tSolution: Finally, what we need to do is to replace F1 memory slot, after the system reboot the memory issue is no longer happening.) j- [- L4 V) s

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2022-6-10 19:55:29 | 显示全部楼层
跑大量高负载程序,造成cpu soft lockup。
& m8 M. a' ^; FSoft lockup就是内核软死锁,这个bug没有让系统彻底死机,但是若干个进程(或者kernel thread)被锁死在了某个状态(一般在内核区域),很多情况下这个是由于内核锁的使用的问题。# f6 s1 Y8 ~/ k: r1 J
解决办法:. W2 s, t- F( r0 q! i" {$ A

! ]) K/ D- i4 z+ B#!/bin/bash
+ A( O8 n: A: x% I& F#修改阈值为30,写入文件2 P1 [- Q( M/ U- _1 B0 i2 z/ T. _
echo 30 > /proc/sys/kernel/watchdog_thresh
+ p6 C) M- M% K( R$ o1 W#修改阈值为30,临时生效6 |# Q+ J" w5 |6 S1 B" q
sysctl -w kernel.watchdog_thresh=303 G) U9 o. p) j5 f3 V
, h/ n5 c0 s5 a* s- }
#修改阈值为30,写入启动文件
! M, j! S+ C& r, b4 \( Agrep 'watchdog_thresh' /etc/sysctl.conf) D. O% J5 N- w( t. t1 I
if [ $? -ne 0 ]; then
9 r, I/ d& S  \# C* S3 n3 z        echo "kernel.watchdog_thresh=30" >> /etc/sysctl.conf
6 P9 L$ V. U# I+ P. aelse( q7 ?; d/ F8 K, C; c) D
        echo "正常"
/ r" c+ n  P6 Hfi
: v5 T/ W; a4 d* N5 y

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2022-6-10 21:30:15 | 显示全部楼层
[root@compute01 ~]# grep [0-9] /sys/devices/system/edac/mc/mc*/csrow*/ch*_ce_count# T& Q0 C% p/ }6 M! c
/sys/devices/system/edac/mc/mc0/csrow0/ch0_ce_count:00 Y$ k* D" g4 ~$ r  ?5 R
/sys/devices/system/edac/mc/mc0/csrow0/ch1_ce_count:0( m6 v) B2 J( k8 E! U
/sys/devices/system/edac/mc/mc0/csrow0/ch2_ce_count:0
) @; u- [+ e% Z  C9 T( W/ h% m/sys/devices/system/edac/mc/mc1/csrow0/ch0_ce_count:02 k; C" z8 C+ `* O$ q- [% W
/sys/devices/system/edac/mc/mc1/csrow0/ch1_ce_count:176451434
# e- z& e! h( i) R/ l5 ^6 e! N/sys/devices/system/edac/mc/mc1/csrow0/ch2_ce_count:0, B, A: }: H& T7 m
[root@compute01 ~]# cd /var/log/  F- M  h( K( Y: I
[root@compute01 log]# grep [0-9] /sys/devices/system/edac/mc/mc*/csrow*/ch*_ce_count8 \% j7 o& q. E+ @
/sys/devices/system/edac/mc/mc0/csrow0/ch0_ce_count:0+ a9 o3 W; C8 S1 E1 m, r- Q* b8 h
/sys/devices/system/edac/mc/mc0/csrow0/ch1_ce_count:0- W$ {( p# ~0 `6 X
/sys/devices/system/edac/mc/mc0/csrow0/ch2_ce_count:0
! k* H) I( M0 J& L/ J/sys/devices/system/edac/mc/mc1/csrow0/ch0_ce_count:0: N2 ]$ `" @- Y1 }( v# `) k1 u" N
/sys/devices/system/edac/mc/mc1/csrow0/ch1_ce_count:1765821435 F6 w! ]5 J8 b7 \
/sys/devices/system/edac/mc/mc1/csrow0/ch2_ce_count:0/ T7 y* o" l3 G2 N

4 C# x; o6 m0 x1 A# `3 j6 ?' \3 j
) h2 w8 ]# p  F- [+ ][root@compute01 log]# dmesg|grep -i error# [! n* K+ m* ^) g4 G2 L7 M5 G
[15469.396093] core: [Hardware Error]: Machine check events logged
& j1 p0 a8 L& V2 v[15469.397553] EDAC MC1: 628 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)5 C$ t7 O  W- X; D: ]* U
[15470.420162] EDAC MC1: 338 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
8 T# i) p* j) n" b4 |4 Y[15471.444203] EDAC MC1: 916 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
& ~  a0 m. }3 u+ y+ Z[15472.404252] EDAC MC1: 31437 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
: D, T8 N5 b2 ]; ^! ?+ f: R[15473.428264] EDAC MC1: 628 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)0 W8 l5 D1 N' r# d5 o3 k7 b6 C) z
[15474.388309] EDAC MC1: 632 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)7 E& z' ]& X1 G8 j* `+ C
[15475.412425] EDAC MC1: 31414 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0). t. {, r/ U  u/ H5 O0 h( X% n& e
[15476.436453] EDAC MC1: 900 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
7 L, T  h/ T. K* h- d( Q2 Y[15477.396476] EDAC MC1: 31373 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)4 U; o/ e- G+ ^' u* `, A$ E4 z
[15478.420523] EDAC MC1: 669 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
8 Q3 x/ t3 Q: C( Y; ~[15479.444574] EDAC MC1: 612 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0); A# r6 b# [6 V1 [8 F2 [
[15480.404592] EDAC MC1: 31720 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)0 Q/ c$ [  l2 R, f0 V
[15481.428631] EDAC MC1: 737 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)" u+ J/ J( F/ F2 D
[15482.388697] EDAC MC1: 438 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
% k& m( Z9 z/ R8 v3 S[15483.412732] EDAC MC1: 31431 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
/ ~, U3 M& ~' j, l5 e- ~[15484.436806] EDAC MC1: 1150 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)- U) c7 E/ ~* B' _
[15485.396805] EDAC MC1: 787 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
: c7 h. s" P( Y. Z) h1 x[15486.420854] EDAC MC1: 31724 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
: R2 l# _4 B: O  C3 s5 i[15487.444923] EDAC MC1: 486 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
8 I7 U7 e9 b7 I, k[15488.528020] EDAC MC1: 31286 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
6 r$ P) G' f* d1 n' l+ h[15489.428983] EDAC MC1: 595 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
( [. w" v3 L6 s( o3 @* k8 ?[15490.389063] EDAC MC1: 482 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)) q+ _2 p! O* I! E7 ~% V& M
[15491.413089] EDAC MC1: 800 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)- s& |' P; a6 L, m& @+ B
[15492.437122] EDAC MC1: 31383 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)2 c8 B' o8 q7 L) U% Z- U' w
[15493.397162] EDAC MC1: 626 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0): `+ ^# y/ P' ]
[15494.421250] EDAC MC1: 475 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)- D, D" m( e' f+ X6 j
[15495.445313] EDAC MC1: 31371 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
2 e. S8 S+ s, n9 D: C[15496.405299] EDAC MC1: 599 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
. A3 C, |) M& S' f[15497.429336] EDAC MC1: 498 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)# w$ S1 v- g+ U! X/ E0 X! G
[15498.389388] EDAC MC1: 556 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
! w, R+ }+ s* }. A4 F7 f[15499.413452] EDAC MC1: 31286 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
. ^) a8 T* c- S. K[15500.437527] EDAC MC1: 562 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0): t% b3 b1 f4 X1 U( n
[15501.397514] EDAC MC1: 809 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)+ `1 t' U# ^0 i- p- {1 Z
[15502.421630] EDAC MC1: 31237 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)7 `) o, ~8 O6 }3 O
[15503.445669] EDAC MC1: 565 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)) ~, Q: L, Y: ^" C6 W1 U
[15504.405665] EDAC MC1: 836 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
3 T8 h6 u: Q; a, g$ _6 S5 z[15505.429756] EDAC MC1: 32290 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
- O% D/ W+ ]+ j0 F" n' ?[15506.389773] EDAC MC1: 31703 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
) O: _* a& Y2 I, w7 r$ u[15507.413826] EDAC MC1: 673 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
6 H% x6 Y  |+ q' g1 F[15508.437879] EDAC MC1: 811 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0): R3 [9 a% X2 V
[15509.397883] EDAC MC1: 477 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
. u/ l" P: X5 O8 a( B. m[15510.421954] EDAC MC1: 31283 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0). _1 N6 K2 A+ Z& {
[15511.446016] EDAC MC1: 505 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
$ N, l' \2 d! r/ q( N; z, K[15512.406017] EDAC MC1: 527 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
% A& j6 O$ d, _6 Y[15513.430072] EDAC MC1: 31324 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0); S  n6 D3 O4 E) |) P! C4 w$ F
[15514.390136] EDAC MC1: 606 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)* n0 K+ a- I1 x, [7 O9 |# N+ r
[15515.414179] EDAC MC1: 550 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
% |7 j3 p- h  A' e! j[15516.438248] EDAC MC1: 31641 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0): [, T3 }/ L" w* N. i
[15517.398265] EDAC MC1: 457 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0), J$ F$ B; u( `0 m, B$ x
[15518.422311] EDAC MC1: 506 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0), m" y6 m% d: n- ], g
[15519.446347] EDAC MC1: 520 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)7 Q0 U7 `% ?5 T" Y( x
[15520.406412] EDAC MC1: 31330 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
6 n1 Y* V0 n! d3 J( C& j" E/ a[15521.430431] EDAC MC1: 821 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)
% l3 c; O' M/ `- O1 {* u( V[15522.390507] EDAC MC1: 483 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)( N/ N, u* Q0 W& Z# @
[15523.414534] EDAC MC1: 31316 CE error on CPU#1Channel#1_DIMM#0 (channel:1 slot:0 page:0x0 offset:0x0 grain:8 syndrome:0x0)( G7 a- o2 P8 A5 w- f% k
: V/ M. f( N3 L$ v
[root@compute01 log]# dmidecode -t memory |grep 'Locator'# ]) K* l' v# X( I: }3 h
Locator: P1-1A4 ^8 _  k. f/ ?$ s$ J- V
Bank Locator: BANK0
  t2 m# j; Q( E. U Locator: P1-1B
) q- ~! R; M- }3 U; o$ S Bank Locator: BANK11 u' o2 J# T* n( M! D! `) n8 _
Locator: P1-2A0 u  R4 ^  p; T+ Y
Bank Locator: BANK2
4 ?  r) z$ ]; w  s3 B0 K0 L+ N4 D Locator: P1-2B% K. F7 w3 ?) }$ k4 p4 J) k0 w/ ~, ]
Bank Locator: BANK3
+ @1 l5 G% r, Q. W8 P* A Locator: P1-3A
2 A7 B% `' `0 Y4 D/ Q Bank Locator: BANK4
8 V& U  O, i5 B% V Locator: P1-3B0 }$ e5 L2 C0 |/ d- M
Bank Locator: BANK5
# `) @9 C, T% {  _9 H  w5 o Locator: P2-1A" c4 L8 i2 b, H# c7 e
Bank Locator: BANK6) {/ a9 S) ^% c8 h+ ]$ W. m- M
Locator: P2-1B
5 ^; z; T# F! N Bank Locator: BANK7
/ q& [3 C3 B5 S3 O, v  f! V Locator: P2-2A
( k# j. |: l  J Bank Locator: BANK8
8 q* d7 K7 E, t8 O1 ^8 w; R Locator: P2-2B
5 u1 h, z" S$ C  s! r Bank Locator: BANK92 a0 Q9 [8 \/ w# g
Locator: P2-3A
* b0 G" k! S% g1 i) s/ _ Bank Locator: BANK10
/ z  ]+ X+ s) _% T) | Locator: P2-3B
! X. ]. w& b# W) q3 E Bank Locator: BANK11
3 K4 ]0 e) X7 G* L5 K. V0 i6 O5 g9 G  P
2 R; r" M' j) e; o; W' [
您需要登录后才可以回帖 登录 | 注册

本版积分规则

返回首页|Archiver|手机版|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )

GMT+8, 2026-6-12 01:59 , Processed in 0.049865 second(s), 23 queries .

Powered by Discuz! X5.0

© 2001-2026 Discuz! Team.

快速回复 返回顶部 返回列表