浏览此站
联系我们相册切换到窄版 Language

 找回密码
 注册
易陆发现论坛»论坛 › 云计算开源区 › ceph分布式存储 › 完美解决过程Reduced data availability: * pgs inacti ...
返回列表 发新帖
查看: 517|回复: 2

完美解决过程Reduced data availability: * pgs inactive 24 pgs not deep-scrubbed in tim

[复制链接]
admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
发表于 2022-11-8 10:29:11 | 显示全部楼层 |阅读模式
购买主题 本主题需向作者支付 2 金钱 才能浏览
回复

举报

admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2022-11-8 10:45:39 | 显示全部楼层
[root@hostceph1 ~]# ceph -s/ J$ w! J" W& O
  cluster:
7 m. A' ?/ h- Q  a    id:     29046cc0-0682-496b-98b1-912e59964282! F+ B/ e8 y& y1 t$ ~  y
    health: HEALTH_WARN
8 m$ ~1 F& s6 J$ H; L8 Q% X            Reduced data availability: 24 pgs inactive
$ n6 @1 B2 f: ~& X) b( i/ H            24 pgs not deep-scrubbed in time8 [9 v" |2 {% o  Q  w
            24 pgs not scrubbed in time
. h  t6 |+ p6 V; R9 u; [
: C+ }0 L  Z6 I; p- d- I  services:+ ~5 j1 @' P9 |% s) v
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 3M)
; m4 Q0 S. Q# m! c    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
/ r/ y4 N+ y8 D- L/ R    osd: 34 osds: 34 up (since 3M), 34 in (since 3M)& v" S) L. H( \0 G% T) V5 U
" t# }% M% i6 n6 o1 N
  data:
. o" h. @6 n* M7 [2 W+ S    pools:   9 pools, 5760 pgs1 s2 d% |8 J$ d3 B; U1 L
    objects: 3.11M objects, 12 TiB
% z9 ?  w; d8 I( j5 E    usage:   33 TiB used, 92 TiB / 126 TiB avail
# y* R: f* {/ o* D0 F6 t: C    pgs:     0.417% pgs unknown: l6 X1 M5 i) W! I: ?- ^: }
             5735 active+clean& a; L- {' q; A/ h2 U' I3 s
             24   unknown$ g+ M  O& r* A8 m6 F
             1    active+clean+scrubbing+deep
; a# y6 m: F1 M, f1 h 5 V% V7 l0 h5 W/ _, k) Y; Z! u
  io:
' F5 n. t/ e% |. L    client:   9.7 KiB/s rd, 20 MiB/s wr, 12 op/s rd, 625 op/s wr
9 g( k$ L. o+ Z' y+ s
. N. F1 _# ?8 e9 L6 e; {[root@hostceph1 ~]#
. ]. J$ H9 m/ [6 F8 \- T[root@hostceph1 ~]# ceph -s
. z" E3 i' c9 r  cluster:
  O9 F; m# r' W+ d" `$ i    id:     29046cc0-0682-496b-98b1-912e59964282$ L: c* _" z# S7 b* E# g5 U
    health: HEALTH_WARN, P* l2 o- d6 L7 }- F
            Reduced data availability: 24 pgs inactive
' B  B5 |+ ~: {- y5 b5 q            24 pgs not deep-scrubbed in time
. E( n7 I  J9 k: e' B2 [! K( `            24 pgs not scrubbed in time+ y4 P- l! y; {7 U0 s

% Z4 h* N7 X1 w1 o  services:
1 g0 [5 ?+ c: ?: n0 v- D    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 3M)& l: s0 ?8 h( v- i/ _1 C7 P; P
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3  t2 Z/ `3 h6 Q7 X) ?7 l; M6 L
    osd: 34 osds: 34 up (since 3M), 34 in (since 3M)# u: I  P7 Y$ Y$ B
- q7 X( ]( g' Q  @* c& J9 V
  data:- ~. W1 m* a% f+ t. m/ S
    pools:   9 pools, 5760 pgs% j6 [0 V/ J- c1 I! s5 ]& b
    objects: 3.11M objects, 12 TiB- N2 ~4 `! e  S1 a9 s$ ?8 U+ P
    usage:   33 TiB used, 92 TiB / 126 TiB avail
. y% a' g+ {1 O3 ]9 X    pgs:     0.417% pgs unknown: L. k, P* X& D
             5734 active+clean
% ?: `$ r# C; @) `4 N& S             24   unknown
4 l+ u( B2 {" @3 C" c8 d+ ^             2    active+clean+scrubbing+deep/ ]0 k$ Z7 x2 @. I
7 f& |4 G( S) k) G& D
  io:
4 p4 @: b/ L/ @: V    client:   90 KiB/s rd, 22 MiB/s wr, 103 op/s rd, 531 op/s wr0 B* z  G: T! k0 Y2 m$ u1 B& A$ \
, M- y. @1 L5 g' E$ i7 l# Q
[root@hostceph1 ~]# ceph health detail
( R6 t1 p6 N' e2 |HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time
4 b! L% r  M* @# j0 |. ~PG_AVAILABILITY Reduced data availability: 24 pgs inactive
( [: I) @( b2 f, [9 j/ U. p  G7 t    pg 10.6 is stuck inactive for 8558718.511785, current state unknown, last acting []
- M! {$ [: \6 R. p- }9 k    pg 10.e is stuck inactive for 8558718.511785, current state unknown, last acting []$ l0 U- v0 h  c' }/ L. m+ ?
    pg 10.21 is stuck inactive for 8558718.511785, current state unknown, last acting []
3 `/ t) @; K6 {5 f8 W) u- ^8 j    pg 10.3e is stuck inactive for 8558718.511785, current state unknown, last acting []3 [7 c1 g8 k( j2 @- E* V
    pg 10.41 is stuck inactive for 8558718.511785, current state unknown, last acting []' \* ?4 O0 J+ C- u! W
    pg 10.6d is stuck inactive for 8558718.511785, current state unknown, last acting []
# `/ j+ W0 C+ j  N' z- {4 ~    pg 10.81 is stuck inactive for 8558718.511785, current state unknown, last acting []
* o- o$ W* {0 P# k: @    pg 10.88 is stuck inactive for 8558718.511785, current state unknown, last acting []
# B3 S1 ?2 K. A2 S8 j3 O8 L    pg 10.90 is stuck inactive for 8558718.511785, current state unknown, last acting []' X, x& L: N. X7 j3 t3 _
    pg 10.af is stuck inactive for 8558718.511785, current state unknown, last acting []
0 o4 T) i, S9 A% ?2 B! U9 R    pg 10.c1 is stuck inactive for 8558718.511785, current state unknown, last acting []( v# y0 l$ Y( U. f
    pg 10.de is stuck inactive for 8558718.511785, current state unknown, last acting []
( t1 r5 Q9 W; W    pg 10.f4 is stuck inactive for 8558718.511785, current state unknown, last acting []4 c" e1 @  f) a8 A4 Z2 @! l
    pg 10.10e is stuck inactive for 8558718.511785, current state unknown, last acting []
; @! X0 J/ e0 a8 p  d9 H  l    pg 10.114 is stuck inactive for 8558718.511785, current state unknown, last acting []  l) s  A5 C" ]- r
    pg 10.11b is stuck inactive for 8558718.511785, current state unknown, last acting []- k9 Y6 i( V& e. S
    pg 10.137 is stuck inactive for 8558718.511785, current state unknown, last acting []
% A& s6 S* o$ R8 d    pg 10.164 is stuck inactive for 8558718.511785, current state unknown, last acting []
, i2 W, C. P& b4 @, E5 }    pg 10.166 is stuck inactive for 8558718.511785, current state unknown, last acting []
3 ?# ^5 i- t5 x: l, g. ~) [. T( E& M    pg 10.16e is stuck inactive for 8558718.511785, current state unknown, last acting []
. {$ B5 Z2 R6 w) X' ?    pg 10.19b is stuck inactive for 8558718.511785, current state unknown, last acting []
$ t( O$ d+ @; `    pg 10.1ab is stuck inactive for 8558718.511785, current state unknown, last acting []
$ `5 M( n! ]4 W8 |& n- ^    pg 10.1ae is stuck inactive for 8558718.511785, current state unknown, last acting []
) i4 `% W# S& ?' N( R: U    pg 10.1b3 is stuck inactive for 8558718.511785, current state unknown, last acting []
3 B/ v1 t7 q* \& Y+ w% W- [8 \' VPG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
6 C, Y4 I) w0 W& f3 `$ l    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.7060772 ^( E  p5 Q$ f6 H! X+ K6 t
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.7060778 W3 n6 h+ E0 N& H0 H- K4 w/ g
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
! a1 J1 L" Q& ~8 r; `    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
. Q8 I$ H3 G4 f- s/ [1 U; Z* z- m    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
/ Z& h) c7 B8 u+ Q1 [    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
" U  S' e  t0 }" I: B; j' c    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077" w7 i& F6 \( ~7 o  p
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
% N. P; X8 Q" ?& N/ G    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.7060776 K) A# R* v) \, `1 ~* \8 N
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.7060771 ~' R& _0 p; u& Q1 L
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077" l6 H: S: m6 [0 a* O) e* d+ `% [
    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077# j, w7 s5 b; |) C
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
* [! ?' Y+ }# _7 |) C5 X    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.7060776 N3 j4 N# x4 \" t
    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077; M' W. {8 u9 d( s6 j$ ]
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
9 p" [" p8 O+ \0 w9 j8 A/ N& R    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
) X  l! u& _, ^2 q    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.7060779 b2 l; b8 ~( e9 z
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077; d. o5 I8 D2 [" y0 _3 D
    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
1 H5 I5 ^: g- Y3 o7 L    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
2 O6 l& L2 @. e. ]' p, I- K    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
5 Z! M! r3 f  K. R0 u( o    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.7060779 y+ N; y! }6 m! I6 a
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
1 r; R( l' P1 h3 x2 g) B: cPG_NOT_SCRUBBED 24 pgs not scrubbed in time) K; z; G9 K7 j/ X$ r( X5 M  l1 w" `3 T
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077& r& A; D" S' m8 I
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077
* x0 s$ r+ X, p9 m' O  q4 w    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
; _2 V: E) r7 C5 G) j    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
$ L2 u. Z7 }/ @3 P( V) P$ E    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.7060779 q1 g! i9 J, b/ X* x
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077' o2 C( u9 _' K, f* s
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077, z+ K8 R5 ^) i$ |  P6 u
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
1 a) N% ^/ I+ k4 p3 A    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077$ @( l+ Y1 d# U( v
    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077/ g( s  o# s& E$ u) I/ z3 J8 O9 I
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
! C5 o8 Y. Y3 k$ u    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077; E* L8 E% Y  U0 k# u
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
4 \5 I" g0 P3 u7 ~; e    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
0 E; J0 q" [, e( p6 C/ P    pg 10.6d not scrubbed since 2022-08-01 09:11:50.7060778 l0 H2 {# V+ O* c3 N, N# j6 E
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.7060774 o* W- Y; r. t, F
    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077" e1 s. v2 n) R
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077, @) @/ }) \$ a2 i+ N1 a# o( s
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077: \* h: {& K' o( a( D* U  ~" R
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
( f% ~# o* w+ W+ P    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
+ Z, ?" P6 b1 f2 v6 @    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077
1 b5 d- n' j& o0 u. d' w, u    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
' ]8 y0 q# v7 q- d. |" N) c    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.7060773 I* |; k  o' S3 c4 X+ t) |
[root@hostceph1 ~]# ceph pg rep, r/ K1 i; J% U  J( d/ Q
repair  repeer  
  R  M- A( ~) D[root@hostceph1 ~]# ceph pg rep
: L) J9 A! d7 N. C0 Arepair  repeer  
# L" @( Y2 N& }/ N" D[root@hostceph1 ~]# ceph pg rep
! u/ N9 z- j! S- `3 frepair  repeer  6 f( @# {+ N+ N* p: {
[root@hostceph1 ~]# ceph pg rep
2 K: Y0 |) A9 x8 ?repair  repeer  0 E: x. n- J9 u, [* ?/ ]2 y
[root@hostceph1 ~]# ceph pg repair 10.6/ H! a! Y* \4 `( |% k
instructing pg 10.6 on osd.8 to repair- h' X! {1 }9 u' }0 r
[root@hostceph1 ~]# ceph health detail
; L$ n) ~5 H! S: x3 tHEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time
2 w7 \; @9 r1 a; p' g: E# u" cPG_AVAILABILITY Reduced data availability: 24 pgs inactive
0 r  u5 F9 d: U9 Y3 L. d# N7 s    pg 10.6 is stuck inactive for 8558779.003482, current state unknown, last acting []
- l. M/ U' I3 X# @1 a0 g( ~% i& \+ F0 W, C    pg 10.e is stuck inactive for 8558779.003482, current state unknown, last acting []
) w! J( g2 y1 h    pg 10.21 is stuck inactive for 8558779.003482, current state unknown, last acting []. G- V, V# r) u* X, h3 d
    pg 10.3e is stuck inactive for 8558779.003482, current state unknown, last acting []. P& m2 D* q- N' A, s
    pg 10.41 is stuck inactive for 8558779.003482, current state unknown, last acting []& m4 i, \) X: ^7 o8 B, p7 w
    pg 10.6d is stuck inactive for 8558779.003482, current state unknown, last acting []. C3 |( h' _, y! N3 h. [  H/ |/ ?8 }
    pg 10.81 is stuck inactive for 8558779.003482, current state unknown, last acting []
( k3 W; U" f3 B! x    pg 10.88 is stuck inactive for 8558779.003482, current state unknown, last acting []' Z4 K6 z7 d2 e- C8 @
    pg 10.90 is stuck inactive for 8558779.003482, current state unknown, last acting []
9 W- h% e' s# Z- D# b, E    pg 10.af is stuck inactive for 8558779.003482, current state unknown, last acting []3 t$ G6 K! y7 \; v% p3 r; F5 m
    pg 10.c1 is stuck inactive for 8558779.003482, current state unknown, last acting []
- Q6 z; s- N( n; U; O: b    pg 10.de is stuck inactive for 8558779.003482, current state unknown, last acting []
; {; _6 J  |6 Y1 s. t4 }. P- ^    pg 10.f4 is stuck inactive for 8558779.003482, current state unknown, last acting []" P, w3 M9 Q# r
    pg 10.10e is stuck inactive for 8558779.003482, current state unknown, last acting []
+ |- ]: {/ L! c4 j# L    pg 10.114 is stuck inactive for 8558779.003482, current state unknown, last acting []! T% [2 I9 g8 B* @
    pg 10.11b is stuck inactive for 8558779.003482, current state unknown, last acting []( w: P' Z5 Y0 p+ Z
    pg 10.137 is stuck inactive for 8558779.003482, current state unknown, last acting []
( a$ C* ]# i. j' E" L    pg 10.164 is stuck inactive for 8558779.003482, current state unknown, last acting []
* _* Z% E& P% p    pg 10.166 is stuck inactive for 8558779.003482, current state unknown, last acting []7 S& Q+ A3 J0 Z# s
    pg 10.16e is stuck inactive for 8558779.003482, current state unknown, last acting []) S& O, ^: Z# d' _  o/ O0 z
    pg 10.19b is stuck inactive for 8558779.003482, current state unknown, last acting []: l4 U  q5 w" M
    pg 10.1ab is stuck inactive for 8558779.003482, current state unknown, last acting []
$ L+ |" D0 a6 ?$ w% V: u* D    pg 10.1ae is stuck inactive for 8558779.003482, current state unknown, last acting []5 x  `0 S) M0 p; B
    pg 10.1b3 is stuck inactive for 8558779.003482, current state unknown, last acting []% \! q2 H, O3 X4 P6 R
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time" l* G* o2 B' q9 x" |3 q
    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077. D, P- p" a; w8 O. V* I! w
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
3 i. ?3 ^& M! V8 @9 u1 e3 C6 U    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077+ J! Q4 _4 m) ~; |2 [$ y
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
4 I* A& h/ G" c1 q' W9 A    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
$ T  `+ J' c+ y( F* `    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.7060777 R3 R4 B; Y( L, Y# {& M& C
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077; o7 u: R) r( L  N. i& E( ^& n
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.7060778 U# d% C, u- m- Z+ i. S6 V5 b7 b' ]! b
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077
0 k3 C; M% o  |9 @    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077* ]3 ^, t! I: {  U1 w" T, A
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.7060778 l- }9 K( V& |8 x" m
    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077
1 R. U2 X2 n5 }' v6 y" t    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
, l8 C( _, \% Y7 p    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.7060771 \% H8 a* {- }; n
    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077
2 Q! l2 {8 ?* i" f    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
3 i1 @1 W& [+ I! c    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
6 V  J4 k( `6 c; R+ l/ Q    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077: z  \3 v) D& D+ _
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
9 u+ R- f; O3 `6 t0 e' P    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
- ]6 x  `& J8 @# i3 H. l8 _" j% k    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.7060772 v' W6 K  B; j3 [
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
7 B& [" w) ^* [; W% U* {    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
  q: D( A" `% _& T* G    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077' g  t" n0 W+ ?5 X) Z/ `
PG_NOT_SCRUBBED 24 pgs not scrubbed in time7 F3 x( m# M7 y, c
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
6 ~; n8 g1 z+ z! B) C3 U! ?    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077" \9 `' g" j; e. B% K: q' a8 m
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
& }; k  A) H: k! S8 `1 f) S, X    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
1 J! e5 g( h" c6 l& M: F* U' ?    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.7060773 U& `$ A( C5 k, [; B- y/ l6 w
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077/ D  R; d( M7 f$ \1 f; i0 P0 M
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.7060779 }! y3 @3 b$ {& v' F% V9 q
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
2 Y: m& h) M$ A/ `* c    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
5 z) H0 [8 g) J6 \- Y+ ]7 @6 ?    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077% g' e* X! s& `9 J" P' p
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
" z8 c6 \  R0 A" q    pg 10.21 not scrubbed since 2022-08-01 09:11:50.7060770 E' r" |7 s  Q+ H
    pg 10.e not scrubbed since 2022-08-01 09:11:50.7060776 \: Z- O' t$ j  i) [
    pg 10.6 not scrubbed since 2022-08-01 09:11:50.7060771 C/ K# f5 P1 r+ p+ n
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077* h0 S1 j) L: k, n
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
) ~; C+ J  m8 K; i% l" Y    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
5 T* q9 s6 m3 H. I; L% a( u    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077' V; ^% [) T  H2 V5 _1 e
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077, k7 Z9 q- k! w3 ]) C
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077" p$ c. t! P( w# J$ b' J
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
. T( J7 k+ U; d' |( F, h    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077
: v. ?" B8 i1 ]1 S4 Y1 e! c9 N    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077. d9 y, K, P6 G
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.7060777 R. B$ J7 f: b& n& E
[root@hostceph1 ~]#
8 q5 H8 S) G; n  r/ J/ D4 z$ K[root@hostceph1 ~]# ceph health detail |grep pg5 p% \4 a( o* d. B  k2 X; m! K7 A: r
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time
1 x3 Z0 ~) P7 t, EPG_AVAILABILITY Reduced data availability: 24 pgs inactive
2 t3 }% d5 d7 S; b% x    pg 10.6 is stuck inactive for 8558795.140009, current state unknown, last acting []0 m! k7 {( L2 H
    pg 10.e is stuck inactive for 8558795.140009, current state unknown, last acting []
# Z. j" R7 y8 ^  P1 H    pg 10.21 is stuck inactive for 8558795.140009, current state unknown, last acting []
& V$ D2 O7 t1 _+ v5 g. g+ }! ?1 s    pg 10.3e is stuck inactive for 8558795.140009, current state unknown, last acting []
  f: Z0 ~$ X8 j( [" o' s! X: `    pg 10.41 is stuck inactive for 8558795.140009, current state unknown, last acting []" w' O; d! y2 X7 e( z8 ?+ b
    pg 10.6d is stuck inactive for 8558795.140009, current state unknown, last acting []% |% U$ i) J2 k2 a7 b7 z
    pg 10.81 is stuck inactive for 8558795.140009, current state unknown, last acting []
0 Z0 T$ A6 J+ l; g9 B2 H1 m( B' ?    pg 10.88 is stuck inactive for 8558795.140009, current state unknown, last acting []
4 q. {- t0 A- f+ a    pg 10.90 is stuck inactive for 8558795.140009, current state unknown, last acting []% I5 H" l0 n) A/ }6 T1 C0 N% A3 C! h; H- s
    pg 10.af is stuck inactive for 8558795.140009, current state unknown, last acting []
" c& ]' U- d4 t( U    pg 10.c1 is stuck inactive for 8558795.140009, current state unknown, last acting []
( \* [; ]/ U- `% D( @/ K    pg 10.de is stuck inactive for 8558795.140009, current state unknown, last acting [], e! \" I7 g; S* K# ]8 Y$ G; |$ V
    pg 10.f4 is stuck inactive for 8558795.140009, current state unknown, last acting []
% E  L8 a1 R( j- C6 l7 H    pg 10.10e is stuck inactive for 8558795.140009, current state unknown, last acting []
. d4 I# g  P' B. X8 K1 ~    pg 10.114 is stuck inactive for 8558795.140009, current state unknown, last acting []# y: a) D- n8 J1 b1 [
    pg 10.11b is stuck inactive for 8558795.140009, current state unknown, last acting []
5 l5 Z& s6 }6 h9 j( @, t. a6 I$ Y    pg 10.137 is stuck inactive for 8558795.140009, current state unknown, last acting []1 l1 C: A+ n3 [" W* i
    pg 10.164 is stuck inactive for 8558795.140009, current state unknown, last acting []8 f8 q6 }1 l3 x4 I8 i' n
    pg 10.166 is stuck inactive for 8558795.140009, current state unknown, last acting []- L2 Z* E$ H# Q2 W% l3 [
    pg 10.16e is stuck inactive for 8558795.140009, current state unknown, last acting []# `' a) d' N, t4 ]3 N4 F
    pg 10.19b is stuck inactive for 8558795.140009, current state unknown, last acting []
( I' G. I. E4 X% U* z    pg 10.1ab is stuck inactive for 8558795.140009, current state unknown, last acting [], [6 ~$ B- B/ [! ], @6 R
    pg 10.1ae is stuck inactive for 8558795.140009, current state unknown, last acting [], C; q' Q# [3 K. J) M& e
    pg 10.1b3 is stuck inactive for 8558795.140009, current state unknown, last acting []: h/ t: w9 G. i6 S6 @/ Z
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
/ O% G& H& c( V    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077
5 E$ Y' X, O7 j. ~. H6 k! s    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
( q: y# J+ |' [; v9 g" k    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077* t1 A# {; V  m3 \
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077- {; i9 ~' C* N- v1 L
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077. k* ~" H+ n- {2 B4 E% B+ K) O
    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077! O! X/ M; Z) `- Z
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
6 n& l8 V, j( O7 w4 B    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.7060773 H4 u. T# _: R2 W
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077
# C9 v, `! `+ y    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
! y! n0 t0 Z. r* J    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
0 u) T0 S, x' O) ~! t    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077
8 X+ |$ N) g  L! ?) i3 b    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.7060775 D% X  ^; ]( ~& n6 I1 ^
    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.7060771 Q& ?$ S1 {0 u% H3 i4 ?. m- v
    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077. O! K* ?. Y7 O2 Q/ I: A% Z6 j
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077' P. J2 h8 n; J4 o
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
, X. ^' |$ z. P' G7 N    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
2 Q* l4 ~0 p5 x, S    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
+ o* Q  U! k# u/ c( O    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077) {9 p8 |$ W( E% R5 {. U
    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
: m0 t, d  g6 w    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
" H3 a8 e8 h4 m4 j9 k    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
# }6 _5 }3 H4 J) ]6 I( `    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
4 o7 c- D% E9 n& YPG_NOT_SCRUBBED 24 pgs not scrubbed in time
* ]' U  e' M* @; H$ I    pg 10.11b not scrubbed since 2022-08-01 09:11:50.7060779 m/ G( y0 K3 I5 u$ I
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.7060777 {% n+ _( ^$ {8 m2 J4 J
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
6 D1 b. ?( p% m: Q* p* H    pg 10.de not scrubbed since 2022-08-01 09:11:50.7060771 u2 @& C3 F8 G; ~1 p2 d6 T
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077
, [9 ^% {& D0 B    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077, V( t3 a& \$ e5 e* B8 e& B
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077; B% @& c8 r2 K# h/ \0 _
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
. s+ f7 o! U% E( V$ c" d    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077$ ^4 S6 T- A- N/ U; x
    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077# E% l3 m% C! n2 b* ?& X1 A
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
# T8 k& w) d& h6 r    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077- O% V7 g, A, t7 p7 ]4 d
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
2 C, d( E, ^3 G! H3 B    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077, z# W5 Q# O9 ?
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077" K3 s7 L' o( b  m- s/ r
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
6 w' I. q& e1 Y7 q6 L    pg 10.137 not scrubbed since 2022-08-01 09:11:50.7060771 Z+ p; v/ \; a% S- z1 Q
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.7060776 V" b; m  `2 l* O1 J
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
% N( F5 u$ y. ]+ L- y7 V    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077: T! p* |6 i& s
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
5 B2 d; i" H8 R7 Y& P    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.7060774 @$ v9 ]3 Y8 A
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
! @6 U2 R0 G/ X% I    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077
+ X1 q5 ?7 r! {! w) b+ C6 Q[root@hostceph1 ~]# ceph health detail |grep pg |grep -v pgs
' Z+ M, k' p! \2 @6 A- l    pg 10.6 is stuck inactive for 8558819.337561, current state unknown, last acting []
! r. n  ~5 F2 h! r$ ~# C! s    pg 10.e is stuck inactive for 8558819.337561, current state unknown, last acting []
) Y2 r: @3 @) Y1 p+ H( B    pg 10.21 is stuck inactive for 8558819.337561, current state unknown, last acting []
/ L' D  y. G5 W2 K0 r, w    pg 10.3e is stuck inactive for 8558819.337561, current state unknown, last acting []6 ]( L9 C; o- a0 m
    pg 10.41 is stuck inactive for 8558819.337561, current state unknown, last acting []. n, ]  ]2 x' Y4 r
    pg 10.6d is stuck inactive for 8558819.337561, current state unknown, last acting []
6 {- T. b% S* w# j; u    pg 10.81 is stuck inactive for 8558819.337561, current state unknown, last acting []4 Q* o3 W7 L, }
    pg 10.88 is stuck inactive for 8558819.337561, current state unknown, last acting []/ {* }9 e1 @3 C  w2 W$ s) L5 G* d
    pg 10.90 is stuck inactive for 8558819.337561, current state unknown, last acting []
; M. E! @6 M2 Z1 u: l4 m  d    pg 10.af is stuck inactive for 8558819.337561, current state unknown, last acting []! ]8 T6 ?( t9 V/ l
    pg 10.c1 is stuck inactive for 8558819.337561, current state unknown, last acting []# B# L# w! d  y: x: f
    pg 10.de is stuck inactive for 8558819.337561, current state unknown, last acting []
3 W& n1 V3 z7 r' f% ?$ k8 h    pg 10.f4 is stuck inactive for 8558819.337561, current state unknown, last acting []
% ~9 j$ {& d5 O$ }    pg 10.10e is stuck inactive for 8558819.337561, current state unknown, last acting []% }; A0 r- |5 z! y) r7 E2 Y
    pg 10.114 is stuck inactive for 8558819.337561, current state unknown, last acting []
2 j# \6 B: d/ G# @    pg 10.11b is stuck inactive for 8558819.337561, current state unknown, last acting []
) ^8 h3 W% w+ ]& g    pg 10.137 is stuck inactive for 8558819.337561, current state unknown, last acting []/ i, ]* N2 n2 j1 [. H, m
    pg 10.164 is stuck inactive for 8558819.337561, current state unknown, last acting []8 r2 u" u, Z1 i( L5 m6 X* b! y
    pg 10.166 is stuck inactive for 8558819.337561, current state unknown, last acting []
0 Y" U/ M$ O0 X4 y    pg 10.16e is stuck inactive for 8558819.337561, current state unknown, last acting []$ [: u; Z( b, U  D! v  x; d" l
    pg 10.19b is stuck inactive for 8558819.337561, current state unknown, last acting []* D/ H  b! T* Q7 |2 A
    pg 10.1ab is stuck inactive for 8558819.337561, current state unknown, last acting []) s& i' X  p* f" P9 Z) ~
    pg 10.1ae is stuck inactive for 8558819.337561, current state unknown, last acting [], a- C" q' w  ]0 ~& K; s6 B
    pg 10.1b3 is stuck inactive for 8558819.337561, current state unknown, last acting []5 Y3 N2 N0 L/ u2 l! Z; y
    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.7060777 q" B) G. X. X; G" r' V9 j8 ~' J
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077. r! @8 _& M# j
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077; x" r; g. d" \8 d8 I2 B- \3 A- D+ T
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
( _9 H) u  ~% h# B4 F" a7 S! W6 V    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
2 [# r- Q  k2 E% E% g. a    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
2 g# n* G7 Y" n6 Z; `. t    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077- Q9 W9 e: D. a- s" S. R
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.7060779 W1 N% X5 m$ o, t% Q
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077
" S8 N6 f: K& ]0 h! d! @1 n! h    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077- L9 c- f0 [* w
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
2 l% g8 s. p! C8 j    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077, b' H" L  K$ J* ]9 k
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
7 `! x4 K8 v3 A+ p    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
' y% [0 K% `* T    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077' p- d! g% x4 c) p
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.7060771 f/ M. d; c; Y$ j' p# z
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
4 @# t( E0 U6 o5 G+ Y0 n# U    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
. I1 A  z) v9 }9 K# l" s4 T    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
( B6 v4 V, S( d0 L5 d3 o    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
- v+ v# }. ]+ u, M    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
5 i! Y3 z! c, x; a7 I& M  U7 P    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
( @3 e- f' [4 X' ~" A: w5 c; u    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
# G1 ~5 J% e4 K$ U" {# r  v' k( {    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
9 V/ E8 E. p3 h7 J    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
6 R' j$ J% K6 z8 E3 t& m    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077- K2 f  S3 f3 D; I. I5 q
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.7060776 h# a! _0 [/ j/ B/ [
    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
) c+ |0 z  l/ F- V    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077" g5 v* L% d7 q9 g
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
3 p9 x, V6 u) X! ?% h    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077
8 _% v. L: q1 ?$ B( z4 d    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
) V6 F, C/ ~5 v. r    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077$ s# |+ z# T# z. ~1 q. i
    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077: \0 `+ K5 U6 Y& z! k' q$ y" T4 D  Q
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
0 [- n- W/ E: Q6 G! R    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077
7 g- e" t# u3 z$ ]/ b, v. S$ h& `    pg 10.e not scrubbed since 2022-08-01 09:11:50.7060772 r7 r3 K6 Z$ T# E; _
    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
2 a) `1 n( D) j7 ?7 x    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
! I9 J( A% M$ |. n    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
$ O, w9 U* G( \7 y$ b6 }    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
" ~$ b# g# D7 r4 z4 H; J' u9 N    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077. c& F/ O" A3 A, q
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.7060772 U/ k8 h$ |& P: U8 H
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
+ o% P# H5 Q. `  V5 t9 ~    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
6 L4 H3 n4 b; w) q" U9 i6 u    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.7060777 o: g  R- U7 q" }' p' U0 V0 p/ Z
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
( `, e! l4 ?4 _* U3 j    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.7060777 r; x6 E: A1 k, B! g
[root@hostceph1 ~]# ceph health detail |grep pg |grep -v pgs |awk '{print $2}'
& r; j$ C: p) V0 s/ s1 Y10.6$ k; V7 Z$ I& L
10.e1 C) f& y% V, I
10.219 u6 N; `1 P0 m) }5 a9 b
10.3e
! j2 S8 H& q! I! J0 H10.41
& `! J1 X3 U2 `: S# [. G10.6d4 d% k5 A: _; r! n
10.814 n3 e* g: d0 \
10.881 G0 C) l/ f* \* S( S3 s7 R0 v4 E
10.90
# v8 ^5 d% q7 \, e' P10.af8 j2 G7 Z2 }9 d
10.c1+ w( [$ {' E6 G( p
10.de
6 ]; w2 ]& g9 ~. `4 ?# I0 S10.f45 k7 U" P9 Y9 L! Y# Z
10.10e
& z6 B  A- T  {4 e+ M. R10.114& d0 ?/ I& |. Q. a3 s- }
10.11b
' y! Y7 j! s8 M2 W9 \( E3 U& G' a10.137
0 W& o1 u6 W; V; H9 l6 Q. q10.164$ c. v* @2 J. d0 A- G& L
10.166
, P# ~' a" f& @3 m10.16e0 G* W; N$ `$ M" O8 F: y9 y
10.19b
0 q2 O& w% l1 m; z6 n- {10.1ab7 h: w8 a# ]8 D, @% y1 e. Z* G9 o' G3 g
10.1ae) [8 N& ?, O5 Z2 F
10.1b3
, h3 T( w: N+ x" u5 l+ v/ m/ P10.11b& O0 o' A3 G  M1 S% q" }- d: Y# Q$ q/ O; J
10.10e
$ L6 E% r. s: C3 W10.f4% Z3 L% B0 J1 h  I, V0 }% N
10.de
2 J' U+ P! W) k& d- ]' O10.c1
6 \6 p6 v3 q3 O1 O$ V4 Q7 |" y5 e10.af* s" c- v5 Q  U! h6 x
10.90; o5 A0 p3 W2 D$ h2 G2 V
10.81
: @, C6 N5 U& @) D( \3 E10.88& E2 |+ |. w2 E; c2 J
10.41* z9 y9 o( m! F- a8 v
10.3e% g, v" r4 d4 d: q
10.21
0 c4 @- x0 J6 ^8 O$ f3 y# s10.e
; |/ F1 T% `* N: A1 M  \6 Y& {( f10.6$ X2 o! p1 D- Y* ~
10.6d
' B: M8 G# I; M- S10.1142 z2 O- E4 y: }5 W- w6 ?: Q
10.137
# b8 {, b' z5 p6 V6 O10.16e
9 S+ t: }1 q' N8 |7 C10.164- P; R/ h! f+ }- K% U
10.166
2 G# b& A  l  N1 f10.19b
% w) D4 ?3 R' z- Z9 G10.1ae
0 `, x" k+ k6 y/ B" L10.1ab
0 k  H7 R, B& R1 J& q1 y+ {10.1b3
% g& J0 e: D; }1 S6 q( c7 v3 V& J10.11b0 L" k2 P  ]) Q! K* v4 }7 K
10.10e
6 v, u" }5 x# J9 J' b# U) w6 e10.f4
8 J# h- s! n% C. p10.de
9 I- e2 R; `- U3 k7 j10.c1
5 q1 ?, r5 J' y) W9 ^) {; L7 t10.af' z: K& Y. c: w/ e# ~# O* g
10.90
4 |1 O% A7 ~4 g- S% S' _10.81& g# l$ _! N9 g8 B+ m. r
10.88
! h6 T6 M! v1 u# c5 e4 M8 Y0 i10.41
* I7 m0 r- E; e, h10.3e" p- H* Q  C  l+ k. |9 p
10.21+ a/ Q0 b' Z0 Y% [9 \# D0 Z3 s
10.e
& ?3 g- p( V0 c" A10.65 |5 s$ L- E1 [& m. u
10.6d9 _! F( Z% e7 j9 [2 r
10.1143 R: d" b, X$ Q" ~
10.1379 n2 |$ o6 T! C" r, R1 Z
10.16e8 W  w& \. m4 Y1 \& X
10.164
9 j+ a  V6 x, D10.166" I3 Q) o) @, C& {
10.19b
% B$ E2 }6 V! B10.1ae
7 Q! `* z" P) c2 e% s  t: T10.1ab
) v( x3 k9 {& A; B10.1b3
# L! J, c& D, Y/ o8 H; G2 S! W* _& N[root@hostceph1 ~]# for i in `ceph health detail |grep pg |grep -v pgs |awk '{print $2}'` ;do ceph pg repair $i ;done ) u* }) L+ k2 i) F
instructing pg 10.6 on osd.8 to repair1 G5 N1 r% d) G! f' l6 n$ Y0 @
instructing pg 10.e on osd.8 to repair3 q/ |+ w, Y" W* Z* u
instructing pg 10.21 on osd.8 to repair$ C5 f0 H, S$ l# [+ y
instructing pg 10.3e on osd.8 to repair* n9 E7 R9 a. b; Z$ H3 S
instructing pg 10.41 on osd.8 to repair
+ y; g2 `" X* v/ Yinstructing pg 10.6d on osd.8 to repair6 T5 I+ j8 L9 e( f, N4 b
instructing pg 10.81 on osd.8 to repair  [3 }" j: x6 a3 J0 P# k8 }
instructing pg 10.88 on osd.8 to repair
) I; W+ |3 G/ \$ Iinstructing pg 10.90 on osd.8 to repair
5 V; r: J( U, K, z3 pinstructing pg 10.af on osd.8 to repair
8 W2 S2 x$ X! ~+ h1 j' @8 O$ |instructing pg 10.c1 on osd.8 to repair' m) V) S( o+ m3 a3 X5 ~. H
instructing pg 10.de on osd.8 to repair
9 d7 Y+ B$ U5 k4 K9 [7 L, Cinstructing pg 10.f4 on osd.8 to repair
4 `2 H# `& A4 E) g9 i' minstructing pg 10.10e on osd.8 to repair! n4 q) E' r' }. _" Q- A( ]8 \
instructing pg 10.114 on osd.8 to repair  ?* w0 e$ j  A7 T0 j0 K% F9 J
instructing pg 10.11b on osd.8 to repair% J& D! y7 L1 H1 z  Y
instructing pg 10.137 on osd.8 to repair$ m% r0 q% A  F9 I
instructing pg 10.164 on osd.8 to repair) N! \1 D6 ]  {4 r$ m+ k, Z7 T) h
instructing pg 10.166 on osd.8 to repair" c% M: y; Q; |% h7 ]
instructing pg 10.16e on osd.8 to repair3 H# N+ z& l( J- U$ p1 H9 R0 s
instructing pg 10.19b on osd.8 to repair' g% @# L! Z3 a5 y( q- t/ k. H
instructing pg 10.1ab on osd.8 to repair$ v/ f% x* c4 j- J( i
instructing pg 10.1ae on osd.8 to repair( H6 Z/ U- R& T5 Q% r1 |
instructing pg 10.1b3 on osd.8 to repair. ~3 A8 i, F, u4 `, b% w1 Y( J
instructing pg 10.11b on osd.8 to repair
) y  D+ r9 G4 N; V* d+ n- einstructing pg 10.10e on osd.8 to repair) S% l( s4 ]( J
instructing pg 10.f4 on osd.8 to repair
* N+ \9 k" X- c' B% H( c( Rinstructing pg 10.de on osd.8 to repair3 \4 u2 @5 ]6 c, z5 L/ b$ u8 n" D
instructing pg 10.c1 on osd.8 to repair( r2 I) m+ p: a$ d/ u* R
instructing pg 10.af on osd.8 to repair
; a3 @; v' B  A* W: iinstructing pg 10.90 on osd.8 to repair- T/ n1 p: z; U, E0 U2 ^/ s3 N
instructing pg 10.81 on osd.8 to repair1 R8 y+ T) z1 G3 k  `
instructing pg 10.88 on osd.8 to repair
  J& @7 a, Z- y# binstructing pg 10.41 on osd.8 to repair
  U8 t& T; R& c& f2 einstructing pg 10.3e on osd.8 to repair6 N+ g$ E( l" m4 }
instructing pg 10.21 on osd.8 to repair
' p& Q1 F+ b; c- C* S, i. Cinstructing pg 10.e on osd.8 to repair9 O, V$ l& r' m: |% L  T8 F
instructing pg 10.6 on osd.8 to repair. ^3 l& H% y$ h6 P/ x6 `, x
instructing pg 10.6d on osd.8 to repair! W. U! r: K8 L$ D, E" j
instructing pg 10.114 on osd.8 to repair
' y2 \0 Q  B- h9 D. l7 q! H; o* Uinstructing pg 10.137 on osd.8 to repair& K, q! T! N/ p0 f7 g5 ?/ Z
instructing pg 10.16e on osd.8 to repair
- {' b; w7 d* I0 Tinstructing pg 10.164 on osd.8 to repair. l! N& `* P" h8 w3 [7 D: [
instructing pg 10.166 on osd.8 to repair
3 P% [) J* X3 C3 vinstructing pg 10.19b on osd.8 to repair
( t3 s3 ^- Z. t1 jinstructing pg 10.1ae on osd.8 to repair" k; i9 L3 ]. `: l& Z8 q/ k. }
instructing pg 10.1ab on osd.8 to repair- c' ^, B7 W8 a7 O: l5 j( ^1 c
instructing pg 10.1b3 on osd.8 to repair: Y4 \" s$ B4 C. J. d; O! W
instructing pg 10.11b on osd.8 to repair
0 U# X' d0 Q6 X7 Z( _8 `& tinstructing pg 10.10e on osd.8 to repair
/ d5 d5 P' d! }; j! ~8 x( \' D# }9 Minstructing pg 10.f4 on osd.8 to repair
  Z2 N' r9 K" s: H  N5 }0 o0 cinstructing pg 10.de on osd.8 to repair
1 d& ?: o5 Q1 j* K3 b# t- Cinstructing pg 10.c1 on osd.8 to repair
3 a0 `( T3 }) o; r- Q6 Ainstructing pg 10.af on osd.8 to repair* e* U# E% H' D/ ^' y& [
instructing pg 10.90 on osd.8 to repair
2 T7 X6 z  J- Q( p. g$ I( A4 ginstructing pg 10.81 on osd.8 to repair
5 |9 n, }3 |* V8 [, ginstructing pg 10.88 on osd.8 to repair+ K2 U" x& |! s' c/ ?
instructing pg 10.41 on osd.8 to repair# u6 C1 m( o$ O
instructing pg 10.3e on osd.8 to repair
6 j: a! G& O4 i* h, S( ninstructing pg 10.21 on osd.8 to repair
  _1 z" C, a# d4 Y; w; u0 ^instructing pg 10.e on osd.8 to repair/ M& j! e0 H3 }7 |$ H+ S
instructing pg 10.6 on osd.8 to repair" w3 v# v% K( K, O( \. _
instructing pg 10.6d on osd.8 to repair% s+ H7 E, ?. ]+ G0 `' z
instructing pg 10.114 on osd.8 to repair
* c/ x4 `; g6 `' Oinstructing pg 10.137 on osd.8 to repair7 [0 X' I" ^- r* ?) n3 [. B
instructing pg 10.16e on osd.8 to repair$ x3 t& g% d6 K
instructing pg 10.164 on osd.8 to repair
# `5 g6 I% B, |instructing pg 10.166 on osd.8 to repair: x  Q5 b" p$ F" u0 z
instructing pg 10.19b on osd.8 to repair+ y  p' q" O" B" j
instructing pg 10.1ae on osd.8 to repair
% R) n, f) E* i; d9 D2 Iinstructing pg 10.1ab on osd.8 to repair: x: X, n$ \, o* H
instructing pg 10.1b3 on osd.8 to repair% t' s2 l1 \6 {7 Y; ?( P
[root@hostceph1 ~]#
回复

举报

admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2022-11-8 11:23:41 | 显示全部楼层
[root@hostceph2 ~]# for i in ` ceph health detail  |grep deep-scrubbed |awk '{print $2}'` ;do ceph pg deep-scrub $i ;done
4 q1 U, `/ z0 r$ J' KInvalid command: pgid has no .
% I  W+ G* y7 Q: Ppg deep-scrub <pgid> :  start deep-scrub on <pgid>
7 m: A4 A6 U' Y6 |0 X0 }Error EINVAL: invalid command
5 K# Z; v: U- ^$ h6 N, S( e; N- w2 DInvalid command: pgid has no .
# \8 E7 G, b. l) u) [' ]+ ^pg deep-scrub <pgid> :  start deep-scrub on <pgid>
) Q( m& N: Q0 ?& a5 F9 A. BError EINVAL: invalid command4 \! W! N& d5 ^: R: H& _
instructing pg 10.11b on osd.8 to deep-scrub6 E! k0 Q! [" V# W: L
instructing pg 10.10e on osd.8 to deep-scrub
( _+ i6 K" |& K/ U# R# Cinstructing pg 10.f4 on osd.8 to deep-scrub9 C- y8 X* m8 q1 w
instructing pg 10.de on osd.8 to deep-scrub1 W; j% J) g9 Z' A6 z
instructing pg 10.c1 on osd.8 to deep-scrub
  I+ ]" ^; a+ |4 E4 binstructing pg 10.af on osd.8 to deep-scrub; e8 L% Q. w: Z7 E( \
instructing pg 10.90 on osd.8 to deep-scrub* j/ G* U. [: s; d" G8 B
instructing pg 10.81 on osd.8 to deep-scrub% e- w# o6 P; A* y( @
instructing pg 10.88 on osd.8 to deep-scrub3 k. o1 y+ z: k( x* z
instructing pg 10.41 on osd.8 to deep-scrub! d: z" ]& g- [5 K
instructing pg 10.3e on osd.8 to deep-scrub! q$ m- S* |( J, @3 l
instructing pg 10.21 on osd.8 to deep-scrub* y# ~+ e. x& G+ K. U& O
instructing pg 10.e on osd.8 to deep-scrub0 Y1 p. m3 E2 F3 F- h7 r; V* t
instructing pg 10.6 on osd.8 to deep-scrub
, G3 U- p  v/ `8 ~instructing pg 10.6d on osd.8 to deep-scrub
4 }1 M) q4 N9 ^- T. Z/ linstructing pg 10.114 on osd.8 to deep-scrub
4 T0 Y" ~2 \3 h- M: u  P4 q' cinstructing pg 10.137 on osd.8 to deep-scrub  E0 F5 |6 C6 x" w8 }
instructing pg 10.16e on osd.8 to deep-scrub
* s* d6 w3 |: ?5 G5 E& [instructing pg 10.164 on osd.8 to deep-scrub
2 a; v' X) {$ q* Z6 sinstructing pg 10.166 on osd.8 to deep-scrub
% W0 z3 s( m9 K' ^' _$ Q; Linstructing pg 10.19b on osd.8 to deep-scrub5 n% S- w* v  s  r8 V: a/ k8 M
instructing pg 10.1ae on osd.8 to deep-scrub
5 ^. r% {4 x* |5 kinstructing pg 10.1ab on osd.8 to deep-scrub& ]* v. x" S2 H# R
instructing pg 10.1b3 on osd.8 to deep-scrub
4 d7 q' H3 X% c' i$ }/ z8 v" |1 Y[root@hostceph2 ~]# ceph health detail 9 E" i! ]5 b5 c& j( m7 A
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time
7 n. X, l; d+ k) L+ K0 L9 EPG_AVAILABILITY Reduced data availability: 24 pgs inactive
0 F5 E1 Z$ e& c3 u7 w    pg 10.6 is stuck inactive for 8561350.091262, current state unknown, last acting []/ f7 k1 ^2 ?2 H7 ]
    pg 10.e is stuck inactive for 8561350.091262, current state unknown, last acting []. F% l- N  p  Y
    pg 10.21 is stuck inactive for 8561350.091262, current state unknown, last acting []
& \9 k; V: g+ d8 e- w    pg 10.3e is stuck inactive for 8561350.091262, current state unknown, last acting []9 p/ }: V& W) J8 @' m/ J* m
    pg 10.41 is stuck inactive for 8561350.091262, current state unknown, last acting []: i. _* g, F6 f7 F9 W
    pg 10.6d is stuck inactive for 8561350.091262, current state unknown, last acting []
! o% H( b% v5 n" V    pg 10.81 is stuck inactive for 8561350.091262, current state unknown, last acting []
3 h8 Z3 w$ B0 |3 D$ b    pg 10.88 is stuck inactive for 8561350.091262, current state unknown, last acting []
% U  [+ U3 F2 x% R$ @    pg 10.90 is stuck inactive for 8561350.091262, current state unknown, last acting []4 ?4 x( h, V6 ^" J8 t# T* O
    pg 10.af is stuck inactive for 8561350.091262, current state unknown, last acting []5 ?: I# W+ B6 G/ @5 D
    pg 10.c1 is stuck inactive for 8561350.091262, current state unknown, last acting []
; r3 c" ]. F! h8 W9 }    pg 10.de is stuck inactive for 8561350.091262, current state unknown, last acting []* W7 N7 O1 [, h$ Z
    pg 10.f4 is stuck inactive for 8561350.091262, current state unknown, last acting []
/ I3 H# i/ W0 S6 M! A    pg 10.10e is stuck inactive for 8561350.091262, current state unknown, last acting []. f" |5 y' r% ?$ j9 k
    pg 10.114 is stuck inactive for 8561350.091262, current state unknown, last acting []
' q8 e" Q2 B4 w* ]7 b    pg 10.11b is stuck inactive for 8561350.091262, current state unknown, last acting []4 f  \* l, [. _  {' A
    pg 10.137 is stuck inactive for 8561350.091262, current state unknown, last acting []
4 ~2 ~" b/ `- k/ r+ p" b/ z    pg 10.164 is stuck inactive for 8561350.091262, current state unknown, last acting []- L4 g6 @2 @( e% z+ s$ g; S
    pg 10.166 is stuck inactive for 8561350.091262, current state unknown, last acting []
  F" ~( {0 W( q8 G4 \    pg 10.16e is stuck inactive for 8561350.091262, current state unknown, last acting []# G, @1 \$ H. k! F% d
    pg 10.19b is stuck inactive for 8561350.091262, current state unknown, last acting []# ~5 L9 d# v! F# Z" Y  Y: U
    pg 10.1ab is stuck inactive for 8561350.091262, current state unknown, last acting []
! A, X+ k1 g/ X3 p3 F1 M    pg 10.1ae is stuck inactive for 8561350.091262, current state unknown, last acting []7 P$ x) y* M' N: ]& b
    pg 10.1b3 is stuck inactive for 8561350.091262, current state unknown, last acting []: B' l+ n  E, R/ h, K& n& B+ \' a7 W
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
1 L7 t% m3 J5 w3 h1 R4 @, T/ U    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077
5 H- e: t* W0 C2 L# T. z    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.7060772 T2 R7 Y3 a. ]& _* H
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
) c8 ]- T# z, v# Q2 A    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
( S- H3 Y* c% e  s4 L# f    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
+ G6 d0 T% D3 b+ r5 J2 m/ \  G5 O    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.7060776 M% X' y' F! _
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
) }. n: B+ n% t$ y  x6 T+ J* Z    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
4 `  B# x7 }. ?5 w$ ]  x! M    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077" ~( ^7 R: y/ r( w: u
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.7060776 S5 H, V, {# h- I; n5 u. d; v
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
0 }2 d5 E: i- `: j8 A  O# H3 O, F4 C    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077$ _& k% W1 p, R4 e, e( n( ]
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
$ x+ Z# ^+ M2 V/ L1 R6 l) [    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
+ E  ?$ v( b8 [6 J. Q- N0 G    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.7060776 {3 l" Y0 w) ]3 L1 y/ ~) @5 @- y
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.7060779 ]) I3 m# L8 Q; G; Q4 w
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
5 U" i; g1 l& l5 t+ ]; b- d& ]    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
* G" H  B7 ]! J2 ^# p& L1 C    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.7060772 T$ ^$ r7 {- J0 D- [9 D3 ^. j% B
    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
( {9 s$ t8 S# p) m3 A; s    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
! G# y& S9 Q& [3 [4 X% F$ a5 r    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.7060774 C' \0 [) s( V% d8 [, _
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
- Q) f1 T. _! A2 ?$ u0 \/ v    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
2 q: D  m  n9 ]% R7 R- ?  Q$ yPG_NOT_SCRUBBED 24 pgs not scrubbed in time, |* K- s" h4 v  E! Q
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
; }3 O! q( J8 m# d4 O8 U. L    pg 10.10e not scrubbed since 2022-08-01 09:11:50.7060771 g4 L5 h+ @  k  w# t# v" E
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
% o4 t6 k0 @( _    pg 10.de not scrubbed since 2022-08-01 09:11:50.7060775 |$ q8 m4 l9 Q3 U! \! y1 C8 c5 {; O
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077
) w+ \; ]/ R7 A) W; o. L; v) b    pg 10.af not scrubbed since 2022-08-01 09:11:50.7060779 ~! G+ M$ m# c/ L+ S
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077/ x+ s2 M3 D8 K( B+ R
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
$ H' b! i4 |$ o0 V    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
1 W! S1 R1 B8 n+ ]+ e    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077, U) O7 I4 o* I9 B* |
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
/ T- g8 E* N3 e& R& n/ E$ I3 f5 A    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077
) }4 ]$ n( \- N: T- R* [, j1 A    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077! ?8 {. g5 }! u- H& c" }6 {% e+ q
    pg 10.6 not scrubbed since 2022-08-01 09:11:50.7060774 b9 _+ [: \" s4 X/ F% C
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
4 ~3 ~% f: `( T" X" M* `    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
9 X6 Y8 O6 d) b# @    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077' L; C# _' {+ H9 w1 K7 v( F
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077$ b7 j8 H  S7 m7 o3 E
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077# Z3 i. ^& T& Z' n9 M
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.7060776 X2 p- H; i# l" C, J
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077& Q3 ^  P3 v+ G. Z+ @
    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077+ I1 \7 u% s4 W8 S
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077% {( g6 ^; b  A2 g
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.7060774 l: c* Q% P+ ^; v
[root@hostceph2 ~]# ceph osd tree/ I; ^4 x0 q: Q$ H  e# E
ID  CLASS WEIGHT   TYPE NAME              STATUS REWEIGHT PRI-AFF 8 {& b: f+ J- P4 o7 Q  s2 \3 p
-25       16.00000 root ssd                                       ' C2 D3 n) |! u3 ?
-26        4.00000     host ssd-compute06                         $ f! s3 d, K& \5 I( H+ ^- F: i; \
18   ssd  1.00000         osd.18             up  1.00000 1.00000
! M( O* h0 a( X4 ^( L+ j$ G 19   ssd  1.00000         osd.19             up  1.00000 1.00000
7 q4 H+ y6 ?' w 20   ssd  1.00000         osd.20             up  1.00000 1.00000 - ^; ]$ h- z9 m9 A  u. ?
21   ssd  1.00000         osd.21             up  1.00000 1.00000   O7 n- l* w2 X+ ?8 m
-27        4.00000     host ssd-compute07                         . {) O' Q7 E7 k( k: r7 ?7 }
22   ssd  1.00000         osd.22             up  1.00000 1.00000 8 @& i7 y3 q  w0 G- B0 `& y$ F
23   ssd  1.00000         osd.23             up  1.00000 1.00000
) @- Z: t. {2 Y  P( J  N2 H% C 24   ssd  1.00000         osd.24             up  1.00000 1.00000 ' Y* n+ s+ m+ {6 x& T1 B& y: q$ O1 e
25   ssd  1.00000         osd.25             up  1.00000 1.00000
8 C% X3 O* `2 Y0 c-28        4.00000     host ssd-compute08                        
5 C! m' F/ z2 |7 u6 V! Z% c 26   ssd  1.00000         osd.26             up  1.00000 1.00000 9 e' P* I$ l, t  l* g" ]6 \; H7 z
27   ssd  1.00000         osd.27             up  1.00000 1.00000
6 O! L+ w4 R! m, E, j 28   ssd  1.00000         osd.28             up  1.00000 1.00000 * Q( ?. @+ d% h7 J& K+ u1 f$ X% V& `5 ?
29   ssd  1.00000         osd.29             up  1.00000 1.00000   ^3 E, q. T- U& C9 n7 z/ `. `: I$ b
-29        4.00000     host ssd-compute09                        
+ q/ ~' ?7 O5 C* Y+ d& Q 30   ssd  1.00000         osd.30             up  1.00000 1.00000
' @9 J7 H3 S9 y- y0 ?" Q5 \ 31   ssd  1.00000         osd.31             up  1.00000 1.00000 4 ]" T; X- A  l- @+ W
32   ssd  1.00000         osd.32             up  1.00000 1.00000 4 v' v/ I/ n5 K
33   ssd  1.00000         osd.33             up  1.00000 1.00000 + ?& \- s' p( k0 j
-9       18.00000 root hdd                                       2 F; f& {; C* J" J6 a
-10        6.00000     host hdd-hostceph1                        
/ N5 k$ C; I+ P0 G# }: z  0   hdd  1.00000         osd.0              up  1.00000 1.00000
, H/ X! p  C8 g2 y  1   hdd  1.00000         osd.1              up  1.00000 1.00000 ! A/ C  Q; Z* Z+ k
  2   hdd  1.00000         osd.2              up  1.00000 1.00000
/ Q9 w/ E0 ^' D. {: N. T& M3 \  3   hdd  1.00000         osd.3              up  1.00000 1.00000
8 e1 @7 T5 U+ l$ N' }  4   hdd  1.00000         osd.4              up  1.00000 1.00000
2 p" p& E1 |! I2 y  5   hdd  1.00000         osd.5              up  1.00000 1.00000 , C8 V" s1 }6 O; [2 \( M" c: t
-11        6.00000     host hdd-hostceph2                        
' z6 v3 T( N0 h2 v  6   hdd  1.00000         osd.6              up  1.00000 1.00000
7 z: b/ [3 S3 N) j. X7 |1 m  7   hdd  1.00000         osd.7              up  1.00000 1.00000 * V6 M7 u# e% H' t2 p* p2 A8 |
  8   hdd  1.00000         osd.8              up  1.00000 1.00000 ' t5 L  c- ?8 f
  9   hdd  1.00000         osd.9              up  1.00000 1.00000
: W% F( ]/ j& P3 R# a# L3 ~6 U 10   hdd  1.00000         osd.10             up  1.00000 1.00000
0 F; |) F# _# i 11   hdd  1.00000         osd.11             up  1.00000 1.00000
' j# E9 m! h4 L-12        6.00000     host hdd-hostceph3                        
5 [. Z; a* V1 P! I 12   hdd  1.00000         osd.12             up  1.00000 1.00000 ; ]- T) h0 e9 d8 q8 ~0 T
13   hdd  1.00000         osd.13             up  1.00000 1.00000 4 M1 N; R, y( y& N" R4 M6 b( H
14   hdd  1.00000         osd.14             up  1.00000 1.00000 - b: m. x- E! i' H, ~
15   hdd  1.00000         osd.15             up  1.00000 1.00000 ' L# b0 C0 B7 a7 b/ ^$ d9 D  K3 k
16   hdd  1.00000         osd.16             up  1.00000 1.00000
7 V9 A2 q% v! X( t! d& V$ @( K 17   hdd  1.00000         osd.17             up  1.00000 1.00000 $ L% V! v/ o. x. U
-1              0 root default                                   
! x4 V# B5 d+ Y& z -3              0     host hostceph1                             
4 D2 S7 m7 P& r2 E0 u -5              0     host hostceph2                             " P8 o8 \0 C) Q- `2 V
-7              0     host hostceph3                             
" m; g1 t- }- b( g3 z. p[root@hostceph2 ~]# systemctl stop ceph-osd
- X1 N% ^  d3 U& h8 B$ c  A, R  v/ uceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      
3 H7 {% i" ^$ m+ o  h[root@hostceph2 ~]# systemctl stop ceph-osd
* t( u% O( L0 C- b& i. H0 y( Fceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      8 M0 Q4 s% j: H* ?/ R) V. M) _3 e4 e/ w
[root@hostceph2 ~]# systemctl stop ceph-osd3 G5 b0 d3 B. u3 Q
ceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      
' Q- @, ]! n4 G[root@hostceph2 ~]# systemctl stop ceph-osd@8.service
" Z" Q1 J' |+ |9 w( M[root@hostceph2 ~]# ceph -s- I) x  ^5 [7 t: d0 y; G
  cluster:
4 F8 l6 O+ n% |# N$ N( q9 w  x, P+ H8 q    id:     29046cc0-0682-496b-98b1-912e59964282
# r) t: _/ k" ^7 O4 k4 y    health: HEALTH_WARN
2 u# e* M0 X& t9 X* d1 z3 _: h+ K3 l            1 osds down
  Q0 o, n- A4 Z/ R1 J0 G9 d& T            Reduced data availability: 24 pgs inactive
- v) P6 ]7 r8 m- h9 p            24 pgs not deep-scrubbed in time0 @7 g" f  k9 _  |
            24 pgs not scrubbed in time" G! B* Z3 T- _7 ?9 J
; ]5 z$ {1 F! |' h
  services:+ w+ f2 f4 k; S, G
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)1 `/ u/ M3 [1 f
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
0 ^5 p+ G% B1 r3 D5 h. ?    osd: 34 osds: 33 up (since 3s), 34 in (since 3M)
9 [; c  o! y" q! T ( J. v' l$ n8 J; @2 K
  data:7 S; `" a- |% S
    pools:   9 pools, 5760 pgs
7 [& g/ n: P& A  K    objects: 3.11M objects, 12 TiB, x3 n% ]0 ~, T, V$ Q
    usage:   33 TiB used, 92 TiB / 126 TiB avail
* y  ^( o* [) R$ _$ ?1 W    pgs:     0.417% pgs unknown8 ?! Z- W6 r& Q$ @- @# u
             5504 active+clean
7 g/ `% s6 m& Z4 a# P, c, R             231  stale+active+clean4 p  j# m% r/ N- F$ s1 ^# q
             24   unknown
( n! X8 m: }% ]( `! P& V+ J/ o             1    active+clean+scrubbing+deep
2 _0 G) ^; V7 @, E+ Z
: C8 `) c4 p; Q  io:, s1 s7 s1 N9 U$ I5 v" M: n: L( p+ o$ b. m
    client:   441 KiB/s rd, 21 MiB/s wr, 504 op/s rd, 546 op/s wr
: `* q9 x. ~6 a: v# f% O 9 A4 T0 V6 _! n& t% b( r
[root@hostceph2 ~]# ceph -s
$ [; P/ s' S( `8 g  cluster:
( Y' n/ Y7 i+ V6 E8 S' a/ V- f+ F; ?    id:     29046cc0-0682-496b-98b1-912e59964282
& V6 h8 @2 f7 d& n    health: HEALTH_WARN+ I$ K) E+ U" }/ Q: Z
            1 osds down- j3 S2 O9 x2 L# Y1 w0 ]9 m
            Reduced data availability: 24 pgs inactive: g" O  F: _0 P+ w( O. _
            Degraded data redundancy: 300823/7651891 objects degraded (3.931%), 465 pgs degraded
: g( }+ E2 {* I8 h" z3 T            24 pgs not deep-scrubbed in time
8 J& w+ X9 T0 X, }4 I            24 pgs not scrubbed in time
( z4 I; v$ c! @* Y
$ i0 Q% M! K2 G  services:9 U/ V6 x- _' h2 A% |, [) F
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
2 `) u% d+ v7 Z6 _* V3 l! \" Z    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
# K4 U% Q* S- d. q( m. K- O, ?    osd: 34 osds: 33 up (since 10s), 34 in (since 3M)% [5 ^) Y/ I6 K$ y3 M

1 k* m( h* m9 W  data:
$ D* j" H) u. {% v  E$ y  k    pools:   9 pools, 5760 pgs( Y  Z/ x( `+ c8 r
    objects: 3.11M objects, 12 TiB' _! J5 I4 {: ?- P" n2 w  ~
    usage:   33 TiB used, 92 TiB / 126 TiB avail
* @0 d- Z  y6 J, ]    pgs:     0.417% pgs unknown
) T9 t. m# h( Q             4.010% pgs not active: e1 p- y5 k7 P
             300823/7651891 objects degraded (3.931%)7 d$ J! Q$ M" `$ D
             5182 active+clean# F6 |" X& a) M6 s% H
             234  active+undersized+degraded) L! P) @: u4 ]$ q, E
             231  undersized+degraded+peered
: Y) r+ P  s% E+ ^+ T             88   active+undersized+ T; ~4 |+ ~: p
             24   unknown
7 X  w, Z) ]8 E- x2 x             1    active+clean+scrubbing+deep, b# h6 J, P4 }
- h9 _: H. a5 j
  io:
! ?* J6 X' l5 l- }9 ]/ P    client:   15 MiB/s wr, 0 op/s rd, 567 op/s wr
) s8 s7 q$ L8 C( c; v
: m4 s; `4 b4 d8 s  L+ m[root@hostceph2 ~]# ceph -s
! N8 u. }- r- z8 ^4 Z$ c7 |  z  cluster:. q) F. F% P6 ]  q! N
    id:     29046cc0-0682-496b-98b1-912e59964282
9 s0 v' r1 v: ~2 m" \    health: HEALTH_WARN! e8 R# u/ y. G
            1 osds down
; V2 N( _1 j% ~8 g% s            Reduced data availability: 24 pgs inactive+ `. S" i* q( O1 b3 `5 b
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded7 J  M/ v; x& C
            24 pgs not deep-scrubbed in time
$ l6 f1 t! O2 d  H  a: P. ^7 T  O  L            24 pgs not scrubbed in time4 S! r# R- V3 p, z2 e; n( S
# S. N: z1 y$ d; T
  services:) m' w3 H+ ?: E! r
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m); y& G& ?' J" u
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3" F: |% J' d9 e. b) Z
    osd: 34 osds: 33 up (since 14s), 34 in (since 3M)+ A  }* `/ O' S- K

# {7 L2 n4 w9 y9 V6 j4 S  ~* F! u$ {2 N  data:
4 ^; O/ T1 o! A1 [( n. e    pools:   9 pools, 5760 pgs: d$ d5 t4 i2 `6 V
    objects: 3.11M objects, 12 TiB, e; w% [6 V& F' d2 S& E# A, R% X
    usage:   33 TiB used, 92 TiB / 126 TiB avail
: `  D/ I2 W1 u0 F    pgs:     0.417% pgs unknown
4 w) `4 c5 f, n5 d- y/ W             4.010% pgs not active
. `, d3 G' q. A: u' O1 ~             300823/7651894 objects degraded (3.931%)+ P2 F. N% w. e. L6 S; Q
             5182 active+clean
) \/ ]2 P* X2 n( H9 g- b9 `6 N             234  active+undersized+degraded
2 q" t) f& m* u             231  undersized+degraded+peered
. D- }9 d+ L/ P0 d1 D& g             88   active+undersized, K& ^6 b* B5 X1 e
             24   unknown2 P7 ~: y, D8 o* [
             1    active+clean+scrubbing+deep
; ?. a. n" v  F% K- i1 m , \: f( D6 t) F4 C- i# F/ R
  io:: W# z5 R5 U( ~4 @" R% m1 \
    client:   18 MiB/s wr, 0 op/s rd, 598 op/s wr
; l) l+ `" K: c* p8 m! c! I
; ~8 u9 V6 O* F7 L. R; S, d8 q' @[root@hostceph2 ~]# ceph -s
/ W1 F% w) g1 b6 }  cluster:( d4 K, ~) N  W# H) E8 X5 `- Q$ a
    id:     29046cc0-0682-496b-98b1-912e59964282- s; ~4 J* [. W
    health: HEALTH_WARN. D! d8 n0 K) v  C4 Z; w; |
            1 osds down8 I* H0 h: ~! Q2 Y8 k
            Reduced data availability: 24 pgs inactive
1 ?$ A% d+ a" C/ v) C. y: P+ \3 L            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
+ i5 l1 @7 O$ s" E( L; Q% G# B6 P            24 pgs not deep-scrubbed in time
$ G- p& ~8 S7 P0 S! P            24 pgs not scrubbed in time
: }1 w/ j2 O2 A' r; R# w
& }3 _+ ~3 ^0 [" N1 k  services:: }8 O: i6 U) g& w5 t
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)) \0 F  Y, s' F7 i
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph30 h! W7 j5 t+ M, q8 p' E; k
    osd: 34 osds: 33 up (since 16s), 34 in (since 3M)
" B5 r0 y# U5 l* Z2 t: N 6 W4 r5 ^. ?' e6 Y
  data:% G3 J/ ]) _; Z) W: I, p# G' H
    pools:   9 pools, 5760 pgs. O/ U& ~+ {( S
    objects: 3.11M objects, 12 TiB
2 E5 x# U9 h# E& [8 C9 W; d    usage:   33 TiB used, 92 TiB / 126 TiB avail" @; y3 h* T( o' O4 w( b2 ]
    pgs:     0.417% pgs unknown
1 ?7 U/ N; t3 O# x* X             4.010% pgs not active
# p- V2 @% l( B9 X             300823/7651894 objects degraded (3.931%), y2 S3 B& y: a
             5182 active+clean
% g5 U. ]! L+ Q2 |) K6 J3 o/ A             234  active+undersized+degraded
3 L7 Q1 h5 i# s2 C) m6 b             231  undersized+degraded+peered  {& {: C* B. n0 W% ]
             88   active+undersized2 J' }  z% H4 F, ^& z) O
             24   unknown
9 X5 R* y3 t7 s7 @. A6 r, i* q             1    active+clean+scrubbing+deep; v. t8 ?" ~8 k2 m" [1 `
( d! \1 y7 B; s) a  I4 P
  io:; r7 d) q" u, h' o  q4 S& t
    client:   19 MiB/s wr, 0 op/s rd, 591 op/s wr
$ @  ?; f5 c& @2 r, ^) o5 e
6 `( t2 [- m/ n/ ~2 k) P[root@hostceph2 ~]# ceph -s5 m5 |( r- E( H
  cluster:
2 g) a) l3 l, D8 @% l    id:     29046cc0-0682-496b-98b1-912e599642829 v# f; q' ?, o* r9 s, ~, C
    health: HEALTH_WARN
7 y+ S, D: B+ Y/ K            1 osds down) C* p5 t2 U4 S. r
            Reduced data availability: 24 pgs inactive& R; o2 S& g" ]! W2 u
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
2 o# i' i% W7 p' t% |7 ?            24 pgs not deep-scrubbed in time
$ u; ?5 R/ P0 W            24 pgs not scrubbed in time. |0 b# N/ |# X8 F5 @; J% m
5 ^- J' H+ A( G
  services:1 b' q! I2 p% ]7 A2 e3 R& O
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)9 v: Q7 Y% N  O
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
- f8 [' e) k0 {3 a    osd: 34 osds: 33 up (since 18s), 34 in (since 3M)( X# o6 E, P! ?0 d: K
' {# H) X% t8 }7 b& D+ q# y
  data:
  s8 p7 r; U6 T7 x    pools:   9 pools, 5760 pgs
/ \$ l* J' N' o% O, Q# L. i    objects: 3.11M objects, 12 TiB
; R1 f8 R* r% N5 f6 ?4 @: g    usage:   33 TiB used, 92 TiB / 126 TiB avail
- a6 ^& I9 ^2 l' x) `% }! E    pgs:     0.417% pgs unknown
3 W7 O5 B/ [; @! u% y) Z5 f2 m; h             4.010% pgs not active
) T2 Q( [& X$ b& M6 E+ y             300823/7651894 objects degraded (3.931%)
1 X: `/ h7 c/ i& ]* D1 P; ?             5182 active+clean
0 E) a3 }3 a$ S3 J             234  active+undersized+degraded: g  y. |0 u5 a( a
             231  undersized+degraded+peered
1 q/ W" ?2 S0 A- x, }. N% a" J             88   active+undersized
* b: j& v9 H9 @# b- c( }             24   unknown$ `* |, f* z: f
             1    active+clean+scrubbing+deep- A9 V5 M0 h( N9 `! ~' L" v( H

  D# V6 S4 k( @9 Y: }- P( m% n* k  io:
) n) \6 t2 x, Z. A, n1 I    client:   43 KiB/s rd, 19 MiB/s wr, 30 op/s rd, 517 op/s wr  U* |/ W  U3 ~0 {
' N' s' Q7 U9 a  Y4 W( ?3 E
[root@hostceph2 ~]# ceph -s: D  N/ f$ z. x) X5 z
  cluster:
3 G: j4 X- \6 i    id:     29046cc0-0682-496b-98b1-912e59964282( n7 w/ l2 x; a! n. Z9 x
    health: HEALTH_WARN; I1 a2 k1 E) I( }
            1 osds down
' a4 \' s1 U) P4 P7 M' i            Reduced data availability: 24 pgs inactive3 d1 v- ^# Q3 [7 _
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded* Q* a: r3 P( ^% p- c
            24 pgs not deep-scrubbed in time
( g8 t. W+ J' e            24 pgs not scrubbed in time
8 X% d/ \9 K1 b; ~; r2 ] ; _- b( L4 E1 v" H5 ~0 X
  services:
7 s  ?' _& u5 P$ e1 t7 y) r* t4 j    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
# \# A) X, Y5 M5 t/ y$ r& R    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph30 S0 C4 i" m8 c. J
    osd: 34 osds: 33 up (since 20s), 34 in (since 3M)
3 e; N  T$ S! P3 l  P& l+ K
1 x* @8 J# S; `. c; S( A( ]# W8 i  data:4 u/ i6 g% R% [; x: K* r8 i/ b
    pools:   9 pools, 5760 pgs
% T+ }$ D' W9 t5 ~; R3 [9 Z    objects: 3.11M objects, 12 TiB) i* R4 c  ~& \: h
    usage:   33 TiB used, 92 TiB / 126 TiB avail; r: Q  h( p: q  u/ x
    pgs:     0.417% pgs unknown
! c- Z0 ^) d1 @6 U9 r             4.010% pgs not active& O6 B; p6 q' L( O
             300823/7651894 objects degraded (3.931%)
. A8 B  B  a# N8 h0 \; D2 c- ?6 _             5182 active+clean
. a1 N* K3 k5 C" i+ n             234  active+undersized+degraded* j0 O$ f( _% u% {0 K) e% P: A! O
             231  undersized+degraded+peered: z: m. k4 U9 j9 ~; r8 [) h6 K: z9 {
             88   active+undersized
3 S8 B% j0 t) n  h% ?             24   unknown7 F. L! ]! Y+ U) B1 s
             1    active+clean+scrubbing+deep9 R+ f* _, ^8 K) ~: V: o4 p1 f

3 H; ~: f: U9 ?" l  io:% x2 T7 G6 ]) n8 {# }, C
    client:   66 KiB/s rd, 19 MiB/s wr, 30 op/s rd, 542 op/s wr/ m; \6 Y+ T% o6 D2 L3 ]
回复

举报

返回列表 发新帖
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

本版积分规则

返回首页|Archiver|手机版|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )

GMT+8, 2026-6-11 23:02 , Processed in 0.021149 second(s), 26 queries .

Powered by Discuz! X5.0

© 2001-2026 Discuz! Team.

快速回复 返回顶部 返回列表