将设为首页浏览此站
开启辅助访问 天气与日历 收藏本站联系我们切换到窄版

易陆发现论坛

 找回密码
 开始注册
查看: 60|回复: 2
收起左侧

完美解决过程Reduced data availability: * pgs inactive 24 pgs not deep-scrubbed in tim

[复制链接]
发表于 2022-11-8 10:29:11 | 显示全部楼层 |阅读模式
购买主题 本主题需向作者支付 2 金钱 才能浏览
 楼主| 发表于 2022-11-8 10:45:39 | 显示全部楼层
[root@hostceph1 ~]# ceph -s
2 g  N8 O" v% j  cluster:
0 L' f3 l# \. z* e9 s- K: z2 F    id:     29046cc0-0682-496b-98b1-912e59964282
! y" J4 y; m+ l    health: HEALTH_WARN
0 g' m/ l8 ^8 Z* R% B2 H3 [2 Y8 a" m            Reduced data availability: 24 pgs inactive  N- g6 c) {# N8 C5 f
            24 pgs not deep-scrubbed in time% D- n4 K) d9 W8 j5 b9 H9 E
            24 pgs not scrubbed in time9 K" l9 S) x% b8 R1 Q) V/ z0 ?; x; l: ^
. x% U$ \) i- I: T1 E# s; ~
  services:) |, W1 i2 G2 N. c) ]! C
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 3M)- W% T3 c! x9 b7 C
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3& [9 W; n& b3 V9 X. x# U
    osd: 34 osds: 34 up (since 3M), 34 in (since 3M)
8 z8 `. B2 e) H% u/ @4 q   B4 G8 ?; H9 B( d- }! {/ a
  data:
' w( v6 q7 e( g( `# l/ ^$ Z& N& C    pools:   9 pools, 5760 pgs
$ s8 x7 q9 @/ m  f" d6 Y    objects: 3.11M objects, 12 TiB
! G7 g& ~$ p, x* K5 @3 O/ n    usage:   33 TiB used, 92 TiB / 126 TiB avail
8 K0 A# Z7 \  B7 v( L% V' ?  ^    pgs:     0.417% pgs unknown
* k: w  L- f. X- v" i  G9 c             5735 active+clean
- n6 E2 J: M1 w( V             24   unknown
3 i0 A" e( e7 b. s8 d) K             1    active+clean+scrubbing+deep
2 z! P4 f8 J# D. A8 A' t$ t
3 i% ]0 p9 I( R  io:
3 G% @% f4 w- ]! n( ^' U    client:   9.7 KiB/s rd, 20 MiB/s wr, 12 op/s rd, 625 op/s wr
0 O5 W# D% ^8 l) A& p
; }/ Z2 y1 J* A" G: K- ~[root@hostceph1 ~]#
- F% p0 }: f( F[root@hostceph1 ~]# ceph -s
; K$ y0 m% b- Y( J# a  S  cluster:$ f+ V" b" r' m/ _) I9 ^
    id:     29046cc0-0682-496b-98b1-912e59964282# A6 a5 B  a- u- Y$ f) s$ r! ]
    health: HEALTH_WARN' T3 \1 l/ O2 r0 c& a( r
            Reduced data availability: 24 pgs inactive' E/ K5 P9 R9 y# e1 K! P5 h
            24 pgs not deep-scrubbed in time
3 B0 F3 ~' w8 A6 u1 T) j& r            24 pgs not scrubbed in time
6 R4 `1 V3 X$ p% G' U# h- |7 ` . Y" M5 W  D, C
  services:" n* K) j  V1 V3 v$ S
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 3M)
0 w2 q( Y& }# q    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3% z/ Q& E0 c; h% j3 Y: s& R& m
    osd: 34 osds: 34 up (since 3M), 34 in (since 3M)
/ Z7 n3 k  ?% T/ `- Q% B 7 l$ D: Q4 u! x; E' ^+ B  k
  data:; H! J) U' y! A7 K) _  \) ?3 L
    pools:   9 pools, 5760 pgs, u- u' t/ z5 U/ d& W1 L' O
    objects: 3.11M objects, 12 TiB( H; P+ a5 h! h8 Y
    usage:   33 TiB used, 92 TiB / 126 TiB avail3 `/ o/ Q2 \9 A! k
    pgs:     0.417% pgs unknown
9 g0 L- C! B1 L6 s* X5 K& S             5734 active+clean
+ M& X2 J7 \  O% _             24   unknown
- ?, V. ?  s+ l- R% n             2    active+clean+scrubbing+deep8 A& k8 `( c8 ^

% H2 l4 K( o& W9 S2 f. Z  io:
" s9 c% _7 ~+ T. J/ D    client:   90 KiB/s rd, 22 MiB/s wr, 103 op/s rd, 531 op/s wr; _; C% Q7 v& z& b& |* [( O; a6 q

- O4 q, r( m1 d2 F% }, C) {: s/ c[root@hostceph1 ~]# ceph health detail ! H! @1 R, h/ j- G! _+ n
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time, K; C+ f3 P- ^# p) Y+ K: p" Z$ y
PG_AVAILABILITY Reduced data availability: 24 pgs inactive: r7 V9 O* G2 n$ T$ j
    pg 10.6 is stuck inactive for 8558718.511785, current state unknown, last acting []" z( T7 N' s  ~5 F" v" P' G+ |; E' O
    pg 10.e is stuck inactive for 8558718.511785, current state unknown, last acting []
8 a' J5 e2 D- n& R. C/ T3 B, t2 M( J    pg 10.21 is stuck inactive for 8558718.511785, current state unknown, last acting []& G7 u0 E2 l6 _6 M; l8 \& p- E
    pg 10.3e is stuck inactive for 8558718.511785, current state unknown, last acting []
  |( V/ l, N# d/ ^' Y! _    pg 10.41 is stuck inactive for 8558718.511785, current state unknown, last acting []  g- T5 g3 D1 _! G# V
    pg 10.6d is stuck inactive for 8558718.511785, current state unknown, last acting []
5 R; m4 N- G+ J& g    pg 10.81 is stuck inactive for 8558718.511785, current state unknown, last acting []
! H  H7 f* w5 w  j! N+ X    pg 10.88 is stuck inactive for 8558718.511785, current state unknown, last acting []
$ U& ]$ `; }6 L% a9 f- ^4 I$ |    pg 10.90 is stuck inactive for 8558718.511785, current state unknown, last acting []. R+ P: v2 e# Y. s, P; ?. [0 @
    pg 10.af is stuck inactive for 8558718.511785, current state unknown, last acting []; ^4 S2 @4 v7 t1 k" _
    pg 10.c1 is stuck inactive for 8558718.511785, current state unknown, last acting []4 \& u* M3 ^" i$ o+ b' B
    pg 10.de is stuck inactive for 8558718.511785, current state unknown, last acting []# ]8 g1 ^! v% s0 M
    pg 10.f4 is stuck inactive for 8558718.511785, current state unknown, last acting []
# {8 n. d: r4 m    pg 10.10e is stuck inactive for 8558718.511785, current state unknown, last acting []
* q/ b2 y$ Z$ ^    pg 10.114 is stuck inactive for 8558718.511785, current state unknown, last acting []
# O; W5 s: [  ?( f. P) b    pg 10.11b is stuck inactive for 8558718.511785, current state unknown, last acting []+ m9 ?. K& d3 O# G, B
    pg 10.137 is stuck inactive for 8558718.511785, current state unknown, last acting []
  T$ e/ |1 |0 O; |( \4 @8 }6 d    pg 10.164 is stuck inactive for 8558718.511785, current state unknown, last acting []9 J; u) z4 f0 S) L5 f
    pg 10.166 is stuck inactive for 8558718.511785, current state unknown, last acting []( o# u) C9 Y2 c# V& P  n
    pg 10.16e is stuck inactive for 8558718.511785, current state unknown, last acting []; a5 W, w7 h0 y- w6 N" d
    pg 10.19b is stuck inactive for 8558718.511785, current state unknown, last acting []
# A1 x2 b1 t( T, R/ O' _( n    pg 10.1ab is stuck inactive for 8558718.511785, current state unknown, last acting []
# o7 u0 \! i( c% q- C    pg 10.1ae is stuck inactive for 8558718.511785, current state unknown, last acting []
, I9 \+ w) X' a' m8 A3 O2 R    pg 10.1b3 is stuck inactive for 8558718.511785, current state unknown, last acting []* b/ V2 b) N# F& n, F8 F: z; y
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
7 H( B" W) h$ {: v6 k& e    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.7060773 V5 [2 X) X  n/ r! ^
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
* G) Y' |; `" E4 ]" z$ x" c' G    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
# k( Y/ H+ T$ r% H" o' x    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
: Q% A8 l5 y# ], R    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
3 y2 _; Y1 H7 c# y6 P: S    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.7060777 v  h. }, h4 d! n
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
( I) O9 C" j! e0 F8 M* ~. m/ u6 K! f, K    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
+ ^; d  j. p% M7 i  c  S    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077) F1 o! U$ K  I* Z! y
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
$ v7 M) f/ a( x5 p0 E: w! z# ?    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
) S" d4 G2 {* Q( K    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.7060776 O, H' f6 A& p) t" [2 _/ a
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
' i$ V0 n( t0 {0 [% }* }* [3 u    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077. m) a8 Z) a& d# V9 w4 r' G, `
    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077
6 v- D0 x2 G, J8 W& P0 i    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
1 \' r; ]: |  h    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.7060775 O6 R! D; g) t* s
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.7060774 R; X# [# a. _9 k) e
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
- _5 V5 R' }; v5 ?- X" L    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.7060771 D5 l1 `5 c2 ^# L" u+ m
    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077: D7 H$ I. D3 x2 [- Z$ a- \
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077# x; V' R0 L7 q( r% N6 p
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077) u. Z2 M! W: ?' ]
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
% Q; }: y) x8 X8 o0 \3 IPG_NOT_SCRUBBED 24 pgs not scrubbed in time7 t& L9 `7 i9 J. N% {
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
' u7 N4 N1 c: S+ i' [" y5 t    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077. k# _0 u( \4 z; O1 M1 k
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.7060773 A( Q/ n1 I; G$ J
    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077: p+ d* C' p" H9 H! K9 [5 }
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.7060776 @! G9 z1 T+ z$ b' Z" L
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
" \* b5 R$ q2 ]' Y) j    pg 10.90 not scrubbed since 2022-08-01 09:11:50.7060771 \. g+ D& b/ R
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.7060774 m4 N  b9 U  Q0 @7 Q
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
/ x# f: [, U, S# n! m3 Z    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
  a9 e: c. C* O& x* G' g    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
/ V3 ?9 [4 I0 D# T    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077
( n% L4 ?! f5 \1 U& f9 u% M    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
2 {- x- m1 E6 D/ h% x! A    pg 10.6 not scrubbed since 2022-08-01 09:11:50.7060775 e) q5 ^; o. ^6 W
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077* y: j! M6 Q0 K0 _
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
7 {$ H5 }8 U1 X    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
. a: V. L+ V6 L# b    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077" M) Z# l' c8 z( L$ t
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
9 X. A; K, |6 {( O0 U    pg 10.166 not scrubbed since 2022-08-01 09:11:50.7060774 T5 q9 u) n9 V
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
- E6 G1 f& U. i7 i  O" N    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.7060772 n6 m  L5 k* }$ h
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.7060779 _9 b  x. Q' A9 @4 J) F
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077
' U* A- l1 L* q: y# r8 {- a& |7 Z  ~3 W[root@hostceph1 ~]# ceph pg rep2 F) O6 x, F  l3 S( W
repair  repeer  
! M) `2 Y# N6 D) n6 K+ o2 V[root@hostceph1 ~]# ceph pg rep. U" O$ p1 |2 T9 W" W5 P' C
repair  repeer    W" P0 _) Q  w# O  ?/ O
[root@hostceph1 ~]# ceph pg rep( H, C. a" Y1 U8 O8 N
repair  repeer  
  b: b6 s/ J1 r: E+ i$ Y" h[root@hostceph1 ~]# ceph pg rep  k& U0 Y2 E" K  P9 F) ?& h
repair  repeer  
8 M) c  O3 R: n% R( g! u[root@hostceph1 ~]# ceph pg repair 10.6
5 f" j! I) @, S; Y* d4 D" Pinstructing pg 10.6 on osd.8 to repair* L% |' d; X3 V* a% a* I# f- n
[root@hostceph1 ~]# ceph health detail ) S+ \5 y# d; O( t9 \
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time( L7 ]! V! V3 |) F
PG_AVAILABILITY Reduced data availability: 24 pgs inactive
/ X9 j' A. J/ F    pg 10.6 is stuck inactive for 8558779.003482, current state unknown, last acting []
) J- s* N$ J- d5 U) `$ }- z7 I: s    pg 10.e is stuck inactive for 8558779.003482, current state unknown, last acting []$ o$ W% k5 L7 g0 f# K9 E0 H
    pg 10.21 is stuck inactive for 8558779.003482, current state unknown, last acting []
4 l9 w: e2 q/ k/ F* R( y0 V    pg 10.3e is stuck inactive for 8558779.003482, current state unknown, last acting [], e8 i. T: j+ w/ ~/ T& ~8 Q# ?" J
    pg 10.41 is stuck inactive for 8558779.003482, current state unknown, last acting []
6 d+ w% Z- u" F5 w% L6 c    pg 10.6d is stuck inactive for 8558779.003482, current state unknown, last acting [], }( N6 b( Z' j0 Q! d
    pg 10.81 is stuck inactive for 8558779.003482, current state unknown, last acting []
. s2 S4 ~( r" Q    pg 10.88 is stuck inactive for 8558779.003482, current state unknown, last acting []) H8 |6 e  W5 e8 m  ]
    pg 10.90 is stuck inactive for 8558779.003482, current state unknown, last acting []! |' c6 I& Z( \' e7 ^
    pg 10.af is stuck inactive for 8558779.003482, current state unknown, last acting []" V. ?9 }# T- S1 s. F) H- n
    pg 10.c1 is stuck inactive for 8558779.003482, current state unknown, last acting []& q! K7 q. p4 I! W1 F4 {* k! e
    pg 10.de is stuck inactive for 8558779.003482, current state unknown, last acting [], _% c4 C) C8 m0 ~
    pg 10.f4 is stuck inactive for 8558779.003482, current state unknown, last acting []& G/ m, ~% S+ ^5 Y
    pg 10.10e is stuck inactive for 8558779.003482, current state unknown, last acting []7 r' Q3 D3 }& H5 Q& F+ R" z
    pg 10.114 is stuck inactive for 8558779.003482, current state unknown, last acting []) L' a7 T! {, B$ p& h& c: L* Z
    pg 10.11b is stuck inactive for 8558779.003482, current state unknown, last acting []
% ?( L9 o' h, p7 u    pg 10.137 is stuck inactive for 8558779.003482, current state unknown, last acting []. @/ q( F) K3 d6 l/ u" C
    pg 10.164 is stuck inactive for 8558779.003482, current state unknown, last acting []
. _, {! b& _( x0 @# K* Q    pg 10.166 is stuck inactive for 8558779.003482, current state unknown, last acting []1 N' U$ z3 X3 L* K- C
    pg 10.16e is stuck inactive for 8558779.003482, current state unknown, last acting []
  r; |$ c5 N& x1 @- @    pg 10.19b is stuck inactive for 8558779.003482, current state unknown, last acting []' W5 G5 c, d6 {, }6 c* ?8 O1 u
    pg 10.1ab is stuck inactive for 8558779.003482, current state unknown, last acting []! H/ L0 R& p, w: K; Y: W; f3 K7 v6 C
    pg 10.1ae is stuck inactive for 8558779.003482, current state unknown, last acting []! E. c. j' w7 T* h+ {! s  ~
    pg 10.1b3 is stuck inactive for 8558779.003482, current state unknown, last acting []
$ Y8 w/ v1 @& S( n" mPG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
3 ?  W- X7 [9 u    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077$ H0 ?: K; r! t2 y2 _- z$ P
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
4 S8 ~/ N+ V* q; D    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077( ~0 z% i, t6 I/ J
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
' k5 t0 T6 c; k" q6 u# @' Y    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077/ v4 D& D7 L# ~4 F
    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
  h  A% J# f$ H, S    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077/ R6 ]0 p5 U: T: m9 n3 Q( R
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.7060773 `! Y: G; F+ \" z4 _* x
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077- J5 I1 ~/ P& u1 o
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
" c) A# c% P! c6 J5 Y    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.7060771 c; V! T+ ~: \( w% e# U
    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077' v( @" a* W1 v
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.7060773 e0 [  ~. o7 B* U
    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
9 k7 N! e5 Z0 G4 L: |% r0 b  l    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.7060772 w4 B+ j  l& i: [  Z+ X: m
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077: w/ ~, \, A7 ^6 s8 V1 _6 p
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
  Y1 v$ G0 Y: b3 ~; l! D    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
6 s/ r% y( _1 Z( W0 l+ Z* i    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
3 w- O' C- U/ n; |1 M( E    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
6 }* J7 O, Q9 K$ B7 c    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077$ h) n9 i3 ]  x
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
" `( [% Z9 ]$ l    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
+ y2 k* P- J0 Z; m/ |/ H    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
' E1 O) J5 f, l$ i  p# @PG_NOT_SCRUBBED 24 pgs not scrubbed in time' W: I/ j% c( D  z
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
7 I) ~1 I% A) ~% |3 |% f    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077
  q* R4 {6 j; ^/ e! g    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
, K3 ~' h: o, a* {    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077, s8 d% n, F) E# g, ^' \+ V
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077* C! p8 c3 C! P
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
/ U) J" d) p8 @9 }( `/ R; e" a$ v    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077. h# _+ h9 h  D7 L) d
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077  J: i9 n& H3 d( w& M- b
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
* E( T1 I# V" ?! Y, \8 e+ w    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
1 j) X: B/ n. Q! U    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077. L* p# g+ I+ z( z9 m+ H8 D
    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077! J# k! h( |9 z7 }, g: W# b! W8 o
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
& y( _7 I! [' d2 M+ S0 ^    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077& ~* p" {& E! j" Z' u0 P+ U/ W
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077# t0 A* f5 b- b: S2 p% m' H: q2 A" i- @
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077$ l4 G- x  |! a1 \6 Q2 J9 x
    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
1 R& X* b0 F7 J1 _7 }) e    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077
2 l; q4 W. {$ e2 G! Z    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077" u! J3 c# T" T& J6 p/ q
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.7060772 I3 M* x8 ~' v- m5 v* E' g2 o) o% R
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
' H0 s, K9 U  x% i# f3 ?/ {/ m    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077  ^' p# p' e' Z6 ?
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077' T( n9 n7 I) l) v1 o# _/ v
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.7060773 e, N3 x1 @9 }
[root@hostceph1 ~]# ; b& [4 o# {! c0 C: x5 p1 n
[root@hostceph1 ~]# ceph health detail |grep pg) @! s4 u/ q, R; ~0 q; ^8 n2 P
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time2 [% o- n; h/ O0 H( ?1 B
PG_AVAILABILITY Reduced data availability: 24 pgs inactive) l; s  ]8 K7 h) N
    pg 10.6 is stuck inactive for 8558795.140009, current state unknown, last acting []+ w- i0 a- a6 V2 r3 E  e! K: D
    pg 10.e is stuck inactive for 8558795.140009, current state unknown, last acting []
# s1 f" W+ h% }. x; z8 V9 l    pg 10.21 is stuck inactive for 8558795.140009, current state unknown, last acting []
  ?9 c3 a9 m. Z$ r7 M5 h5 g. _    pg 10.3e is stuck inactive for 8558795.140009, current state unknown, last acting []
* r& A2 P: f  f3 S0 p    pg 10.41 is stuck inactive for 8558795.140009, current state unknown, last acting []8 s! g& m- _* g5 ?0 ^* v
    pg 10.6d is stuck inactive for 8558795.140009, current state unknown, last acting []
4 a- Y4 |& o* t, t# q    pg 10.81 is stuck inactive for 8558795.140009, current state unknown, last acting []. R% r- x2 X+ {5 E
    pg 10.88 is stuck inactive for 8558795.140009, current state unknown, last acting []4 _  g2 t* x- }4 M5 H) n
    pg 10.90 is stuck inactive for 8558795.140009, current state unknown, last acting []: F" }0 F  {2 a: y3 I
    pg 10.af is stuck inactive for 8558795.140009, current state unknown, last acting []  D+ E$ Q9 a. B9 j
    pg 10.c1 is stuck inactive for 8558795.140009, current state unknown, last acting []9 b4 I# b+ G* ?" N, ^5 O
    pg 10.de is stuck inactive for 8558795.140009, current state unknown, last acting []
1 o/ ]4 l9 a& N# O+ I    pg 10.f4 is stuck inactive for 8558795.140009, current state unknown, last acting []# d; B" m" R6 U2 I
    pg 10.10e is stuck inactive for 8558795.140009, current state unknown, last acting []" x. Z& P  f" t8 X3 W
    pg 10.114 is stuck inactive for 8558795.140009, current state unknown, last acting []
6 P, a, e) m! c' X( D0 B    pg 10.11b is stuck inactive for 8558795.140009, current state unknown, last acting []
1 [2 }9 W( c$ ]& U. q* K3 T/ v    pg 10.137 is stuck inactive for 8558795.140009, current state unknown, last acting []  H: S& a  O* h0 z/ }
    pg 10.164 is stuck inactive for 8558795.140009, current state unknown, last acting []5 V4 ~, B0 \0 x
    pg 10.166 is stuck inactive for 8558795.140009, current state unknown, last acting []- c1 n) e/ l7 U" x2 U: b. k
    pg 10.16e is stuck inactive for 8558795.140009, current state unknown, last acting []
7 r; Y0 `- {+ R, x1 M& l    pg 10.19b is stuck inactive for 8558795.140009, current state unknown, last acting []( t# l4 D5 o5 v9 u
    pg 10.1ab is stuck inactive for 8558795.140009, current state unknown, last acting []1 l7 Z: B9 [' ]. g8 n
    pg 10.1ae is stuck inactive for 8558795.140009, current state unknown, last acting []
" J$ s0 X+ H+ U    pg 10.1b3 is stuck inactive for 8558795.140009, current state unknown, last acting []
7 T* p) T% j5 I7 B, V! ~+ M+ A4 KPG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time7 o" @0 v# x, U% B
    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.7060771 |% b7 @* O/ Z( ~
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077; N2 p* n9 g/ R0 @& C: C
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077# {" g2 B( P& ~- x
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
+ y3 `& e* }& L6 e+ J. U$ ?    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077' |2 }6 e; a  ^7 d* ]
    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
# r/ ]; S4 i9 v4 _    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
! G0 R4 W" [) o% r: `    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
% h: d2 V! ]' X1 F5 W    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077
% D" K$ F) P+ H" q- c$ J    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
' I' O/ X3 b+ `& _2 i    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
; K/ h/ |0 J" h0 g    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.7060775 k  S- C" e% o) E' @
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077: z( x' Y9 G, l5 N
    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
2 y5 k; W  @: F    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077
) Z  y8 p# H6 ~$ D) ]) c/ F    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077* Q/ p- @. g9 s
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077# i" O/ _1 k3 B5 {) W
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.7060774 k# Q7 }3 A. r9 W
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
4 ], m/ i( q" c. M% p! C: V/ p5 E    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077. t5 a8 ?. g+ c2 z  m: k
    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
* y3 ?2 ?9 b% j! {+ N, E/ L, S    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.7060778 _; n: O2 F$ ~
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
  j. N7 {' y4 _# N    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077& Y8 e* @. Y* u6 a6 [4 ~/ k
PG_NOT_SCRUBBED 24 pgs not scrubbed in time* n' G5 ]' ^7 Z
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077" W2 {: q) q7 G/ n3 r/ h
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077
7 B% d9 W" @2 L" w$ c" B2 [3 ]    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.7060772 F/ d# E1 X- {( m& C
    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
$ c* ?4 s) |6 c1 D    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.7060779 k) A. P- a5 M4 s8 @
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
' x* _& L; S) a; ^' P    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077& J* I& f; z3 c. ]0 x  m$ j' _
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
! h3 {$ ]$ G( Z2 l+ c7 e* `6 [( y1 l    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
6 D! M/ Y4 {' A8 r$ f6 y9 R% K    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
$ l8 c. O4 ?# ~( \9 i& A2 d& _3 z    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
+ f7 s5 @- w6 a) r7 h7 s$ a9 x  b    pg 10.21 not scrubbed since 2022-08-01 09:11:50.7060777 L+ h1 B& S2 c) r
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
) k+ V5 [8 Y- L9 A6 d  K; N* J* J& q    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077$ O* B; W8 P/ c' z5 L
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
7 I& E3 L7 e2 x3 ]- [9 B) ~    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
& k& i& Q' {' Y( {" o7 d# N    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077+ d' D/ J( F: @3 Q
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077, s. R4 y9 ?: t0 A* `; Y
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077! _0 x; O6 a% `
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
& o0 W5 ]0 j: `, e' S    pg 10.19b not scrubbed since 2022-08-01 09:11:50.7060774 W: P7 n1 C; ^" \$ ]% t
    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077
$ U' A, [3 r; X6 t# M7 G4 y    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.7060774 I! b) Y5 V0 V( @& C5 e' D: L3 [$ K
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077
" Z4 |* w) L7 r$ O8 B7 W4 [0 i[root@hostceph1 ~]# ceph health detail |grep pg |grep -v pgs+ N9 g& F8 x8 y% y7 }! T( S
    pg 10.6 is stuck inactive for 8558819.337561, current state unknown, last acting []
9 |  v0 r$ l7 n) g: }1 E- ]$ C    pg 10.e is stuck inactive for 8558819.337561, current state unknown, last acting []9 C3 l- {5 }0 q7 A$ t; K
    pg 10.21 is stuck inactive for 8558819.337561, current state unknown, last acting []  R: W% j% a% J& N: U
    pg 10.3e is stuck inactive for 8558819.337561, current state unknown, last acting []$ a( w7 R  p- K4 N+ a- D
    pg 10.41 is stuck inactive for 8558819.337561, current state unknown, last acting []  L6 m- v, o( b0 ^
    pg 10.6d is stuck inactive for 8558819.337561, current state unknown, last acting []6 i, g$ ~; J) }, X8 D
    pg 10.81 is stuck inactive for 8558819.337561, current state unknown, last acting []
: }& h1 Y3 f, E! {$ W! c7 j/ s    pg 10.88 is stuck inactive for 8558819.337561, current state unknown, last acting []
! b; g! I( I% N3 d8 J    pg 10.90 is stuck inactive for 8558819.337561, current state unknown, last acting []  [6 {- |' x: V) N1 D
    pg 10.af is stuck inactive for 8558819.337561, current state unknown, last acting []/ j0 G, ~$ \, V+ P
    pg 10.c1 is stuck inactive for 8558819.337561, current state unknown, last acting []7 \+ d- A, A( _- T) S/ |
    pg 10.de is stuck inactive for 8558819.337561, current state unknown, last acting []
& y1 N: Z; |; N) i. h8 P7 n( P    pg 10.f4 is stuck inactive for 8558819.337561, current state unknown, last acting []
; R, K) x; n, |  x, m" _    pg 10.10e is stuck inactive for 8558819.337561, current state unknown, last acting []! T) H6 g7 _$ }, V# }
    pg 10.114 is stuck inactive for 8558819.337561, current state unknown, last acting []
2 p- a- e- t1 M& D. p2 ~    pg 10.11b is stuck inactive for 8558819.337561, current state unknown, last acting []8 `7 d" T5 M5 ?7 Q0 I* T
    pg 10.137 is stuck inactive for 8558819.337561, current state unknown, last acting []- n- n  k8 l# G. ^  t
    pg 10.164 is stuck inactive for 8558819.337561, current state unknown, last acting []
6 {: z& p& [0 a( [% c: ~    pg 10.166 is stuck inactive for 8558819.337561, current state unknown, last acting []6 i6 W* q% Z* j  v0 |* H6 a
    pg 10.16e is stuck inactive for 8558819.337561, current state unknown, last acting []( ^. ^2 {, a$ Z9 r
    pg 10.19b is stuck inactive for 8558819.337561, current state unknown, last acting [], W# \" v; a" c8 F
    pg 10.1ab is stuck inactive for 8558819.337561, current state unknown, last acting []* `2 |# X% Y/ ]  I1 w: O  G! g# B4 e
    pg 10.1ae is stuck inactive for 8558819.337561, current state unknown, last acting []
2 [; H2 N  d+ {7 J& c( j% ?) ?    pg 10.1b3 is stuck inactive for 8558819.337561, current state unknown, last acting []
* f. ?0 H( h' R) f: e8 B1 z& _4 j    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077
+ A# G9 L0 q8 g    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
4 ~5 X& M0 w  s' K# C' l    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
1 ~; K5 u5 g1 i0 v3 V    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077: O& x" h& H- \$ x  u1 @4 Y
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
: A% O) _0 V& ~; d1 N    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
- y- h; x8 C. y9 Z/ z    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077; j" ?4 }2 n- T& Q4 Y
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
& Y: c# z6 e4 O/ t2 `5 O    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077
; p  t/ i* m  f# A/ d. q$ F' H    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
& m5 c: \3 p9 U2 K& \    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
3 h( k, ?! B% n    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077
8 Q( ~- r1 V5 V& p7 [) s8 Q5 x, f    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.7060773 z0 y% B% Q2 H& e( O: {
    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077% E3 C2 N' N1 O6 Z; P
    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077+ Q: X8 j; ^( }* o: Y
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
( e4 j9 }5 b  c$ }8 I" Q    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.7060774 F6 y: [6 j9 Y% Z; E+ J
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077  H) P, O; w2 w- o( y1 [8 o
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.7060774 D9 T& G6 A; C1 Q0 r  D
    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
  O8 U) x+ Z8 {' w    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077( d$ J7 z+ E* B1 U4 `
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
, }7 J& b+ s0 z' O, p: g    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
3 }7 Q) P. z# u2 R3 i2 R/ d    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077" h7 ]( O: T! R+ T3 e
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077- ~) M7 e4 ]# G" R
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077
4 J2 c" D9 i  a7 d( h    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.7060779 _" l! y/ p1 |' ?  f6 J0 T6 ]. k
    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
: O. i! }4 a+ n" G1 n+ }) n    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077/ ^. a/ |( A/ E" q+ u" Y5 j- _
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077. I1 l+ d0 R+ F: {. o) N! L
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077. G; P# l9 ~, D- ]9 ]& e
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077" ?% u8 x' b, [: F
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077; Y4 U) Y9 B7 I% M, f6 f
    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
/ b2 k4 }6 S! v    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
% ]8 [* Z) M5 v2 P    pg 10.21 not scrubbed since 2022-08-01 09:11:50.7060775 l0 N! G4 Z& [- \2 C
    pg 10.e not scrubbed since 2022-08-01 09:11:50.7060777 _  q2 g8 n" w
    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077% F' H0 l/ w4 ~/ b4 z9 w
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
8 {6 t; z# y5 j3 n$ ?    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077" M1 p' L' e( {" v2 x
    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
6 ~6 [4 u" \+ ~7 Z: e- A; H4 H    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077
, I5 J5 X4 V; \' G) K4 Y    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077) J8 w- y8 a4 m8 T& K; q
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
/ g% C- {; g) _% R6 p1 m    pg 10.19b not scrubbed since 2022-08-01 09:11:50.7060774 @) D" V% m5 ?& R  A4 A4 Y
    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077. ~( [1 J4 D" d( u" [0 M9 K( q
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077! F+ ~0 t$ H0 p: O* y
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077
, `2 j2 U& w2 e# \6 l7 ]1 J[root@hostceph1 ~]# ceph health detail |grep pg |grep -v pgs |awk '{print $2}'
  |3 M4 i9 W5 L7 g, B( C10.6
5 P8 ^; a7 C) E3 H9 F# J; y10.e
7 Z8 z" B3 G* H6 n8 }, Y8 L10.21. X# y7 [: d" Q, B0 _
10.3e
) J- W7 R' o2 c3 H10.41  C8 \8 _2 o2 w. V5 ?
10.6d
6 {  ]* a' [+ O- u' L5 V5 x10.81
) n2 u4 O+ f2 K10.88( `9 h1 Y1 D# e/ d% e' P8 S3 F
10.90' D: c* }9 L1 U2 C5 \
10.af$ x  V* d1 G# L* I
10.c1
$ k& f3 U" f7 h' ]& ]) x10.de. `  U6 z& K7 ^0 `% N. s, V
10.f4
* }& }1 F. ?) i* g* D# f+ D' T10.10e4 c1 z/ {" o' a9 [: A0 i6 b
10.114
" b( Y% F  C/ n7 z10.11b9 H' r0 u; ]& A3 F
10.137
$ s7 h$ N( `! H$ }& g10.164
0 e' b7 `( @- t) M4 p10.166
4 e% P9 O" O% @4 ]10.16e
2 a, |9 W# Z( L6 ]! D' u, t10.19b
( M+ R& G, e7 a: B  h2 |% ]7 F10.1ab$ U/ W* s1 Z2 Z
10.1ae
/ f  m7 }# X& Q& ^* ?+ b10.1b3
7 D3 S( l7 R) _* c9 K) y3 c10.11b
7 S8 P6 x# m/ I( d10.10e
% j6 W" R+ f5 v- ?. E10.f4
9 r. U+ x, a- M* s9 u) o10.de
5 c% n# X0 K! B# m10.c14 f+ @# M. C7 Z
10.af. I# E" B7 @! z! K( F& s, X
10.90- j& c- x, N2 p$ n- F
10.815 P4 _9 ?. p; s$ E& B7 a1 ?0 y
10.88
; A$ g- B* p% V( r; e10.41
" ~% O4 ]2 |3 ?" K$ G9 ^- D' z10.3e
/ A0 |2 u) T0 ?* V10.21
* N3 n: \$ f6 Y! k: I% D10.e/ T5 }4 O- q  O% P: Z
10.6# v& M9 p9 {. J% D
10.6d- ?3 l) _6 l6 _9 V
10.114( ^( y8 B7 [2 Y1 r, L
10.137
% Y2 @! q9 |; P- B( d* e- V10.16e! G, g0 c+ U6 u( }1 c. Z2 y
10.164* N2 N" _3 k* D# V, j
10.1665 ]! W: x! a/ J
10.19b4 _3 a/ w6 D4 g
10.1ae( d% c! n4 Y, T1 B+ H3 s
10.1ab0 {* z5 D& r9 \- o
10.1b34 o& ?4 s. _0 b4 |/ B( h; D, D
10.11b' t" c! {( r) {% |. {; L
10.10e
- K- P' h. u. n, u- L10.f4
: W2 L+ x% B# Q3 F: G. i0 s10.de
, \6 Y- ^; h( r8 J( i10.c1# E  j0 k3 X  r' T" N* I' s
10.af
2 v  d& p$ ^: |' ?6 ?0 [10.90
+ h/ v! m; G1 N) v1 i: K& A# z10.81
* \/ a- N/ b+ Q2 f. l; r10.880 |$ R$ `4 R/ R# \+ |6 F
10.41
2 C$ F0 g& [( w  i/ ~, _10.3e$ Y9 |' R" A& b9 x& q* c
10.21
( m% U  X  H7 J- E8 ?10.e
, `$ o, J7 y4 a! V10.68 w+ Z. v! t. ?' S5 x( L& b
10.6d' p1 g2 [+ \; S: ~
10.1145 }& k- S9 Z( h$ E! o" f
10.1371 w0 b/ T3 p3 ?% e" d& x
10.16e
: k( X  w; O+ ~, W, |10.164
! [3 K6 }, J) }) c& d& d10.166
( I5 g4 o5 h" e7 }8 _6 X' V7 @10.19b
6 Y  T: H9 m1 V# u7 D: n10.1ae
- [  `) H9 }+ e5 ~$ I( z) d10.1ab
, P/ l, }. t( ^( c) u10.1b32 }/ O  p/ X8 Y( n: b* z; A
[root@hostceph1 ~]# for i in `ceph health detail |grep pg |grep -v pgs |awk '{print $2}'` ;do ceph pg repair $i ;done
" P9 H9 s) B: u/ A2 zinstructing pg 10.6 on osd.8 to repair9 I$ M2 D6 d+ [  k* u
instructing pg 10.e on osd.8 to repair2 j+ Z7 r0 N0 f7 U% v; H- z
instructing pg 10.21 on osd.8 to repair
6 @- L/ r' a) x- l% hinstructing pg 10.3e on osd.8 to repair
! Z  d. D7 X4 C& F0 {( ^7 Pinstructing pg 10.41 on osd.8 to repair1 s6 T/ L, n( T5 }- @; b
instructing pg 10.6d on osd.8 to repair
: q- ~+ x. s" W8 Ninstructing pg 10.81 on osd.8 to repair
* F! J# `" c) w( E+ _instructing pg 10.88 on osd.8 to repair
$ l/ _: q5 B, q! W  xinstructing pg 10.90 on osd.8 to repair
3 u! d5 n" s3 {3 @: @instructing pg 10.af on osd.8 to repair
, m6 A7 A; O0 o1 @7 S' H8 {/ Zinstructing pg 10.c1 on osd.8 to repair
) [6 F2 X: z) h1 u2 Linstructing pg 10.de on osd.8 to repair5 F9 a8 j; _) }9 f
instructing pg 10.f4 on osd.8 to repair
9 }  X( Z5 H" r0 S: R" ]# U6 O. Sinstructing pg 10.10e on osd.8 to repair. p2 S0 t. H$ |  o
instructing pg 10.114 on osd.8 to repair
/ l9 \5 I  q% i/ @: p. cinstructing pg 10.11b on osd.8 to repair! H% V# |# F5 u' R
instructing pg 10.137 on osd.8 to repair
& o1 B; s0 B/ d$ B; Uinstructing pg 10.164 on osd.8 to repair" p/ }( ^/ l: z  ]8 O, d
instructing pg 10.166 on osd.8 to repair$ w% Z# H& E) b- ~% b% D0 R
instructing pg 10.16e on osd.8 to repair, P7 a9 i; g5 l3 `5 j( Q
instructing pg 10.19b on osd.8 to repair6 l$ L; l6 n1 N' e/ d0 h
instructing pg 10.1ab on osd.8 to repair
: C8 i% ^- S& h7 r, v0 c7 q' v) pinstructing pg 10.1ae on osd.8 to repair- h0 D4 _  E$ \5 v% ~
instructing pg 10.1b3 on osd.8 to repair" R# F- M3 e; W/ T5 F) u' F
instructing pg 10.11b on osd.8 to repair
: S3 Y6 X, p, a: linstructing pg 10.10e on osd.8 to repair/ e. K$ l+ J7 e* m+ V  i3 c
instructing pg 10.f4 on osd.8 to repair$ z' _- e. w* v8 a7 _# F
instructing pg 10.de on osd.8 to repair1 R, E$ P6 o* N. U+ f& ]
instructing pg 10.c1 on osd.8 to repair% G  V/ f# \- q/ m1 k+ ~
instructing pg 10.af on osd.8 to repair
+ }6 o! O; {6 I! B! h% n, n0 u, b. @8 Pinstructing pg 10.90 on osd.8 to repair' ~' |  i% O% K' J: [% L
instructing pg 10.81 on osd.8 to repair
2 G; B( {4 K& G, Xinstructing pg 10.88 on osd.8 to repair3 A/ f% f1 j5 k8 x/ D
instructing pg 10.41 on osd.8 to repair3 y$ j1 Y6 B; l
instructing pg 10.3e on osd.8 to repair
( e$ x  d4 s8 j" }instructing pg 10.21 on osd.8 to repair
$ T' K0 o# C5 g4 @+ W6 Minstructing pg 10.e on osd.8 to repair
  w! O) D/ t5 _; W- F% J/ xinstructing pg 10.6 on osd.8 to repair- B4 p" C* U5 i
instructing pg 10.6d on osd.8 to repair
1 N4 V/ ^( x' v3 hinstructing pg 10.114 on osd.8 to repair
$ u2 n5 I) g2 Tinstructing pg 10.137 on osd.8 to repair* F$ h% v! ~/ R  k7 k( C4 @
instructing pg 10.16e on osd.8 to repair1 t5 t. G% r7 g0 u; T
instructing pg 10.164 on osd.8 to repair* w1 |% j# {9 e* p
instructing pg 10.166 on osd.8 to repair, T9 T: v1 W6 [) q3 a. m
instructing pg 10.19b on osd.8 to repair3 D' o! F# J6 g5 @8 m4 Q- p1 P  t
instructing pg 10.1ae on osd.8 to repair0 ^% u6 E, W7 J6 W- k) Y
instructing pg 10.1ab on osd.8 to repair  ~' @; ^4 `, v% Y% u; u, P
instructing pg 10.1b3 on osd.8 to repair! T/ G  j8 y3 ?. u7 \
instructing pg 10.11b on osd.8 to repair5 r2 s) H: M$ ], I- J" O* {9 M
instructing pg 10.10e on osd.8 to repair
/ }% w$ r) E5 e# Z, {: \# Q! ]1 N( X  winstructing pg 10.f4 on osd.8 to repair
2 t  V3 t- }* {# e% W3 M+ Tinstructing pg 10.de on osd.8 to repair
, j) D  j  C6 x3 d# S$ o$ `instructing pg 10.c1 on osd.8 to repair
+ f5 z) V0 o1 s* m8 Z4 uinstructing pg 10.af on osd.8 to repair1 M5 X3 E* M/ f, E5 X
instructing pg 10.90 on osd.8 to repair
' t4 |% Z. V8 ]) v$ n4 B3 Oinstructing pg 10.81 on osd.8 to repair) T" s; t* @$ k9 Y8 u
instructing pg 10.88 on osd.8 to repair
- K9 Y$ m, a5 Oinstructing pg 10.41 on osd.8 to repair8 {5 s, Z: u9 \* v! b" m
instructing pg 10.3e on osd.8 to repair
2 z4 ?6 y! s( P8 h# @* rinstructing pg 10.21 on osd.8 to repair
$ s2 y$ r5 i6 g3 Sinstructing pg 10.e on osd.8 to repair  A7 H3 A4 a9 f$ s' `0 {8 Y8 D  Q
instructing pg 10.6 on osd.8 to repair) Z4 `$ O# L9 q
instructing pg 10.6d on osd.8 to repair* Y. d3 ]$ O, K* U3 B9 Q
instructing pg 10.114 on osd.8 to repair& \. f/ z, j1 A$ r% _
instructing pg 10.137 on osd.8 to repair
" O% B+ z9 P1 p3 D. S7 g& _, _instructing pg 10.16e on osd.8 to repair9 f% d1 T. _% A% K+ y) C' J) G
instructing pg 10.164 on osd.8 to repair- `& f3 r. B) D7 q" r$ p; T& d8 n
instructing pg 10.166 on osd.8 to repair9 Z( h' P! {* }
instructing pg 10.19b on osd.8 to repair
5 t' k# e! T8 U+ X, a0 e8 D2 Oinstructing pg 10.1ae on osd.8 to repair
1 Z. N' m: M. C1 oinstructing pg 10.1ab on osd.8 to repair# ^+ ^; |0 B$ w( P8 D5 O+ _( a
instructing pg 10.1b3 on osd.8 to repair9 D8 \9 \, H& V  P2 v
[root@hostceph1 ~]#
 楼主| 发表于 2022-11-8 11:23:41 | 显示全部楼层
[root@hostceph2 ~]# for i in ` ceph health detail  |grep deep-scrubbed |awk '{print $2}'` ;do ceph pg deep-scrub $i ;done / ]7 O" D4 i# G4 e0 n
Invalid command: pgid has no .
( u. [4 ^1 \" N4 a$ D& lpg deep-scrub <pgid> :  start deep-scrub on <pgid>  w0 [' t0 ^" g; S
Error EINVAL: invalid command% T- E7 u# g! z2 q; Y+ c
Invalid command: pgid has no .
% m6 F6 G( t) y' jpg deep-scrub <pgid> :  start deep-scrub on <pgid>8 \, j5 u. c9 \
Error EINVAL: invalid command
% G+ q8 d3 G  [0 N# H9 L/ y  }/ rinstructing pg 10.11b on osd.8 to deep-scrub4 M! r( b8 L$ V
instructing pg 10.10e on osd.8 to deep-scrub
3 D+ x5 }3 s6 hinstructing pg 10.f4 on osd.8 to deep-scrub/ w$ h/ t! ?8 }( H3 N; A9 U
instructing pg 10.de on osd.8 to deep-scrub3 J3 k. E4 [1 _6 g1 l, z9 B
instructing pg 10.c1 on osd.8 to deep-scrub
# ^  ?4 c$ Y2 s! p) m, Minstructing pg 10.af on osd.8 to deep-scrub: K. I- }% \% c7 A4 I2 w0 S2 h
instructing pg 10.90 on osd.8 to deep-scrub
. P' L8 c; @/ J# o/ H! b9 }instructing pg 10.81 on osd.8 to deep-scrub
$ W8 L/ U( ]& ]; n+ c) ninstructing pg 10.88 on osd.8 to deep-scrub7 X6 G$ X) y1 P, s. X0 K+ s% _
instructing pg 10.41 on osd.8 to deep-scrub: U* u8 F% m8 O- ]( F
instructing pg 10.3e on osd.8 to deep-scrub
: @" C& c, @/ {instructing pg 10.21 on osd.8 to deep-scrub
* V( V! i# b9 N2 ?3 Q- @! Minstructing pg 10.e on osd.8 to deep-scrub
. v5 x+ q( ~0 j+ a0 v# Q. ninstructing pg 10.6 on osd.8 to deep-scrub8 Q" }! l. @9 q$ l& \5 ^
instructing pg 10.6d on osd.8 to deep-scrub
8 H9 P4 o+ v9 U/ ~( e2 |1 P; \instructing pg 10.114 on osd.8 to deep-scrub* `$ U5 A# c# n' I/ W
instructing pg 10.137 on osd.8 to deep-scrub
8 Z/ M0 s8 v; ~/ G7 j5 x5 \instructing pg 10.16e on osd.8 to deep-scrub8 r7 S, d5 }! R. ]/ A+ u2 X
instructing pg 10.164 on osd.8 to deep-scrub8 P+ ^0 ^( d0 U# J5 B: C
instructing pg 10.166 on osd.8 to deep-scrub6 ^/ K* T, Z$ P  E6 u) A( q
instructing pg 10.19b on osd.8 to deep-scrub  `' o2 d/ E0 T8 h. |' c& W$ S! j- H9 S
instructing pg 10.1ae on osd.8 to deep-scrub
) ^; z& f5 u5 `9 l8 B6 Ninstructing pg 10.1ab on osd.8 to deep-scrub
* |- \0 ~: s, A* o7 @, ~9 c* M; ^  Cinstructing pg 10.1b3 on osd.8 to deep-scrub" G* c; }6 S( d+ O
[root@hostceph2 ~]# ceph health detail # ^# A0 x* K' y! u& T% s7 \
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time, X% O2 r5 T' H3 Q1 z
PG_AVAILABILITY Reduced data availability: 24 pgs inactive* e: @+ l* j* t
    pg 10.6 is stuck inactive for 8561350.091262, current state unknown, last acting []
$ D( X5 Z. u0 E8 \( h( ]( |9 u( o    pg 10.e is stuck inactive for 8561350.091262, current state unknown, last acting []" t; r7 u" c% [% T7 \9 j
    pg 10.21 is stuck inactive for 8561350.091262, current state unknown, last acting []4 ~  u" T( T; P" J9 q
    pg 10.3e is stuck inactive for 8561350.091262, current state unknown, last acting []
  B3 `& E; m) V- @8 W8 |4 e    pg 10.41 is stuck inactive for 8561350.091262, current state unknown, last acting []
. |8 e0 d+ e- l& Y3 T' V    pg 10.6d is stuck inactive for 8561350.091262, current state unknown, last acting []+ M3 h. u! W% X$ h2 I6 T
    pg 10.81 is stuck inactive for 8561350.091262, current state unknown, last acting []
4 v& ]) G1 o0 l2 {    pg 10.88 is stuck inactive for 8561350.091262, current state unknown, last acting []
, u3 K  z) q3 h6 c, j    pg 10.90 is stuck inactive for 8561350.091262, current state unknown, last acting []
3 T: \7 l9 o( W/ u    pg 10.af is stuck inactive for 8561350.091262, current state unknown, last acting []
' y' a/ U2 e% H! y    pg 10.c1 is stuck inactive for 8561350.091262, current state unknown, last acting []2 L9 ^; a! c! {9 w
    pg 10.de is stuck inactive for 8561350.091262, current state unknown, last acting []9 m6 l5 W3 ~0 [' H8 S: z; R! W$ z
    pg 10.f4 is stuck inactive for 8561350.091262, current state unknown, last acting []# f; g: j8 \. J1 E$ i
    pg 10.10e is stuck inactive for 8561350.091262, current state unknown, last acting []
* \( y( x+ [) n& J8 z7 B    pg 10.114 is stuck inactive for 8561350.091262, current state unknown, last acting []
5 m' T9 ~% Y$ ~- y    pg 10.11b is stuck inactive for 8561350.091262, current state unknown, last acting [], r  K9 r' s- Y
    pg 10.137 is stuck inactive for 8561350.091262, current state unknown, last acting []3 H! l- D  i- s% e0 R7 M
    pg 10.164 is stuck inactive for 8561350.091262, current state unknown, last acting []
% {7 h. g. J* K- N, d; I    pg 10.166 is stuck inactive for 8561350.091262, current state unknown, last acting []
8 |) u8 ]; p$ q; U+ S# W    pg 10.16e is stuck inactive for 8561350.091262, current state unknown, last acting []6 f' H0 w" [1 f2 r0 `/ A! o
    pg 10.19b is stuck inactive for 8561350.091262, current state unknown, last acting []8 B& O, Y! a% D
    pg 10.1ab is stuck inactive for 8561350.091262, current state unknown, last acting []' a8 q9 K/ F  D* T( n
    pg 10.1ae is stuck inactive for 8561350.091262, current state unknown, last acting []
' j( B+ ]) t% d) N    pg 10.1b3 is stuck inactive for 8561350.091262, current state unknown, last acting []; I- C$ `. ]2 B$ T7 `. b; m4 M
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time& r5 ~- n/ m* ?
    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077& ^) e$ I( i/ _
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
/ E; |! o5 T% t& g, j    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
) z% l' d  S& F& D: s( c' z    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
- [* y6 q" e3 `/ }" r3 q    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077+ |* D' X  C* w- s& ^2 r
    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077. Y* W- v$ `7 `' T, o0 \3 k9 `# L
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
7 q, o3 Q  s% f3 T- K    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
: X3 [. n/ N) ~    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077
/ g! q" x- ~2 A2 N9 I% {    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.7060772 B5 x. B: t) T8 ]
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
8 D1 ?: H2 `8 e$ ~; v$ ~    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077
+ o- J* ]: s0 |1 v( T: d    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
% _% X6 E1 K8 Z8 ]    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
2 F( [. f, Z: T6 w    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.7060775 o5 H. s9 n" l' k8 I5 U; F; F
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077% v1 Z+ `7 O8 d2 g1 m7 W
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
6 M* H2 W$ e- W3 [; {    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
3 W3 |3 n5 y  h; o: }: Q- l    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.7060771 t5 E2 X. Z) Z/ s7 h
    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077* H% L" d' Z' L. c
    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
; ]4 j( ?7 J5 |    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
6 b5 c; p3 L2 j( S, j8 A    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077( C$ n* G) C2 q7 |; [/ v5 S
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
$ E+ k* l/ I, {5 r. a- g8 ePG_NOT_SCRUBBED 24 pgs not scrubbed in time
0 @! S" T7 R5 @& c6 Y* n) z7 ^3 b    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077( ^# B, `; y1 E
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077
$ c# G* g) Q* W% N6 f% N8 z  c    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
( _- V" {! u4 B    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
2 x/ a. B3 t( R4 Q! v; X9 F    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077
+ R8 v0 _0 U; K; V5 m* V. d5 r# ]    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077$ p4 x' U+ O+ D1 r
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077! a9 Z& ?+ A; T+ [9 F% ~% I
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
' [% g& ?" w& j, i6 l5 q0 O    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077! H9 N. Y  {& d2 I
    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077; ^# o& E  f( f; y% c
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.7060774 q9 {/ Z7 E7 ~3 T
    pg 10.21 not scrubbed since 2022-08-01 09:11:50.7060774 C1 L  O# j# ?! Q) ~4 M  X! ~
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077' J2 |% e& r3 y
    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
/ s) v" |1 {$ U' ?. w, z4 h0 ?' m    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
/ c5 d4 j- Z( R: t- }8 B    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
9 S" o5 q/ B! v7 Z: v  w1 i    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077+ m8 v7 w0 w# B# k2 ^8 V. b
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077
, X" V8 |7 `& z4 n6 w    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077$ P* t0 Y$ ~' W' ^) e) |
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
, d, M( j& _  o8 y+ _: C9 J, u" s: p$ h    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
+ y! `$ G/ t  E    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.7060777 F1 X( ^/ I7 D9 y: T  S: y# o
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077: {( O. @( z1 Y. o# B; m
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077
6 \0 s1 t6 T9 a# X+ f# Y[root@hostceph2 ~]# ceph osd tree
- U4 D; H( G- v$ ?6 k8 I& B& i1 S- ?ID  CLASS WEIGHT   TYPE NAME              STATUS REWEIGHT PRI-AFF 1 ~4 R- w/ L& c( j/ o
-25       16.00000 root ssd                                       
) s" U" M9 W. K/ Q: `- g-26        4.00000     host ssd-compute06                         % _, O% Z' W8 `' G4 ^% j3 a
18   ssd  1.00000         osd.18             up  1.00000 1.00000
$ g0 ~1 e/ {  s1 U1 W* \ 19   ssd  1.00000         osd.19             up  1.00000 1.00000 * Z/ p, D2 S% B3 _6 ?$ V$ d, `& X
20   ssd  1.00000         osd.20             up  1.00000 1.00000 " D- V% A1 p& O8 G" }1 U
21   ssd  1.00000         osd.21             up  1.00000 1.00000
! |; U$ g9 ?- {% ]* W& E: V4 j7 z-27        4.00000     host ssd-compute07                        
4 p. |8 ^4 r$ ?2 X' A) G: [. E' { 22   ssd  1.00000         osd.22             up  1.00000 1.00000 % J) w2 H# r. r6 A- m  [
23   ssd  1.00000         osd.23             up  1.00000 1.00000
& H4 t* T& u8 ~" b' M 24   ssd  1.00000         osd.24             up  1.00000 1.00000 8 b  S5 [: P0 O9 ^0 x
25   ssd  1.00000         osd.25             up  1.00000 1.00000
! ?7 p/ J! t5 k-28        4.00000     host ssd-compute08                         , v' _# A) ]: A* P7 T
26   ssd  1.00000         osd.26             up  1.00000 1.00000
( M1 G; I5 B0 F( y* m 27   ssd  1.00000         osd.27             up  1.00000 1.00000
* ]; b: V; g  ?- X: |' w 28   ssd  1.00000         osd.28             up  1.00000 1.00000 9 s2 M8 ?3 l8 V# I3 Q. ^4 I2 q( B# f
29   ssd  1.00000         osd.29             up  1.00000 1.00000
1 Z! Y8 T% Y! r! `, q-29        4.00000     host ssd-compute09                        
+ R% h% u9 Q/ }) z5 Y 30   ssd  1.00000         osd.30             up  1.00000 1.00000 # O( c) t% p2 l3 H  f1 e
31   ssd  1.00000         osd.31             up  1.00000 1.00000 4 |$ T/ w7 u; `
32   ssd  1.00000         osd.32             up  1.00000 1.00000
4 E! Y8 a, y2 [# O( x 33   ssd  1.00000         osd.33             up  1.00000 1.00000 2 H1 c1 D- X" m* W+ P$ k8 L( Y
-9       18.00000 root hdd                                       ) k& i) R( R( N5 x( {* S* }7 Z* E( {
-10        6.00000     host hdd-hostceph1                        
4 U' j- X2 V5 q% c, x' n  0   hdd  1.00000         osd.0              up  1.00000 1.00000
8 D& p4 }; d- m0 F, m  1   hdd  1.00000         osd.1              up  1.00000 1.00000
7 q2 g) Z5 n& W" j9 z  2   hdd  1.00000         osd.2              up  1.00000 1.00000 / y' g5 n: p" S/ n0 L( H
  3   hdd  1.00000         osd.3              up  1.00000 1.00000
6 J/ ]+ {7 {% l' {9 F* X) m- |  4   hdd  1.00000         osd.4              up  1.00000 1.00000 9 p2 q  g( k- N  c# T- ^  h
  5   hdd  1.00000         osd.5              up  1.00000 1.00000
, q7 i6 K5 O1 D+ q4 i8 Z$ ]-11        6.00000     host hdd-hostceph2                        
! e: \2 o0 z* {6 U  6   hdd  1.00000         osd.6              up  1.00000 1.00000 / U/ L5 w7 O! i7 v
  7   hdd  1.00000         osd.7              up  1.00000 1.00000 * [; ~+ N8 ~: A# z8 p) e8 e3 G( T; v
  8   hdd  1.00000         osd.8              up  1.00000 1.00000
; A5 F. y7 {8 _( [" U. n# C0 J  9   hdd  1.00000         osd.9              up  1.00000 1.00000 1 i* [& A( g2 L/ W- Y9 {
10   hdd  1.00000         osd.10             up  1.00000 1.00000
9 K- w. O# x* o' {0 z+ ^ 11   hdd  1.00000         osd.11             up  1.00000 1.00000 ; \# {1 m0 P( n2 _, w8 P3 y/ `
-12        6.00000     host hdd-hostceph3                        
9 N( E. ]- S7 \ 12   hdd  1.00000         osd.12             up  1.00000 1.00000
9 `8 N( \1 G. Y  ~8 Q" c6 ] 13   hdd  1.00000         osd.13             up  1.00000 1.00000 , D6 p8 u( Z5 J8 k0 [; x8 ]( \
14   hdd  1.00000         osd.14             up  1.00000 1.00000 $ W: r' q8 A! Q$ ~, L+ m
15   hdd  1.00000         osd.15             up  1.00000 1.00000 / h+ W3 F- |# P7 D
16   hdd  1.00000         osd.16             up  1.00000 1.00000
2 _) J. }: D8 H- ~- w8 h 17   hdd  1.00000         osd.17             up  1.00000 1.00000 ! K( E& ^; F( d+ D# W4 \
-1              0 root default                                   
: i1 e, T/ r4 q/ d -3              0     host hostceph1                             
6 G2 D2 w  l3 v. P -5              0     host hostceph2                             
; ^. h% t; Q4 @2 r7 G -7              0     host hostceph3                             
) k* S) P2 N  _, `+ m: }[root@hostceph2 ~]# systemctl stop ceph-osd
8 [7 Q1 q6 B* |ceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      ; _+ y# [" r% }  @
[root@hostceph2 ~]# systemctl stop ceph-osd
+ o1 ~& {8 E" o9 g3 K2 Lceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      6 e7 ]* ^7 Q3 D6 i" @9 \' {4 Z
[root@hostceph2 ~]# systemctl stop ceph-osd+ I) `/ N! r: t% X' |. B
ceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      ; c, n" z! S+ q
[root@hostceph2 ~]# systemctl stop ceph-osd@8.service & @, S, _0 j6 y2 @
[root@hostceph2 ~]# ceph -s
' |! I7 v2 K& j8 A- Q  cluster:3 u% Z( n6 ]$ q( ^1 b
    id:     29046cc0-0682-496b-98b1-912e59964282
/ g4 ]! S5 r9 X* B) c    health: HEALTH_WARN  N) Z% A8 o- G+ W/ V& O
            1 osds down4 n% Q$ D  d' x/ g9 I
            Reduced data availability: 24 pgs inactive% Q0 v1 H, h- ]% C
            24 pgs not deep-scrubbed in time
* y% N' ]! @/ v% ~! j, a; P            24 pgs not scrubbed in time7 R# P* D( ?" }5 j; a1 ~' }

" w8 A& v" _: _# v4 V  services:. k- \0 Y1 Q+ h/ J! y! h
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)2 b- j; q* m% q# w7 Z- P9 T- h5 |
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
, f' o1 T" V9 L9 D    osd: 34 osds: 33 up (since 3s), 34 in (since 3M)
. I6 E; g* b( B   p6 Q; k6 V3 I
  data:
2 z5 h( D+ D8 D& N4 k    pools:   9 pools, 5760 pgs
. ~0 p* w' Y; v% z7 N& @    objects: 3.11M objects, 12 TiB5 W% n: @) e" c; Z, s. y1 R( D
    usage:   33 TiB used, 92 TiB / 126 TiB avail/ w7 O7 H2 q0 Z& W/ i
    pgs:     0.417% pgs unknown0 S! M! [* ^- Q" Y2 |
             5504 active+clean
: X& I5 T: i  J0 Q             231  stale+active+clean+ O4 y; @+ T0 j, D9 j# q' ?; o& C
             24   unknown
# ]7 w  J7 p0 Z             1    active+clean+scrubbing+deep
2 e" P6 o% x/ T$ V* _! F
5 U# j: U2 F1 k& [  io:( }" t) E+ {- W! L- e
    client:   441 KiB/s rd, 21 MiB/s wr, 504 op/s rd, 546 op/s wr) R- b7 |/ S6 |6 |7 t* @
" M5 h  e* N; M$ Q
[root@hostceph2 ~]# ceph -s' ?% \$ W2 ]. M6 b6 l5 n
  cluster:
' \/ P; o& o7 F7 _7 V* a+ q0 w    id:     29046cc0-0682-496b-98b1-912e59964282
6 ~2 Y. v, `# D' x% Y- ~5 t    health: HEALTH_WARN
  O" U' ?8 i1 r, O            1 osds down
" \( l# v& D% H- z) Z" D            Reduced data availability: 24 pgs inactive
$ T# }7 `. J' O& Q. N            Degraded data redundancy: 300823/7651891 objects degraded (3.931%), 465 pgs degraded
$ L3 a# @. S& M  T            24 pgs not deep-scrubbed in time
/ A) P2 M2 H/ V% O. I0 U            24 pgs not scrubbed in time* }% R! O# y8 B$ M+ m4 p, E
. T6 G* ~( I7 W& W
  services:
  H$ t4 s7 w* @. T9 w4 @+ K    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
) v& J, @* d$ E0 L    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
/ k4 G0 G' w: E! U6 B1 |    osd: 34 osds: 33 up (since 10s), 34 in (since 3M)( K9 Y: Z9 `. C/ u2 t/ i

7 j6 m% D$ Y* Z7 h2 i8 A. r  data:! V7 j3 Y5 g: O. T4 `9 J* \6 ~  }
    pools:   9 pools, 5760 pgs
* c  g( d& o* `! t    objects: 3.11M objects, 12 TiB4 L1 M6 R1 Z2 T! ?
    usage:   33 TiB used, 92 TiB / 126 TiB avail
* B) Q4 z- u' }& |# u$ Y% {) d    pgs:     0.417% pgs unknown
$ K; Z9 b  C# [( ^6 f             4.010% pgs not active* N; E, P: z7 c' p8 m! s
             300823/7651891 objects degraded (3.931%)& t1 ~: p9 R9 t$ M$ Q; c
             5182 active+clean
; b  S6 G0 h' L             234  active+undersized+degraded
9 ?" V4 m8 l/ Q2 v% I1 a             231  undersized+degraded+peered) }3 t  w5 f( q; {. W! k3 U8 _3 e
             88   active+undersized
& T, x2 r. \' V             24   unknown
. o& r( @2 r/ V9 ^0 L) [             1    active+clean+scrubbing+deep8 v' _1 V8 U) r9 ?1 T
- o4 ]9 l! g: ]
  io:: J: E2 @! R$ g; A
    client:   15 MiB/s wr, 0 op/s rd, 567 op/s wr9 D( K2 E4 `9 [
2 ^9 g: m) `5 {- Q
[root@hostceph2 ~]# ceph -s
0 {6 n$ M+ m- i5 m% I, Q: w  cluster:2 e' i6 o/ r* l; d/ P: {
    id:     29046cc0-0682-496b-98b1-912e599642827 P$ A4 q, {# A% W+ \1 Z
    health: HEALTH_WARN: b7 M% G; H8 K8 l" J
            1 osds down
5 W- b. i1 T5 C" H6 c            Reduced data availability: 24 pgs inactive! u" L3 w8 s+ q  F+ Z/ R
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
5 p( J. j, J! r) C1 s: o1 o            24 pgs not deep-scrubbed in time
; [& ~' Q( U) P4 {+ i$ }            24 pgs not scrubbed in time5 l& ?8 V3 }7 B# `+ _

7 w% v2 D. F0 T5 ]- O7 L  services:
( R: y, L8 N/ M( }6 Q  |! m8 p( e    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)  `3 D$ R1 l$ T" l! F; e5 C
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
$ H9 P7 C/ {% H4 }; T( E' y  s    osd: 34 osds: 33 up (since 14s), 34 in (since 3M)
- o, y  m" j" P* }- t5 M+ T0 ~
7 d2 W! t+ r- ]- F  data:5 l6 Z+ ~  ^, j% l& o4 f3 _
    pools:   9 pools, 5760 pgs
8 r; |; v9 E& F; @, G! I    objects: 3.11M objects, 12 TiB
% s2 p1 w: ?& r  w! c! H- v) c    usage:   33 TiB used, 92 TiB / 126 TiB avail
; _% k/ ~3 a2 J6 {    pgs:     0.417% pgs unknown) P, C2 M& L- H- B' S7 _
             4.010% pgs not active
2 R. v* d8 g7 r5 V3 p# n             300823/7651894 objects degraded (3.931%)+ ^/ \; b# u' S
             5182 active+clean
9 ^5 C! }1 f8 Q             234  active+undersized+degraded$ M; t$ Z  `3 Y: m) k
             231  undersized+degraded+peered! O. y' @. t  q  a) J: K
             88   active+undersized
$ N" e* R3 \3 @" {- a. ?             24   unknown
) v! L7 b; Y# {             1    active+clean+scrubbing+deep
4 U- z* @( ^$ l" L' A
- W( c9 v1 }8 [  io:+ Q0 O7 E; F7 f( H. |
    client:   18 MiB/s wr, 0 op/s rd, 598 op/s wr
, e4 A: K) l: n+ E
) |( d) ?) H6 v# |7 ^[root@hostceph2 ~]# ceph -s& y! U# h, u. y+ r5 [, W4 E/ w# X/ {" |" d
  cluster:# i* D! ]: T) h; @  ~
    id:     29046cc0-0682-496b-98b1-912e59964282
/ o5 q) A& b- T4 m! h5 G' Y* {    health: HEALTH_WARN' D& {$ v% b  r+ V
            1 osds down
, W8 \: I+ W6 n0 q! p- ^7 [2 C4 G            Reduced data availability: 24 pgs inactive8 N, a9 i9 o" g3 ~
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
, q: P2 Z6 t, [8 i5 B, E            24 pgs not deep-scrubbed in time% r5 I+ r3 b8 x' X( [
            24 pgs not scrubbed in time$ [) d- j) q2 E0 X5 |' d9 U7 V8 P, g

. V& U: Z- `. G, k* ]  services:
) c, n) r- I% ?! x    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
( _5 L( M0 I- S0 j/ B# Y1 a) G    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
3 A; g6 N. y$ j) K+ Q/ m    osd: 34 osds: 33 up (since 16s), 34 in (since 3M)
" b) \) y8 {( ^- u 6 X' }5 Z- P9 P. C/ g: p
  data:6 u+ l7 B3 W" X+ r
    pools:   9 pools, 5760 pgs  e$ y* L4 j, n" I
    objects: 3.11M objects, 12 TiB
% B. J3 R' k' D% W$ c# m, k( p    usage:   33 TiB used, 92 TiB / 126 TiB avail/ Q" `, x9 L; D4 G1 O" T9 p
    pgs:     0.417% pgs unknown4 z) T- {/ T5 v. l( `& _+ ^
             4.010% pgs not active/ U; z7 g- `  S# [* @  W" N* S% Y
             300823/7651894 objects degraded (3.931%)4 }; _. n, h7 o/ B0 M) ~
             5182 active+clean
' i9 w1 O0 [- w* K# Q' q& Y! X/ B             234  active+undersized+degraded/ c7 W# x+ v: k6 Y8 {- ]& ?5 }$ j
             231  undersized+degraded+peered
$ p7 x) _7 C$ ]: S/ O             88   active+undersized
) U8 z  k2 ]' P" p! B) g             24   unknown
3 Z! u9 {9 U0 K$ b             1    active+clean+scrubbing+deep/ `# ^4 I( o( Z5 f  X$ O4 O

) E( ^9 [$ s) `- P. z  io:3 B6 E9 S' j5 H, O5 ]3 g/ [
    client:   19 MiB/s wr, 0 op/s rd, 591 op/s wr
& T7 i% m. X3 o3 }; H' Q
) G$ g$ q0 i  p4 g2 [7 L7 B[root@hostceph2 ~]# ceph -s6 B0 d+ o9 ]7 o; w9 ?
  cluster:
8 q" A: q7 J' p- w( B    id:     29046cc0-0682-496b-98b1-912e59964282  a% U1 T. u  x+ M( z
    health: HEALTH_WARN% k) K# i3 y6 T) S
            1 osds down
& D) B+ F( Y* _5 c4 q7 M            Reduced data availability: 24 pgs inactive) ^# G0 y, n. G, ]
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
' a9 Z1 j1 Y5 c. g            24 pgs not deep-scrubbed in time: v" z7 y; a' m9 y8 R9 @& v
            24 pgs not scrubbed in time% F6 {+ Q! K* \0 y' k  ^- p! f
; ]" Q9 E, y7 N7 b  ?
  services:
9 r$ j0 N, H$ \/ X* Q    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
; F. S0 M+ d4 H5 Z    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph30 c* F# w8 d$ A8 s
    osd: 34 osds: 33 up (since 18s), 34 in (since 3M)
  R0 I8 x6 I7 K" f& v 9 H2 V! H$ X" `, k3 [( l. U3 }
  data:4 }( J$ y& V9 Y# ]9 i
    pools:   9 pools, 5760 pgs( j7 k. b1 d- d, s2 Z# {# K
    objects: 3.11M objects, 12 TiB0 `# r$ u) F: c5 p+ Q
    usage:   33 TiB used, 92 TiB / 126 TiB avail3 s8 n/ N/ O/ O; v* R* _
    pgs:     0.417% pgs unknown
' H: ~% t% t" e  Q- O             4.010% pgs not active2 a- ~6 u0 T0 O' {
             300823/7651894 objects degraded (3.931%)
( ~: C1 ~% a0 K8 r             5182 active+clean9 T# ]% @! s9 A) Y
             234  active+undersized+degraded; q7 A- A" q, T) X: i3 d
             231  undersized+degraded+peered
% S7 U' C( c/ O3 i             88   active+undersized
4 a8 T; I" N( a. m% g/ `             24   unknown
# Q7 z4 h+ I) i% [" b6 b* U             1    active+clean+scrubbing+deep* Z6 n' \2 j+ K/ j9 O

$ D4 E+ a& G/ d: b  io:, E! n8 i- C. b8 [9 e4 l
    client:   43 KiB/s rd, 19 MiB/s wr, 30 op/s rd, 517 op/s wr
) `5 K/ q: }/ |1 v5 F6 t
4 j7 C3 }) z0 g' ~! @8 A[root@hostceph2 ~]# ceph -s3 F/ R" \& l  P5 m% y0 _
  cluster:
4 }- A) G! S  A) Z/ J% f5 i7 X" T) f4 V+ l    id:     29046cc0-0682-496b-98b1-912e59964282
7 b; Z& j: `1 B7 }% `/ ?' G    health: HEALTH_WARN& }9 q/ t. V0 s8 Q' d/ b
            1 osds down2 U1 v) E; G4 x9 }: D: z* Z
            Reduced data availability: 24 pgs inactive; {9 e' M; ^+ u& |
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
' g5 }/ S$ |! v) \/ ~. w            24 pgs not deep-scrubbed in time
1 x  Z0 a$ M2 m! Q& o) Z$ A( g! ^            24 pgs not scrubbed in time
; R* g' `( f0 c7 o0 \( [& D4 Y  D
- g" J0 Z7 h$ R1 l" A0 I% |# F  services:6 D' H# m& Q5 S( t' q3 ~' M/ W' U
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
6 U0 S9 O' \* o    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph30 |: X; s. L* b4 l4 r: [
    osd: 34 osds: 33 up (since 20s), 34 in (since 3M)3 i" x9 Z9 A+ t% {
( k" o0 p5 k" y- y, L& ?( l6 t
  data:
: P: ?" x/ m% G5 ~/ C9 C( l  n+ `, x    pools:   9 pools, 5760 pgs! b& z" Q- |; n& I7 D% q9 `
    objects: 3.11M objects, 12 TiB
/ d1 P4 a& _5 F+ i- H    usage:   33 TiB used, 92 TiB / 126 TiB avail( z( L, C$ L9 B; t$ K5 {' T2 u( }
    pgs:     0.417% pgs unknown* f/ ~% K5 c- ^6 f- L2 M& a
             4.010% pgs not active
! |0 n' x; d# Z2 w3 j- G             300823/7651894 objects degraded (3.931%)
+ }" F' g  `+ {+ T             5182 active+clean
6 F( H$ u$ [. u8 y             234  active+undersized+degraded
& C: f3 ^& S& n% X+ g1 c+ {             231  undersized+degraded+peered
% c* X: T. W: W1 ^8 ~             88   active+undersized
0 U$ K7 S# f4 y3 q/ x! i  s6 z             24   unknown
2 q  {1 \( Z" t8 o, n             1    active+clean+scrubbing+deep
% _4 e) P+ R3 x4 {6 e' G 2 M$ e: y; x6 z2 M# @
  io:
7 a# i- z# J- d/ S  y    client:   66 KiB/s rd, 19 MiB/s wr, 30 op/s rd, 542 op/s wr$ |' b' m" b3 X& w
您需要登录后才可以回帖 登录 | 开始注册

本版积分规则

关闭

站长推荐上一条 /4 下一条

如有购买积分卡请联系497906712

QQ|返回首页|Archiver|手机版|小黑屋|易陆发现 点击这里给我发消息

GMT+8, 2022-12-10 11:07 , Processed in 0.984044 second(s), 24 queries .

Powered by LR.LINUX.cloud bbs168x X3.2 Licensed

© 2012-2022 Comsenz Inc.

快速回复 返回顶部 返回列表