浏览此站
联系我们相册切换到窄版 Language

 找回密码
 注册
易陆发现论坛»论坛 › 云计算开源区 › ceph分布式存储 › 完美解决过程Reduced data availability: * pgs inacti ...
返回列表 发新帖
查看: 516|回复: 2

完美解决过程Reduced data availability: * pgs inactive 24 pgs not deep-scrubbed in tim

[复制链接]
admin

0

主题

0

回帖

9

积分

管理员

积分
9
QQ
发表于 2022-11-8 10:29:11 | 显示全部楼层 |阅读模式
购买主题 本主题需向作者支付 2 金钱 才能浏览
回复

举报

admin

0

主题

0

回帖

9

积分

管理员

积分
9
QQ
 楼主| 发表于 2022-11-8 10:45:39 | 显示全部楼层
[root@hostceph1 ~]# ceph -s' M; b8 t! [( {$ M/ j, Q7 M4 [
  cluster:: c# P4 Z5 \' w  b8 H, C
    id:     29046cc0-0682-496b-98b1-912e59964282+ i. }5 d2 t5 e& \) C  A6 h
    health: HEALTH_WARN/ N2 Q; G0 X0 I; p' F
            Reduced data availability: 24 pgs inactive/ P- L9 R  Z9 O
            24 pgs not deep-scrubbed in time
  q7 |; u; j8 C4 j4 k1 z            24 pgs not scrubbed in time& k" i( z# i% O  b3 M
6 {% a9 ]6 {4 S8 L7 E5 d5 B
  services:' T; r+ ~2 u( k' `& j6 H7 v1 p4 C8 g
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 3M)# H6 ?) f9 ~5 L/ _  O) ^( \9 Q
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3* U2 Y. J; c: s
    osd: 34 osds: 34 up (since 3M), 34 in (since 3M)
6 g$ Z" {/ D% p) E, ]! f: X( H) ~ 9 J7 P7 h% [$ U: s  m0 W9 ]2 y; O9 }
  data:
/ Z! u/ K# q2 ~1 l, a7 b! {    pools:   9 pools, 5760 pgs( U5 J+ V, x" J  m6 C
    objects: 3.11M objects, 12 TiB" S) I9 r& @$ b6 F" o% Y
    usage:   33 TiB used, 92 TiB / 126 TiB avail
$ {, M4 O: {0 Q* w    pgs:     0.417% pgs unknown! L5 }9 n) M9 q% {4 h; z# i
             5735 active+clean
6 K/ B4 X: J! |* T* M             24   unknown
1 ^5 d' I; }. P8 L  o% F' ]             1    active+clean+scrubbing+deep
* f8 V$ k4 m2 ? 6 W2 O2 x1 X2 |! J3 E0 C
  io:# @# z) L+ y7 K# X' F  N' j1 Y
    client:   9.7 KiB/s rd, 20 MiB/s wr, 12 op/s rd, 625 op/s wr
) T; n; K2 v2 \8 l
8 L  M, z4 |' r, H" P8 N; A[root@hostceph1 ~]# 6 d+ t0 h' L& e
[root@hostceph1 ~]# ceph -s
; b0 A  t5 r0 ^9 ~  cluster:% J/ m  n& G; K$ }( R) a. M. V
    id:     29046cc0-0682-496b-98b1-912e59964282
% z" \/ p( c9 d' k    health: HEALTH_WARN
9 ?* Y0 H9 g$ a! n+ v            Reduced data availability: 24 pgs inactive
. i, n" j: T% V- s1 S# y0 l% F# p            24 pgs not deep-scrubbed in time
. @3 s$ v, k# ]6 c            24 pgs not scrubbed in time
3 c4 i# J+ }+ l7 e
5 v" U- p3 C' J2 w  c  F# w  services:# n9 C8 _% \0 E9 r
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 3M)6 F+ g' U0 i' v' o1 W1 j( s: g
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3" O4 \4 b+ H/ N( `  M6 C; S. @. i
    osd: 34 osds: 34 up (since 3M), 34 in (since 3M)
, L# Y% U; p5 r/ T
3 w; ?9 ~8 B% r% o) E  data:, m1 ~4 g3 ~" S: t% v5 p
    pools:   9 pools, 5760 pgs, V% g4 y& R8 e! W: i
    objects: 3.11M objects, 12 TiB! p, }1 m. M1 ^/ i
    usage:   33 TiB used, 92 TiB / 126 TiB avail
1 v( B* X) x' ~* g1 d) s7 v4 A) G    pgs:     0.417% pgs unknown: ]: x; @$ |7 V4 g0 N
             5734 active+clean
' d, s- `: q3 s. k7 T             24   unknown
) r, R1 }. [; j; L' z             2    active+clean+scrubbing+deep
1 a1 ]" X$ l7 H4 D1 P7 `, v
- E2 e1 d2 K2 Q$ n  io:
% W9 X3 x( j# Z) I# T- M/ @0 E    client:   90 KiB/s rd, 22 MiB/s wr, 103 op/s rd, 531 op/s wr1 r  p, _3 m2 b" Z7 e; |9 g
" V- @* H8 D& M7 }4 C1 v
[root@hostceph1 ~]# ceph health detail
" V% s) A* R# d. m: j, ]0 JHEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time) @0 ~3 P- u" i# K4 D* V8 m
PG_AVAILABILITY Reduced data availability: 24 pgs inactive: c3 S. D+ d" u! M' b
    pg 10.6 is stuck inactive for 8558718.511785, current state unknown, last acting []
) t/ Y  V# L$ g0 P! |9 V4 {    pg 10.e is stuck inactive for 8558718.511785, current state unknown, last acting []: s0 D! Z& L- U; F- T
    pg 10.21 is stuck inactive for 8558718.511785, current state unknown, last acting []
+ B* x' z3 z5 T7 M: _3 k    pg 10.3e is stuck inactive for 8558718.511785, current state unknown, last acting []  u1 G2 A! Q# I# a) c
    pg 10.41 is stuck inactive for 8558718.511785, current state unknown, last acting []
# u1 }8 f: [. @. h, V2 z    pg 10.6d is stuck inactive for 8558718.511785, current state unknown, last acting []9 i+ }/ M2 n; |% i' A* s( e8 |
    pg 10.81 is stuck inactive for 8558718.511785, current state unknown, last acting []
& z" c4 D% O4 ^/ n$ o9 G) ?' j    pg 10.88 is stuck inactive for 8558718.511785, current state unknown, last acting []* G: x& L$ D( |. Z" S6 v$ f
    pg 10.90 is stuck inactive for 8558718.511785, current state unknown, last acting []
" C+ e" ~  Z, n7 z    pg 10.af is stuck inactive for 8558718.511785, current state unknown, last acting []* w/ u0 `/ X3 |+ }6 x; q
    pg 10.c1 is stuck inactive for 8558718.511785, current state unknown, last acting []
, H+ p% G  d6 E8 C5 i! M0 \    pg 10.de is stuck inactive for 8558718.511785, current state unknown, last acting []  p0 w: a6 I8 {, D) w
    pg 10.f4 is stuck inactive for 8558718.511785, current state unknown, last acting []
) h8 p5 ?0 d. N: h. |& t    pg 10.10e is stuck inactive for 8558718.511785, current state unknown, last acting []
3 k% \  D( M) V7 o    pg 10.114 is stuck inactive for 8558718.511785, current state unknown, last acting [], ^6 v* Z  K4 Z8 R! M' S
    pg 10.11b is stuck inactive for 8558718.511785, current state unknown, last acting []
2 M" K2 h/ I' w  Q. `. r& @    pg 10.137 is stuck inactive for 8558718.511785, current state unknown, last acting []* v! |! \3 G7 Y7 A8 p6 [
    pg 10.164 is stuck inactive for 8558718.511785, current state unknown, last acting []
% @3 l$ t) Z, o! d; |    pg 10.166 is stuck inactive for 8558718.511785, current state unknown, last acting []: m% {2 u7 ]& p3 N( u5 [$ a" W
    pg 10.16e is stuck inactive for 8558718.511785, current state unknown, last acting []. \6 }# R7 X* g  N; O: E4 T
    pg 10.19b is stuck inactive for 8558718.511785, current state unknown, last acting []
8 H& n' ?, L, F- C3 h    pg 10.1ab is stuck inactive for 8558718.511785, current state unknown, last acting []
. ]0 U( w1 J: X* w& ~    pg 10.1ae is stuck inactive for 8558718.511785, current state unknown, last acting []1 K, G" X8 U; T; c' [& @. w7 c
    pg 10.1b3 is stuck inactive for 8558718.511785, current state unknown, last acting []
+ p, I+ l$ b5 ~! nPG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
( M, f, i6 v% c) d' Y! t* p    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.7060772 B: @% j# k3 W! v
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077" \3 P/ S9 |" \0 M4 H
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.7060771 T+ C% d4 u2 a7 r- x0 ~  o
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077; I( s) V* L6 o) E4 ~$ _4 j
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
' x2 Y; W& p: p. W% @3 V    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
. N, x2 X: p& }' }" m" L" u5 e    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077, \$ N0 K6 @4 i1 w7 J# J+ L
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
6 y9 g% y" f" t" {) T    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.7060776 l% @* M) x$ {  \
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.7060771 w" i% ]: w! ?9 Y3 q( U3 J: m( U2 |
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
1 J" n/ a' c  X4 \. x    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.7060773 Z! A3 \# p' n7 C7 z; B: M! i
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.7060774 S4 L: s: A5 l& K5 _% W
    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
' o( W# O8 j5 O# {    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077  K% r" b8 ~" o, h& x5 i
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077: }: a3 E# h7 j- @! H- w
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.7060770 w: U+ b, ?+ u2 a, i
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
7 g% U  ]# O2 m: i) F' U: K    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
8 y1 }$ j# P5 H% h( s" K    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
  A; A8 g7 d2 c$ P& s* r0 W" y6 Q    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077) }8 A" D2 L- o% o9 J
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
+ f- p& v5 Q9 r0 @/ m    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077* v  [% J% ?0 C9 W" y7 M( [. y1 K
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
% w( p' K8 e  U# U# P4 J2 F5 f1 ?PG_NOT_SCRUBBED 24 pgs not scrubbed in time
9 o8 r& ?9 F, ^$ n3 C  r    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
9 N+ z4 B# P) d1 p" p9 B6 q    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077! V" G- U$ p. S2 ?
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
. |6 {: Y4 ^. e    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
. C6 {$ u5 F, x5 w    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.7060779 h) B  O2 N$ y/ n% M" T+ m& q
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
- T  Q8 m1 ~" R    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077
) X$ }* p0 n9 r/ q    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
1 _5 P( E) j  n( E    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
  w. P. F- [- _- C5 j+ b3 s/ n    pg 10.41 not scrubbed since 2022-08-01 09:11:50.7060777 H, J& ?. e& W" U. P" I
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077& _4 {: [( B% V9 S
    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077! z; }) X  ]3 e6 z% X
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
& J* K6 u) ]# M, h8 E) A& ^    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
+ C* t' Y3 `. \9 l% Q6 G    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
( c9 w# |% w4 u5 Y& p: \  A    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
, M1 v. a+ \. f    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
- Y) E! y' ^( y4 O. H1 P    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077( e) w# \# q) Z
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
) J) K. [- X0 N+ V; S    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
! d9 i3 M9 b2 H; }6 ^( M& ]    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
0 c& X2 k& q9 B, O( s; J    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077
, i" j* N0 w% k. P* F  v: I1 _    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077! e* i$ N' \* D& ]
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077
! D( ^' e1 U. E3 K, B& Z8 E[root@hostceph1 ~]# ceph pg rep/ ^( V3 u! p! M9 R% p4 T) e
repair  repeer  4 v" v4 s( T1 Z# c4 F; {1 ~  @
[root@hostceph1 ~]# ceph pg rep
3 Z, f0 h4 _0 |- R& A0 ?# @repair  repeer  + M& h& Y) j- s  M$ s! E, t- {; ~
[root@hostceph1 ~]# ceph pg rep
! L" u7 `0 n1 Erepair  repeer  
0 O, O6 y; {1 a[root@hostceph1 ~]# ceph pg rep. t$ \/ {: q6 S0 h
repair  repeer  9 C* d% `& F) j& ^. P3 V, y
[root@hostceph1 ~]# ceph pg repair 10.6+ V& C4 {: u: t, W" x0 {
instructing pg 10.6 on osd.8 to repair; ^2 K% ^; ]) _0 \! r
[root@hostceph1 ~]# ceph health detail : J9 b8 G6 J. P; k- ]0 l* @( u$ ~% x  p
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time: M, h- I1 \) Z+ t" F$ ~3 B
PG_AVAILABILITY Reduced data availability: 24 pgs inactive
/ \: j& o+ v* w5 ]    pg 10.6 is stuck inactive for 8558779.003482, current state unknown, last acting []
0 R; g1 r8 g$ m- u0 Y0 \' }" n    pg 10.e is stuck inactive for 8558779.003482, current state unknown, last acting []6 Z6 O6 D9 m( y; D1 a5 I# @
    pg 10.21 is stuck inactive for 8558779.003482, current state unknown, last acting []8 Z8 Q' P% a& C6 d' t' C, i
    pg 10.3e is stuck inactive for 8558779.003482, current state unknown, last acting []3 G5 F2 v, n) D/ Y0 o! x
    pg 10.41 is stuck inactive for 8558779.003482, current state unknown, last acting []
" G# Y) U. X" {4 e7 a* y9 g    pg 10.6d is stuck inactive for 8558779.003482, current state unknown, last acting []
! ~) z; `4 z) P2 f# ?/ K0 c# f    pg 10.81 is stuck inactive for 8558779.003482, current state unknown, last acting []
" v- y. K7 W6 v9 G8 @# M' y8 L7 P    pg 10.88 is stuck inactive for 8558779.003482, current state unknown, last acting []6 Y3 x4 j5 V1 T9 m/ S4 ~/ j
    pg 10.90 is stuck inactive for 8558779.003482, current state unknown, last acting []
. w- S5 ~$ t/ z7 F  d  j    pg 10.af is stuck inactive for 8558779.003482, current state unknown, last acting []
! D8 r- J+ F9 D, V3 M    pg 10.c1 is stuck inactive for 8558779.003482, current state unknown, last acting []% c; W4 ?$ D* `. R( ^
    pg 10.de is stuck inactive for 8558779.003482, current state unknown, last acting []
. F" N8 d- D4 [# k/ K    pg 10.f4 is stuck inactive for 8558779.003482, current state unknown, last acting []
- p1 b+ t5 ?& j  g( G    pg 10.10e is stuck inactive for 8558779.003482, current state unknown, last acting []# T/ _/ n1 Q" E4 S/ Q( T
    pg 10.114 is stuck inactive for 8558779.003482, current state unknown, last acting []
5 p: E* Z# e) l0 M) E7 H+ k    pg 10.11b is stuck inactive for 8558779.003482, current state unknown, last acting []
6 I% p# x5 u# j7 y- Q! P  Z    pg 10.137 is stuck inactive for 8558779.003482, current state unknown, last acting []( m' {* C( P, f6 a6 O- L
    pg 10.164 is stuck inactive for 8558779.003482, current state unknown, last acting []
+ [+ S+ H) C4 [+ ~3 v) U2 `    pg 10.166 is stuck inactive for 8558779.003482, current state unknown, last acting []" u. e' `' I. I' B
    pg 10.16e is stuck inactive for 8558779.003482, current state unknown, last acting []' g) Y2 t+ w" y
    pg 10.19b is stuck inactive for 8558779.003482, current state unknown, last acting []6 H9 q/ o  g3 c6 P
    pg 10.1ab is stuck inactive for 8558779.003482, current state unknown, last acting []) I# r8 P, b& ?+ X2 v
    pg 10.1ae is stuck inactive for 8558779.003482, current state unknown, last acting []1 Z/ _4 q/ E& F/ H3 z
    pg 10.1b3 is stuck inactive for 8558779.003482, current state unknown, last acting []
/ p0 J! v( c5 APG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
- T/ ]; K. {( f" z: o: m2 j    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077
; n* d. N+ Q. ]1 u" S' ]    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.7060772 L0 D% ~: l  O" t. y' p9 U
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
  ^# P; [( W( B7 |' X' J    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077# s2 I# h8 M" B, M5 o; O7 ?) o6 _
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.7060778 D5 j- `! E' t5 {& f, k
    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
2 l, H& A4 ?- J& p: R    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077/ F' N' s# s! l! l# L5 j+ J
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.7060771 x1 M- Z# A) [2 j: e  i; U4 ]
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077' T7 |- C$ x2 C0 [& J' @! d5 Q/ V
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077+ A6 X2 I* F9 L( M* r
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077' ]; o6 R+ ^6 j
    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077
" P% a  X+ _6 r+ L! ?    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
) a) g! C' U. @% m3 f/ b    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.7060774 f0 L  X2 C4 _9 P4 M  x3 c
    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077/ a" V# }4 W7 q4 j$ B$ e+ ~* s5 Z5 M
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
: U2 f" b( Q6 K  Q6 o# ~1 ]    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
7 R9 l4 P5 V& ]    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.7060774 H, z* J& R# h
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
/ R/ M7 n1 H- x+ u& s( f- r    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077  b! d' g) h, i( N+ g
    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077% h- ]2 W0 a" G" Y; i( v0 \7 O% E
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077& ~( i& S5 u: e# y' C9 _( v
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
6 I3 j% Z$ L0 J- G    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
, C5 a+ ]: [3 {. A& }PG_NOT_SCRUBBED 24 pgs not scrubbed in time7 F6 c7 }2 `% N. z: G" O
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077% @# I) D; R0 u
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077' X9 C: E: g( m  c# c& y2 M
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077: g& z5 J1 l) t4 x1 u$ A5 h1 C
    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
5 ?$ \6 {& C# Z) K( P4 e; P; M    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.7060776 t: b6 D  i) M4 [7 x
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
/ p. }/ v$ {% q* H    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077. b  |2 {- w0 Y: A: [
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.7060774 f9 M% {+ e# J' T! s2 m
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
# ]$ M; H0 \3 a3 N) O    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
; ^2 |5 M; c) n9 f3 U) S" b    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077: u  X! @! u' {2 t
    pg 10.21 not scrubbed since 2022-08-01 09:11:50.7060774 g( U+ x- M/ a& ]1 P9 |' ~
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
) G$ m- U% v7 V( |    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077+ r9 W% C. u/ }
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077- @( W* _2 _1 S4 _
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077' M# y- v& S/ G" r9 i
    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
! D- }1 d3 x0 `    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077" a. _& |" J+ V* Z* M
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077, t/ j- m* C( l# z" i8 {3 f  b
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
" `" i& O" {9 D$ |& N, n    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
( H* q6 U; U3 h    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077
/ ?5 `) m/ ~( h5 U7 I    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.7060774 V3 \+ n+ }1 ]+ I
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.7060775 O- ?6 ?: J3 n
[root@hostceph1 ~]# 7 |8 F. C3 G1 J, E/ l
[root@hostceph1 ~]# ceph health detail |grep pg0 q& S+ Q; b: K! R' f& j8 Q# Y
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time
' ?4 e* R; T8 @! jPG_AVAILABILITY Reduced data availability: 24 pgs inactive5 f: S$ r( P* Q
    pg 10.6 is stuck inactive for 8558795.140009, current state unknown, last acting []1 ^$ c9 L- Y! H1 l8 k- R* q6 d
    pg 10.e is stuck inactive for 8558795.140009, current state unknown, last acting []
9 ?/ A& j* o8 p! L3 A% ?* V    pg 10.21 is stuck inactive for 8558795.140009, current state unknown, last acting []
" u' Z( g6 J" Z8 v    pg 10.3e is stuck inactive for 8558795.140009, current state unknown, last acting []! z8 N# w% |. e. p; j9 Q# U
    pg 10.41 is stuck inactive for 8558795.140009, current state unknown, last acting []
4 t! o/ c% V) B: d    pg 10.6d is stuck inactive for 8558795.140009, current state unknown, last acting []+ B' P- t- c. ]
    pg 10.81 is stuck inactive for 8558795.140009, current state unknown, last acting []
8 b5 H6 q- G( D7 b$ H    pg 10.88 is stuck inactive for 8558795.140009, current state unknown, last acting []+ \0 X9 A! L- i& D
    pg 10.90 is stuck inactive for 8558795.140009, current state unknown, last acting []
$ l0 u( Y- r, ~  e( ]& H    pg 10.af is stuck inactive for 8558795.140009, current state unknown, last acting []
5 o6 M  H9 A; v# x& U    pg 10.c1 is stuck inactive for 8558795.140009, current state unknown, last acting []
: E7 f' ~0 ^8 @, P' N* \    pg 10.de is stuck inactive for 8558795.140009, current state unknown, last acting []& y$ w+ n( S, `' w6 B3 N
    pg 10.f4 is stuck inactive for 8558795.140009, current state unknown, last acting []; T2 \! s, X! B' i' L/ A0 m2 O
    pg 10.10e is stuck inactive for 8558795.140009, current state unknown, last acting []+ Y9 @9 M( M  w; P
    pg 10.114 is stuck inactive for 8558795.140009, current state unknown, last acting []
2 ?* c; [+ i4 O& G; v+ q4 \    pg 10.11b is stuck inactive for 8558795.140009, current state unknown, last acting [], L9 v: x1 i% k4 x  N- U) G
    pg 10.137 is stuck inactive for 8558795.140009, current state unknown, last acting []& x' y" a1 [1 L) B# B6 _' s8 L
    pg 10.164 is stuck inactive for 8558795.140009, current state unknown, last acting []) U- n* R7 Z) P" D
    pg 10.166 is stuck inactive for 8558795.140009, current state unknown, last acting []$ x+ Y( Y) r- M# s
    pg 10.16e is stuck inactive for 8558795.140009, current state unknown, last acting []
9 N- s  \: m+ t    pg 10.19b is stuck inactive for 8558795.140009, current state unknown, last acting []1 ^( N/ w6 M- E; R7 f
    pg 10.1ab is stuck inactive for 8558795.140009, current state unknown, last acting []* T# F7 O/ u% [# d' Y3 Q
    pg 10.1ae is stuck inactive for 8558795.140009, current state unknown, last acting []" g4 q5 e8 R( A8 s
    pg 10.1b3 is stuck inactive for 8558795.140009, current state unknown, last acting []- k- B9 c3 e' G3 w# N0 w
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
7 }* _9 J: |6 K3 D, C. q    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.7060773 J  m6 O8 D) N8 \
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
& S  _& I, s. _+ M% ~    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
9 m, q& h" ^$ [* \" ^2 j  h    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.7060779 U+ p5 g8 R; P
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077( _3 ]" Z6 w: L7 M
    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
- ]5 j5 {0 w: D) ?2 L4 s' x5 ^9 y+ ]    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077: [7 I& `2 i' |* n" c* F
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.7060771 X" s  ^  Q# F& k! b
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077
$ {$ {# N4 D- y1 Z2 }9 ~    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
/ V5 ]2 k9 K0 c* t! v0 E% t' T* v    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.7060771 }  P; u, p8 V2 G  ~3 T5 U
    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.7060771 ?5 b) f6 H6 j/ U3 I. z$ c* y
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
; s2 _( u: V( q% }7 `& [9 ~* L    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
* }: Q! p# Y- f7 V' d: j- r    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077
( E8 {5 |; o) |+ o4 K$ f    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
5 Y# G! q- p: o  y' ]! s    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077# K+ L, M! B7 i8 y9 `2 X( p
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
, f8 A# x$ q! r, H) b* D: B+ B    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077& @- L6 c) ?9 _/ l% G2 M, k: t
    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
6 r' ?7 Z$ x0 p+ R6 i; M    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.7060777 k+ i2 l3 p7 g5 f( {: z
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077! w0 a& T. ]3 u$ ~! y, y
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.7060770 V) Q3 k5 q2 o5 K7 U8 k2 {
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
  H- t- w' T# e2 u! x* E. GPG_NOT_SCRUBBED 24 pgs not scrubbed in time9 f3 W7 T) A8 v
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.7060778 j4 A  @2 I! f5 ~% A
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077! B* F6 r/ D1 H" a, T2 T7 z
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
3 x+ G9 {, e6 `/ r$ ?1 |1 j$ X    pg 10.de not scrubbed since 2022-08-01 09:11:50.7060775 h* C  [$ k" C8 U0 P" Q
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077
; m1 D: K0 c/ j9 d9 U    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
+ ?1 x/ a6 |: E2 U# R) N    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077
, [6 M6 m5 h8 P! E5 E  G  s4 T- s    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
% M8 r/ N) J/ q6 z5 |    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
0 s4 {$ m1 N$ N    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
# v' O% }! I; b7 Y4 e' f) t    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077, t* S2 q9 ?( ^7 S+ P, C
    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077
# K9 p6 r+ E% ^9 l7 B1 \# {    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
: s, F9 Q: a! I    pg 10.6 not scrubbed since 2022-08-01 09:11:50.7060777 E& y. D5 b- ?% @
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
& b4 O( C7 b: y! a, M! J    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
  [. ^& h& ~9 \" g9 P1 Z/ t    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077' h6 C& B  o" K
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.7060778 l9 M  N4 _# {
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.7060778 C. ?& O7 ~# q/ U0 T
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
: @, U8 R' P- L6 n    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
% e9 E5 k4 d6 p+ ]2 P9 J( x6 r( Z    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077
) x- Z  k7 j" p' W) n# b    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
- ?4 _/ `; L4 r% E' F3 K( n    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077' H* L; Z' d* j' F  ~; V9 j3 ]  ?
[root@hostceph1 ~]# ceph health detail |grep pg |grep -v pgs. K2 U  K/ h0 G0 z$ d6 S/ t, o
    pg 10.6 is stuck inactive for 8558819.337561, current state unknown, last acting []
" E1 ?+ T: H3 S7 t) I" K2 C" @    pg 10.e is stuck inactive for 8558819.337561, current state unknown, last acting []
# J5 \' w+ A4 g) @, f    pg 10.21 is stuck inactive for 8558819.337561, current state unknown, last acting []
3 m5 S# z$ i5 m: s    pg 10.3e is stuck inactive for 8558819.337561, current state unknown, last acting []9 @& ]; [  h. m; z
    pg 10.41 is stuck inactive for 8558819.337561, current state unknown, last acting []& ^. I7 T& ^0 U$ t
    pg 10.6d is stuck inactive for 8558819.337561, current state unknown, last acting []/ u9 V# n; `1 o: `% U
    pg 10.81 is stuck inactive for 8558819.337561, current state unknown, last acting []
/ ?) M8 s% M3 P' n    pg 10.88 is stuck inactive for 8558819.337561, current state unknown, last acting []6 [- G: y5 m9 ^4 U
    pg 10.90 is stuck inactive for 8558819.337561, current state unknown, last acting []& ?& g! b& k$ V) h6 \- `1 k# w
    pg 10.af is stuck inactive for 8558819.337561, current state unknown, last acting []
/ u5 P; v! w4 ]9 m) C% a. R; w    pg 10.c1 is stuck inactive for 8558819.337561, current state unknown, last acting []
9 o- m7 z" X4 a! o! ?. `    pg 10.de is stuck inactive for 8558819.337561, current state unknown, last acting []
6 P5 R" j/ h- f7 d    pg 10.f4 is stuck inactive for 8558819.337561, current state unknown, last acting []
$ t* i* O8 @: F2 y    pg 10.10e is stuck inactive for 8558819.337561, current state unknown, last acting []
0 ]+ C4 K# z' h: u+ V    pg 10.114 is stuck inactive for 8558819.337561, current state unknown, last acting []
8 w, A+ T8 P- x4 V    pg 10.11b is stuck inactive for 8558819.337561, current state unknown, last acting []
& t; u( ~- ~7 H: O! {2 A5 c  r    pg 10.137 is stuck inactive for 8558819.337561, current state unknown, last acting []5 e6 o. K# J: a7 O! `$ q
    pg 10.164 is stuck inactive for 8558819.337561, current state unknown, last acting []
8 ?1 m, g& b' _) C2 \& B: L' d    pg 10.166 is stuck inactive for 8558819.337561, current state unknown, last acting []
8 r- j+ Y- D9 G    pg 10.16e is stuck inactive for 8558819.337561, current state unknown, last acting []8 M4 L% n) u" p% N  d+ J: D
    pg 10.19b is stuck inactive for 8558819.337561, current state unknown, last acting []" T1 C5 i% v2 o5 C2 t2 r  t
    pg 10.1ab is stuck inactive for 8558819.337561, current state unknown, last acting []0 n5 o' g, H8 M1 ~
    pg 10.1ae is stuck inactive for 8558819.337561, current state unknown, last acting []4 u4 P4 D2 \7 N) A" |) B+ b) Q
    pg 10.1b3 is stuck inactive for 8558819.337561, current state unknown, last acting []
3 P6 n! i9 Q9 h: d2 z, ]. Z, H    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077
& \+ U8 o) L+ K6 `* F" n* x) W( a    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077% r5 e8 m0 e4 Y2 A- x* n
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
, R6 |1 J' M* }2 j, c6 D9 ]    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
& G$ F) e: b- f    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
  c! k0 }6 @% Y) V    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
7 Y- H, R/ M7 V; Z. R9 a    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077) Y# h: I! m, j" Z
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
' f! ~, Y: o" A& g1 F3 _0 b    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077# M9 S5 s  m& j% n$ Z4 y
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
9 y, v0 k; j  |$ s, h    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
: G) M+ v8 V. \) D    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077
1 C! A+ K! S( K$ ~    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
/ e7 C0 @6 g7 Q. G    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077) ~/ e+ _' }9 t. s# `
    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077
7 f3 y7 j: S# |; d% z    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077. |5 j2 o, |( [" v, q
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077& v6 }, }6 L" w& m
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077. _7 B( j  p5 {
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077$ F3 ~0 c8 F, ~8 X
    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
: G8 [3 c: T6 c2 b& o+ z# y    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077! U2 ]- T9 x2 e. F
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077- \' R  `$ y8 n/ g" a9 ?
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077; y' O- D" q( f& D  n
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
* O1 R2 r. E& W5 U, {! V    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
$ y; X: Q( \' F; I/ N    pg 10.10e not scrubbed since 2022-08-01 09:11:50.7060778 E2 z6 x( G' a  s5 K5 ?
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
. Z1 ]! r6 d7 b+ `    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
9 a1 h% b4 x" r! w! B" z' k8 [    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077
/ p2 W4 L7 a: n, X9 I    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
+ H6 Q& s7 ^8 k9 _7 S    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077
* p' A3 m! Y1 n/ d! q( D- J! W  p    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077  y- A9 ~. j+ c+ V4 Y& x
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
" ]0 b+ z% ~* Z8 O$ G9 m3 [8 O    pg 10.41 not scrubbed since 2022-08-01 09:11:50.7060772 w+ C5 O$ f  \7 L7 `0 G% v
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
. ?0 q& K" X; D    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077
, i( L7 w9 j$ r: X8 D. V& x    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
7 D8 k3 ]2 k% n: v    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
4 M( }$ }4 T2 w$ K* a* u    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
. V; _6 L8 r6 o" R    pg 10.114 not scrubbed since 2022-08-01 09:11:50.7060778 |; |4 J  v5 C; L
    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077- }+ N4 a4 I* e- {
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077$ g& K( K# n, S8 |0 N
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
: I# E' i6 ]& e8 j) K9 h. w    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077; r, I- I8 |' Q! L& G1 p
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
6 t, N; r: L0 v) ]; F    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077$ k3 Y& S6 c" b( Z/ K
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
( D" p. w; q  }8 R5 i: [/ ]: P    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077
1 x8 _% v- z  O4 [6 [  `0 o. O- r  b[root@hostceph1 ~]# ceph health detail |grep pg |grep -v pgs |awk '{print $2}'9 D5 X- b4 n7 `% z; ?# W0 c. D$ M/ H
10.68 I* C& ]! D  {) K( y  k: f; |
10.e
  X" ]  t* h" X& R8 s/ M0 m4 E10.21
& p$ v: H0 _! Q% P* p/ B10.3e. l$ }! m- q% ^6 J! O3 i
10.41* ?  Z5 O+ T$ Y* ?6 k9 C
10.6d
2 Y, t( @  B( ?2 [" S2 ^9 n0 N10.81
/ s4 F: l! |1 w6 p, Z10.88) l, _! G, \0 |# A4 ?! A
10.90
( b& p: Z0 O9 V  z" U10.af
* r& y! @6 T& K* x1 R( h10.c1
0 g& w0 M1 M; E1 M, {10.de$ Q7 M) i5 o3 |4 K+ A9 K0 A
10.f4$ g4 N# F: X- k9 T
10.10e4 p& O+ P' A* ?4 N! H
10.114' y6 j/ ?& H: {  p5 l
10.11b
1 v6 P( _( n& K' o; v% ~10.137  [% `; V  ^3 _3 r8 P% J# C% H
10.164
: e, u/ }) ?  v5 T' y/ p' t10.166
+ \/ H9 a7 V. k; C6 c1 v10.16e
8 w+ J4 w+ p( Y3 {% s10.19b
- J; l$ q8 T5 ]& C% m; O* S10.1ab
0 O* D8 i: }& I8 E. E  \10.1ae
& N* ~4 C8 k) M  v) L# C10.1b3
% p# n1 i! ?6 e  D1 \10.11b  d9 D# {# a  \( C1 \& P! k
10.10e8 X; i' i+ Y; t* c4 \! I$ C
10.f4
' p5 w& [" C$ v3 A5 v/ C10.de
1 ~! q, l7 b3 b4 c  Q! @10.c1
  A4 `* }( ~  v  |0 d+ G10.af
2 \8 j# R) X' _5 V6 l10.90. F# }. B8 P$ V( N
10.81& o# q; u; |8 `/ Y
10.88
% M9 |" d' j- v+ Z) q3 j8 T$ o. J10.417 d4 z$ W" r8 W$ G" z5 N0 s
10.3e0 n6 t4 c. j& I  `7 k) b
10.21
% e% G- Q1 W8 E+ R10.e6 |' @$ p/ K5 I  }% r
10.6# v# |' b( x- n* h$ F
10.6d! }7 m- i% b, V" s
10.114/ ^& A* T$ P7 ]' `% w+ \2 \. c
10.137
( e5 x7 A7 M7 j10.16e+ F& g4 C0 ?  M" d7 M
10.1645 V$ U3 X! J4 g. P0 ~: U8 o
10.166& o, G! o8 b: D7 f
10.19b- a8 ]# S( T* ?( U' i- _1 B/ m) I
10.1ae4 u9 W1 Y- l) ^# Z' F
10.1ab
! H+ C6 Q2 D& c4 [9 p10.1b3( O% i2 M% r" T& w* b8 M; F- P/ ~, J
10.11b
0 y: m0 Q  W: J2 t4 j; G10.10e! y. v, F( Z5 u. t( p
10.f4
: _$ Q% F. g. f10.de
' y4 Y- j& {' C, [6 H10.c1
8 B" P6 B/ N% X10.af
  [. |  b) c! Y& [: L* ?; R10.90
  p, M) P1 s' P10.81
8 Z, q' i3 |/ R/ F4 h7 ?7 A7 U6 ~10.883 T( H4 P5 ], J/ m3 G' m
10.41
4 n* l# {, d2 e3 t$ D3 I) \10.3e+ p9 D- m5 p5 \8 P6 D7 k- Z: ]
10.21
- |8 ?3 s/ Q, G8 R10.e7 k. B9 O) T4 e5 n
10.6
/ F# d; k) v7 c3 R. h$ H# c10.6d+ f+ m. m" d( Z) \5 u# M
10.114
, n2 q. A- B' J% E10.137+ c6 ^/ n: N+ z% q" R% w* e0 K* A
10.16e
: Z+ m/ c7 G( C1 q4 Q; `8 j6 S10.164
7 o" J/ A* u  ~- H7 G10.166
+ X! \3 ~0 |# G4 J8 q% f10.19b
) {* P5 M% C8 C! |10.1ae
6 G5 j2 p3 w; d5 y+ L# g% [10.1ab0 v) H* ]9 l0 S8 i; z
10.1b3  O9 O$ u/ A6 H( j1 U7 H' Z. M
[root@hostceph1 ~]# for i in `ceph health detail |grep pg |grep -v pgs |awk '{print $2}'` ;do ceph pg repair $i ;done
6 b; T" n, J, r0 H3 Kinstructing pg 10.6 on osd.8 to repair; ^. I4 K5 `7 m; p: @
instructing pg 10.e on osd.8 to repair
! g2 d6 N* d: Q  M( `" sinstructing pg 10.21 on osd.8 to repair' E( c4 C" R( T& a  i/ h" R
instructing pg 10.3e on osd.8 to repair7 W2 k2 ^$ ?9 ~' w4 i* h
instructing pg 10.41 on osd.8 to repair
: w! O. q3 g8 I, U$ Dinstructing pg 10.6d on osd.8 to repair
; Z- Y, e: \. |instructing pg 10.81 on osd.8 to repair
- k' W4 h- _- S# U8 jinstructing pg 10.88 on osd.8 to repair& R) B$ K( Z* v4 U
instructing pg 10.90 on osd.8 to repair
3 X* w  r" w: @8 ^& p: d. Y% `8 d* Tinstructing pg 10.af on osd.8 to repair
6 j% Y0 B) P; m7 n8 {instructing pg 10.c1 on osd.8 to repair+ n- O9 [4 x9 X1 i6 ^! g' O( E9 y
instructing pg 10.de on osd.8 to repair
& m" I% D; H9 einstructing pg 10.f4 on osd.8 to repair5 f% p  {1 M1 V$ K6 M3 M# s
instructing pg 10.10e on osd.8 to repair: b8 b: w% a! e) k
instructing pg 10.114 on osd.8 to repair
. t# T8 `+ j( h9 yinstructing pg 10.11b on osd.8 to repair
9 g& ~) {/ _/ L2 X3 Finstructing pg 10.137 on osd.8 to repair6 O9 X7 p6 ]9 A3 j$ @# `
instructing pg 10.164 on osd.8 to repair1 Y+ Z: g9 d' X  P
instructing pg 10.166 on osd.8 to repair" E" P* \1 N& f6 I! ]
instructing pg 10.16e on osd.8 to repair
9 p7 @) k) J& h5 sinstructing pg 10.19b on osd.8 to repair
9 a6 Z1 Z' w+ V. P  ~4 X; F! L) qinstructing pg 10.1ab on osd.8 to repair
, ^' l+ \8 d9 i* b4 M* ninstructing pg 10.1ae on osd.8 to repair
+ g/ Y" _4 r+ S: @instructing pg 10.1b3 on osd.8 to repair
8 Y/ M. o/ m/ E8 e. i( c3 v) qinstructing pg 10.11b on osd.8 to repair
$ O# h+ i+ D; H; L! N: pinstructing pg 10.10e on osd.8 to repair
  K1 y- f8 Z) R6 V8 H5 L/ ?+ G5 Uinstructing pg 10.f4 on osd.8 to repair4 a" }6 t/ G) o1 h+ \7 C3 u
instructing pg 10.de on osd.8 to repair$ b; ^2 B9 L' L7 U" S
instructing pg 10.c1 on osd.8 to repair
( s( ]& E2 P: M' ]. \instructing pg 10.af on osd.8 to repair
2 }0 S1 R2 M# _! j. q5 [  R6 T& dinstructing pg 10.90 on osd.8 to repair
; `- s) w% v+ Pinstructing pg 10.81 on osd.8 to repair
9 q% z* p% T. x2 M4 Sinstructing pg 10.88 on osd.8 to repair, C2 D' h6 p4 y  y0 t) _* ~/ h% u
instructing pg 10.41 on osd.8 to repair- q0 o; J4 o3 I7 J* K  ~4 S' [6 }2 g
instructing pg 10.3e on osd.8 to repair+ \0 k  S' G" j0 z* @9 ^+ X
instructing pg 10.21 on osd.8 to repair) \! \; |; h/ U. ^
instructing pg 10.e on osd.8 to repair
- Y+ K% j) b9 K8 rinstructing pg 10.6 on osd.8 to repair
/ }- m/ I" S) h* k' K6 m2 G% b" Zinstructing pg 10.6d on osd.8 to repair1 z1 H1 P5 `4 B  d( }3 l
instructing pg 10.114 on osd.8 to repair
% F0 h, E1 i- `1 T) K, p, A8 Tinstructing pg 10.137 on osd.8 to repair
, g+ L! {  g* t- V. X. sinstructing pg 10.16e on osd.8 to repair
, B/ g2 C2 k3 S2 E- a  Jinstructing pg 10.164 on osd.8 to repair; N, R* M! D' U0 O
instructing pg 10.166 on osd.8 to repair9 h$ n4 ?! t! I
instructing pg 10.19b on osd.8 to repair, M3 J% R  p# b
instructing pg 10.1ae on osd.8 to repair
6 J8 A& i: N* a6 t' g7 E# Finstructing pg 10.1ab on osd.8 to repair
2 c% s/ P8 g" ^6 qinstructing pg 10.1b3 on osd.8 to repair
$ {) j) R) e! i9 Y2 S0 c' l7 Vinstructing pg 10.11b on osd.8 to repair
8 T' C9 V" ?* q  U( u  ]9 Jinstructing pg 10.10e on osd.8 to repair
" F9 d! c% {/ }1 U3 V; x* Iinstructing pg 10.f4 on osd.8 to repair
- c& K8 J: E% j! `$ F- `" Qinstructing pg 10.de on osd.8 to repair
+ G% C4 r, d4 G2 X% |instructing pg 10.c1 on osd.8 to repair- B/ }9 d+ y4 L; Y/ F
instructing pg 10.af on osd.8 to repair
: W. ]; P+ I  _7 b3 R% |, q' P2 einstructing pg 10.90 on osd.8 to repair
7 s7 n! S& S7 k" Sinstructing pg 10.81 on osd.8 to repair
. G2 [3 N- l. |instructing pg 10.88 on osd.8 to repair. c/ d! h8 c2 {# E) l
instructing pg 10.41 on osd.8 to repair( i! M/ \/ ~8 h
instructing pg 10.3e on osd.8 to repair8 d. ]$ o4 W) N  g
instructing pg 10.21 on osd.8 to repair
, O3 E2 \& G- v! |$ binstructing pg 10.e on osd.8 to repair; W: {% D4 w+ A0 C8 }
instructing pg 10.6 on osd.8 to repair
7 {4 i) t# G: j+ V) s' O5 x7 _8 {instructing pg 10.6d on osd.8 to repair* I5 D- l! n- V" `$ G- G
instructing pg 10.114 on osd.8 to repair
- b1 r1 g5 Q+ P) B) G9 Linstructing pg 10.137 on osd.8 to repair0 H: G/ \! e. y7 S  _1 {
instructing pg 10.16e on osd.8 to repair( B" ?$ U$ M( x( h
instructing pg 10.164 on osd.8 to repair! M# z1 N5 u  j' j
instructing pg 10.166 on osd.8 to repair
7 m: E8 G3 H! f1 R8 hinstructing pg 10.19b on osd.8 to repair
' K& i) Z' _# s" |instructing pg 10.1ae on osd.8 to repair" i6 Z, q7 g; p, s2 y
instructing pg 10.1ab on osd.8 to repair
. x9 I/ }8 L% [  ^instructing pg 10.1b3 on osd.8 to repair) L  I  O4 x# |: g" b
[root@hostceph1 ~]#
回复

举报

admin

0

主题

0

回帖

9

积分

管理员

积分
9
QQ
 楼主| 发表于 2022-11-8 11:23:41 | 显示全部楼层
[root@hostceph2 ~]# for i in ` ceph health detail  |grep deep-scrubbed |awk '{print $2}'` ;do ceph pg deep-scrub $i ;done ; x; {. r9 ^. a) w
Invalid command: pgid has no .
5 C1 ~: n: r3 e! @pg deep-scrub <pgid> :  start deep-scrub on <pgid>
0 P+ ~5 e  u0 V% U% R, Z" z# ]: pError EINVAL: invalid command& B; y6 Z. V' B  z1 g
Invalid command: pgid has no .
+ O. P8 o3 G" apg deep-scrub <pgid> :  start deep-scrub on <pgid>
) ?- m' z4 O6 ]7 w" jError EINVAL: invalid command3 c. J1 h3 H2 u! E% q: c
instructing pg 10.11b on osd.8 to deep-scrub
, S6 r: L# B4 h2 I+ ?( c8 K* T3 Zinstructing pg 10.10e on osd.8 to deep-scrub
. ]$ m( J, X" h9 V/ W; R$ W0 {instructing pg 10.f4 on osd.8 to deep-scrub9 x& x& N0 _2 C7 S( ]- T
instructing pg 10.de on osd.8 to deep-scrub
" n, `2 Y9 J; h& sinstructing pg 10.c1 on osd.8 to deep-scrub
- h7 \6 S7 u: e- I" x5 Xinstructing pg 10.af on osd.8 to deep-scrub/ d3 `: g% x) v" B8 v' I! }" o
instructing pg 10.90 on osd.8 to deep-scrub
% z5 m) d& ?2 E, Z9 E# j+ |instructing pg 10.81 on osd.8 to deep-scrub
: f" v$ ^2 V# D/ e2 rinstructing pg 10.88 on osd.8 to deep-scrub
4 x- Z7 O: n$ `* ]instructing pg 10.41 on osd.8 to deep-scrub% g2 v# q! G) C0 w, X
instructing pg 10.3e on osd.8 to deep-scrub0 L6 _5 b; S* A/ z
instructing pg 10.21 on osd.8 to deep-scrub& C3 U' d* i+ i
instructing pg 10.e on osd.8 to deep-scrub6 }0 |( t8 C" Q
instructing pg 10.6 on osd.8 to deep-scrub; W5 w% p$ ?5 Q
instructing pg 10.6d on osd.8 to deep-scrub
6 v/ |" S  c, Hinstructing pg 10.114 on osd.8 to deep-scrub) I5 D' Y5 @2 T
instructing pg 10.137 on osd.8 to deep-scrub: [5 f* @) L' _! C) y
instructing pg 10.16e on osd.8 to deep-scrub2 P2 |9 T* i( |! p# J7 f' l( V. c
instructing pg 10.164 on osd.8 to deep-scrub
" h* V& @+ v3 @! J  j  [instructing pg 10.166 on osd.8 to deep-scrub; d" ^8 v- d2 y: t% J' z
instructing pg 10.19b on osd.8 to deep-scrub
( U7 J  R  l  \( f6 d6 Z1 Winstructing pg 10.1ae on osd.8 to deep-scrub- D6 q, `/ ]  [1 O
instructing pg 10.1ab on osd.8 to deep-scrub. u% c: ?/ J! h. q
instructing pg 10.1b3 on osd.8 to deep-scrub# y" o; _9 U/ T% i8 m# n' Y
[root@hostceph2 ~]# ceph health detail ! n/ \- {; }: v) M0 ]% O+ `( f( t
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time) a1 I+ P0 Q. P
PG_AVAILABILITY Reduced data availability: 24 pgs inactive2 r6 v* H$ t" P4 a
    pg 10.6 is stuck inactive for 8561350.091262, current state unknown, last acting []
+ J. n# k$ O# c: s' c    pg 10.e is stuck inactive for 8561350.091262, current state unknown, last acting []
. ]4 T( \' v6 @    pg 10.21 is stuck inactive for 8561350.091262, current state unknown, last acting []
6 c" ^. F% d, j1 k0 S" \. f    pg 10.3e is stuck inactive for 8561350.091262, current state unknown, last acting []
. L" A1 p* j3 }4 S    pg 10.41 is stuck inactive for 8561350.091262, current state unknown, last acting []
0 k, f3 S* p& z  q$ n    pg 10.6d is stuck inactive for 8561350.091262, current state unknown, last acting []
5 }6 ^2 j5 {9 b! i/ j- Z  Z    pg 10.81 is stuck inactive for 8561350.091262, current state unknown, last acting []+ \8 ]+ e& \" H2 E. x& ^2 x* Q- m# K# |
    pg 10.88 is stuck inactive for 8561350.091262, current state unknown, last acting []
' k; C2 \7 H9 q& Z9 R    pg 10.90 is stuck inactive for 8561350.091262, current state unknown, last acting []) N: t; x+ s+ }
    pg 10.af is stuck inactive for 8561350.091262, current state unknown, last acting []( @5 ~8 [% g* a) ]3 L
    pg 10.c1 is stuck inactive for 8561350.091262, current state unknown, last acting []
1 ~# _& Q4 ?. s4 R2 m) x    pg 10.de is stuck inactive for 8561350.091262, current state unknown, last acting []" m* I" m% Z% _! X/ m  i
    pg 10.f4 is stuck inactive for 8561350.091262, current state unknown, last acting []$ Y" ?# i& g# }: U. e3 p
    pg 10.10e is stuck inactive for 8561350.091262, current state unknown, last acting []( E+ d# G, ^0 U, y& z
    pg 10.114 is stuck inactive for 8561350.091262, current state unknown, last acting []2 [" b$ Y) C* _
    pg 10.11b is stuck inactive for 8561350.091262, current state unknown, last acting []
$ L/ f7 k" @2 k    pg 10.137 is stuck inactive for 8561350.091262, current state unknown, last acting []
( O* @7 K8 x6 v: X$ R    pg 10.164 is stuck inactive for 8561350.091262, current state unknown, last acting [], A! h) b$ H" f( e& v' a$ N
    pg 10.166 is stuck inactive for 8561350.091262, current state unknown, last acting []+ W( l( o% _/ T& w: h6 C6 X4 @
    pg 10.16e is stuck inactive for 8561350.091262, current state unknown, last acting []; R; A" o% K" A+ R$ a5 o7 |+ d( w. c
    pg 10.19b is stuck inactive for 8561350.091262, current state unknown, last acting []
: S) Y4 @, @* U, p& k    pg 10.1ab is stuck inactive for 8561350.091262, current state unknown, last acting []- {4 S' }2 i; J! j* x" d
    pg 10.1ae is stuck inactive for 8561350.091262, current state unknown, last acting []! ]* ~$ b- T6 b8 Z: n# w
    pg 10.1b3 is stuck inactive for 8561350.091262, current state unknown, last acting []& z) ]3 }0 v& }/ J; M& U9 ~
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time* h+ Y: N2 n# \, j/ O  ?  F- \: C
    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.7060774 H! M( G- m3 N! B1 W+ g7 r
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
# ]/ v; m. B0 Y. {- s    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077( C( P) B( n! b" o8 M% ^
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
$ j9 m% x, ?$ q8 K& Y% s    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
+ _& K+ q  F7 S/ C. s    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077- C, G( m" y9 ?. ]& \# Z* s
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077$ i# ~8 V/ G. S: q0 v9 |
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
& J% W- @7 U0 |' U' Q    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077' C" b' t1 m* W( E+ ]- ], F
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077+ P& b5 O; R# D
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
7 Q  X6 D' i* j0 |6 @' j* X  S    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077/ d8 \) `" B4 D! `, `
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
' e: N9 C. l& i2 T9 V    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
7 o* U' ~; d( A' i" k    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077& Y, t1 H0 d4 Z8 _0 g
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.7060776 w; O. L8 d  I0 o
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
0 n3 S3 o" L" F( ?    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077$ C; u; @0 L6 @0 ]. o/ z+ t8 O) W
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
* I( P/ o# t1 {    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.7060777 y& B9 M; ^3 q) s
    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.7060771 w4 z" C, _, _! A/ U
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
# S" `$ Z: Y: c" h5 _- h2 v* s3 H    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
, z1 Q4 ]+ g6 P    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077" Z8 v2 t3 W3 L' D3 x" ^) r' Q( Q: @
PG_NOT_SCRUBBED 24 pgs not scrubbed in time7 e9 s9 G. Z/ Y* r
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.7060774 x6 A3 H  w5 H( q
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077
8 J6 \* K4 J2 D! ^6 E    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.7060776 U+ A. h4 Q% y  Z1 ~# t9 W
    pg 10.de not scrubbed since 2022-08-01 09:11:50.7060773 a% r$ V; O; o7 v  a' i! p; _7 d
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077  j' x1 j, M" N! ?- \& m6 m
    pg 10.af not scrubbed since 2022-08-01 09:11:50.7060772 w) s: r) e' _6 V' V. n( m0 X
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.7060778 e& o% K/ N; ~3 a4 Y, A0 c3 Y
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077; D. b/ d+ W) _
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
' [( P( R1 P0 t% l5 ~    pg 10.41 not scrubbed since 2022-08-01 09:11:50.7060774 K7 R9 U' @6 ]' y* Z
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
/ z' @' ~2 Q  I. R: L, Y+ e3 B0 {, _    pg 10.21 not scrubbed since 2022-08-01 09:11:50.7060778 Z, S6 y7 d1 S5 Q
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
2 Z1 S$ P& V  e    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077( P' a5 E6 |! m/ T  Q9 L2 ~5 J7 ^0 w
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
' h' O1 v8 M4 x- U7 p: e    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
# _( O5 N( u5 B- d    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077. A  H) @- C( o& K6 ?  h8 i6 f+ ~: `
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.7060774 v+ M: h* o% \+ D' Q
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
3 c0 q4 i$ r1 P% x$ F    pg 10.166 not scrubbed since 2022-08-01 09:11:50.7060779 C  S# x* B8 G! X
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077! L7 y  S  n+ B; y) r6 V( {
    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077" ?0 R1 j: t2 b  N; U) Z
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
- }) ~) X, i: [# _( h! e' m    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077; @2 U; {) [  X! l
[root@hostceph2 ~]# ceph osd tree2 o* T% q. \0 }9 D9 q% t: F& i
ID  CLASS WEIGHT   TYPE NAME              STATUS REWEIGHT PRI-AFF
* m1 {  |1 b4 L6 y$ P-25       16.00000 root ssd                                       
: Q. P+ U* l( ~% W* e$ H-26        4.00000     host ssd-compute06                         , C2 d2 j: E% t  X6 e4 e0 l2 d1 b0 y
18   ssd  1.00000         osd.18             up  1.00000 1.00000
7 F, y! s; c& J, z7 l+ M 19   ssd  1.00000         osd.19             up  1.00000 1.00000 % d- B) J- @+ L9 F6 Y, m) n! i7 W) u
20   ssd  1.00000         osd.20             up  1.00000 1.00000 1 b3 G$ u) D, q, Z
21   ssd  1.00000         osd.21             up  1.00000 1.00000 ) H- c# C6 _7 v1 h. @
-27        4.00000     host ssd-compute07                        
* g* V; |6 K3 I) b2 h' ] 22   ssd  1.00000         osd.22             up  1.00000 1.00000 / W; s) O- A; Q* `7 X9 m2 t
23   ssd  1.00000         osd.23             up  1.00000 1.00000 9 N2 Y9 j4 M0 N' x/ t
24   ssd  1.00000         osd.24             up  1.00000 1.00000
2 ~" K. b" i: w3 h; |3 c- h1 `5 t 25   ssd  1.00000         osd.25             up  1.00000 1.00000   Y! j( ^8 M! G- M% y7 @
-28        4.00000     host ssd-compute08                        
" p  W. \& x' v2 g* D) X( c 26   ssd  1.00000         osd.26             up  1.00000 1.00000
) g1 p2 O6 \. b# c! ?% A2 O# l7 l 27   ssd  1.00000         osd.27             up  1.00000 1.00000 7 k& ~; G) A# p5 V5 @
28   ssd  1.00000         osd.28             up  1.00000 1.00000
8 w! ~( x) Y3 t2 J% d; a 29   ssd  1.00000         osd.29             up  1.00000 1.00000
' _1 j3 Q  n$ p3 h0 l-29        4.00000     host ssd-compute09                         * V" R( n# D/ q
30   ssd  1.00000         osd.30             up  1.00000 1.00000
1 T9 ?5 w+ F/ P6 U* r+ M 31   ssd  1.00000         osd.31             up  1.00000 1.00000 & ?+ I6 h! F- n0 C4 c8 e$ A
32   ssd  1.00000         osd.32             up  1.00000 1.00000 1 f8 z2 T  z3 Z6 R- b: ]/ F
33   ssd  1.00000         osd.33             up  1.00000 1.00000
9 K4 W1 ?( ]9 e, ?3 a9 @ -9       18.00000 root hdd                                       # w0 ?9 g" H0 v& Q& F
-10        6.00000     host hdd-hostceph1                        
% J. @  Q+ O/ A3 v  0   hdd  1.00000         osd.0              up  1.00000 1.00000
( d9 W% j4 d7 `" S  1   hdd  1.00000         osd.1              up  1.00000 1.00000
; f& o( _# Y1 L  2   hdd  1.00000         osd.2              up  1.00000 1.00000 7 ?# M! d( D) W/ ^! m9 n6 N% q
  3   hdd  1.00000         osd.3              up  1.00000 1.00000
$ S4 b/ @& k+ ?9 h1 z  4   hdd  1.00000         osd.4              up  1.00000 1.00000 0 A! X5 ?! L; n$ K5 n
  5   hdd  1.00000         osd.5              up  1.00000 1.00000 9 T" Y: G! F) N% a
-11        6.00000     host hdd-hostceph2                        
" P# {+ I9 X5 w( g  6   hdd  1.00000         osd.6              up  1.00000 1.00000
- f4 `% Q5 Q4 r0 y  7   hdd  1.00000         osd.7              up  1.00000 1.00000 , d% n( c& U; M) J* z
  8   hdd  1.00000         osd.8              up  1.00000 1.00000 % I' @4 z# z: J7 t7 A! ~
  9   hdd  1.00000         osd.9              up  1.00000 1.00000 , S# b; B5 c" A" l3 |. F8 h, e+ u' X
10   hdd  1.00000         osd.10             up  1.00000 1.00000
5 e6 d/ m: ^$ O( o  Z 11   hdd  1.00000         osd.11             up  1.00000 1.00000 - h7 A3 G! K: f6 T
-12        6.00000     host hdd-hostceph3                        
5 o' `* \& V$ D# F2 Y  k5 W 12   hdd  1.00000         osd.12             up  1.00000 1.00000 % x# r+ ~0 y7 v) Y3 d7 i
13   hdd  1.00000         osd.13             up  1.00000 1.00000
% w6 K2 M- R4 k 14   hdd  1.00000         osd.14             up  1.00000 1.00000 - l# h: X2 U1 }
15   hdd  1.00000         osd.15             up  1.00000 1.00000
0 i2 n& j; S, U5 e* C5 p 16   hdd  1.00000         osd.16             up  1.00000 1.00000
$ N9 t  X: A+ N; i, [( l 17   hdd  1.00000         osd.17             up  1.00000 1.00000   R' i  J) H6 G# Z6 u5 C% M
-1              0 root default                                   8 i' d0 c* y- P9 J( r6 ]0 {1 R/ I  X
-3              0     host hostceph1                             8 r/ `* o( T; Q: {+ t
-5              0     host hostceph2                             # s  v% L+ C2 i$ W
-7              0     host hostceph3                             $ Z6 o9 Y' }* x6 e( P
[root@hostceph2 ~]# systemctl stop ceph-osd
1 ]- `% l- e9 {* L' P- I) Uceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      : K$ {% ~  i; f! G  J$ X* B
[root@hostceph2 ~]# systemctl stop ceph-osd6 f* V4 r" C* I3 `8 ~
ceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      + h) j7 G9 i1 z
[root@hostceph2 ~]# systemctl stop ceph-osd
+ U5 M# P% t9 x8 |" b! {+ {ceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      
# L$ \  w2 X5 R8 S( R[root@hostceph2 ~]# systemctl stop ceph-osd@8.service * Y5 e4 B$ C: V+ p
[root@hostceph2 ~]# ceph -s8 m5 v  s# X) D: v
  cluster:
; J8 P& {  V$ U$ z2 |    id:     29046cc0-0682-496b-98b1-912e599642824 C' W, j. \( A4 Q
    health: HEALTH_WARN
& y2 a9 C  b' p2 ^7 [0 S+ i3 K3 x            1 osds down% c, w& V: y, d3 E9 E  m1 ^/ ^
            Reduced data availability: 24 pgs inactive
# Q2 h" [' y! u            24 pgs not deep-scrubbed in time7 |* q3 y! @2 C7 v* ?0 k/ p# W; M
            24 pgs not scrubbed in time$ ]# n+ j, {- s) _

, @  j6 Z0 H: Z; Y  services:
+ s% p6 M. ?& e! e$ [    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
( J& N0 a, Q+ Y2 Q2 e  |    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3) i9 R9 w  l  _( n
    osd: 34 osds: 33 up (since 3s), 34 in (since 3M)5 Z; H6 s+ e! C8 ]! N  W
2 [9 n' S5 T0 j3 ]4 R
  data:$ i* s' |% {' ^( @0 y
    pools:   9 pools, 5760 pgs
- j7 H; z2 N3 I! M    objects: 3.11M objects, 12 TiB$ E( \& }4 C( {4 ]& E
    usage:   33 TiB used, 92 TiB / 126 TiB avail1 L8 S8 Q$ \- V, e% B
    pgs:     0.417% pgs unknown
- Y* P! N2 W5 Y# u             5504 active+clean
+ X) c- k+ U% M9 a" W7 B             231  stale+active+clean
! }/ n, E: i) m1 _- `( `             24   unknown) i' H  ?2 h# q7 U- I
             1    active+clean+scrubbing+deep
, E' o) H( K% @% G( }( K+ `( E ) {" a2 e1 C* s1 _7 w" x
  io:
  a- ^  h* B4 m& o    client:   441 KiB/s rd, 21 MiB/s wr, 504 op/s rd, 546 op/s wr: i: P% l( }- K0 l
4 }) V2 u" W8 m
[root@hostceph2 ~]# ceph -s6 l7 M, ~; f, \3 {) I# Q' m
  cluster:
: c, B$ D2 _  z3 j. `    id:     29046cc0-0682-496b-98b1-912e59964282
5 k: V: g$ p8 L, G: r    health: HEALTH_WARN- m8 S8 k7 H0 b1 [7 }
            1 osds down, P; z/ R/ V% a/ V
            Reduced data availability: 24 pgs inactive; N% K2 i  I3 W2 z
            Degraded data redundancy: 300823/7651891 objects degraded (3.931%), 465 pgs degraded; ~! h1 ~+ y7 ~( }: c
            24 pgs not deep-scrubbed in time
" i  a, J! {: I2 J0 r            24 pgs not scrubbed in time$ B! E' ?$ F' A0 `, C# ^
7 P" n  M8 I5 V' Z0 y) D
  services:0 K) v' `, Y2 i0 D$ G! q
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
4 Z! M) A0 V$ _$ E; x& _    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph33 y/ G- _* {, a5 I
    osd: 34 osds: 33 up (since 10s), 34 in (since 3M)
" C. g6 \4 E* k- ~: A4 \! }5 n
$ g9 z; X% y( B4 {+ I' u1 O* c  data:
! @& z! I5 V  N9 U$ @- F7 K6 W; ^& U    pools:   9 pools, 5760 pgs, d( M4 z" P! X2 }0 Q! [
    objects: 3.11M objects, 12 TiB
4 |" W5 s1 ]4 ?( \$ ]    usage:   33 TiB used, 92 TiB / 126 TiB avail
* L2 P: ]  x# @& L% D7 _    pgs:     0.417% pgs unknown  Q, U8 d1 N8 M% v6 I; a
             4.010% pgs not active
2 N. M5 c) C$ H5 v. W             300823/7651891 objects degraded (3.931%). A9 s4 k1 P$ \( [! z: n
             5182 active+clean
! J7 Y, C& V( u. B5 g  [             234  active+undersized+degraded
  _0 Q3 }/ Z/ n* v( _- a$ p- s             231  undersized+degraded+peered3 i5 [9 e( ]. a) N) H
             88   active+undersized
2 ]0 S2 L+ E; c$ y+ R6 {9 Z             24   unknown' X4 U2 H- H: o5 N9 R( C
             1    active+clean+scrubbing+deep
% k; P0 q; t& |& ^ / S- M: g2 m! O1 B
  io:- `5 u9 e1 ?$ r0 ^5 ~( w0 m2 [1 z' L
    client:   15 MiB/s wr, 0 op/s rd, 567 op/s wr5 ?5 G0 T, M! ?8 a7 {9 j! c
7 @) \  Q) ~0 X) \) `
[root@hostceph2 ~]# ceph -s+ k4 P  Q) A4 _  C' ?, a
  cluster:: J7 @* g, v8 R1 p
    id:     29046cc0-0682-496b-98b1-912e59964282
2 l( K* a) Q* Y- {    health: HEALTH_WARN4 l/ Y+ R, s2 ]7 }# I' U
            1 osds down- B+ ?( K7 q# B! X, A7 h% y
            Reduced data availability: 24 pgs inactive
9 k+ ?9 X) d3 r: ]" z4 L) T5 J; d7 s" o            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded% j) d8 [  ]" c/ t5 l
            24 pgs not deep-scrubbed in time5 _; b  m& E$ B. D7 E! e6 I
            24 pgs not scrubbed in time6 E7 I2 t  e" j6 [3 b. f, i  n

7 x  e5 O2 m. a# z/ j  services:6 @# Q, I7 v) T: H* {4 r0 |
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)  o8 X, K6 @3 t: W4 ?$ `# j; E1 O
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
+ x% s, j) ^$ r. ~) i    osd: 34 osds: 33 up (since 14s), 34 in (since 3M)( |4 ^/ Z" z* c! ?- S2 z
% Y* y. p! u' [
  data:
( }. r( C5 Y1 S9 r/ `# D) P* Q" y/ a    pools:   9 pools, 5760 pgs) {$ j( S+ G2 p( Q6 q7 l
    objects: 3.11M objects, 12 TiB# M5 s: }7 J/ ]; L( Q8 \9 G
    usage:   33 TiB used, 92 TiB / 126 TiB avail
8 n! s) M" T9 P8 \) |$ A* f    pgs:     0.417% pgs unknown* `) {3 m) }) i/ N4 O1 |4 ?, t1 H% {
             4.010% pgs not active
% \; z0 k  j& D  N             300823/7651894 objects degraded (3.931%), ^) B' E* R9 O; [8 B4 ]/ k2 b7 n
             5182 active+clean) C/ W0 c9 A" D7 h6 M2 T9 l
             234  active+undersized+degraded8 K5 x. Z% P+ R% ^
             231  undersized+degraded+peered
7 X2 I$ r& \# H             88   active+undersized( I" X3 Q) S& y8 n/ B
             24   unknown+ b7 d8 q5 |& v/ P
             1    active+clean+scrubbing+deep( e+ L- o3 {6 o9 y8 j, m

0 H( c! w' y1 R5 Z' P$ n  io:
1 w2 U4 H2 K" f( b/ [) Y    client:   18 MiB/s wr, 0 op/s rd, 598 op/s wr
! h  F$ H  H+ Q1 `. t
; b6 o& S( @6 ^4 i' N+ w[root@hostceph2 ~]# ceph -s* P/ i8 K2 Y+ m& ]5 y4 Z( Z0 X
  cluster:  M3 `0 I) K) r( W0 J1 Q/ o# f8 C6 v
    id:     29046cc0-0682-496b-98b1-912e599642826 q& u; L+ H  f6 [# X
    health: HEALTH_WARN) o; b+ `( Z# G- c0 I( _: Q4 n
            1 osds down
/ D! J# p8 q8 H: I# v5 X            Reduced data availability: 24 pgs inactive* H9 v: d- O2 r) t) x7 P/ e5 k
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
( {* [: p, P: K. f1 a0 _3 i( _            24 pgs not deep-scrubbed in time
7 c6 D! P- @+ ~, A" R1 j            24 pgs not scrubbed in time3 ^. ]. K0 C/ O& T% z
3 _; o  Z! i: c* y0 I' K! g5 Q- |
  services:2 H' }& D# {" W: u$ d  \# v
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m): T# O% _1 r4 J5 w  y4 o/ q" W
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3$ _, j7 P) @8 A4 `8 u# R
    osd: 34 osds: 33 up (since 16s), 34 in (since 3M)  C: s! ]! \+ {' I: N
$ Z6 ~. Z4 l" z* N
  data:
+ l8 G  K1 p3 `    pools:   9 pools, 5760 pgs. x6 T5 m5 k7 s% @
    objects: 3.11M objects, 12 TiB
1 l4 V( Z& r* x* O    usage:   33 TiB used, 92 TiB / 126 TiB avail
3 X5 e3 F( a  n: }5 d: r3 K2 u$ D    pgs:     0.417% pgs unknown
! r" `% R+ u$ |/ }7 |             4.010% pgs not active& E, a. Q. F2 {6 O, l) P; T* P1 \
             300823/7651894 objects degraded (3.931%)* M. g0 a. J: N+ m- m- B. l+ `8 i
             5182 active+clean
; n' l0 E/ Y/ C3 z' }% T             234  active+undersized+degraded
' z5 }! i1 D4 n: B             231  undersized+degraded+peered8 I- v, Z6 |" c: x7 Z" \0 ]7 f
             88   active+undersized
/ B! P; ]# t. X! R' u             24   unknown; @! \9 e' Y5 x! c( M# e7 v' |
             1    active+clean+scrubbing+deep' r) j/ u; |7 K- M

3 k4 Y/ ^" T. N; l! Y  io:/ w6 l! d3 M5 f9 T/ {* q* [: G
    client:   19 MiB/s wr, 0 op/s rd, 591 op/s wr
6 O6 {  [! Z& s" j2 q/ `. b( |) L- Z  R& u ! f  ]1 h0 C% T) r! h1 p+ @
[root@hostceph2 ~]# ceph -s, b. ~3 `& h/ k3 M9 }- h- q8 H& x5 t+ R
  cluster:' O+ }2 u5 _  ^1 M1 ~
    id:     29046cc0-0682-496b-98b1-912e59964282! M+ c. s8 \0 j) @# D5 r
    health: HEALTH_WARN
: `8 p% E, i5 u# ~            1 osds down
6 z5 n, Y4 Y. k            Reduced data availability: 24 pgs inactive
2 n' D, A! d/ a5 O            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
9 W) E0 u; P: c* p; y% R            24 pgs not deep-scrubbed in time
8 \8 @- y7 }5 g  x            24 pgs not scrubbed in time+ g- ]! \" K$ Y6 ^' I
' M4 N$ C! R0 U7 O) T+ B. K( V
  services:/ `3 f9 ^7 `& T% ?; g
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
& X; U) z( p% t7 t" _3 g, R    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph33 r+ _1 O" Y1 Z
    osd: 34 osds: 33 up (since 18s), 34 in (since 3M)
# O( Z$ ~2 S) c+ V" y4 I
* e1 f6 a! z+ r  data:2 s0 x; H8 f6 L( d+ e
    pools:   9 pools, 5760 pgs, L5 G2 m, t  u$ L; d9 |
    objects: 3.11M objects, 12 TiB
6 T1 x2 h% V/ O! H" M: [    usage:   33 TiB used, 92 TiB / 126 TiB avail
6 g! s9 b1 j2 d3 A8 m; x    pgs:     0.417% pgs unknown
3 ^0 ^) V( a1 D. Z. a0 g, Q, |6 {             4.010% pgs not active
  Y8 D$ {- p0 O' Q             300823/7651894 objects degraded (3.931%): D& o+ e7 x0 p0 _0 s9 M$ l$ [3 X
             5182 active+clean
0 Y7 k' T' t# R0 h' j             234  active+undersized+degraded
$ j* i) h  I) H  ?             231  undersized+degraded+peered
; W5 b' f2 Y6 Q3 m. q             88   active+undersized
" c4 v# _: e) x) y0 G" R             24   unknown7 b$ C6 o8 Y' ?" g- `0 f1 X+ D: s$ Q
             1    active+clean+scrubbing+deep' A* o! E4 u1 @( z

' [" }  H# N) V/ O& V* m, G2 B! `  io:
' Z0 G$ A1 S5 [2 ?0 m    client:   43 KiB/s rd, 19 MiB/s wr, 30 op/s rd, 517 op/s wr9 N3 k. g$ n) S$ T

8 k: n& k) J$ [) U[root@hostceph2 ~]# ceph -s, \9 {8 ^+ ~; \2 y. w
  cluster:" l9 A8 `3 b  L# g. a& \
    id:     29046cc0-0682-496b-98b1-912e59964282! s" J" W' y& O- t0 y
    health: HEALTH_WARN
, e: _- P( Q; d7 r            1 osds down3 N' M: \- d' Y/ f- N8 W8 r
            Reduced data availability: 24 pgs inactive
. |8 S# T9 x4 ^8 o% K  E' p            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded% ]3 k( q, N& C: t6 H
            24 pgs not deep-scrubbed in time
# b$ l/ a9 h+ g% ~. j$ c+ b; x# m$ r            24 pgs not scrubbed in time3 s5 b$ O( F7 W! G

0 x8 n, C  m  N: D  services:
$ i- X$ B2 d4 M- D    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
2 B' d" D7 b" A3 r& E1 V    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
  `- s, q0 \" M2 l    osd: 34 osds: 33 up (since 20s), 34 in (since 3M)' |5 s9 i3 T0 R5 q4 z; ^% |3 d

/ W, B( E. H) m  {: z  data:
0 r9 T7 Q) f* i: {/ k8 n3 {    pools:   9 pools, 5760 pgs& U  K) G/ x7 j6 R
    objects: 3.11M objects, 12 TiB
) i! |6 b* ?( \9 O/ X! C- v    usage:   33 TiB used, 92 TiB / 126 TiB avail
% F! a9 \# K( Z1 K    pgs:     0.417% pgs unknown
8 G: k% l3 l! j4 B, E; p( U' T             4.010% pgs not active- }+ W. f) B+ Z* H# K
             300823/7651894 objects degraded (3.931%)- O( _( S0 T, ^, B  [2 n" U9 _
             5182 active+clean0 k! v: p# K/ {, Y& a
             234  active+undersized+degraded( u6 e0 J9 l( t! t
             231  undersized+degraded+peered/ Z+ _- a6 A- r6 @" P; K% f- L$ j) E
             88   active+undersized
+ O% q0 g$ v* g             24   unknown+ {6 y% ~! Q5 w8 B) A9 F0 K
             1    active+clean+scrubbing+deep$ V6 F& L4 [/ I3 q" H- Y
2 D& J& Z$ l% m0 p& Q- j
  io:
2 ]: D' |$ [( Z4 V    client:   66 KiB/s rd, 19 MiB/s wr, 30 op/s rd, 542 op/s wr2 j, x( Z$ Z5 l" d% B( \
回复

举报

返回列表 发新帖
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

本版积分规则

返回首页|Archiver|手机版|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )

GMT+8, 2026-6-11 22:58 , Processed in 0.034575 second(s), 26 queries .

Powered by Discuz! X5.0

© 2001-2026 Discuz! Team.

快速回复 返回顶部 返回列表