浏览此站
联系我们相册切换到窄版 Language

 找回密码
 注册
易陆发现论坛»论坛 › 云计算开源区 › ceph分布式存储 › 完美解决过程Reduced data availability: * pgs inacti ...
返回列表 发新帖
查看: 518|回复: 2

完美解决过程Reduced data availability: * pgs inactive 24 pgs not deep-scrubbed in tim

[复制链接]
admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
发表于 2022-11-8 10:29:11 | 显示全部楼层 |阅读模式
购买主题 本主题需向作者支付 2 金钱 才能浏览
回复

举报

admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2022-11-8 10:45:39 | 显示全部楼层
[root@hostceph1 ~]# ceph -s6 u0 ~* C8 X* E- _, L* X( w
  cluster:
% E1 ^3 L! T, o7 L( [    id:     29046cc0-0682-496b-98b1-912e59964282
6 h( F" o" ^0 W9 q$ @) o& b6 Z    health: HEALTH_WARN0 M& y  U* S6 I) F+ e  [' O& [
            Reduced data availability: 24 pgs inactive3 n) u. g0 p+ d' _  \
            24 pgs not deep-scrubbed in time
8 S0 ?" s/ }9 _            24 pgs not scrubbed in time
( ]  p' g$ [, }5 L! h" k& w' | ' F4 P2 k6 D  O* C9 D" S! |3 O
  services:
2 A  b9 w, }, {* ~% _5 f( F    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 3M)
3 n% i! C, z7 }% o* E' Y4 r8 }    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3  j) h$ Y, `  ~: @- n/ v1 I
    osd: 34 osds: 34 up (since 3M), 34 in (since 3M)
1 i( E" R2 H5 z
  x; Q! i# L, r, g# G3 w: @- N  data:0 Y# j' i+ R& R$ Y% T9 @$ d. w2 K
    pools:   9 pools, 5760 pgs
7 D* c2 S" k8 q* V/ q    objects: 3.11M objects, 12 TiB( a/ f# i) d" X1 u
    usage:   33 TiB used, 92 TiB / 126 TiB avail7 _. Q1 A) H8 W0 S
    pgs:     0.417% pgs unknown
) H6 M! k9 }* K- w& h             5735 active+clean
/ F: I9 w- h; z9 J4 B! j7 X             24   unknown1 ^! k9 G& l! }! A$ C2 u! m8 y
             1    active+clean+scrubbing+deep
9 T8 V* \8 _6 R
* }0 }$ j. s; `& M0 b  io:9 G& v6 p! A: u& g! k+ d, s! J" E
    client:   9.7 KiB/s rd, 20 MiB/s wr, 12 op/s rd, 625 op/s wr
5 G: w3 |' D. R
, C6 u; Y7 L: R# @[root@hostceph1 ~]# , v# u' @- ]# s; f" ^
[root@hostceph1 ~]# ceph -s* J- N& c5 I. I6 m% n( v* c8 Q# ~
  cluster:) h' J* @: m. n; I
    id:     29046cc0-0682-496b-98b1-912e59964282
+ N2 L3 X2 z& o! m. P$ m    health: HEALTH_WARN
; C; S& Q, T! }4 z  \            Reduced data availability: 24 pgs inactive5 F* p( u; x# w$ @( [* N- H9 j" g5 q- Y
            24 pgs not deep-scrubbed in time
7 v1 L+ H* S2 F& m1 u9 [            24 pgs not scrubbed in time: j1 I( W( `+ Y+ A

% Y. F( K* ?7 z6 @) d# y  services:+ v  {7 p. F/ v* [; ~
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 3M)
/ j$ U$ g& d2 d& X9 x1 x. \  x    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
& i; O) O- \8 F# ]! s    osd: 34 osds: 34 up (since 3M), 34 in (since 3M)
* l$ h3 x; F' X3 v / E  R; q! ]3 H; R) F% G
  data:
) ~# L% @" x1 J( e    pools:   9 pools, 5760 pgs
0 q3 s0 G' E- U1 X8 L' M    objects: 3.11M objects, 12 TiB
+ q( e2 M( s! j) k/ u  w    usage:   33 TiB used, 92 TiB / 126 TiB avail
1 R& Y5 S# c% L    pgs:     0.417% pgs unknown/ ~( S8 l. Z! F" N! i$ E' Z+ k$ F
             5734 active+clean  ~8 Q! Y& q! U3 m5 h
             24   unknown& L, P( M# H0 b2 x5 F- H- n. }
             2    active+clean+scrubbing+deep5 a4 J. `1 z7 }9 }: k
& u' p, u- {. U3 r$ p) S1 r
  io:
& t5 B7 `# {' t& _4 m1 a    client:   90 KiB/s rd, 22 MiB/s wr, 103 op/s rd, 531 op/s wr
4 W7 l+ p! j, U( n; e  R 4 k" o) R8 ?' p' s
[root@hostceph1 ~]# ceph health detail
! O# A8 _; I; [- t; M* M: ]HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time$ D8 L4 X7 w1 ]
PG_AVAILABILITY Reduced data availability: 24 pgs inactive
9 ]# k2 @+ N" O9 S* j& r4 y    pg 10.6 is stuck inactive for 8558718.511785, current state unknown, last acting []5 j3 H( s5 c5 `
    pg 10.e is stuck inactive for 8558718.511785, current state unknown, last acting []
. {1 y" `- x" f9 r5 k/ S* M    pg 10.21 is stuck inactive for 8558718.511785, current state unknown, last acting []+ Y' h, S  t1 |  J
    pg 10.3e is stuck inactive for 8558718.511785, current state unknown, last acting []
, y9 o4 v; P$ c( X1 S8 i    pg 10.41 is stuck inactive for 8558718.511785, current state unknown, last acting []6 l' I5 S& r! u1 b5 p
    pg 10.6d is stuck inactive for 8558718.511785, current state unknown, last acting []
) C! k! s0 ]% G/ T% P8 c3 L' P    pg 10.81 is stuck inactive for 8558718.511785, current state unknown, last acting []
0 {  ^/ p* E; a    pg 10.88 is stuck inactive for 8558718.511785, current state unknown, last acting []7 N  w5 r/ f8 v+ z
    pg 10.90 is stuck inactive for 8558718.511785, current state unknown, last acting []
; `) c: c1 E2 \    pg 10.af is stuck inactive for 8558718.511785, current state unknown, last acting []2 g& X" C: b. N1 J6 x4 N4 i
    pg 10.c1 is stuck inactive for 8558718.511785, current state unknown, last acting []! |& Q) b. W: G
    pg 10.de is stuck inactive for 8558718.511785, current state unknown, last acting []
! _. [) ?% U" P, c6 r1 `) C    pg 10.f4 is stuck inactive for 8558718.511785, current state unknown, last acting []
( k" n8 P  D2 b! i# P/ m6 K    pg 10.10e is stuck inactive for 8558718.511785, current state unknown, last acting []
! l) Y( H  V1 k) z+ Y3 r    pg 10.114 is stuck inactive for 8558718.511785, current state unknown, last acting []/ t& Y0 p/ _4 {5 ~% G
    pg 10.11b is stuck inactive for 8558718.511785, current state unknown, last acting []7 W( r1 L' T  p# b& h
    pg 10.137 is stuck inactive for 8558718.511785, current state unknown, last acting []( e- T" {/ j! m1 s6 h1 L. @
    pg 10.164 is stuck inactive for 8558718.511785, current state unknown, last acting []
* |7 K3 R" s1 D, T. X" P0 ~    pg 10.166 is stuck inactive for 8558718.511785, current state unknown, last acting []
+ |  ]( ]+ p! |- m) r) }    pg 10.16e is stuck inactive for 8558718.511785, current state unknown, last acting []
; e) i$ Y+ J5 p4 k% d8 b0 P' @    pg 10.19b is stuck inactive for 8558718.511785, current state unknown, last acting []
' f0 X9 M0 e. i  \    pg 10.1ab is stuck inactive for 8558718.511785, current state unknown, last acting []
$ G( {/ o' F9 }7 {9 s* _  R. T9 }    pg 10.1ae is stuck inactive for 8558718.511785, current state unknown, last acting []
; H$ Q9 Z( x, h# I* f    pg 10.1b3 is stuck inactive for 8558718.511785, current state unknown, last acting []
, ?* C9 \& T# r5 r8 KPG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
2 I4 F  Q" Q, y% f* S0 d    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.7060777 d( i- S5 E7 J
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.7060773 z1 a! H8 g  f
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.7060779 C* V) r' K9 q$ e+ K: v; d
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
7 J/ w$ r( m) \1 ~/ @    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
4 z* z, [3 @3 y4 L    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
7 P/ a/ L6 H- j    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
* N5 o% R( n# G5 E    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.7060775 K" L/ {+ b+ N  y; g5 u2 X! `
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077
  k6 \- a# @9 i2 l    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
% H9 e# S: A+ u    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
: Q' |# j& \' M9 v" M& {- f    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077
0 G* a5 G5 R  x  d; j6 H    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077# \* j8 M% O5 m6 t. D
    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
% `( }9 k2 ^$ a7 s. M& J0 c    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077
& Z+ D% b; D6 e    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
# k. A$ {, o* u+ Q% g0 F- A    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
: x3 B' l! c: Y! H! [4 d" i  o9 q    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
: ]2 O8 B" m% }( f    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
. V: E+ e* j4 a    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
: s# z) |( f% {4 _    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.7060777 V9 e- v9 t/ p6 U2 f8 h% {
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077& F2 x! p+ o  s: o" N
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
/ O$ ?* x0 X' b: \0 ]! V1 G( g    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
0 u2 r2 \) G8 n: b& w$ sPG_NOT_SCRUBBED 24 pgs not scrubbed in time' {( y5 m4 _9 T% \- {) J
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
+ ?8 n( M1 ^( ?2 Y  \; e    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077! \- r4 U6 T5 L! k, i
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077! s7 \- [( C) V" T6 t; B5 v
    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077* e2 E; b  D- }% ]
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.7060772 j3 d9 B0 @9 w/ e6 n
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
- |5 z; x; G% t: m, u: e( b, Y- @$ a    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077! O0 q- X" e' p/ b6 I( X, a% k
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
$ v7 F& b- V7 b% V    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077) M& M, a4 E# J" }
    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
  w: U/ o2 o8 m/ @" `    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077  B3 y7 ~: r& f4 ]" J/ [+ P
    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077, I3 D& e1 m' a
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
8 V3 P9 ]+ R' U( [( s    pg 10.6 not scrubbed since 2022-08-01 09:11:50.7060773 m) e( |$ D4 H  u! g# \
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
- ]& p9 }, G5 @3 a    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
' e1 j; h& i0 o    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
- {1 ]' U# x2 r. r    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077( u! s- C8 }3 \5 Z
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
" a9 u' E8 V% z9 ^    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
5 ~0 @- J2 w0 V6 X0 N$ }3 X6 K    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
8 ~$ g9 j4 I4 y( W    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077" C* @: @; C$ ~8 ~  x) X
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
5 W0 ?: k% W  A* ^    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.7060775 v- @$ Z! ~0 A2 Z& B9 ]
[root@hostceph1 ~]# ceph pg rep" G( J+ I# o" _- c( v2 ^! _
repair  repeer  
( |1 h+ c9 F3 c- |$ ]% D[root@hostceph1 ~]# ceph pg rep; l+ r& ~5 b) O: w8 X7 r  t
repair  repeer  
! e. Y. ~& Q# R3 E" o[root@hostceph1 ~]# ceph pg rep3 v3 z' L/ ?& t1 u
repair  repeer  
. z+ W$ }, T  a$ B" r[root@hostceph1 ~]# ceph pg rep' d3 R1 F$ J* H& Y! H% c1 `
repair  repeer  
! S8 ]! Y9 z+ i1 g3 g# b- F[root@hostceph1 ~]# ceph pg repair 10.6
, _% v* A! e" `; b; [instructing pg 10.6 on osd.8 to repair
! |" A" q" l) y! e6 [% _[root@hostceph1 ~]# ceph health detail
5 {2 E% [$ B$ b- Y3 v9 f$ z. `& kHEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time7 o2 `' c. _/ K  q4 w9 m& K# y( @
PG_AVAILABILITY Reduced data availability: 24 pgs inactive
+ o( ^/ W9 }/ R2 Y! [- U    pg 10.6 is stuck inactive for 8558779.003482, current state unknown, last acting []
5 [; }, F# ?/ J' k" L$ l    pg 10.e is stuck inactive for 8558779.003482, current state unknown, last acting []
2 M6 @* I2 M' [9 y8 w. i    pg 10.21 is stuck inactive for 8558779.003482, current state unknown, last acting []
7 W; ?9 S7 X. o% G* Q  X( `    pg 10.3e is stuck inactive for 8558779.003482, current state unknown, last acting []
4 r$ C& H# I- [, n/ _3 b3 U    pg 10.41 is stuck inactive for 8558779.003482, current state unknown, last acting []  Y! K# P" L- d0 `/ [
    pg 10.6d is stuck inactive for 8558779.003482, current state unknown, last acting []
. t  F: Q) B% B- n' M    pg 10.81 is stuck inactive for 8558779.003482, current state unknown, last acting []
0 s3 c7 H% m! q' R3 ~' [    pg 10.88 is stuck inactive for 8558779.003482, current state unknown, last acting []/ M2 {- G) }% |2 w: f* H7 h  i& @
    pg 10.90 is stuck inactive for 8558779.003482, current state unknown, last acting [], g# k* }7 s) a7 ]* n/ e9 B( k- E% B
    pg 10.af is stuck inactive for 8558779.003482, current state unknown, last acting []
$ Q% s0 \: v8 X    pg 10.c1 is stuck inactive for 8558779.003482, current state unknown, last acting []  o8 V# x+ G, x/ {, r7 u% J
    pg 10.de is stuck inactive for 8558779.003482, current state unknown, last acting []
0 t* X! X/ @0 X9 Y    pg 10.f4 is stuck inactive for 8558779.003482, current state unknown, last acting []+ k! U; |2 C. \( l
    pg 10.10e is stuck inactive for 8558779.003482, current state unknown, last acting []4 C; {( _* y" B- P% E6 T# H
    pg 10.114 is stuck inactive for 8558779.003482, current state unknown, last acting []
$ R6 G6 B. ~8 F. B$ n8 f    pg 10.11b is stuck inactive for 8558779.003482, current state unknown, last acting []
9 O( U- [9 `$ l( R3 j    pg 10.137 is stuck inactive for 8558779.003482, current state unknown, last acting []
. y4 X2 v# k+ }& U3 a$ s    pg 10.164 is stuck inactive for 8558779.003482, current state unknown, last acting []& l( ~) ~6 x8 U5 p- @- o3 ^; x
    pg 10.166 is stuck inactive for 8558779.003482, current state unknown, last acting []% o; T2 N" }5 E8 ]) L
    pg 10.16e is stuck inactive for 8558779.003482, current state unknown, last acting []
- E& w5 L, [) j1 H( b5 p6 x    pg 10.19b is stuck inactive for 8558779.003482, current state unknown, last acting []+ [$ Y* Z- e. ~$ j! E- t! t( X# N4 `
    pg 10.1ab is stuck inactive for 8558779.003482, current state unknown, last acting []; B) h; m, x, c6 q5 x
    pg 10.1ae is stuck inactive for 8558779.003482, current state unknown, last acting []; v& _& g1 |3 Z
    pg 10.1b3 is stuck inactive for 8558779.003482, current state unknown, last acting []% I0 h3 l* d; t) U
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
' T5 }% F2 R7 l1 V& S  X    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077* F& R5 [% R/ M: K; h5 b
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077* \4 I) C- `7 o3 n
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077+ b- R8 B$ S% [# X/ E4 v
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.7060777 _" u) T; `" Q) E* {. ^! v  ]
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077: W5 F. [- {: E# C
    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
! l' x4 P2 D$ P% O4 @    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077+ o) f0 B" h& p! |
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077+ M  L  R( f1 [4 d# Z& R& g: m
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077
2 {" z/ F1 ^0 q7 E5 J    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.7060770 b8 ]# e; Q7 N5 A( I
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
/ [6 v4 x  y' n' d& N    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.7060772 x/ `: u' T0 l7 ~! Q! E4 Q/ u' Z0 t& T/ A
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
5 ?1 k- n' S+ E( J    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
7 e  u) ~- U' i* b4 z8 q3 F    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077
) i' M$ R0 d) }/ v5 u    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
* n# @' e! _8 V1 o  K    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077$ V& e/ y$ W. f( {
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
6 j# _+ V  Z$ C) Z+ `( m$ |    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
! a( R% v0 Y7 [: J5 z) w    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
, G! S" \" i, i  k! q. G" X2 D    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077  }! Q( n: b' \7 R, p, E. d$ u
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
1 Y$ r$ w# B2 d    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077+ b  V9 ^" d3 ^' L( z
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077  x5 e& w- w5 A3 q5 M, R+ k& Y
PG_NOT_SCRUBBED 24 pgs not scrubbed in time' x6 J/ q1 L3 T! G4 T9 P# c+ V' L
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
. R; D8 I9 ?7 L5 f3 U5 ]3 A7 n5 O0 x" p    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077& c, q: c6 O. ~& B
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077! e  J; |( y- j3 K  ?) x! y& S) @+ S
    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
' x" v! Y+ k9 M: b" q    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077& d3 g, |; |4 C2 u3 y" N- G
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077  p/ O0 b1 s2 S. b" R' e2 M! s
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077
+ L. v% W5 L6 n* t' l6 H$ S0 q    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077: s9 Q1 R$ {! e9 i
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
# V, D3 t: Z% U' [+ F2 v; j    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077" a/ M4 l! ~9 @) s! m6 ]
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
0 ~8 b) o% R% ^& s    pg 10.21 not scrubbed since 2022-08-01 09:11:50.7060775 f" U& T7 x. _+ P  j4 A: v
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
* |& C5 P4 V' \/ J) M! z    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077$ B; H1 L4 x. U* K
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
9 h6 h3 r: l  V% V    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077* m- ~9 D" \8 L0 X  D& F) e) {' [
    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
9 B4 K! e4 r3 N) L3 @) ~2 M* v    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077
$ ~" Q3 c9 ~. B# q6 J" Y    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
0 _6 z6 Q8 c, T    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
4 w( p# ]9 Y: c; S, J7 o    pg 10.19b not scrubbed since 2022-08-01 09:11:50.7060770 x* z# N7 w9 t! E2 v
    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077
% C8 |  T, }% W, D& X& A- }    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
2 M& g. Z( i( |9 U( G# @    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077( j3 u+ \1 u& {" q8 D4 b( i' g2 o$ `
[root@hostceph1 ~]# 0 g3 G. u" B. Z) l, Q0 r
[root@hostceph1 ~]# ceph health detail |grep pg: x( c+ {+ D8 j6 I
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time
  K  A  w2 G8 B) `* PPG_AVAILABILITY Reduced data availability: 24 pgs inactive
0 K0 N+ `8 k; O" X: ^# N    pg 10.6 is stuck inactive for 8558795.140009, current state unknown, last acting []
8 S. `  ]) |" t, `    pg 10.e is stuck inactive for 8558795.140009, current state unknown, last acting []5 p/ k6 f+ j! L( n: F
    pg 10.21 is stuck inactive for 8558795.140009, current state unknown, last acting []0 s; M# g" o% f
    pg 10.3e is stuck inactive for 8558795.140009, current state unknown, last acting []* |( g% {6 J) n5 g4 O  n
    pg 10.41 is stuck inactive for 8558795.140009, current state unknown, last acting []
* |+ z- I0 W& I* @- @/ ]    pg 10.6d is stuck inactive for 8558795.140009, current state unknown, last acting []/ L8 ^  C0 l, L; Z6 ~& y4 _
    pg 10.81 is stuck inactive for 8558795.140009, current state unknown, last acting []
8 `! @: p- @! _/ g5 D3 h* E    pg 10.88 is stuck inactive for 8558795.140009, current state unknown, last acting []
+ i, H' c; u7 m( n5 n+ Y, ?. ~! w2 K    pg 10.90 is stuck inactive for 8558795.140009, current state unknown, last acting []
5 d3 b2 g) K* `, l) j1 Q    pg 10.af is stuck inactive for 8558795.140009, current state unknown, last acting []
* w, X! f! \8 P    pg 10.c1 is stuck inactive for 8558795.140009, current state unknown, last acting []* I$ T5 [) b: {( r9 I
    pg 10.de is stuck inactive for 8558795.140009, current state unknown, last acting []
/ R; L3 x$ X! B) h5 r+ G% _  i; I. {" z    pg 10.f4 is stuck inactive for 8558795.140009, current state unknown, last acting []9 Y" Z4 H* h# f1 `; p
    pg 10.10e is stuck inactive for 8558795.140009, current state unknown, last acting []
5 h5 j5 s5 q1 f    pg 10.114 is stuck inactive for 8558795.140009, current state unknown, last acting []$ A0 b: n* W* g" X+ C0 |: X
    pg 10.11b is stuck inactive for 8558795.140009, current state unknown, last acting []
+ k0 K, \) O- e: n    pg 10.137 is stuck inactive for 8558795.140009, current state unknown, last acting []9 j+ Y. j5 R; k6 Z0 u
    pg 10.164 is stuck inactive for 8558795.140009, current state unknown, last acting []
- o) u3 s) v" @5 p    pg 10.166 is stuck inactive for 8558795.140009, current state unknown, last acting []
/ f+ s$ o* _5 O- n; h    pg 10.16e is stuck inactive for 8558795.140009, current state unknown, last acting []$ q0 K6 S5 U) m" f9 }* ]1 g
    pg 10.19b is stuck inactive for 8558795.140009, current state unknown, last acting []
2 G* {4 I' I4 F! g3 X; s: g4 c    pg 10.1ab is stuck inactive for 8558795.140009, current state unknown, last acting []
1 V+ P: T! @- R    pg 10.1ae is stuck inactive for 8558795.140009, current state unknown, last acting []
$ P& o0 S* ?! a; G) c8 K    pg 10.1b3 is stuck inactive for 8558795.140009, current state unknown, last acting []
; ^+ Y9 F" E+ \PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
( B1 ]: ^5 n2 v4 O/ M    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.7060778 }/ `: p- p3 M' Y9 s3 e# r5 p& q& |
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077& ~$ ^! o9 f3 y+ C1 `, X: w
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
) K2 M$ N5 R- j    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077. e8 c$ u" @! y  w
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
5 \$ B2 g: `8 k! |+ @! s    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077. Q' I9 F+ V! W0 M, n: T4 ^6 @2 o
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077% W/ D1 J$ V: @
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077* e9 i. f; f$ x5 L/ G8 G
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077% B7 z+ Y5 p7 f. _/ ^: }& ]
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077) O$ ^' G8 r* ~8 U
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077- w0 f. q2 E; O
    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077& f1 I/ e) c$ i4 b
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
/ c% \6 e4 K1 ]* a2 M' F9 ~    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
6 T8 }8 `% Z; ]    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077( G; e; L' }( m. Y
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077+ e. ^3 ?: Z% _: C
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.7060777 J6 ?7 M, ]5 o# O- e/ e
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
; Z% t0 G: r7 z7 F# |    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077. ~5 F- e" l, z+ R% b" `
    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077! _7 t  l, u9 g  d4 {7 r2 ^' m7 G
    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
* X' p9 T. s$ B! i' l/ K3 F    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.7060771 K- W3 S1 z+ S6 w5 D, ]  y* l
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.7060779 a5 t9 ^8 V% u3 ^8 K
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
" y. O; P" |" r  aPG_NOT_SCRUBBED 24 pgs not scrubbed in time9 {8 [! |, V; H1 ^- E- H. ^
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
; n; v, w, n& J5 q* k$ ^    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077
+ s5 t% c! [5 r0 `    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077* R) V: h1 {2 w* T. M+ p7 i
    pg 10.de not scrubbed since 2022-08-01 09:11:50.7060774 ?0 q4 ~% R2 q5 j4 {% w" j0 |
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077
& e* M+ M; a- C4 R* u/ _4 m+ t# T    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
' h* u( @: O8 N# s# g( J    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077
: u8 J5 x# H  P( E0 Z6 [; `7 l3 D    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077: w6 j# c9 r8 F, q2 e3 i5 W5 R
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
1 w0 U' K& }4 z    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
( I" f" Q2 z$ S5 @    pg 10.3e not scrubbed since 2022-08-01 09:11:50.7060773 s: x7 K. C+ j
    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077
4 |( \; }1 i9 G  Q. G+ I$ M    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077" z/ K, t& B/ h4 A
    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
/ x; K# v4 P4 k  Q. e. v( d, r8 N    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077, `& c0 L$ ^: b' d' @" k" v+ @. U
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
3 M  q) A) U3 n    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
8 G! a2 D) ^/ O2 f9 F; D    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077
7 Q6 J" h4 V* Z8 a" u6 Q    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
6 i- `* X+ W  _( C* d- q* P! I4 A    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
% R2 [! ~2 ~' }( s* t    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
: K3 k, x% m+ ~! J. P, X- {( O    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077
$ X/ ?" K" I& M5 q2 ~7 f, B' C    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077/ @! l6 W! ?& [4 A: P8 c
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077- U! J9 v! {5 f5 S
[root@hostceph1 ~]# ceph health detail |grep pg |grep -v pgs8 {' x* a; T5 e. m* H
    pg 10.6 is stuck inactive for 8558819.337561, current state unknown, last acting []  U! ^" Y" L/ q0 ~  N$ X
    pg 10.e is stuck inactive for 8558819.337561, current state unknown, last acting []" k6 J9 j% o' E6 P; u" g
    pg 10.21 is stuck inactive for 8558819.337561, current state unknown, last acting []7 n3 b6 R1 B+ z6 C1 K  s9 S
    pg 10.3e is stuck inactive for 8558819.337561, current state unknown, last acting []: w* {9 C$ {$ \, z( i
    pg 10.41 is stuck inactive for 8558819.337561, current state unknown, last acting []
* l# J. T8 q" V6 H0 r4 _. M    pg 10.6d is stuck inactive for 8558819.337561, current state unknown, last acting []1 D4 T5 z/ H4 V, P7 s
    pg 10.81 is stuck inactive for 8558819.337561, current state unknown, last acting []
7 ]! W& X) Q- c+ W. `4 }    pg 10.88 is stuck inactive for 8558819.337561, current state unknown, last acting []
6 ?" L  r/ k) y) J2 I( K2 e    pg 10.90 is stuck inactive for 8558819.337561, current state unknown, last acting []
, s- l+ L* L4 A  Y2 H$ m    pg 10.af is stuck inactive for 8558819.337561, current state unknown, last acting []/ @+ j9 a) ]: X# \5 p
    pg 10.c1 is stuck inactive for 8558819.337561, current state unknown, last acting []
/ Y/ t+ H7 Q0 ^1 M  E7 [6 T+ D' t    pg 10.de is stuck inactive for 8558819.337561, current state unknown, last acting []
0 b9 S/ Q. U; T* c# c& t0 Q    pg 10.f4 is stuck inactive for 8558819.337561, current state unknown, last acting []
$ F7 d+ v5 U/ y$ }. f    pg 10.10e is stuck inactive for 8558819.337561, current state unknown, last acting []
  e3 O+ y: I& H% I/ Q$ K; M    pg 10.114 is stuck inactive for 8558819.337561, current state unknown, last acting []2 e  q0 {) ^3 s" v; G6 x1 U7 O
    pg 10.11b is stuck inactive for 8558819.337561, current state unknown, last acting []; `! n2 U' j! I9 x
    pg 10.137 is stuck inactive for 8558819.337561, current state unknown, last acting []
# f1 z" `6 O" F    pg 10.164 is stuck inactive for 8558819.337561, current state unknown, last acting []
# _+ _/ W% ]3 i0 l, o    pg 10.166 is stuck inactive for 8558819.337561, current state unknown, last acting []
$ X0 w; c, ]+ T; \8 L0 U    pg 10.16e is stuck inactive for 8558819.337561, current state unknown, last acting []
; ~* [3 ~0 g1 b3 o/ w    pg 10.19b is stuck inactive for 8558819.337561, current state unknown, last acting []
6 Z1 t2 r- W, R4 H9 Q    pg 10.1ab is stuck inactive for 8558819.337561, current state unknown, last acting []
0 i1 N% ^# J7 w9 e. D    pg 10.1ae is stuck inactive for 8558819.337561, current state unknown, last acting []
1 M* t) ]2 T  O4 v% C. d    pg 10.1b3 is stuck inactive for 8558819.337561, current state unknown, last acting []- ], n% n4 G4 Y5 ~' N5 {
    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077. x+ e% [& L1 }' J7 e5 k
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077( U$ a8 x; M% k) ]) D8 O
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.7060777 P: q8 p! T, m, y$ w
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.7060771 C  @" \( {# a! u; n! t
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.7060771 t$ g5 {) H  A' @) o0 B
    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077; t- [' X  ^" u, J( |: M4 B- F
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
) ^# t, @' W) w5 ?! R- E* {    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
# Y+ n$ T6 X- c7 D6 t    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077- q, i, J7 ?, h9 U. r. E
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
5 e' q, x4 ~' d1 Q9 m7 H2 E    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077) }7 l& a' d. @
    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077& _3 P6 Y* q7 {1 I% a3 t
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.7060779 k1 k0 x% d' R% b$ {' O+ _
    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077- c; F- t* f& m' b( v
    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077# J/ j; v$ _6 {8 e& t
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077) t9 E3 |$ W4 F, l
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
& t) ]4 I9 N7 _    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077! O* w. ?7 }2 E1 s' n
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
. Y& X& a  _( [, C4 j3 B    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
  M) Y# {1 M* T" N2 |% k" U    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
; y. b1 r7 E, L# {. I    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077% ^. c; k' N2 l5 S/ F* ~
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
7 _5 s& Z/ V* i  l* k0 s    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077, s  ?+ `& {1 Y  J' n
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.7060777 L" t5 e5 i& k& d9 m9 n
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077; O. B: I+ f2 T' f2 Y5 @
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
5 G, B6 C5 x, a5 Z4 N    pg 10.de not scrubbed since 2022-08-01 09:11:50.7060776 h% D! e% c& ~* U9 z& E3 r' Z2 L
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077
# B3 U9 Z: L# _1 a, }6 F    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
0 c' J0 V+ U# Y: i- H    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077
- R$ P) l! y+ ~. p, r3 f    pg 10.81 not scrubbed since 2022-08-01 09:11:50.7060770 X" l! ?" P7 V0 D" t- v
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
0 p3 q0 ?( l6 d. k: ~8 i# ^  @9 O, ^    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077! \. S( u# E5 t# T8 c5 G! p
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.7060778 u1 B  R3 Y; }
    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077
1 X% u2 y2 Q8 s) t: t    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077  N: L1 I* T5 S( K
    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
1 z9 W- O4 b. b1 Y+ h- ^    pg 10.6d not scrubbed since 2022-08-01 09:11:50.7060775 ^1 L1 z- r6 n6 [- X$ I8 W
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077/ X! D: b0 G# s8 r
    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
  c/ Y+ ~1 f. y  w) a    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077
+ H, B1 C0 e3 L    pg 10.164 not scrubbed since 2022-08-01 09:11:50.7060779 `3 o: Q/ e+ w5 {7 R0 ^! C
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.7060772 i7 H' o5 {" d/ w2 O' y
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
# n+ f6 w( R" y  H6 \! n' G3 O    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077& P/ S# \/ R, [- x5 _. n7 K4 e) [
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
* i) h0 i0 C7 U4 `    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077
& C) r( a2 C/ ^2 z[root@hostceph1 ~]# ceph health detail |grep pg |grep -v pgs |awk '{print $2}', N! @6 N( U3 \6 S# h" }
10.68 x+ u1 y3 D: j1 _3 E6 J# i
10.e
6 a" `8 r/ z! ^  Z" X& i4 e10.21* D3 p4 Q  K) D7 H$ \
10.3e3 E' a2 n/ X* H* \: |$ J7 j. f
10.41: C7 B0 A$ k  E% V9 F: r; C
10.6d
1 c( @- M8 j5 V$ ], h5 a9 ]10.81# k+ [4 e) R- G2 U. J' {- q5 E
10.88/ @7 A- Q. {. d& Z2 O* c, h
10.90
" O+ `' x3 R/ ~, J9 T+ N& C10.af
  f" |9 M1 A, k( R! t) ^10.c1
# ]* k0 G! V2 F# Y0 g, @0 y10.de! G( E0 [  ~5 n, }" W* x
10.f43 e& g. v$ H% W% l9 K2 X- x$ N
10.10e
- N- _' q6 b5 {6 [10.114
. D+ y1 o( [% U2 R+ ^$ G; b+ D10.11b
6 D' W9 {9 q5 _: c10.137
; x4 S! u8 W* E/ D/ o7 o10.1644 u8 c6 j4 z! g0 m
10.166" @. @- c; J( R7 j- c/ e' z
10.16e' R, j7 {( \+ @, R7 j+ Y( h" i' S: ^+ I
10.19b
4 b, i+ G( I* O7 r' U! M) d10.1ab
0 _7 ~% k" v, i0 u' |10.1ae' F. E6 T8 i, f- ^. i
10.1b3- N, J( [+ x5 g/ `3 |
10.11b" z8 M8 g( w+ B0 W3 M% f
10.10e3 B" m# Q0 j7 F" }4 ^! `3 I
10.f4
( y$ d; Z! W- ]3 ~10.de
# k$ `, _! D; y$ Z  Y; y10.c1
1 r, S; r) i0 [10.af
# s+ o$ J8 ~& `( n3 t  @10.90
& `+ y% f7 O, [+ U9 X/ O5 ^10.81) h) H4 \. a* q. k- ^1 t1 d
10.88
) I+ T" q) _" z10.41" l# A9 a% J4 u+ b; I
10.3e
+ K- ]. S" m5 N+ D9 r, o3 n10.21
5 V  O' f- C& W1 {; x10.e
( r  U  b; E% t; _10.6' }/ Q! D# W  h. q
10.6d
3 Q3 b$ q  Y( g& `10.114
7 T/ _5 X2 r5 o8 n+ W4 P- _10.137
5 c7 e9 o0 s$ P+ y5 a6 g. `, l10.16e2 W: Y. W5 q# h- ^7 d' t" B
10.164+ I) D5 s* S* K5 I
10.166
. a; L# x, u+ a% ]0 i10.19b
0 n6 A: r0 A; X" }2 Y10.1ae
! u8 V6 Q# v% ]( S10.1ab
" A" n7 J' k( D- O" E6 s10.1b3
" H$ E7 {; c# }* U6 I$ a7 e10.11b+ Z3 Q7 q0 ?! h6 f0 e6 q$ g: Z
10.10e
$ x! x: F  S$ L6 _' i+ K10.f4
2 x1 l8 v( Z7 R- {10.de! ?- `- i2 K5 y' A
10.c17 k4 p( z+ H& v- N3 w
10.af9 L) {0 N8 t( C9 Q. G
10.90
, H- x1 p8 z4 y% f5 V, l9 ]5 {0 h) q3 |10.811 D# D& z0 s* H7 q
10.881 }9 c6 O4 X8 q/ P; ]8 T' b, X! L
10.41
4 T& g( ], ~) c9 ]3 |! t" y1 y10.3e
% S) l0 ~( P& T$ `# V! ]10.213 ~8 s) i6 y1 _' w4 D
10.e
3 N: L) ~& B7 o5 s$ y  x10.6
  k) G- n# X+ S. n" `4 K6 y9 Y, x10.6d
. s. U* }0 H( W$ v5 U10.1146 G, `) A$ q* b: H6 D7 v
10.137
5 u) B! c0 M6 K; O! V10.16e
$ C, ?1 w! t+ U8 D$ v( `. n10.164" Y* J" b# w# {" b
10.166! w9 i9 s" e4 d, A- Y) [3 c( H
10.19b
+ W) g5 y; O( t8 }1 m  I10.1ae
* W' B9 }% m9 E, h' _- Q8 G10.1ab
- K/ a0 f' ?, d; q. O10.1b3: V$ M) V  I- n  i
[root@hostceph1 ~]# for i in `ceph health detail |grep pg |grep -v pgs |awk '{print $2}'` ;do ceph pg repair $i ;done
! b5 L! v, f  Finstructing pg 10.6 on osd.8 to repair
' w1 \! T1 h6 ^* pinstructing pg 10.e on osd.8 to repair
2 u; V2 }5 d: _7 _6 Xinstructing pg 10.21 on osd.8 to repair
- [4 U' I. E- ]1 s5 U, n- rinstructing pg 10.3e on osd.8 to repair7 G: r( Y6 n9 q
instructing pg 10.41 on osd.8 to repair8 \" [* ~$ |/ N$ n& U# M8 i
instructing pg 10.6d on osd.8 to repair
+ p' ?5 ?& P, S7 d" C( Kinstructing pg 10.81 on osd.8 to repair: z% G, r1 {9 B$ b/ ~
instructing pg 10.88 on osd.8 to repair- [  j6 E2 U8 [- h$ p
instructing pg 10.90 on osd.8 to repair
9 w  X& N# q. c4 d# X' P7 v0 v4 Pinstructing pg 10.af on osd.8 to repair
& a  N3 Z# \6 A  rinstructing pg 10.c1 on osd.8 to repair+ c/ }# P) O% g9 t/ z4 W1 P' _# u$ a/ h
instructing pg 10.de on osd.8 to repair
/ H- [* v+ W+ f" F! F$ ginstructing pg 10.f4 on osd.8 to repair
) B$ q& m2 s7 E/ einstructing pg 10.10e on osd.8 to repair" @, H- P, F- b' h& K# z# a5 B
instructing pg 10.114 on osd.8 to repair
6 W" c* Z4 T! u8 D; g. ~$ Linstructing pg 10.11b on osd.8 to repair
8 W4 I  |* K, n4 j4 |" Minstructing pg 10.137 on osd.8 to repair/ p6 ?/ C) C/ m- k) ?
instructing pg 10.164 on osd.8 to repair
& m% A# S: ]5 ^2 Qinstructing pg 10.166 on osd.8 to repair
* A1 D5 D$ L) x7 k8 binstructing pg 10.16e on osd.8 to repair" C/ Z/ f! O6 R& n1 Q, [! z6 k
instructing pg 10.19b on osd.8 to repair
, b9 p) b( R2 X. sinstructing pg 10.1ab on osd.8 to repair
9 ^) D, r2 L2 p- _! A+ V4 n3 iinstructing pg 10.1ae on osd.8 to repair
2 q/ Z9 N* Q& G7 E" }. cinstructing pg 10.1b3 on osd.8 to repair2 S1 I. ]7 j+ x6 s0 |
instructing pg 10.11b on osd.8 to repair
! D8 [& i/ y0 K4 Ginstructing pg 10.10e on osd.8 to repair
, R3 }- t9 z3 f( E3 l; ?" Q+ n% Zinstructing pg 10.f4 on osd.8 to repair
) H. _  m0 c2 @& u% [instructing pg 10.de on osd.8 to repair
/ ]" c: X8 X7 D" Z' ^$ [$ zinstructing pg 10.c1 on osd.8 to repair# U  G) O* Z" a3 V
instructing pg 10.af on osd.8 to repair
2 Z) S4 S7 i& j/ T. x: Q3 Q. finstructing pg 10.90 on osd.8 to repair7 B) g/ |- {" h5 J& a  M
instructing pg 10.81 on osd.8 to repair. y+ d+ u& G' h2 S1 j- @
instructing pg 10.88 on osd.8 to repair; t- @2 W, O; w6 V* E7 p5 c" g6 w
instructing pg 10.41 on osd.8 to repair
1 F) p; I! q! W" m3 _3 n2 R4 }instructing pg 10.3e on osd.8 to repair
. o' a: R' C- a8 g& x0 r2 b; A/ S: rinstructing pg 10.21 on osd.8 to repair3 l5 U8 i0 O2 [' d% q
instructing pg 10.e on osd.8 to repair. W$ _/ B5 t/ P; Z6 h
instructing pg 10.6 on osd.8 to repair
; h; o% j, t# \4 W; T: M* D1 Linstructing pg 10.6d on osd.8 to repair; N0 O5 K+ n9 a; W0 g' K: p
instructing pg 10.114 on osd.8 to repair0 D$ w& l( O2 `+ ~- j. c
instructing pg 10.137 on osd.8 to repair
3 d2 G; x$ l- f3 a5 Y9 Kinstructing pg 10.16e on osd.8 to repair. i/ V0 S/ v- y" L, X
instructing pg 10.164 on osd.8 to repair4 r" k6 D0 z" j; l% ]- M; L
instructing pg 10.166 on osd.8 to repair
! Y  `3 C4 c; ^! |7 ?1 i% {instructing pg 10.19b on osd.8 to repair
* X1 m5 a$ F. o4 o( |: k+ u- U5 Tinstructing pg 10.1ae on osd.8 to repair/ k. Y" I/ u+ V* n# g
instructing pg 10.1ab on osd.8 to repair3 `! ^* B. N. }+ N1 h. K; F5 l" b2 @
instructing pg 10.1b3 on osd.8 to repair. ~* t6 N) J2 p
instructing pg 10.11b on osd.8 to repair
* j' ~$ ~/ k) a: B6 Kinstructing pg 10.10e on osd.8 to repair5 L# u% `* `4 S& I
instructing pg 10.f4 on osd.8 to repair7 f& H% x; H* X2 a: L
instructing pg 10.de on osd.8 to repair+ Y' F, s% A) A
instructing pg 10.c1 on osd.8 to repair" Y5 s& w5 v& g$ j. j
instructing pg 10.af on osd.8 to repair8 }/ z0 \/ `  k9 ?
instructing pg 10.90 on osd.8 to repair4 q$ k$ x9 A" x! x
instructing pg 10.81 on osd.8 to repair
* [3 }! c; ]! s0 Tinstructing pg 10.88 on osd.8 to repair. ~9 f* M- K2 o& l5 ^  M2 Z) i
instructing pg 10.41 on osd.8 to repair1 J: i( e( V# [( S) y
instructing pg 10.3e on osd.8 to repair4 Q% G+ K# {3 f! E* D
instructing pg 10.21 on osd.8 to repair+ K$ E* b3 E6 [% x
instructing pg 10.e on osd.8 to repair
1 V: c# @6 a* E* sinstructing pg 10.6 on osd.8 to repair
( `# [6 F# ^$ O4 N3 `- Z+ pinstructing pg 10.6d on osd.8 to repair
' U6 m) v: G0 g# G8 y3 h2 ]instructing pg 10.114 on osd.8 to repair
3 }. g) [0 b& pinstructing pg 10.137 on osd.8 to repair
; @7 f3 @4 }- a5 d- T  f: Iinstructing pg 10.16e on osd.8 to repair
6 L0 |  Z- R+ E$ A' u- g& h5 ninstructing pg 10.164 on osd.8 to repair
+ c0 N" O+ R- iinstructing pg 10.166 on osd.8 to repair
' s! j, o3 [: r: T: t% Jinstructing pg 10.19b on osd.8 to repair0 n. A8 k4 P* b- ?, e4 m
instructing pg 10.1ae on osd.8 to repair  }* C" `' y% k/ O
instructing pg 10.1ab on osd.8 to repair2 V# z% ~- }+ f; J5 o1 R; `8 y
instructing pg 10.1b3 on osd.8 to repair
# H# a. \6 m0 O  N[root@hostceph1 ~]#
回复

举报

admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2022-11-8 11:23:41 | 显示全部楼层
[root@hostceph2 ~]# for i in ` ceph health detail  |grep deep-scrubbed |awk '{print $2}'` ;do ceph pg deep-scrub $i ;done
" V! l% g, @6 ]; HInvalid command: pgid has no .2 H* I6 ?+ U8 o
pg deep-scrub <pgid> :  start deep-scrub on <pgid>
) {4 B# o3 [+ K& k% N6 IError EINVAL: invalid command$ P' u+ i- W# q1 W
Invalid command: pgid has no .
1 S2 o0 i2 L; Q9 C9 x2 d! s7 ~pg deep-scrub <pgid> :  start deep-scrub on <pgid>$ D- x4 N3 f- _6 ^. W4 m, G
Error EINVAL: invalid command4 ~. k: b+ ~. O; b' c
instructing pg 10.11b on osd.8 to deep-scrub
! e$ N) K3 o. n0 A2 d/ J5 uinstructing pg 10.10e on osd.8 to deep-scrub- T; d, p: T3 g4 Q# _
instructing pg 10.f4 on osd.8 to deep-scrub/ G6 @2 A- @; M
instructing pg 10.de on osd.8 to deep-scrub
4 W$ Q3 D% j8 _6 N1 }instructing pg 10.c1 on osd.8 to deep-scrub; g. z( I* @3 c! f
instructing pg 10.af on osd.8 to deep-scrub6 c3 u/ c& ^( u
instructing pg 10.90 on osd.8 to deep-scrub
% P( v' Q  w# N7 Z  K$ linstructing pg 10.81 on osd.8 to deep-scrub
1 [! O+ ^2 l/ Y  Iinstructing pg 10.88 on osd.8 to deep-scrub' L$ c& r+ Y  M2 n: V. O7 Y; Q3 z
instructing pg 10.41 on osd.8 to deep-scrub
! ~2 ~  S3 j- n5 Q  k! Jinstructing pg 10.3e on osd.8 to deep-scrub
; l4 f6 j% N& T7 I7 oinstructing pg 10.21 on osd.8 to deep-scrub
: [; m) d: }4 jinstructing pg 10.e on osd.8 to deep-scrub" ^0 u+ P+ `, B8 D* d, W
instructing pg 10.6 on osd.8 to deep-scrub
2 \2 j' w+ w7 X/ x4 @' \/ Binstructing pg 10.6d on osd.8 to deep-scrub
: h4 U. o+ R  h4 P: ainstructing pg 10.114 on osd.8 to deep-scrub
! `, F/ U, \" O* [" \- zinstructing pg 10.137 on osd.8 to deep-scrub* p1 i: N) ^6 M
instructing pg 10.16e on osd.8 to deep-scrub( z: z- G; C) u0 F% `
instructing pg 10.164 on osd.8 to deep-scrub
& f  z4 j& d& t8 }, `! R( }" f0 vinstructing pg 10.166 on osd.8 to deep-scrub+ {( Q7 K$ R6 M; K$ N
instructing pg 10.19b on osd.8 to deep-scrub/ t5 Q5 d* p3 e. W' w) J
instructing pg 10.1ae on osd.8 to deep-scrub8 o' c7 D* r- @% ^3 I2 z7 @" c
instructing pg 10.1ab on osd.8 to deep-scrub
/ k# e* t1 s9 M7 Tinstructing pg 10.1b3 on osd.8 to deep-scrub9 H3 _, o2 Q9 i# Y
[root@hostceph2 ~]# ceph health detail
4 T* H6 r8 N# e* e5 v1 KHEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time
) ~9 A" U$ J. V- ?PG_AVAILABILITY Reduced data availability: 24 pgs inactive
0 l& i3 K9 Q8 Z: s( ?/ a    pg 10.6 is stuck inactive for 8561350.091262, current state unknown, last acting []
6 c% s7 z, q6 Y. ]    pg 10.e is stuck inactive for 8561350.091262, current state unknown, last acting []1 o- o1 j: w% [( I8 P8 Q( j+ d
    pg 10.21 is stuck inactive for 8561350.091262, current state unknown, last acting []
# y" n2 k- M$ ~1 N; H# E    pg 10.3e is stuck inactive for 8561350.091262, current state unknown, last acting []" y% r" I8 ~% P: x, O7 H: t' Z5 S
    pg 10.41 is stuck inactive for 8561350.091262, current state unknown, last acting []
5 o- _1 f& t" [& A    pg 10.6d is stuck inactive for 8561350.091262, current state unknown, last acting []8 ]$ `% ~# L; O1 X2 `+ Q/ Z0 C
    pg 10.81 is stuck inactive for 8561350.091262, current state unknown, last acting []
9 y" t. W; z3 Y4 @2 z8 j6 ]9 ^    pg 10.88 is stuck inactive for 8561350.091262, current state unknown, last acting []
9 B! f1 K7 M! V" K    pg 10.90 is stuck inactive for 8561350.091262, current state unknown, last acting []
5 T! `1 S5 R; c+ C7 C- W. i    pg 10.af is stuck inactive for 8561350.091262, current state unknown, last acting []# }9 A! l6 Q; I/ n2 R
    pg 10.c1 is stuck inactive for 8561350.091262, current state unknown, last acting []
9 r( B7 G1 {8 f2 V% [7 P8 H    pg 10.de is stuck inactive for 8561350.091262, current state unknown, last acting []
9 w/ b+ z5 T; `1 q    pg 10.f4 is stuck inactive for 8561350.091262, current state unknown, last acting []
/ e9 J/ V* ~4 P    pg 10.10e is stuck inactive for 8561350.091262, current state unknown, last acting []) T$ K( @9 E* H
    pg 10.114 is stuck inactive for 8561350.091262, current state unknown, last acting []
+ u" j: V& f9 n% f- M6 B    pg 10.11b is stuck inactive for 8561350.091262, current state unknown, last acting []: Z6 x* o/ S& W( q; L
    pg 10.137 is stuck inactive for 8561350.091262, current state unknown, last acting []; E, ~6 a# m- [% t; c  p4 Z7 c
    pg 10.164 is stuck inactive for 8561350.091262, current state unknown, last acting []
8 y) b4 q5 t9 U7 B( ~    pg 10.166 is stuck inactive for 8561350.091262, current state unknown, last acting []
$ t% |4 B0 {/ [, A2 o2 k( a    pg 10.16e is stuck inactive for 8561350.091262, current state unknown, last acting []
- o* j; p) t1 z5 z0 q% T# d    pg 10.19b is stuck inactive for 8561350.091262, current state unknown, last acting []
$ v% M8 N7 q( V2 \  t    pg 10.1ab is stuck inactive for 8561350.091262, current state unknown, last acting []
: k: k( W" p  {  e' |# P    pg 10.1ae is stuck inactive for 8561350.091262, current state unknown, last acting []. |0 s+ X2 `6 K! `/ ?
    pg 10.1b3 is stuck inactive for 8561350.091262, current state unknown, last acting []
9 A; \- L. \" t. W" l5 @PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time* m7 q& _0 Y( l# W
    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077
6 W" c: z# A: L8 ?% i2 C    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077& m" {' B  e$ L% h
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
) R! [/ u# W5 F$ p7 ~, w' N' C; M3 O* t    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
+ }5 f$ x9 S0 [2 i    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077/ h: @8 d" z9 K1 T+ ]
    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
9 a/ r* W: _3 d! t& ^+ A    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
. Z# ~/ ?. i* x/ A/ d, p  q    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
, t3 O- v4 D1 S, `    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077  n+ t. A3 Q/ G# r# H5 I1 ]+ P7 H& y
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.7060776 k( D- Y2 f; M0 d4 b7 B
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077: a: g  F# ~' A: q3 G
    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.7060774 Q) {. |- ]9 |. _% e& @
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.7060773 c- R: m+ E' j4 s- |
    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
) O+ D) D; d! \! y& z4 L8 U    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077
: S/ @3 z( x5 P    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
  W1 ^( l7 Z/ n) N/ D& ]' J    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077/ F4 f4 a% u  \4 W" p0 w$ m
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.7060770 Z3 x2 T# t5 P2 m( t7 K
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077- d7 Q0 S9 `* c. t9 a
    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
* G% R4 F' m. ~0 B& e) b    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077- J' x7 [2 d! f: R' A' H- K9 [
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077' ]4 `: e+ J" e$ ]( R
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077$ e$ J/ M0 m* d+ c4 q  y
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077( x$ f! B$ x% U6 F% f4 {4 |
PG_NOT_SCRUBBED 24 pgs not scrubbed in time
' o6 a5 s7 o' Y6 |2 j    pg 10.11b not scrubbed since 2022-08-01 09:11:50.7060774 ]6 ]8 a. c+ G# @
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077/ H- z; i/ r0 y9 x" L% t
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
( p) h" a# M2 Q5 F! R+ B    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
$ ~6 s3 G* z$ s! C# H0 v3 w' W; F. q    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077( a3 ]5 U& g1 u4 b- M
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
" ?* N9 x: e! F5 y; y0 Z) u    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077
: K7 s: D9 n1 c0 v    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
) k4 t# o  ~+ H, t: C# v    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077! G" y5 v5 T  M1 \  o8 t
    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
7 |- \- [5 K, q  t. ^1 `8 A, B    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
$ ]( M, X  O: o8 N    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077
' q" p/ ]- W9 A    pg 10.e not scrubbed since 2022-08-01 09:11:50.7060778 @+ w" \, J& d1 q+ b
    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
  m/ ?) F. r' x% }# S# P    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077, S, M: [/ O/ d$ ^) N9 F2 J( ?7 m: T
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077% Q: N& ~6 ]7 i) G/ ^
    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
( A9 f) Q6 W% u7 G    pg 10.16e not scrubbed since 2022-08-01 09:11:50.7060774 T: D* W5 {0 |: N% Q# g( [
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
+ y- O7 P3 b3 }5 I1 h    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077, Q8 j8 q, e1 \# I( K5 B
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.7060772 q, E+ T: U8 n3 a* l
    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077
. q( C7 i5 a3 F  }( D3 D; J- ~    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.7060770 |* z& w4 [, ^
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077& C  B) K% n3 p% _7 k
[root@hostceph2 ~]# ceph osd tree
, k: h2 n$ x3 T4 o  O: mID  CLASS WEIGHT   TYPE NAME              STATUS REWEIGHT PRI-AFF
* v/ b& `' e% {1 q  F% M# _-25       16.00000 root ssd                                       ( u9 i1 @% C& r9 x5 E* x
-26        4.00000     host ssd-compute06                        
. \$ {: I7 n8 P, o* _$ y 18   ssd  1.00000         osd.18             up  1.00000 1.00000
5 v/ ?1 D/ D% v* A; h: i 19   ssd  1.00000         osd.19             up  1.00000 1.00000 0 b5 M4 r) I( ?( o
20   ssd  1.00000         osd.20             up  1.00000 1.00000
5 ^, L' I8 Z: y9 f9 o 21   ssd  1.00000         osd.21             up  1.00000 1.00000 6 q4 N, O' d. ^+ D" W
-27        4.00000     host ssd-compute07                         / r  _& N, x9 \  j7 m, S
22   ssd  1.00000         osd.22             up  1.00000 1.00000
! b, V, s+ C+ N. i2 v 23   ssd  1.00000         osd.23             up  1.00000 1.00000 9 \# \! L# k6 X" l1 B
24   ssd  1.00000         osd.24             up  1.00000 1.00000
4 K" }4 x) a, E3 n 25   ssd  1.00000         osd.25             up  1.00000 1.00000
; M0 Q; M& E0 p! F-28        4.00000     host ssd-compute08                        
9 ^/ h  q, j! k3 h 26   ssd  1.00000         osd.26             up  1.00000 1.00000 & J3 \- z5 O" p' u; W
27   ssd  1.00000         osd.27             up  1.00000 1.00000
( @' V# v/ }* `: P" P/ K; A 28   ssd  1.00000         osd.28             up  1.00000 1.00000 8 ~- |9 A  u! {( y* e4 M# E: u$ |6 O
29   ssd  1.00000         osd.29             up  1.00000 1.00000 1 d0 J* L0 l4 ~& v' c# D$ ]
-29        4.00000     host ssd-compute09                        
: z% x, u  w- h0 i& M: U. c 30   ssd  1.00000         osd.30             up  1.00000 1.00000
* j7 a4 W7 n. C: F/ j' X( F4 S1 x9 C 31   ssd  1.00000         osd.31             up  1.00000 1.00000   V2 u1 l9 ^, J1 O" z2 E
32   ssd  1.00000         osd.32             up  1.00000 1.00000
8 N  w0 }  b1 e9 ] 33   ssd  1.00000         osd.33             up  1.00000 1.00000 5 ~/ S3 f8 u8 ~" @4 j  [9 W
-9       18.00000 root hdd                                       
  @- P5 J, P6 \0 W2 Z-10        6.00000     host hdd-hostceph1                        
$ b' X. L0 F! T& D* H# t2 g  0   hdd  1.00000         osd.0              up  1.00000 1.00000
# x! g4 C& ?# j& a  1   hdd  1.00000         osd.1              up  1.00000 1.00000   a3 c- z' A$ e7 a
  2   hdd  1.00000         osd.2              up  1.00000 1.00000 7 c1 [$ q4 A7 I8 l& X1 q; a. L
  3   hdd  1.00000         osd.3              up  1.00000 1.00000
5 \5 l6 W7 `3 ]& a  c  4   hdd  1.00000         osd.4              up  1.00000 1.00000 " H+ }# K& O8 g& T* p
  5   hdd  1.00000         osd.5              up  1.00000 1.00000
+ v( p+ p/ g' q# t! L-11        6.00000     host hdd-hostceph2                         * `8 o4 {+ n3 J2 Q
  6   hdd  1.00000         osd.6              up  1.00000 1.00000
1 \" |# A2 V3 u1 U  7   hdd  1.00000         osd.7              up  1.00000 1.00000 & h  u# u* m7 L5 N7 _5 C
  8   hdd  1.00000         osd.8              up  1.00000 1.00000 + [5 B- @7 o6 K. _% Y( f
  9   hdd  1.00000         osd.9              up  1.00000 1.00000
+ P9 n( ^8 C1 N& u9 O8 d: G. k( F 10   hdd  1.00000         osd.10             up  1.00000 1.00000 - r- N4 U9 B8 }# J' F* |) [
11   hdd  1.00000         osd.11             up  1.00000 1.00000
6 [- L9 a1 c: h- ^& o" z$ H-12        6.00000     host hdd-hostceph3                           X7 I) j2 x6 D4 U, t- _. l1 S$ T
12   hdd  1.00000         osd.12             up  1.00000 1.00000
0 t+ k4 F8 j* H" \6 W 13   hdd  1.00000         osd.13             up  1.00000 1.00000
$ q+ J8 }  A* W; }; S: ^ 14   hdd  1.00000         osd.14             up  1.00000 1.00000 0 W  Q8 X. j3 c
15   hdd  1.00000         osd.15             up  1.00000 1.00000
( X# a! J1 l$ s7 ^ 16   hdd  1.00000         osd.16             up  1.00000 1.00000
' Q" {% x/ L7 c 17   hdd  1.00000         osd.17             up  1.00000 1.00000
# j6 _1 h* O' s0 _2 H -1              0 root default                                   9 L! {7 W6 A' J
-3              0     host hostceph1                             
% M; j9 g9 ~7 U/ t& J -5              0     host hostceph2                             
1 _# I; |; t: u: |9 A! B, p -7              0     host hostceph3                             
3 f: e2 g  j5 \6 t( E- I[root@hostceph2 ~]# systemctl stop ceph-osd% {5 G, C2 _4 {; M0 {/ c
ceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      7 g, x+ @6 K& r' }
[root@hostceph2 ~]# systemctl stop ceph-osd
* T# \" l* D% U5 [) `7 Xceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      
! }$ f- ]" |# o: m$ I[root@hostceph2 ~]# systemctl stop ceph-osd
+ \7 q% P. S8 I) h7 y+ nceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      5 _+ H& Y- [/ B: j& d4 ^
[root@hostceph2 ~]# systemctl stop ceph-osd@8.service
* @/ L& Y, B- |) N+ _[root@hostceph2 ~]# ceph -s# N  e- B' f: C5 S0 u& k; u: V
  cluster:
* a. ^5 |$ W! B2 O. a    id:     29046cc0-0682-496b-98b1-912e599642826 K7 t4 a( E7 }' N
    health: HEALTH_WARN) M, _# E  a) N( F
            1 osds down3 P( w" z6 J* z  H2 l2 t
            Reduced data availability: 24 pgs inactive
- l- p7 r- O. j/ v1 L3 r* A            24 pgs not deep-scrubbed in time; W2 y( A* }: F, T" L. @8 S
            24 pgs not scrubbed in time; K3 M6 ^" O" i' h+ e( z2 V5 r( q9 b
) q7 V" V- f. I0 d- r5 J0 _' S# I3 J
  services:
4 r7 B& n! v' E$ _5 C: K' p. K    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)" g/ Q+ X8 ]7 p5 X  D+ k
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3- e6 r8 o( j2 v
    osd: 34 osds: 33 up (since 3s), 34 in (since 3M)0 ^. _9 V6 z8 k) L

" X- O. x7 N+ |8 q4 B  data:+ W" X! p1 }% O/ l1 N8 r4 e
    pools:   9 pools, 5760 pgs
$ o* O8 O! @- a8 m2 }    objects: 3.11M objects, 12 TiB
" W" t- n0 i$ ^    usage:   33 TiB used, 92 TiB / 126 TiB avail6 Z( @* I  G- z' d; z, i  V/ f
    pgs:     0.417% pgs unknown
$ D! ?) M# r! N7 q, V8 e9 _             5504 active+clean. r/ C. Y& m+ u$ X8 C# t+ E  o
             231  stale+active+clean0 n# Z, w. X# F# F, A
             24   unknown
. o8 ^: h, A: N- j             1    active+clean+scrubbing+deep$ h6 S4 A1 Y$ I& \6 M4 p" u; j1 M& F

( x  W: D/ s+ U# [" o1 w3 x" O  io:4 W- K1 B: Y- \9 B+ ]2 u* B
    client:   441 KiB/s rd, 21 MiB/s wr, 504 op/s rd, 546 op/s wr
* m/ i( c, x, s8 K' F  F 6 A' v+ V3 P: U
[root@hostceph2 ~]# ceph -s
. L& v& e; O: p5 S# g  cluster:
% ?, H/ i; S' ], c0 h. h    id:     29046cc0-0682-496b-98b1-912e599642829 C% g4 }9 m8 m" A3 [, R+ v% ?' o% b
    health: HEALTH_WARN! s5 N' ]8 y  ^1 c8 B% @" L1 k
            1 osds down
3 y# Z: D8 b6 s# F            Reduced data availability: 24 pgs inactive; \7 i$ V+ t! h& H9 v9 X* ]* P) l
            Degraded data redundancy: 300823/7651891 objects degraded (3.931%), 465 pgs degraded2 _/ s* n( W. v" V! t. P% F
            24 pgs not deep-scrubbed in time" d+ p0 {7 Y2 O; J6 A! s6 F/ S
            24 pgs not scrubbed in time
, J. i: P3 C. d& J9 T * z( r2 b# }& T- T6 p: j
  services:: L, d1 z* D5 `& A9 ?$ }% ?
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
  m! u$ r; k% G: J+ b* K4 b% [9 e    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph34 e1 y  \, s4 P6 p0 o' ^2 W! N  Q( r
    osd: 34 osds: 33 up (since 10s), 34 in (since 3M)( I  d4 r( @+ C' U4 B

$ B8 F3 R. z* S- T& t- o  data:
* D0 e% `3 I3 X+ {- B    pools:   9 pools, 5760 pgs
# l, h4 }( R" v8 J5 h    objects: 3.11M objects, 12 TiB
, L4 w4 N! C* F4 Z4 g  N2 Q1 Y    usage:   33 TiB used, 92 TiB / 126 TiB avail
/ h  S/ k( f$ l# T9 [3 r/ I    pgs:     0.417% pgs unknown- R+ L' i3 u1 ?( N/ m0 N
             4.010% pgs not active
  l! N, f4 B# R  C0 x             300823/7651891 objects degraded (3.931%)& H5 P. i% O* j$ O
             5182 active+clean6 J. L7 q5 v+ E; `) x7 }3 r
             234  active+undersized+degraded: E: @/ A5 O! u5 V% U8 N
             231  undersized+degraded+peered2 c4 O! A' Y0 @7 k/ x
             88   active+undersized% a$ T; w+ h; y& D9 q( ]
             24   unknown
& Y& M, B( f/ n$ I) C             1    active+clean+scrubbing+deep8 U/ |0 v5 N6 y5 d
6 m  ~& s3 S4 K' i! v
  io:6 N8 W) D0 u& C
    client:   15 MiB/s wr, 0 op/s rd, 567 op/s wr
! Z) i7 L$ _, |$ u# e. S' N
- Z8 t1 r& \4 n5 B6 G[root@hostceph2 ~]# ceph -s
5 Q  |  Q( D' X* ~) X  cluster:1 c! a: z& s' `# G
    id:     29046cc0-0682-496b-98b1-912e59964282
  z, J, n: J* L. l. A- T    health: HEALTH_WARN
1 L# _& b1 X% q$ t            1 osds down% H$ X2 p$ X9 X
            Reduced data availability: 24 pgs inactive
1 X% C, f  I( A9 ^+ }9 F9 U" h1 e8 l) F            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
8 E& G% ]( m9 n            24 pgs not deep-scrubbed in time3 w0 }- g0 a3 ], s" T+ m
            24 pgs not scrubbed in time" k6 c& m& o, K" {3 Y

/ x5 z; j  t" W3 s  services:
: [# d: o% B, l0 Q" G    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
6 s& u/ f9 T1 k7 t; v    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3. i. U+ m/ k- v( A+ d
    osd: 34 osds: 33 up (since 14s), 34 in (since 3M), _8 I0 a8 O2 H7 J' C3 l; e

9 w3 V% `: \9 Q  data:
6 ]* {7 w% n+ Z$ }4 E  V    pools:   9 pools, 5760 pgs
6 b7 s. d- R4 F" D    objects: 3.11M objects, 12 TiB
! V/ ~7 b3 n# |, _% m    usage:   33 TiB used, 92 TiB / 126 TiB avail
1 D$ p: ^2 r, P" e4 }2 ]    pgs:     0.417% pgs unknown
+ H) u0 Z1 E+ V6 ^; b' s             4.010% pgs not active
4 v" ?* B5 @& D5 N9 c0 l4 G             300823/7651894 objects degraded (3.931%). a6 b! _. q/ e7 b
             5182 active+clean) X$ `7 Q: W* T$ W. Z3 z9 Y1 ]
             234  active+undersized+degraded' h& ^5 C# H2 j/ e
             231  undersized+degraded+peered% D5 S; @2 v. H
             88   active+undersized
1 `: P/ ]$ V9 y) e) L' }4 y9 j             24   unknown+ V+ h& A6 y$ G
             1    active+clean+scrubbing+deep/ y& A7 {8 h1 X: r- d7 m
/ D& V3 o* M1 s: a7 F! \3 ~) b
  io:2 F3 D$ u$ v7 d3 C, R$ t4 U) O
    client:   18 MiB/s wr, 0 op/s rd, 598 op/s wr
2 e7 i; \. [# R; L0 R: I+ C0 } 9 _6 v  ]; ]: F% D
[root@hostceph2 ~]# ceph -s
9 o7 i" J- q4 Y' _, d, `' z0 |2 z( U+ q  cluster:
2 y+ P& [! z! e; m1 c) o3 R# F! ]    id:     29046cc0-0682-496b-98b1-912e59964282* L$ g* D. ?* X: l, m& R/ |; P
    health: HEALTH_WARN
: {9 m9 J* L: [( I            1 osds down
0 ]) `' S% b# h2 g9 Q            Reduced data availability: 24 pgs inactive
: l* T+ a3 [" Y  F            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded7 A/ a! R5 }# u% X. Y2 ?
            24 pgs not deep-scrubbed in time
4 w) U1 c$ u8 q( [+ I- C            24 pgs not scrubbed in time
' w' E/ S  s9 Y/ L4 N" T; f + h& ]! w/ P- k1 b" y* Z! D9 k$ w
  services:+ D# u' k4 R3 m1 s, E6 e, B
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)5 b  g8 P* h' B0 g
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
' _/ ^+ i- ]4 U, }  _' C  c. N) U    osd: 34 osds: 33 up (since 16s), 34 in (since 3M)& t" W. f; |! _$ f6 ^7 U

( c4 T6 G/ ~2 ~  data:0 B! I. }( ~3 `: j
    pools:   9 pools, 5760 pgs2 ]" d$ Z! S& X# d+ w+ t
    objects: 3.11M objects, 12 TiB
; m9 p, K  r( j    usage:   33 TiB used, 92 TiB / 126 TiB avail3 e7 ]! Q/ v, ?% G. q! D+ {* k
    pgs:     0.417% pgs unknown
2 e+ ~5 g: @; u4 J, E, F             4.010% pgs not active
/ j+ |- D" A( X8 P             300823/7651894 objects degraded (3.931%)
3 e9 I' }# i/ Q: S, Z             5182 active+clean( J$ n' T  V% Q$ O$ z( @, j+ Q
             234  active+undersized+degraded
" S% h) A& l1 K/ x+ b* }             231  undersized+degraded+peered
; i: Z  E0 X& Y# Z$ b7 J6 T+ r             88   active+undersized
5 O9 \3 K5 _: [             24   unknown
! q! b2 S, H# W7 O0 l1 D. L( ^& K2 u- r             1    active+clean+scrubbing+deep
% w; ^# g& b4 r  ^4 ]. {, d8 G/ M   ^9 x# S' u) a' r, s$ @3 `
  io:
8 s1 J/ m& T. ]% C% U" I    client:   19 MiB/s wr, 0 op/s rd, 591 op/s wr7 Q7 O5 ?# j4 X2 I9 G% h8 P- {$ m
( y, K% y0 b8 w5 V. D
[root@hostceph2 ~]# ceph -s+ U, o3 J! E$ c. T8 e! _
  cluster:! X0 s  t, I7 B  T  [# o
    id:     29046cc0-0682-496b-98b1-912e59964282# q& i; E$ T( M) \" P
    health: HEALTH_WARN
& ~, x7 @% k6 F( o" i: ~; ?            1 osds down
- B. r. `6 D  U' u7 }# d, B            Reduced data availability: 24 pgs inactive
/ l+ [! _# r6 _, a* Q- }            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
+ W) m4 d' S% y5 l* \" G7 ]) J$ U            24 pgs not deep-scrubbed in time
1 B/ _3 A+ @' J% v( D# h            24 pgs not scrubbed in time
2 \  _. z/ T" j: H $ I! o  y+ x* _4 P
  services:
$ [4 o" v4 ~7 j% E: j    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)# ?, @% c( @6 P  s  K5 V6 ?' [$ V' q6 O
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
; z" J9 |3 i+ t    osd: 34 osds: 33 up (since 18s), 34 in (since 3M)
" m6 t8 [% u5 F7 t4 U+ k$ s5 g
* ^2 @5 c$ V  m+ X% c  data:! y$ o  c) V! ]& g0 ?, k  o* ^1 u
    pools:   9 pools, 5760 pgs
8 A: \) s/ A: L$ M' r6 b    objects: 3.11M objects, 12 TiB+ l+ G2 Q4 j* x) j* A
    usage:   33 TiB used, 92 TiB / 126 TiB avail
# R: P2 T' T: w" ~2 T; k) r& d    pgs:     0.417% pgs unknown
2 q4 `2 q  R% p. y- |2 b             4.010% pgs not active
& q4 }9 h) v9 b/ y$ ~             300823/7651894 objects degraded (3.931%)
3 H: @. M* [3 a! i, N             5182 active+clean
- d1 V8 `- r- b9 }; [2 w0 ^             234  active+undersized+degraded) e8 a# E  L9 A/ N. v
             231  undersized+degraded+peered
% X+ C" X+ C) M             88   active+undersized
& B  X: t0 M' W1 b9 I- o- ]             24   unknown$ o, P: N# B" g7 ?% P
             1    active+clean+scrubbing+deep
2 B! t, M0 g8 ~: C2 V
* ^) d* P9 X) ~6 [  io:
# T$ O1 v  `5 R) ^: y    client:   43 KiB/s rd, 19 MiB/s wr, 30 op/s rd, 517 op/s wr* X+ ?7 `; m1 x( j4 {

  y3 e- L  a& v6 |, j7 l4 _[root@hostceph2 ~]# ceph -s7 Z% @. q% F" O6 B; j+ B) g+ f
  cluster:
+ X8 L8 N% m5 {! a$ G    id:     29046cc0-0682-496b-98b1-912e59964282
( ?; {1 g1 I( u5 B    health: HEALTH_WARN+ v! ]4 v8 i% F
            1 osds down1 b2 ]/ M2 {9 X; F) i
            Reduced data availability: 24 pgs inactive
% T; F! x) V2 q- ^9 ~            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
- A+ C: l& d% [            24 pgs not deep-scrubbed in time
1 k; ^+ u$ u( M, I2 z            24 pgs not scrubbed in time  i: t, o$ q  S
1 _& \6 W/ |0 @8 s
  services:
: I9 X. X7 Q7 @! `: ?! \7 j1 x    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
1 b& q) Z/ k  j* Z    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
" T0 Z3 u( z3 H# L5 h    osd: 34 osds: 33 up (since 20s), 34 in (since 3M)
/ p9 Y8 D; m7 L) M7 w! M; i4 Q  ~
3 i+ p3 s0 k: ]3 A* h6 r( R  \4 d  data:
7 ]# z7 O8 `1 p. Q% I5 Q" b    pools:   9 pools, 5760 pgs* p* j+ S' @* \
    objects: 3.11M objects, 12 TiB  V# x7 B3 ^, ~
    usage:   33 TiB used, 92 TiB / 126 TiB avail
4 y& }' [* P5 l' j/ R! S1 E    pgs:     0.417% pgs unknown
9 o) r4 }8 }0 H0 N/ Y             4.010% pgs not active2 z( n. B# C" [7 T2 }# b: |
             300823/7651894 objects degraded (3.931%)
" g/ V5 a  T4 e2 S7 V             5182 active+clean
$ W5 l2 w* S7 V" ?% ~/ k- ]             234  active+undersized+degraded/ A9 R; U8 T0 w, w" H/ x$ s$ Y
             231  undersized+degraded+peered
& e( E4 B8 I1 b! H             88   active+undersized
* ~: _2 W" w5 t$ a# _( s9 K             24   unknown
( b( O; _# ^  v& g2 G0 V! Q" N             1    active+clean+scrubbing+deep
( S; i+ R( e9 Q. r& k* {
3 V7 F0 n6 }) I- U  io:2 P4 L. ?/ x. y
    client:   66 KiB/s rd, 19 MiB/s wr, 30 op/s rd, 542 op/s wr/ Z1 Y" z0 y. u# W" l
回复

举报

返回列表 发新帖
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

本版积分规则

返回首页|Archiver|手机版|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )

GMT+8, 2026-6-12 00:05 , Processed in 0.028293 second(s), 26 queries .

Powered by Discuz! X5.0

© 2001-2026 Discuz! Team.

快速回复 返回顶部 返回列表