浏览此站
联系我们相册切换到窄版 Language

 找回密码
 注册
易陆发现论坛»论坛 › 云计算开源区 › ceph分布式存储 › 完美解决过程Reduced data availability: * pgs inacti ...
返回列表 发新帖
查看: 519|回复: 2

完美解决过程Reduced data availability: * pgs inactive 24 pgs not deep-scrubbed in tim

[复制链接]
admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
发表于 2022-11-8 10:29:11 | 显示全部楼层 |阅读模式
购买主题 本主题需向作者支付 2 金钱 才能浏览
回复

举报

admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2022-11-8 10:45:39 | 显示全部楼层
[root@hostceph1 ~]# ceph -s
! {) K" ^4 v3 L6 i( B! o6 Z  cluster:
0 X! V6 I9 Y$ z0 @! G# |    id:     29046cc0-0682-496b-98b1-912e59964282) O5 E5 A6 }, z2 Z) `* }
    health: HEALTH_WARN
# X( \/ ~# ]. p# v: p* _            Reduced data availability: 24 pgs inactive' S, c3 R7 ?# `( u5 x% V9 D
            24 pgs not deep-scrubbed in time
" A0 e: \: N# I7 N' r$ P& e            24 pgs not scrubbed in time$ D2 L8 g3 g/ g' a' w

" H% v6 p: {, G* G7 q  services:0 O) P: Z" L8 O4 Z! P; A. n! K3 u  L6 @% \
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 3M)/ [& {" B: B: _# y
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph31 c3 Z8 \/ b% j+ W3 i2 i: K: |
    osd: 34 osds: 34 up (since 3M), 34 in (since 3M)
1 z; L/ r* N+ j3 u, T( g5 V1 T
# Q8 V& d7 T5 S9 N6 Q4 ]  data:
: \: m9 \4 |9 f* N. q! g9 [    pools:   9 pools, 5760 pgs8 w2 j0 X/ L) b( B0 ]% U
    objects: 3.11M objects, 12 TiB
+ a1 R. {& O0 W; e    usage:   33 TiB used, 92 TiB / 126 TiB avail
6 d  M1 @4 d$ Y# @7 ~3 {3 g    pgs:     0.417% pgs unknown- `% R. a5 r5 G: V9 h6 w
             5735 active+clean
0 q# ~  G0 h- Y$ s( D! V: r! Z             24   unknown0 N# o, ?' }9 l8 Y
             1    active+clean+scrubbing+deep8 j* |" s8 s: p( d5 a. o$ h
" M, }+ {# d( o8 @
  io:1 d! p# B8 E5 ~
    client:   9.7 KiB/s rd, 20 MiB/s wr, 12 op/s rd, 625 op/s wr
  J. t. u! N9 h$ t# r6 I+ C & ?: z5 ~2 q) o
[root@hostceph1 ~]# 3 R1 s* M$ b  j& S9 D' G3 v5 |* }
[root@hostceph1 ~]# ceph -s
6 V" d* {9 G! a$ q  cluster:
. ^+ h9 E' D! K6 l, a& f! K    id:     29046cc0-0682-496b-98b1-912e59964282, z' ~- B9 s2 _0 u1 l# P9 H
    health: HEALTH_WARN
  s  \- M# r9 Z- n            Reduced data availability: 24 pgs inactive
% N+ ?3 o# ^, m1 d, c, x            24 pgs not deep-scrubbed in time
: U2 O1 Z; z4 U; L            24 pgs not scrubbed in time6 h: E( b% Z4 m( f/ F
8 T7 z7 T3 Q2 A9 }( A; u/ y; d" s
  services:
0 \# _" w: s6 A+ h. g7 v- B% m* e    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 3M)
) U& v6 l! a! [( {; S  ~6 _$ S    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
' W% p8 y/ H! `" `6 z& p    osd: 34 osds: 34 up (since 3M), 34 in (since 3M)
  U! [& R0 e) Y: m. A ) J- q! K; O5 q% G2 L
  data:
+ O, {: x+ z) ^3 |3 b* g    pools:   9 pools, 5760 pgs
2 W2 }7 E) n" f* p9 x+ Q    objects: 3.11M objects, 12 TiB8 i' c: R& u! Y
    usage:   33 TiB used, 92 TiB / 126 TiB avail
+ s1 ]1 m+ }  m) g1 I    pgs:     0.417% pgs unknown4 d0 T- o1 ^* ]5 [6 H1 n
             5734 active+clean" G# d* w, [$ G. Y" D
             24   unknown7 k+ m* e- F2 s# ^! U/ Y" k
             2    active+clean+scrubbing+deep
/ \9 j; J8 f+ L9 q/ o
0 ?+ v  t3 U9 X# N/ l1 D  io:
2 [' n. y5 B7 Z    client:   90 KiB/s rd, 22 MiB/s wr, 103 op/s rd, 531 op/s wr
/ f5 V5 G* u' V   L, m2 |* y( |( A
[root@hostceph1 ~]# ceph health detail
" q5 P2 N6 ?; ?* nHEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time
/ y1 y7 q* [% M  Y3 |. OPG_AVAILABILITY Reduced data availability: 24 pgs inactive
% }. M8 s4 U% X1 W* k! G    pg 10.6 is stuck inactive for 8558718.511785, current state unknown, last acting []
  {( k. }# O$ M% I( W    pg 10.e is stuck inactive for 8558718.511785, current state unknown, last acting []
% i$ n, M4 W, \; ?1 b: u6 M+ R6 b4 W    pg 10.21 is stuck inactive for 8558718.511785, current state unknown, last acting []
) o" m# l# y# X: X- Q9 `; ?    pg 10.3e is stuck inactive for 8558718.511785, current state unknown, last acting []# l6 d, C! E1 F) E9 g- W
    pg 10.41 is stuck inactive for 8558718.511785, current state unknown, last acting []
2 }- |0 i7 p/ O; l2 S" @- {9 }9 G( z    pg 10.6d is stuck inactive for 8558718.511785, current state unknown, last acting []
. j- J: s' `1 n; b    pg 10.81 is stuck inactive for 8558718.511785, current state unknown, last acting []6 b7 n  R. X4 G  Q% ?# K
    pg 10.88 is stuck inactive for 8558718.511785, current state unknown, last acting []5 C2 X/ Y7 {! `9 G# m
    pg 10.90 is stuck inactive for 8558718.511785, current state unknown, last acting []  a) F" n# L4 `, _% S, P
    pg 10.af is stuck inactive for 8558718.511785, current state unknown, last acting []! H0 O% f; I6 V- ^3 o
    pg 10.c1 is stuck inactive for 8558718.511785, current state unknown, last acting []$ \  j7 V! O# ~8 p9 @* g
    pg 10.de is stuck inactive for 8558718.511785, current state unknown, last acting [], f! |3 \5 Y3 Z! @  x) u
    pg 10.f4 is stuck inactive for 8558718.511785, current state unknown, last acting []' p8 l" d' t% G& ^2 S" ]3 w6 r( @
    pg 10.10e is stuck inactive for 8558718.511785, current state unknown, last acting []
1 b/ t" l  v' B( i; S9 \8 Z) l) Z  ]    pg 10.114 is stuck inactive for 8558718.511785, current state unknown, last acting []
7 Q5 H( g3 o! F: Z' d, P: [    pg 10.11b is stuck inactive for 8558718.511785, current state unknown, last acting []
" z& [1 R; y0 D  E' x    pg 10.137 is stuck inactive for 8558718.511785, current state unknown, last acting []
% J) U, K3 t( ]$ A9 X    pg 10.164 is stuck inactive for 8558718.511785, current state unknown, last acting []
5 ]( y: z  ^! ~& j* H- T* W$ r    pg 10.166 is stuck inactive for 8558718.511785, current state unknown, last acting []
# n$ y9 B9 v" s    pg 10.16e is stuck inactive for 8558718.511785, current state unknown, last acting []
. I7 T( f( ]2 i5 ~+ r: @" r    pg 10.19b is stuck inactive for 8558718.511785, current state unknown, last acting []
! }5 N4 G7 n! |    pg 10.1ab is stuck inactive for 8558718.511785, current state unknown, last acting []! }' _2 Y  w, a. ~
    pg 10.1ae is stuck inactive for 8558718.511785, current state unknown, last acting []1 G+ o! ]  m0 I
    pg 10.1b3 is stuck inactive for 8558718.511785, current state unknown, last acting []
  i! [3 Q0 A0 @% y* b& |' {+ s% mPG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time7 k) d$ ?5 B0 u" g* K$ f
    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077
/ ]: C" b5 _" A9 k    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
' J3 q) l: @: C$ z    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077/ D' _9 a9 {0 |' I  q- t& j
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077/ \$ m# v. q  d* J# M* O0 g
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
. L$ _6 r4 I! B/ B3 o1 p    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.7060779 I7 l1 O5 k2 k, o! V/ o( t
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.7060779 N; ]' U" T* w# e4 p  z" J  G
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077! D6 p6 B! ]7 [) U4 ~* P
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077; A5 E8 N4 y% M, D( l. a  q/ \
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
, k- R4 K$ v5 o' s: I+ D6 [7 Z    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077: y' g; X# @' [5 |9 E, e
    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077
  B" l" r, f5 O* j  u" n/ `$ g    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
! P1 B' m0 o5 s+ O+ H    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
- H! x, H$ C9 d' w6 ^    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.7060771 O9 \/ }& O* W+ _7 K4 @* H
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
9 S& h4 W: e' |2 ]    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
& ~2 k" g2 m; s) x- D0 q+ j/ p    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
  {# l% t3 X& }0 h! U7 r    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
6 Z; W, G  O2 k; d8 a    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
) M# s9 K3 m- z6 V3 q    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
1 a% M  f5 f; I    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
0 e' ^$ _- E# ^4 D5 F    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.7060775 r, g5 P* p: [! K0 t
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.7060778 Z0 [8 q( k  ~8 I- }
PG_NOT_SCRUBBED 24 pgs not scrubbed in time' ~/ u. _7 G1 h) K% x7 n4 {
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077+ Y* |. k% A0 n+ u$ f) G
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077% ?7 v- u5 R& n% p9 Z' C# Z' @$ c
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
6 z$ \9 P# s' S2 i/ Y1 K    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
' k4 e" o5 S6 ]" Y# C    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077
" k: B% n, L$ G    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
: j* m' I/ o/ F% R' c    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077$ i. D5 z7 ~6 y4 U
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
3 I# r1 u5 o8 H4 D- E9 `    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
/ V& F/ S* G- i; [( s! J2 K2 g    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077% C; y: X9 T1 ]
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.7060772 w2 E1 n) Y" n' L
    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077
. u  E' y$ t) t( e  v$ B    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
+ y0 f# i4 n9 v! Q& e7 V    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
6 x8 H, n9 K- X    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
2 f# C4 v- e. i1 c& w    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
  v$ t- m# l- B7 F0 h+ r) X+ q    pg 10.137 not scrubbed since 2022-08-01 09:11:50.7060771 O! w4 ~, a$ a* C9 L$ I7 Y
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077! M: j4 u8 Y5 M( y5 p& R3 L
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
9 ]8 R+ H7 s- W9 O8 s    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077( O. L- ^0 M! u! T0 V& k
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077: H* {- N: k# T( Z% ]
    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077% |/ ?) Z9 L  I5 k. e
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.7060778 ], d! o. U, W! W  s! N6 v
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077* |# ^: ~6 z' [
[root@hostceph1 ~]# ceph pg rep' d7 i3 Y, r6 s& q& y) B0 x8 A" e" J
repair  repeer  
( s3 ~  x! d4 c7 R$ a[root@hostceph1 ~]# ceph pg rep6 y+ r8 L, _7 C& z* P6 l! n
repair  repeer  
  O: l3 u9 m! e0 `: C3 E5 k5 D[root@hostceph1 ~]# ceph pg rep
, `. \8 Y# E" a: n5 D' Zrepair  repeer  ; ]4 I6 H1 q0 d
[root@hostceph1 ~]# ceph pg rep
6 h4 k; f: E: v2 R4 Q3 yrepair  repeer  : @: t  f! W, |/ i# G' W1 {
[root@hostceph1 ~]# ceph pg repair 10.6
% m+ }) `9 C( m* b4 Cinstructing pg 10.6 on osd.8 to repair
6 a0 y! G5 ^9 C9 I; A: n[root@hostceph1 ~]# ceph health detail ) z  i# e/ m' O9 u
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time" u& m+ A, P' ^7 K, C
PG_AVAILABILITY Reduced data availability: 24 pgs inactive& b% j: u$ \/ g" K, p& g
    pg 10.6 is stuck inactive for 8558779.003482, current state unknown, last acting []
( W! {0 i# S" r" k" G, Q& i2 X    pg 10.e is stuck inactive for 8558779.003482, current state unknown, last acting []7 n" ?4 w" b9 K& o: A0 s5 X
    pg 10.21 is stuck inactive for 8558779.003482, current state unknown, last acting []" y6 T+ H( E' Q, l1 z5 d! ?+ K0 W- k
    pg 10.3e is stuck inactive for 8558779.003482, current state unknown, last acting []3 W4 y% I# l$ e" ?
    pg 10.41 is stuck inactive for 8558779.003482, current state unknown, last acting []
) i" L1 Q, C' Q8 t, y    pg 10.6d is stuck inactive for 8558779.003482, current state unknown, last acting []
; ^3 f3 r1 H( _+ u! u    pg 10.81 is stuck inactive for 8558779.003482, current state unknown, last acting []
( r+ j  q4 [. B1 w3 O    pg 10.88 is stuck inactive for 8558779.003482, current state unknown, last acting []
8 e4 {. ]% k, [6 s, h" L3 p8 g    pg 10.90 is stuck inactive for 8558779.003482, current state unknown, last acting []1 O2 `9 ^  l5 ^& U, C
    pg 10.af is stuck inactive for 8558779.003482, current state unknown, last acting []
& }/ W2 u' D1 n; ^) ?    pg 10.c1 is stuck inactive for 8558779.003482, current state unknown, last acting []
! n/ B! E) N# W; ^, [5 F: ^    pg 10.de is stuck inactive for 8558779.003482, current state unknown, last acting []7 m* @  ^$ h& ?" d% z4 O- @( L
    pg 10.f4 is stuck inactive for 8558779.003482, current state unknown, last acting []5 a9 @2 G( f5 S7 t
    pg 10.10e is stuck inactive for 8558779.003482, current state unknown, last acting []
; v2 M* e/ W) ^! q$ G    pg 10.114 is stuck inactive for 8558779.003482, current state unknown, last acting []
3 Q) ?/ z+ T2 _1 S3 J7 r! h    pg 10.11b is stuck inactive for 8558779.003482, current state unknown, last acting []
" J' u4 l8 A7 g; U    pg 10.137 is stuck inactive for 8558779.003482, current state unknown, last acting []  {- M: x2 f- A4 K- ]( b4 L5 x) g
    pg 10.164 is stuck inactive for 8558779.003482, current state unknown, last acting []
' |$ _: Z  v/ H$ {* |( J, m    pg 10.166 is stuck inactive for 8558779.003482, current state unknown, last acting []( G2 u/ f3 d( m% z/ t0 [% l
    pg 10.16e is stuck inactive for 8558779.003482, current state unknown, last acting []
( g* q0 g3 U0 U6 `  V    pg 10.19b is stuck inactive for 8558779.003482, current state unknown, last acting []
4 H3 d4 G( _& }4 C0 a8 h, o7 E    pg 10.1ab is stuck inactive for 8558779.003482, current state unknown, last acting []. f$ c/ H: w8 N" r, X3 m7 }
    pg 10.1ae is stuck inactive for 8558779.003482, current state unknown, last acting []+ [+ `6 v1 u! P9 H% y0 I5 ~
    pg 10.1b3 is stuck inactive for 8558779.003482, current state unknown, last acting []  r1 J% R/ ^' F
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time/ e& X$ [7 t6 @/ v
    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077  v* i* ?8 J( T% U
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077* u/ s( p6 g% c0 e( g
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
; r1 O" @- j4 G: b& {  J% ^" f# Q& o: \    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077. K4 v$ K8 u7 y1 }, m
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
& N6 o' B. {6 I0 F    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
, a8 A5 O7 n- F/ O9 f    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.7060773 E4 w5 N0 p3 E4 \- z: c' B, o, q
    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
; M6 u8 f& Z/ l; ]    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.7060773 b# ~9 L5 T% v
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
2 r) e* E9 u8 {! E: m) s    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
1 X: a# [1 f* [6 K8 ]( P    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077  c2 V4 E0 A5 d  [. `9 T4 H, o7 s& O
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
" e9 i! u/ M" G. _- l9 h0 R5 v    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
# j0 x; j. V3 C" t5 ~( T* W. U    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077
0 O* U( H/ {- g/ e3 N( X9 j2 ~    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077$ f  L# @# ^$ t' H8 c
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077
; C$ @( i6 k; D! o& ?+ k! f    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
6 a8 B# ?) i7 N/ s* _0 B    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
8 W0 J* l$ n. {    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
& ^+ G$ W" v( K. G3 }    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077% `7 K5 D0 m' R1 z
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077% `) w& b' `. U, l  m3 v
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077( y2 I3 A, v! R  {* j
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
4 B/ C7 ^; J& K  @. I' C+ ePG_NOT_SCRUBBED 24 pgs not scrubbed in time
0 i1 r& a/ k2 n9 ^2 D$ z* W5 X/ A1 M    pg 10.11b not scrubbed since 2022-08-01 09:11:50.7060777 `3 N# v9 u  n5 W3 \$ Z  @: H
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077' E0 S  L+ @2 K3 K4 x
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
! |1 E  L. q8 D    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
5 {* U& e7 E$ B: ?+ `  }    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.7060779 G1 N/ \3 L2 i0 |1 ~
    pg 10.af not scrubbed since 2022-08-01 09:11:50.7060770 q) W. {( M& V8 |' s" B% L
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077- |2 U. H! J/ D; X
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.7060775 i/ g: E3 O9 Q4 _- V' s
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.7060778 k, N+ X* R* X* E( B3 S+ ^/ Q8 I
    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
7 z% R. r+ |1 I  ^4 K  |" W4 P$ Q    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
* B' ^  O+ M( L    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077+ |6 Z: C1 h( Y1 o0 G4 U5 x
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077: H6 o) l+ K2 F2 ]
    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
1 w+ z* q% Q) P    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
2 Z4 w! k, J0 m1 v/ e, n! E4 y    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
$ B3 s" z  ~8 Q8 _6 _6 [; m3 @    pg 10.137 not scrubbed since 2022-08-01 09:11:50.7060776 T! D0 {" B* S, m0 }6 r7 M* s
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077
% H- U: B2 z4 @7 N. d' Y4 {) z  c    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
2 d3 }( x3 c4 @) \" D* q( u    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
& E$ \# I, ?9 [3 Y& m    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
# z: d% @8 C2 [4 K9 k    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.7060775 j, V( X* I# }/ u* c; d( A3 w  G
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
9 q! _+ F5 X/ q" S1 y    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077
' @. ^' {) r$ u( U2 w[root@hostceph1 ~]# % p" X. v% ]* B- m/ z' J& [
[root@hostceph1 ~]# ceph health detail |grep pg$ e, `" G6 X: B
HEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time
/ I5 p! I6 J7 {9 uPG_AVAILABILITY Reduced data availability: 24 pgs inactive( f2 V; o2 ~: q4 c+ l) D
    pg 10.6 is stuck inactive for 8558795.140009, current state unknown, last acting []& D2 F0 t* o, `2 \" f
    pg 10.e is stuck inactive for 8558795.140009, current state unknown, last acting []' F! x1 {8 L. N4 ~7 b! ~
    pg 10.21 is stuck inactive for 8558795.140009, current state unknown, last acting []
% \: V# }! a; v$ K  G    pg 10.3e is stuck inactive for 8558795.140009, current state unknown, last acting []
" {* G+ i" n5 ~9 h$ \+ t' c" c    pg 10.41 is stuck inactive for 8558795.140009, current state unknown, last acting []
  x+ U; v6 `8 T/ T- B" |8 D. O4 q    pg 10.6d is stuck inactive for 8558795.140009, current state unknown, last acting [], N& k  H4 B8 n2 i. E0 G
    pg 10.81 is stuck inactive for 8558795.140009, current state unknown, last acting []
9 W5 N. J6 F4 K. t; N# t3 S' E    pg 10.88 is stuck inactive for 8558795.140009, current state unknown, last acting []( U0 c  b8 x7 d# r- r
    pg 10.90 is stuck inactive for 8558795.140009, current state unknown, last acting []
" b' _5 I' h5 T    pg 10.af is stuck inactive for 8558795.140009, current state unknown, last acting []) V+ v: x& ^8 a& y- @4 m4 e# B, C
    pg 10.c1 is stuck inactive for 8558795.140009, current state unknown, last acting []  F* T2 k, `; w' ?! ^
    pg 10.de is stuck inactive for 8558795.140009, current state unknown, last acting []
, }5 A$ y4 u" J& _( r8 E! `5 s    pg 10.f4 is stuck inactive for 8558795.140009, current state unknown, last acting []
5 g1 Z& s0 D! D2 z+ X    pg 10.10e is stuck inactive for 8558795.140009, current state unknown, last acting []
& x7 ?0 C2 m; }3 Y$ v    pg 10.114 is stuck inactive for 8558795.140009, current state unknown, last acting []
; A9 C4 J) [& j" ?    pg 10.11b is stuck inactive for 8558795.140009, current state unknown, last acting []
, L6 r. V6 F, Z& e; ?, }; c' n' T    pg 10.137 is stuck inactive for 8558795.140009, current state unknown, last acting []
/ ?9 R; q2 s4 `0 u    pg 10.164 is stuck inactive for 8558795.140009, current state unknown, last acting []
: r9 E4 a- n3 [$ ~    pg 10.166 is stuck inactive for 8558795.140009, current state unknown, last acting []
8 z5 @; `% S1 G' X1 p, G  m2 R    pg 10.16e is stuck inactive for 8558795.140009, current state unknown, last acting []5 \2 s4 f9 z, ?4 D/ w! S% f
    pg 10.19b is stuck inactive for 8558795.140009, current state unknown, last acting []7 x) M$ I: c9 B$ V! E
    pg 10.1ab is stuck inactive for 8558795.140009, current state unknown, last acting []
( n9 ]; i0 m; `; B    pg 10.1ae is stuck inactive for 8558795.140009, current state unknown, last acting []
6 u3 u  G, B- x    pg 10.1b3 is stuck inactive for 8558795.140009, current state unknown, last acting []* S0 A4 W) w2 ^, q% \
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time1 O; M7 {* ?- q" x+ D: H! f* c
    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077
% d% u' H" ^1 N" E) j' [    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
7 H! D& I# `7 w1 h, F$ \    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
  |4 }( u$ Z- a, L    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
# ~) c; G! W; K3 R) Z/ [4 a/ j    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
, `2 _! K+ ^; s! u    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077
. l) v; t  [! c& l7 Z( ?    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
3 `8 s, R2 ]# h$ @9 I( ]( H4 V' V    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
; @7 }2 v' e4 P9 L( E; U    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077& E  l0 l! z' ^) Y# V) H- R$ X
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077! ]! s! F) B" p7 D; M
    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
" R: l' a" Z1 p  z3 f9 S, E    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077
$ W6 C2 T2 m8 U( S# F: m* ]9 I    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077
5 Y8 Z. R* O. \7 y    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.7060773 b7 t6 I+ n0 R
    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.7060778 Q0 o- a. m8 b$ H! z: z
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077' [; X4 O! C! g
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.7060770 K9 E; |3 M$ }& Y2 K; L. n
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.7060772 l! J0 L4 |$ F$ G/ [
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.7060777 P: {. A! z: ~* q; w, E" d
    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.7060773 i' t& E; m+ J
    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
  e$ C4 m8 z& S: }( @7 h. y& s    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
0 M+ K* Z; a/ A2 B) ]! Z2 n    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.7060779 {7 L$ U: l3 d+ A' X$ ^2 ?' ^
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077
$ J1 T6 r' x) z$ }5 T  LPG_NOT_SCRUBBED 24 pgs not scrubbed in time
/ t$ Z6 v9 R5 s  b; ^' `, ~% i    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077' N9 N& f( r9 G% r2 d4 e/ a
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.7060776 n- e) p  }0 }/ [
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
. t3 C: v/ m* m, X    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077+ w( ^: X" W* n0 R2 Y2 z
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.7060778 a; ^8 C/ i% g- p; [1 z  ~+ l
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077& ^% C' \, U+ u
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077
8 j# E' i7 U4 O! b9 f    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
( C4 l+ v# h5 i' X    pg 10.88 not scrubbed since 2022-08-01 09:11:50.7060778 {" X. F$ P  N" [
    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077) B% z( u0 y: \9 O5 |
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
9 v: M& B2 C1 F. d) f7 R* x3 f  t    pg 10.21 not scrubbed since 2022-08-01 09:11:50.7060776 u3 o. M$ O# e, l
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
3 c! B/ J5 Y5 v* @    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
! s% R2 l- d& |. n8 ~9 t    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077$ P/ Q8 T! B+ Q8 ^/ P0 w+ m
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.7060776 w" o% T: k: l2 Q# M
    pg 10.137 not scrubbed since 2022-08-01 09:11:50.706077
5 U( R6 D9 H8 j/ p* A. H* W( K    pg 10.16e not scrubbed since 2022-08-01 09:11:50.7060770 y- G/ w/ [; S) b7 i" f5 E
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
: L. i7 J0 h; f$ k) ]7 g    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
0 h, B( S9 i4 u4 g1 W    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077( U. G' q2 w; \$ F- W) |( c
    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077/ h% ?4 F5 I, t3 s7 a5 A
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077( d1 H: _+ \9 W3 t, B$ z4 n
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.7060775 m" }/ c$ X$ J8 X8 Z
[root@hostceph1 ~]# ceph health detail |grep pg |grep -v pgs% l; e) Z6 F  e& o, v% e
    pg 10.6 is stuck inactive for 8558819.337561, current state unknown, last acting []; V- G, Z2 c  e0 W9 P4 S' v( F/ W
    pg 10.e is stuck inactive for 8558819.337561, current state unknown, last acting []
8 V7 {9 w. K* x7 w/ }5 Z4 S9 H4 R8 U    pg 10.21 is stuck inactive for 8558819.337561, current state unknown, last acting []- ?3 O& ]1 g9 b
    pg 10.3e is stuck inactive for 8558819.337561, current state unknown, last acting []
, s/ L; w# @' _) J    pg 10.41 is stuck inactive for 8558819.337561, current state unknown, last acting []& a# Q$ {2 w; V- [' w
    pg 10.6d is stuck inactive for 8558819.337561, current state unknown, last acting []/ l1 K1 _$ [- Q1 ], G) p# p4 X3 \
    pg 10.81 is stuck inactive for 8558819.337561, current state unknown, last acting []
( A  B: S, |7 [8 Y% [9 F    pg 10.88 is stuck inactive for 8558819.337561, current state unknown, last acting []6 X1 D7 ]6 t; E. T" |8 J6 h
    pg 10.90 is stuck inactive for 8558819.337561, current state unknown, last acting []
3 V; |. S  I' N1 {    pg 10.af is stuck inactive for 8558819.337561, current state unknown, last acting []
' e# F) [( G1 C7 R    pg 10.c1 is stuck inactive for 8558819.337561, current state unknown, last acting []
' H  R* H9 Q" R& X# ^    pg 10.de is stuck inactive for 8558819.337561, current state unknown, last acting []
( V/ _6 V0 p$ B  Y9 A    pg 10.f4 is stuck inactive for 8558819.337561, current state unknown, last acting []0 T3 v! q9 N+ U2 G% J+ f2 k# t& D
    pg 10.10e is stuck inactive for 8558819.337561, current state unknown, last acting []
/ Y& m* d1 q; v8 T  J3 L5 Y    pg 10.114 is stuck inactive for 8558819.337561, current state unknown, last acting []
# V0 ^$ r1 s$ w+ F. s    pg 10.11b is stuck inactive for 8558819.337561, current state unknown, last acting []
% T; K% w/ [/ m9 ]  B    pg 10.137 is stuck inactive for 8558819.337561, current state unknown, last acting []! M& h* S: v4 A4 F9 {! p2 W- Q$ {/ B
    pg 10.164 is stuck inactive for 8558819.337561, current state unknown, last acting []
( G% l5 q4 z& Y7 c: D4 m( c; }' k    pg 10.166 is stuck inactive for 8558819.337561, current state unknown, last acting []
# g% ]% v5 K4 g    pg 10.16e is stuck inactive for 8558819.337561, current state unknown, last acting []5 h7 J) i( f& x) @+ B
    pg 10.19b is stuck inactive for 8558819.337561, current state unknown, last acting []
6 n& x+ K- a, p    pg 10.1ab is stuck inactive for 8558819.337561, current state unknown, last acting []
" `: x# c8 F( h# C    pg 10.1ae is stuck inactive for 8558819.337561, current state unknown, last acting []( q! j0 b" v* ^' x( ~% ]
    pg 10.1b3 is stuck inactive for 8558819.337561, current state unknown, last acting []
' v  F; b: h6 T# U1 X. U    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.706077. n' L/ C/ O% D5 }3 E, s
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.706077
* P" T' |: ~/ f( W' G, Z    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.706077
3 }+ O' [' b/ z! X: M. s" B    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.706077
) d& @* Y! |; d: }+ M/ ^: @    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077& E. x1 j. f1 N
    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077% Q  L  O. R/ X/ f% y
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
' a# h8 N0 x9 J# \    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077* x' L% ]5 Y% W3 Z1 Y) e
    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.706077' Q" V8 u1 U7 K) D
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
. B' O( |* f; n    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
/ E1 i$ @) U7 S1 S9 C    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.7060774 J9 h9 B5 _. _1 }( G
    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077& _% e7 {+ v0 S3 }- a* F; S/ S
    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
0 @" t' q; {" D8 G* t% u) x. n    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.706077
/ o7 v/ h& ^/ V. E* q" z    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.706077
2 ^* {5 w. N" k! D$ {: T- Z    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.706077* j, a# F5 A; E* u0 x# J
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077
. H6 _& w$ G2 P7 t    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077! W" G% U2 d' P4 E- \- h
    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077
. ^% M- F/ o$ F! m    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.706077
, ]# b) I  _7 S5 B    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.706077
$ `: f9 i: Z) F" D* Y/ a$ Q    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.7060776 j; o4 Q3 i" P! w* c
    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.7060778 y, d' G; A& }8 u2 t/ M2 i  Z
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077
2 T5 [* E: e- H, b0 [    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077
, F4 p2 ?! i0 Y: Q6 l    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077
* N( Z0 T, l1 w. n/ B( S6 g: }6 w2 x    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077
* ~* f- P4 {4 ^" f$ {    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077: ?+ k- O/ \" P: O
    pg 10.af not scrubbed since 2022-08-01 09:11:50.706077
* o4 J, {1 y- p( l0 q    pg 10.90 not scrubbed since 2022-08-01 09:11:50.706077
+ |7 o, m7 x2 R) M% e0 L1 M, y8 P    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077
; J4 U" Q3 ?+ F- `- J    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
9 [1 Q, o( k1 p2 s/ D    pg 10.41 not scrubbed since 2022-08-01 09:11:50.706077
/ E( o3 x+ f5 H. I" M, U6 M    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077
' Z* A) _  n5 M8 k5 j    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077$ |3 B% O+ @3 i
    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077
" q( n  W4 Y6 M0 P, m" M    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077/ y$ F4 [2 t/ s3 x0 x1 W* |
    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077
* w- A. D# S& a9 i    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077
, E" J+ N5 l3 _! l: A    pg 10.137 not scrubbed since 2022-08-01 09:11:50.7060773 j- |; z0 {/ L
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077
  d- p" b) A- T# v+ y8 \    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077
; V  ~' l% N. k1 x; P    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077  h4 o$ E: W- e$ m7 `( q
    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
' B0 V* b, `( Y2 i. b7 ]( i    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077
! G$ z$ _: o7 w8 t% w3 w; o    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.7060771 K- {: d$ V# L% C3 B
    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077, m2 l5 W2 T8 N
[root@hostceph1 ~]# ceph health detail |grep pg |grep -v pgs |awk '{print $2}'4 L, N; }# q- n/ G/ S  s9 g
10.6
: p- F0 {1 ^9 u# {7 v1 ?10.e- f$ ]4 b3 `  i1 X/ [: u: D1 v
10.21
. Q( x* k- R$ [: H! d10.3e
8 g# N3 L" V1 V  `" @. h10.41
" j2 X# b' w. u) v" c/ [$ B10.6d
% {+ E7 |7 D) q8 ~/ p( m; c: L10.81) t* {5 p' Q- _7 i( y. y/ c
10.88' @4 K5 c. \% D
10.90
( M" z! x4 {8 K8 |" I% n- p. G5 t10.af
3 p0 {' G. e9 d- n+ J2 n10.c1
5 v" U& W4 ?- d6 o& f8 I) |10.de% J5 s7 }% S6 z9 {/ S
10.f4* ]. v" Y. j' K/ l, ~+ r  p
10.10e
5 L& V5 t& w4 f0 C4 n" d/ z10.114
1 ^* J) e0 W& n9 x4 P6 p10.11b
$ ?2 O% T3 j$ O6 T  B) J3 p! A10.137- F9 \% k) L0 W9 s7 V5 m  A% j
10.164
# u7 }6 Y; _5 e1 R10.166* G6 z. Y; |" \$ b, q+ u- Y9 z
10.16e  `' q- ]4 ~: t# i6 r
10.19b, v2 ^$ p: t" p) }
10.1ab: ~6 ]% n, n2 p1 ~% `) v
10.1ae) |8 M* L- V, p! @1 m. r
10.1b3  ?$ J2 X4 u7 b; d; l
10.11b
! o3 l2 D" M. C+ j7 i( y10.10e2 {- [) `9 a' B" y! n$ y
10.f4
( f$ o! j( I3 ]9 K5 s0 I  ^10.de5 q/ s0 {2 U8 _2 N0 A  C5 d9 ]2 @2 K
10.c10 b: u% O) f' }* D$ e' |0 F
10.af% R3 `# q% f' L) Z; ?
10.90  H3 W: x. T- `' D" Y& H3 P5 S
10.81
! M2 y5 y1 \  H1 O( `& q; U" b, p10.88: F7 M3 p; O' o+ H' E
10.41
$ z& i; @' t) l# h" V$ C10.3e
0 [4 I6 u4 P. X8 X! ?10.21( M# O8 T8 o  [: D7 d5 R
10.e
' K* `/ e% R- D9 |10.6
, W6 K) [2 W' s10.6d: T6 T0 @4 O  r4 g. f3 D
10.114
  z% U* ~1 F' o$ \% I10.137& d5 F" P6 ~+ ]3 f
10.16e7 w( G  P2 s% x4 p% z/ i
10.164
9 X+ J; q- c6 h/ N* W# S' i5 {' L10.166
; c2 r  |9 e9 B: S9 P2 E; a) b10.19b
" f3 F" W' ~' d& F5 e5 a10.1ae$ ^4 A  q( R5 K$ E' p7 W! [" i& D
10.1ab
; O2 K  `$ ]4 C" |10.1b3/ ]) ~# X% M- y* D3 A1 J
10.11b1 T, x# z% K" u5 S$ M
10.10e
; y2 w. J" \: E. N10.f4
; g, A. P; M' T, F! m10.de
4 x/ g5 h* R7 F, h* u10.c1
3 z7 b- F+ G) ]$ L- B* R0 p10.af
! ^6 s! E% E% f0 }5 b10.90
! N. K. }2 h; w. i3 s! P2 [. }" \9 M10.81
2 ^4 t$ O0 e7 [# [& s8 `10.887 J6 {( _4 [  L4 u7 S% v
10.41
9 b* `  R  Y6 _& Y10.3e" {1 H% o1 p) `3 W1 d/ B$ g
10.218 Z, o  P9 c( u" y4 }
10.e0 b8 q- ~7 a! O5 q% i
10.6
( p/ M" f: k2 m4 _; p10.6d
, x% |9 P  T1 L; x+ j' |10.114
* f2 ~$ r4 G* n) P" A$ y2 J0 [10.137) R: u1 V7 ?  @
10.16e  Q3 g9 z5 ^) f, s
10.1642 D$ G4 v$ B' w; Y
10.166
9 n: w$ W. t% d8 ]/ x; i7 s10.19b
  Y6 C$ i' \) y$ f# I10.1ae6 G( a) e# P- }6 ?
10.1ab# r" g3 K& R4 R, U
10.1b3
! {, Z$ k/ F) w1 W* ^[root@hostceph1 ~]# for i in `ceph health detail |grep pg |grep -v pgs |awk '{print $2}'` ;do ceph pg repair $i ;done * ~& B; J: n. O- G7 _) B
instructing pg 10.6 on osd.8 to repair9 U/ M* }; {+ ?
instructing pg 10.e on osd.8 to repair8 h" `. l  D: B% y* I
instructing pg 10.21 on osd.8 to repair+ a$ l4 p3 J9 S2 j9 P" n" X) n7 |" N
instructing pg 10.3e on osd.8 to repair6 @# j4 B) [+ B  J2 e0 X1 }$ ]# H
instructing pg 10.41 on osd.8 to repair0 Y1 l. z* ?0 K) Y2 d3 y2 F% m
instructing pg 10.6d on osd.8 to repair
& q& b$ G1 F7 [7 ^* F2 I" V+ x, Jinstructing pg 10.81 on osd.8 to repair
6 e  \1 E8 f4 O, V3 r2 Ainstructing pg 10.88 on osd.8 to repair
8 W# X* K# r2 H8 _% m$ Einstructing pg 10.90 on osd.8 to repair
6 r  J) S% a0 Pinstructing pg 10.af on osd.8 to repair6 E9 w1 p% x% N5 X9 Y# N! O1 i! u
instructing pg 10.c1 on osd.8 to repair. K8 K6 _( @/ L, a" L! p3 U
instructing pg 10.de on osd.8 to repair
+ x% P/ A% Q; i! Winstructing pg 10.f4 on osd.8 to repair
$ t9 h1 l: f  `instructing pg 10.10e on osd.8 to repair8 k- [/ d" {! w. z
instructing pg 10.114 on osd.8 to repair
% O9 b& M, H9 J" @instructing pg 10.11b on osd.8 to repair
6 S. [4 \" J- |' w" Oinstructing pg 10.137 on osd.8 to repair
9 T) P: J" q% b. g, ?6 {2 j# Qinstructing pg 10.164 on osd.8 to repair7 @6 m7 o1 F/ ^4 P( Q) \
instructing pg 10.166 on osd.8 to repair
5 V% v. O$ o/ ]1 ~( einstructing pg 10.16e on osd.8 to repair
/ h2 B( Y6 _+ g0 U. q+ dinstructing pg 10.19b on osd.8 to repair- t0 v3 Q- Z5 x2 s7 A
instructing pg 10.1ab on osd.8 to repair  x( `4 z( z" R9 t
instructing pg 10.1ae on osd.8 to repair) q9 g6 v' j; s" G$ U, z
instructing pg 10.1b3 on osd.8 to repair. t5 F( O, ?; Z/ V% u" T" u
instructing pg 10.11b on osd.8 to repair
7 _: w7 ~" _1 C" k3 F" o4 minstructing pg 10.10e on osd.8 to repair) y7 L7 B, E. ]8 i0 Q- p" A- ]+ ?
instructing pg 10.f4 on osd.8 to repair/ ]8 V  G4 q; G" c% t: `5 ^
instructing pg 10.de on osd.8 to repair! K( C! k% h9 @$ x) X
instructing pg 10.c1 on osd.8 to repair
& R" i/ F5 V6 m! w. u4 j' O5 cinstructing pg 10.af on osd.8 to repair" |% U9 v; D4 s6 s' {8 H& S9 }1 [
instructing pg 10.90 on osd.8 to repair4 S% \: @$ V/ z- ^, s8 g( v, D0 t
instructing pg 10.81 on osd.8 to repair
) w5 Z0 Q. J1 ~' V/ Q/ M$ Sinstructing pg 10.88 on osd.8 to repair
" T: ~1 n) u  `# a; [instructing pg 10.41 on osd.8 to repair
" \/ B# u5 n( w  q6 ^instructing pg 10.3e on osd.8 to repair4 |% M" j% f$ A5 z5 \0 w
instructing pg 10.21 on osd.8 to repair
% x# `: ~; O; o/ I  xinstructing pg 10.e on osd.8 to repair# q$ m1 f+ q3 V, I% t  V7 c
instructing pg 10.6 on osd.8 to repair4 V. R2 y- s; t) a9 G, E& l. Z6 g
instructing pg 10.6d on osd.8 to repair7 j4 Y+ s; f# U5 i. x4 ^7 n, C) v
instructing pg 10.114 on osd.8 to repair
. }3 E+ O7 n- T3 U& x' }2 Winstructing pg 10.137 on osd.8 to repair7 S; e) P5 l0 J( l8 f" ?
instructing pg 10.16e on osd.8 to repair
& b  O. X2 E1 X: {8 V9 Xinstructing pg 10.164 on osd.8 to repair
! R9 E2 P' J# I" C9 I. Cinstructing pg 10.166 on osd.8 to repair
# R: k+ a; j' E5 D# ?" E: k; Yinstructing pg 10.19b on osd.8 to repair5 l2 v$ t9 G+ S+ K3 y) M5 `
instructing pg 10.1ae on osd.8 to repair% A& e; ~+ r% l3 s
instructing pg 10.1ab on osd.8 to repair- W- E! Q/ h! W
instructing pg 10.1b3 on osd.8 to repair' }! W3 V- V! Y: e; e5 e
instructing pg 10.11b on osd.8 to repair
5 o% l$ n3 K* c' f5 t( k% z6 q  zinstructing pg 10.10e on osd.8 to repair6 s" I6 u3 `+ c' }4 j, H5 J8 h
instructing pg 10.f4 on osd.8 to repair
0 v- R; N4 k' q" Winstructing pg 10.de on osd.8 to repair
! W# f) `* {) e$ iinstructing pg 10.c1 on osd.8 to repair( Z% N4 m6 A. Q5 l
instructing pg 10.af on osd.8 to repair% p* O+ c: z9 U1 ]9 J" b1 ~
instructing pg 10.90 on osd.8 to repair9 {6 l, H  _* W9 F& h
instructing pg 10.81 on osd.8 to repair8 P* ?" E, P% D: A+ F
instructing pg 10.88 on osd.8 to repair
0 Y5 p: g9 M  Ainstructing pg 10.41 on osd.8 to repair, T! ^- \' `+ D( D0 M3 h' A
instructing pg 10.3e on osd.8 to repair
0 y8 Q# O0 T# P6 uinstructing pg 10.21 on osd.8 to repair
5 W) G6 P% M4 tinstructing pg 10.e on osd.8 to repair8 U% \/ U2 E4 l, S5 o+ _* |0 h
instructing pg 10.6 on osd.8 to repair( `" R. W9 G' [) K5 t# @
instructing pg 10.6d on osd.8 to repair5 h# T7 L7 U* t$ q$ @  {* @& p8 U
instructing pg 10.114 on osd.8 to repair
1 r9 G# m+ k# k" l) Q( Vinstructing pg 10.137 on osd.8 to repair
; t, h2 ?. }+ h6 A6 vinstructing pg 10.16e on osd.8 to repair
7 Y) ~9 K* S7 ~$ c2 b0 ?  r: l# }instructing pg 10.164 on osd.8 to repair2 c9 \, s5 J$ g* P
instructing pg 10.166 on osd.8 to repair4 s3 ]$ F6 k+ F9 I
instructing pg 10.19b on osd.8 to repair- M$ A* h! C+ q8 D+ V; Y3 ]* Y' Z
instructing pg 10.1ae on osd.8 to repair. e! Q  m- W( L) f& S; ?
instructing pg 10.1ab on osd.8 to repair7 D) ^9 r8 M! m: P( r! t
instructing pg 10.1b3 on osd.8 to repair4 \0 T3 r: o. j. t- ~. g( @
[root@hostceph1 ~]#
回复

举报

admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2022-11-8 11:23:41 | 显示全部楼层
[root@hostceph2 ~]# for i in ` ceph health detail  |grep deep-scrubbed |awk '{print $2}'` ;do ceph pg deep-scrub $i ;done 5 T! i4 ]4 G- D- W5 Q
Invalid command: pgid has no .! L# B3 Y, `7 x
pg deep-scrub <pgid> :  start deep-scrub on <pgid>
) c- E1 o  S( IError EINVAL: invalid command' u( T1 @; b8 ?4 ^+ E
Invalid command: pgid has no .
# Q5 |6 F9 s* T) i. k6 {$ k* Xpg deep-scrub <pgid> :  start deep-scrub on <pgid>
5 P, A9 g7 B, G# z  y" UError EINVAL: invalid command
' n0 k5 |& s5 Iinstructing pg 10.11b on osd.8 to deep-scrub5 s3 N" ?# ?0 Z1 m+ g0 \! s' ]
instructing pg 10.10e on osd.8 to deep-scrub: h6 l' u8 W3 T, x$ S
instructing pg 10.f4 on osd.8 to deep-scrub  d! m1 Y9 g! ?9 M1 I# p; h6 f* ?
instructing pg 10.de on osd.8 to deep-scrub
7 `3 R" n+ b, C, b) jinstructing pg 10.c1 on osd.8 to deep-scrub
; w+ ^8 G( C. binstructing pg 10.af on osd.8 to deep-scrub& h8 G% o3 G" S, }
instructing pg 10.90 on osd.8 to deep-scrub
" h, {% c/ F# K3 w. einstructing pg 10.81 on osd.8 to deep-scrub1 {, O: l4 m! B/ c8 z1 @; J  N3 _
instructing pg 10.88 on osd.8 to deep-scrub7 j( ?  o; J6 g( T) z7 Y+ ^
instructing pg 10.41 on osd.8 to deep-scrub
. S+ b& b4 a/ G& ^1 d$ ginstructing pg 10.3e on osd.8 to deep-scrub
+ v8 f7 x% d" dinstructing pg 10.21 on osd.8 to deep-scrub! R' l1 i+ B; h+ J
instructing pg 10.e on osd.8 to deep-scrub
& V  {; v5 x5 z# Z6 einstructing pg 10.6 on osd.8 to deep-scrub
1 g2 I6 J7 R9 m7 e  Qinstructing pg 10.6d on osd.8 to deep-scrub
) q+ t' V' v( ]* }& V/ \" H6 Zinstructing pg 10.114 on osd.8 to deep-scrub
5 X8 h4 y8 z$ p8 R2 r* winstructing pg 10.137 on osd.8 to deep-scrub$ V/ e1 K4 x5 M, m
instructing pg 10.16e on osd.8 to deep-scrub
: ^0 ~& y, T5 u* _0 X" _1 Linstructing pg 10.164 on osd.8 to deep-scrub9 ?/ v. y" i0 J; {3 {! s! X
instructing pg 10.166 on osd.8 to deep-scrub' C$ o! V" {6 L( B  {
instructing pg 10.19b on osd.8 to deep-scrub7 W! [2 ]$ P! {, l/ |  G! ^' ~
instructing pg 10.1ae on osd.8 to deep-scrub
: \6 s1 C; |; l  K. V1 ^instructing pg 10.1ab on osd.8 to deep-scrub
3 ~+ Z' U' k, M' `/ d: X' Binstructing pg 10.1b3 on osd.8 to deep-scrub' B. X# C8 @6 v4 n* ^  F8 `1 t
[root@hostceph2 ~]# ceph health detail
4 Y& ~& f. j  @# \! S8 AHEALTH_WARN Reduced data availability: 24 pgs inactive; 24 pgs not deep-scrubbed in time; 24 pgs not scrubbed in time; r( ~" I0 W6 O6 e4 l
PG_AVAILABILITY Reduced data availability: 24 pgs inactive
! y" U2 y5 B; w1 y/ p0 g    pg 10.6 is stuck inactive for 8561350.091262, current state unknown, last acting []" E9 j# l* o2 m( K
    pg 10.e is stuck inactive for 8561350.091262, current state unknown, last acting []  o: C/ x1 M1 V
    pg 10.21 is stuck inactive for 8561350.091262, current state unknown, last acting []- H  [' d9 v/ W: l: S( u
    pg 10.3e is stuck inactive for 8561350.091262, current state unknown, last acting []
+ x5 R# C0 z1 H' {: \; u0 l    pg 10.41 is stuck inactive for 8561350.091262, current state unknown, last acting []
2 V4 M- j; E5 m' D" }# E% `* ^2 X0 A    pg 10.6d is stuck inactive for 8561350.091262, current state unknown, last acting []
5 A% x+ x) W2 E8 P# g% {    pg 10.81 is stuck inactive for 8561350.091262, current state unknown, last acting []
$ Q$ S! {# k) h7 ^& Q6 _( \    pg 10.88 is stuck inactive for 8561350.091262, current state unknown, last acting []; v/ s) j$ m/ [" s0 U" d
    pg 10.90 is stuck inactive for 8561350.091262, current state unknown, last acting []
2 B& y) G8 F( d% b! H    pg 10.af is stuck inactive for 8561350.091262, current state unknown, last acting []* p, V! D5 Z" M2 j3 z9 {( X4 F' n
    pg 10.c1 is stuck inactive for 8561350.091262, current state unknown, last acting []
! S# r3 ?) K, f9 Z" w  S    pg 10.de is stuck inactive for 8561350.091262, current state unknown, last acting []
  P* ?4 L% P' ^7 T  t    pg 10.f4 is stuck inactive for 8561350.091262, current state unknown, last acting []6 [7 }+ Y4 }! u5 O! [6 [% m$ t
    pg 10.10e is stuck inactive for 8561350.091262, current state unknown, last acting []4 B. g; M! b! U# s# p7 J
    pg 10.114 is stuck inactive for 8561350.091262, current state unknown, last acting []
5 h# M5 U4 Z4 b  n9 {    pg 10.11b is stuck inactive for 8561350.091262, current state unknown, last acting []0 l) `$ p: p2 e1 q7 e0 u2 P
    pg 10.137 is stuck inactive for 8561350.091262, current state unknown, last acting []4 ]. ~  X6 b, T* z' J% p% N; J
    pg 10.164 is stuck inactive for 8561350.091262, current state unknown, last acting []8 c% {3 C% n/ y: {
    pg 10.166 is stuck inactive for 8561350.091262, current state unknown, last acting []5 u' T/ \7 c  A- I
    pg 10.16e is stuck inactive for 8561350.091262, current state unknown, last acting []! E: P0 a" r. P
    pg 10.19b is stuck inactive for 8561350.091262, current state unknown, last acting []
+ I4 @7 b& B, A. \: u    pg 10.1ab is stuck inactive for 8561350.091262, current state unknown, last acting []
  @. G" b6 \$ v7 y" q    pg 10.1ae is stuck inactive for 8561350.091262, current state unknown, last acting []
* y$ `  ~1 B7 S. U0 b    pg 10.1b3 is stuck inactive for 8561350.091262, current state unknown, last acting []7 N0 M" I( M7 E
PG_NOT_DEEP_SCRUBBED 24 pgs not deep-scrubbed in time
5 u: ]" V7 E# B' N1 `: p  O    pg 10.11b not deep-scrubbed since 2022-08-01 09:11:50.7060770 h1 r2 ~5 h4 r+ O8 b7 X
    pg 10.10e not deep-scrubbed since 2022-08-01 09:11:50.7060772 X4 z# ~9 `' q
    pg 10.f4 not deep-scrubbed since 2022-08-01 09:11:50.7060771 O) \" W0 G" y& z5 b" s, n( _
    pg 10.de not deep-scrubbed since 2022-08-01 09:11:50.7060777 E1 `1 X# I2 N3 U
    pg 10.c1 not deep-scrubbed since 2022-08-01 09:11:50.706077
* J# ^+ Z3 y: [) H7 n4 L: |& c9 E    pg 10.af not deep-scrubbed since 2022-08-01 09:11:50.706077  S- d  v- S( |" u' v0 P7 c
    pg 10.90 not deep-scrubbed since 2022-08-01 09:11:50.706077
* M. o% f2 ~: D. ~  u    pg 10.81 not deep-scrubbed since 2022-08-01 09:11:50.706077
! z/ r5 \. b# A. u; `; f    pg 10.88 not deep-scrubbed since 2022-08-01 09:11:50.7060775 N, D* \9 k1 d4 l7 n: T* S% Z7 |
    pg 10.41 not deep-scrubbed since 2022-08-01 09:11:50.706077
# E2 U" B, W6 V9 S& V: Z# B, u    pg 10.3e not deep-scrubbed since 2022-08-01 09:11:50.706077
1 e0 H$ e( Z2 m+ w8 c    pg 10.21 not deep-scrubbed since 2022-08-01 09:11:50.706077
! W. y, R: d9 f4 n) W5 _    pg 10.e not deep-scrubbed since 2022-08-01 09:11:50.706077; @$ r* s" I: _, ?' I
    pg 10.6 not deep-scrubbed since 2022-08-01 09:11:50.706077
3 R) @& S8 `7 j. Q. |) Z    pg 10.6d not deep-scrubbed since 2022-08-01 09:11:50.7060777 Q+ s, R- b; N) @0 a/ N
    pg 10.114 not deep-scrubbed since 2022-08-01 09:11:50.7060774 l8 D0 l3 e# k% ^
    pg 10.137 not deep-scrubbed since 2022-08-01 09:11:50.7060770 M) j& X0 ~! V! b0 M
    pg 10.16e not deep-scrubbed since 2022-08-01 09:11:50.706077. r$ \8 u0 j3 i* ?- t+ Y% f
    pg 10.164 not deep-scrubbed since 2022-08-01 09:11:50.706077
5 u+ ?+ e2 E. R- N# B4 V    pg 10.166 not deep-scrubbed since 2022-08-01 09:11:50.706077$ I* ]  {. x& X
    pg 10.19b not deep-scrubbed since 2022-08-01 09:11:50.7060773 |5 _4 M7 S5 w+ ?  U; F; g
    pg 10.1ae not deep-scrubbed since 2022-08-01 09:11:50.7060778 q+ C3 c! D, S5 ]/ m0 o
    pg 10.1ab not deep-scrubbed since 2022-08-01 09:11:50.706077
: R: Q8 }/ f/ Y- y  X    pg 10.1b3 not deep-scrubbed since 2022-08-01 09:11:50.706077! O, ^9 I0 m/ i# M$ ]) I
PG_NOT_SCRUBBED 24 pgs not scrubbed in time1 k$ ^+ M* K& F
    pg 10.11b not scrubbed since 2022-08-01 09:11:50.706077% q1 I/ C& x, j: z. q1 T
    pg 10.10e not scrubbed since 2022-08-01 09:11:50.706077+ i; C- M- @" l% n. u  }
    pg 10.f4 not scrubbed since 2022-08-01 09:11:50.706077" |" \$ U# L, J$ T) u
    pg 10.de not scrubbed since 2022-08-01 09:11:50.706077- R% z" t+ u$ P9 g* ]; u) o
    pg 10.c1 not scrubbed since 2022-08-01 09:11:50.706077
- J8 n/ x& z* U) b+ O/ B0 n% e    pg 10.af not scrubbed since 2022-08-01 09:11:50.7060779 ?, `; |0 X! o! t
    pg 10.90 not scrubbed since 2022-08-01 09:11:50.7060776 k$ F8 @6 @3 K1 F
    pg 10.81 not scrubbed since 2022-08-01 09:11:50.706077+ o/ l. G) L' d" ?
    pg 10.88 not scrubbed since 2022-08-01 09:11:50.706077
9 Z# f. f6 M9 [! q/ R8 L5 K    pg 10.41 not scrubbed since 2022-08-01 09:11:50.7060771 h7 x3 M, p2 s- N( w/ Z
    pg 10.3e not scrubbed since 2022-08-01 09:11:50.706077: m6 R) v% v" l1 I1 M6 I2 x& e; [
    pg 10.21 not scrubbed since 2022-08-01 09:11:50.706077
* @3 f0 K/ Z9 N    pg 10.e not scrubbed since 2022-08-01 09:11:50.706077$ y% f7 u3 b- C5 ~6 h' V, L7 F  T
    pg 10.6 not scrubbed since 2022-08-01 09:11:50.706077
0 E4 _) }7 M  ^9 k+ Q3 X    pg 10.6d not scrubbed since 2022-08-01 09:11:50.706077- Z8 q* ~; N! `
    pg 10.114 not scrubbed since 2022-08-01 09:11:50.706077! j' ]0 v2 j3 u7 B% c
    pg 10.137 not scrubbed since 2022-08-01 09:11:50.7060772 L* B% q! L. g( d6 H5 K% {, E
    pg 10.16e not scrubbed since 2022-08-01 09:11:50.706077% G' j4 l' K; W' e; B* N8 Q0 }  ]
    pg 10.164 not scrubbed since 2022-08-01 09:11:50.706077* d# x3 x( c5 f& z' T+ T. H& h
    pg 10.166 not scrubbed since 2022-08-01 09:11:50.706077
* R6 J8 S3 @( v. B    pg 10.19b not scrubbed since 2022-08-01 09:11:50.706077
( J9 m4 v# D0 q  H2 l3 y3 N! R3 ~    pg 10.1ae not scrubbed since 2022-08-01 09:11:50.706077. |$ ?: Q  R7 G
    pg 10.1ab not scrubbed since 2022-08-01 09:11:50.706077
% e3 {& x4 |" ~1 p. G9 o8 z    pg 10.1b3 not scrubbed since 2022-08-01 09:11:50.706077
5 _( T4 `+ f! \, n, A5 N[root@hostceph2 ~]# ceph osd tree
# W1 f, N8 m8 j# l4 e) s2 WID  CLASS WEIGHT   TYPE NAME              STATUS REWEIGHT PRI-AFF
/ o3 G- [, H8 W0 r& G-25       16.00000 root ssd                                       
! P1 W; M. G! R4 c8 ^-26        4.00000     host ssd-compute06                         / h7 r  C. W0 P4 U  R
18   ssd  1.00000         osd.18             up  1.00000 1.00000
2 j" [) |+ |! Y- p" F# _! C$ b 19   ssd  1.00000         osd.19             up  1.00000 1.00000
3 G$ a2 p) @# q+ `2 r  t3 Q% M, ] 20   ssd  1.00000         osd.20             up  1.00000 1.00000
# R  k* m9 m4 m' F 21   ssd  1.00000         osd.21             up  1.00000 1.00000 : [7 t) d! ?) C# h% l  J* a: _
-27        4.00000     host ssd-compute07                         5 U5 x" h( S2 K# ?' Y) q
22   ssd  1.00000         osd.22             up  1.00000 1.00000
5 D+ h1 H/ k! x& z* ]  t 23   ssd  1.00000         osd.23             up  1.00000 1.00000 . i) n$ i1 U: i! \$ j
24   ssd  1.00000         osd.24             up  1.00000 1.00000
6 [6 z: b2 _6 a8 i9 Y6 D% z9 s 25   ssd  1.00000         osd.25             up  1.00000 1.00000
, {4 A$ A* G) D% ^% [-28        4.00000     host ssd-compute08                         9 @/ Y" {3 L1 A  j* D
26   ssd  1.00000         osd.26             up  1.00000 1.00000
1 J% m5 ?0 c$ c9 }4 j  u 27   ssd  1.00000         osd.27             up  1.00000 1.00000 1 w. M0 v3 n+ [4 W% V/ \& ?* s
28   ssd  1.00000         osd.28             up  1.00000 1.00000 6 H; b8 |# ?) l2 C  Q. x% r
29   ssd  1.00000         osd.29             up  1.00000 1.00000
6 r) e% `3 e( u7 w$ o7 D' Y-29        4.00000     host ssd-compute09                         9 d# i9 i  W2 y
30   ssd  1.00000         osd.30             up  1.00000 1.00000
& a& q$ n; `; [" \4 z# k 31   ssd  1.00000         osd.31             up  1.00000 1.00000
6 l- d" m+ N9 I, |' J# n/ u$ t 32   ssd  1.00000         osd.32             up  1.00000 1.00000 4 D& I# {- h5 n, _$ @( I
33   ssd  1.00000         osd.33             up  1.00000 1.00000
9 {* u1 r3 N0 a7 U& j; v  }+ L4 z8 F -9       18.00000 root hdd                                       
& N$ Y3 V0 E" m1 {) p-10        6.00000     host hdd-hostceph1                         $ b5 `! _6 a& w4 P3 S- K
  0   hdd  1.00000         osd.0              up  1.00000 1.00000
, r1 ~5 s+ A: X5 H1 ^  1   hdd  1.00000         osd.1              up  1.00000 1.00000
, m, g/ T) v  E, |0 W  2   hdd  1.00000         osd.2              up  1.00000 1.00000
6 e3 n( F9 i5 l! J+ Z  3   hdd  1.00000         osd.3              up  1.00000 1.00000
7 d5 c9 P" c5 T8 o7 p9 K  4   hdd  1.00000         osd.4              up  1.00000 1.00000
5 [3 j: y2 @# W8 z6 `  m$ D& |+ ?- a  5   hdd  1.00000         osd.5              up  1.00000 1.00000
9 T, A+ J& h4 A- l0 h  K: F-11        6.00000     host hdd-hostceph2                        
/ J7 }# Q4 Z5 M  6   hdd  1.00000         osd.6              up  1.00000 1.00000
; e3 e$ O- z& f6 P6 f  7   hdd  1.00000         osd.7              up  1.00000 1.00000 & U) n3 s" D$ g5 ^! `
  8   hdd  1.00000         osd.8              up  1.00000 1.00000 ' b4 H) `5 B" z: ^! a- M, n2 w9 U
  9   hdd  1.00000         osd.9              up  1.00000 1.00000 9 N9 i' P% u4 m( I* J  z
10   hdd  1.00000         osd.10             up  1.00000 1.00000 / p0 F  X2 E( ^5 X: s
11   hdd  1.00000         osd.11             up  1.00000 1.00000 . Y+ W" j1 ~7 J- {& X- d: L/ s! q5 ?* w# k
-12        6.00000     host hdd-hostceph3                         $ h; y- {3 L2 r0 A) {; G
12   hdd  1.00000         osd.12             up  1.00000 1.00000
# r( v' Z* T+ x, e 13   hdd  1.00000         osd.13             up  1.00000 1.00000
; Q8 Q7 r( E( v. h4 S 14   hdd  1.00000         osd.14             up  1.00000 1.00000
' {; o: p" M! j+ ^# N 15   hdd  1.00000         osd.15             up  1.00000 1.00000
: _; W# T! v+ h 16   hdd  1.00000         osd.16             up  1.00000 1.00000
1 c' p3 L# W0 R. P* R3 R7 |8 k9 Q 17   hdd  1.00000         osd.17             up  1.00000 1.00000
9 }3 d5 c" i, ] -1              0 root default                                   
, {3 U5 n5 B3 z. R6 S5 r -3              0     host hostceph1                             
; A; b, r! z0 J -5              0     host hostceph2                             
4 ^/ J$ Y; |. P6 x: Y2 O -7              0     host hostceph3                             $ Q! ?, W# a7 {' y
[root@hostceph2 ~]# systemctl stop ceph-osd
( f# k# X' a. c" ~5 h7 d- kceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      
( o; B- k9 A# c- \: {. P[root@hostceph2 ~]# systemctl stop ceph-osd
* J+ I. Q' u, m" Q. V1 aceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      
' D( w# _3 v% `/ `6 E3 C[root@hostceph2 ~]# systemctl stop ceph-osd
4 Q! i  X6 q; a2 O7 d# c2 Vceph-osd@10.service  ceph-osd@11.service  ceph-osd@6.service   ceph-osd@7.service   ceph-osd@8.service   ceph-osd@9.service   ceph-osd.target      + D7 o7 B/ `- f% F/ ~" x
[root@hostceph2 ~]# systemctl stop ceph-osd@8.service * Q. z: q* ~" Y5 Z6 m
[root@hostceph2 ~]# ceph -s
, ]: {- R8 N- d% h- \  cluster:
# N  `1 |9 n; E! i( s    id:     29046cc0-0682-496b-98b1-912e59964282
5 ^% i) x5 s; {# v! b) G  d+ w* X# w    health: HEALTH_WARN
& ^: }$ C8 o( x! i4 R, f# k            1 osds down
5 R! Q  G9 R8 C3 H# i            Reduced data availability: 24 pgs inactive
0 O, d" x# |! t4 [" k2 _; d# G            24 pgs not deep-scrubbed in time
# e/ }: p. P, r: i4 n            24 pgs not scrubbed in time
0 t+ W1 M4 F# L# C6 n1 b2 N ) ?1 n- P! @- O. ~$ ~
  services:  S3 d6 ?4 F/ w$ h! d
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
0 g" G& y/ W& x5 M/ r: O    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
7 }/ x. u8 h1 F7 Q7 v    osd: 34 osds: 33 up (since 3s), 34 in (since 3M)
6 _: G7 B& X8 B& x ) M" z: U) S$ q# F! ]
  data:
% |, A, _' B  J    pools:   9 pools, 5760 pgs
8 _( g5 w5 H. r5 K    objects: 3.11M objects, 12 TiB  x, c* u; h8 D/ K
    usage:   33 TiB used, 92 TiB / 126 TiB avail
, S) _% q9 X) f+ Q: n    pgs:     0.417% pgs unknown% B. w3 ^' G, G. j" B3 D4 m
             5504 active+clean9 m/ j/ m/ _) w+ x( V5 i
             231  stale+active+clean! d1 M4 x+ M2 n: h/ {+ |. v
             24   unknown# e: ]  ~+ n# o; o
             1    active+clean+scrubbing+deep
$ S* s; k2 |; P $ d- i7 B; ^* ^/ t
  io:* `3 Q1 R( Z" u( E) Y6 ~
    client:   441 KiB/s rd, 21 MiB/s wr, 504 op/s rd, 546 op/s wr
- O# I2 W0 s, k9 J
$ [: N0 ^" N' P- k6 k# C; c0 f! }[root@hostceph2 ~]# ceph -s) X# P  E$ V2 I
  cluster:* q0 i0 L. D8 K9 s: o: q4 o0 r
    id:     29046cc0-0682-496b-98b1-912e59964282
# P/ w% i% |% e) A& c7 a1 j* V$ `    health: HEALTH_WARN; q( \, y9 N2 w% C! j9 j
            1 osds down
* Z' G4 |8 Z" C$ X% j5 a            Reduced data availability: 24 pgs inactive" R- S: p2 w# l1 x4 d; Q
            Degraded data redundancy: 300823/7651891 objects degraded (3.931%), 465 pgs degraded1 w9 v: U8 C0 ^& z5 S! e& e  {9 |
            24 pgs not deep-scrubbed in time
( b; O- d9 j  |( s! R0 ?            24 pgs not scrubbed in time
4 M( a  ]  i" [5 [, q; |7 ~+ f
5 C- l: t. @& @# r  services:
& \' \$ \9 z+ g4 g    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)5 N8 Z6 ^- c5 }7 }! ~7 U' _+ L
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph34 Y/ p! l  `; w
    osd: 34 osds: 33 up (since 10s), 34 in (since 3M)
! k/ a  p! j- f' Z+ r % l! }+ P- r  f5 g7 E
  data:4 E7 p. @* M: y, D
    pools:   9 pools, 5760 pgs
3 ?3 `, w; l: S. x2 h  }    objects: 3.11M objects, 12 TiB
/ x+ K6 L( f( j) {    usage:   33 TiB used, 92 TiB / 126 TiB avail! W0 `! P& y: J- w% S. x
    pgs:     0.417% pgs unknown
! k- j$ m! n- y/ }, P3 @             4.010% pgs not active. S; f' j* T3 m; p; q( p
             300823/7651891 objects degraded (3.931%)
' O$ f' r, H; Z& q             5182 active+clean
1 u  d% `+ a! a4 R( e             234  active+undersized+degraded
/ `' [! H2 Q" g1 y+ v9 B/ L( T             231  undersized+degraded+peered; n" S# ?! }0 t
             88   active+undersized
- r( X5 d9 h- M9 x, @             24   unknown( I# z% M! `' l( I& e6 P# Y
             1    active+clean+scrubbing+deep
* n% D8 i2 _/ h2 o
8 B( _% N$ D( M5 y  io:- Q# W$ r6 K6 R$ _: J0 `
    client:   15 MiB/s wr, 0 op/s rd, 567 op/s wr+ y) i" I9 j  P4 g5 `

' x3 b- Q/ M0 ~3 T[root@hostceph2 ~]# ceph -s
# Q. }5 s- T+ s, j* {, u  cluster:5 b$ D* V1 l8 j8 x
    id:     29046cc0-0682-496b-98b1-912e59964282& w7 a, H3 Z5 W0 x
    health: HEALTH_WARN# b1 m4 w- m* m# e# H1 [8 w
            1 osds down1 o: }( ?1 X, a/ l: z3 a" m9 A) b
            Reduced data availability: 24 pgs inactive) S/ ^2 W9 n8 i2 M& {
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
5 A+ O+ @9 L/ Z9 B! K            24 pgs not deep-scrubbed in time: n& I2 Z3 L+ ~( D4 J& o
            24 pgs not scrubbed in time
& e- a) _1 \! O' B8 N : s, }7 G% w: h6 X  [% h, a
  services:
6 N; s5 B5 `% p4 }! w& [1 C9 b    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)5 Q1 ~9 O+ T; ?) f! ~" m: T9 h
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
: G% ]3 L% N! j" h( r7 p! c3 \) a9 p    osd: 34 osds: 33 up (since 14s), 34 in (since 3M), O: g8 D+ y% l

, ]. N: I( Y: o) G  h! @  data:
! u( H. `# ~9 P6 z: C4 W; X    pools:   9 pools, 5760 pgs
& [$ {$ c6 @- d6 f! g5 O6 e    objects: 3.11M objects, 12 TiB
( ]; `7 [( }! E' s' h* H    usage:   33 TiB used, 92 TiB / 126 TiB avail# W2 {. r0 B# p% B1 F( A# z3 z
    pgs:     0.417% pgs unknown
0 D" i) c% k* N             4.010% pgs not active
4 Q" w+ l, {$ |             300823/7651894 objects degraded (3.931%)
! a8 I4 X4 p1 T             5182 active+clean# g# W; B) X  ^/ d: ^  ]
             234  active+undersized+degraded
0 K% H4 u' x8 X: U4 ]  k5 G! t             231  undersized+degraded+peered6 G3 b9 d0 Z* i$ s( j% A) `
             88   active+undersized/ V: E$ w) T! m" Z
             24   unknown
" E6 y) R# Y5 \' q6 R             1    active+clean+scrubbing+deep
$ O2 k3 \4 }6 I4 U% {3 _7 g$ n1 Q
: u/ B' U9 n1 K5 g7 r4 F  io:8 s( s6 m0 T& \9 [- e9 h
    client:   18 MiB/s wr, 0 op/s rd, 598 op/s wr+ |# q0 i: Z  X

$ d; x* U8 J/ W  W[root@hostceph2 ~]# ceph -s
% Q2 m7 A/ I9 \, t* K2 I( J; H  cluster:) `8 p9 X- j: W3 J& G9 F
    id:     29046cc0-0682-496b-98b1-912e59964282: G4 m; B% Y/ y  k# _' D% {. \- e0 V" X
    health: HEALTH_WARN; n) a) b1 Z! A% N; s: s
            1 osds down, F# S( s. E. u% p
            Reduced data availability: 24 pgs inactive
, K! G+ J$ c1 Y+ y) D            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded
# }' b& Z7 g' a$ y' l            24 pgs not deep-scrubbed in time& M: {' @+ \. H% p9 k0 ?
            24 pgs not scrubbed in time
4 y" f  h% V9 n8 y! P9 V# \
  C4 v, X  Q2 C( a9 t2 H, b+ z6 h  services:5 H0 {/ q7 T, y( W5 m$ }4 x% g
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)7 _) l" [+ x  H2 W0 X! S# v
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3* g3 r* i& b# D0 v: d$ `2 o5 t
    osd: 34 osds: 33 up (since 16s), 34 in (since 3M)
# N# I  Y" P) |4 |/ s) Y
( s. ^. Y7 r2 n5 r; T3 J  data:8 u; P& I, x0 D) i& K& L+ N
    pools:   9 pools, 5760 pgs
/ G4 C' T5 w& q- I' B    objects: 3.11M objects, 12 TiB
0 H. B1 N8 R& F2 F6 C    usage:   33 TiB used, 92 TiB / 126 TiB avail! c3 P; w& Y) [: n! U' \, D
    pgs:     0.417% pgs unknown! G9 J2 ]7 Q; V4 \
             4.010% pgs not active
) C8 }/ a9 f8 m3 f- s) |             300823/7651894 objects degraded (3.931%)
; o6 [, ?  V5 p& P- T             5182 active+clean2 M/ v" w1 Y. |1 t$ W' V/ u
             234  active+undersized+degraded
: G$ O& {; \+ ]# O/ q+ e, R+ ?             231  undersized+degraded+peered
) B5 m* J0 O5 N: I             88   active+undersized
* l5 e- U/ ~7 F- e' B' {1 }             24   unknown9 w0 m  M% c" Z
             1    active+clean+scrubbing+deep
3 \2 d- n) e7 D  H8 f: F: y
& N( Y" X4 Y; k! m$ ?  io:% U3 k3 F- X: P2 Q$ ~; t4 S0 Y* _
    client:   19 MiB/s wr, 0 op/s rd, 591 op/s wr! t8 X, N) ~% }' D4 Q1 Z: c) ^  \; d

% A, h$ b) s  G* d" H' E% l# I[root@hostceph2 ~]# ceph -s
$ Z- j. r, W: @  ^. I0 ]  cluster:' w# @' \4 U$ K& e' v; B2 R
    id:     29046cc0-0682-496b-98b1-912e59964282
) D5 X. T  r6 U1 z. a% s. |% K    health: HEALTH_WARN
: Q) F" R! R, Z( d  d7 L* j0 P            1 osds down' u: V6 M% K( p2 y' z& f4 z
            Reduced data availability: 24 pgs inactive/ P  k& T# q& ?' G4 v7 R
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded+ ^: ?5 u; E, B$ e$ ?( R; u" [
            24 pgs not deep-scrubbed in time3 r2 k9 k+ E( E2 }( r# M9 e
            24 pgs not scrubbed in time
. \+ G& [% {0 z! v8 P
! s/ s2 ^3 g/ q) w  services:
' c3 M: ^- \8 p! U    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)* t* C5 r  Y" ]
    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph3
( k: z' [8 v7 H) a0 U4 Y1 _: q( F    osd: 34 osds: 33 up (since 18s), 34 in (since 3M)5 U: }! Y7 e& n& f4 e* @

6 H) g) s7 v: @% x  F! B  data:( F' J; X& {' A  v
    pools:   9 pools, 5760 pgs
6 C; X8 f, }- B$ h    objects: 3.11M objects, 12 TiB
0 A8 V( n" x( B/ I& U    usage:   33 TiB used, 92 TiB / 126 TiB avail
9 j& r% a9 V7 b1 a+ a. `) q, X( Y    pgs:     0.417% pgs unknown. a5 W4 F- d# j: s1 }/ D/ V
             4.010% pgs not active
, t3 a9 X+ J; S, y) j" c             300823/7651894 objects degraded (3.931%)
6 ~  b% {9 J8 d! m* w  m- j' `5 n             5182 active+clean
! V' D: }' X! `+ _, @2 m* _, p: o. S             234  active+undersized+degraded* T$ M. s! z9 \2 }8 t
             231  undersized+degraded+peered
$ h8 v% }+ H- |& ^* ^             88   active+undersized
: n" R5 Y& t$ B- t) E             24   unknown5 J' a4 [1 Q- k7 @" S& [
             1    active+clean+scrubbing+deep4 Q* E% j  e! n7 q. r  A

, n6 O, p8 H4 n# ?6 c3 r  io:: I- ~* r* h- K, c9 Q* K2 l- m; Z
    client:   43 KiB/s rd, 19 MiB/s wr, 30 op/s rd, 517 op/s wr
# z+ l2 _, b- e2 S* X2 O; [ + W8 E3 N& e; `. q. _. x4 Y, n
[root@hostceph2 ~]# ceph -s
+ l0 U4 D: y' H, n  cluster:) i; f% D- O% o: ]! R/ o$ i7 M
    id:     29046cc0-0682-496b-98b1-912e59964282
! d3 t+ H) f" B: }    health: HEALTH_WARN, N4 k. T* y, N$ I, n( l
            1 osds down
8 m6 M  T5 o2 M3 T            Reduced data availability: 24 pgs inactive, y* s$ f& {% {3 M. b1 \
            Degraded data redundancy: 300823/7651894 objects degraded (3.931%), 465 pgs degraded0 \7 D" H/ |& b4 R) M1 r
            24 pgs not deep-scrubbed in time
5 X' E" n- j0 D            24 pgs not scrubbed in time
' `$ Q! q  x) m4 {; N3 {
0 C% @0 G5 [% }$ T0 i7 q5 ]  services:2 X4 e6 b9 C4 V5 |9 ~7 F
    mon: 3 daemons, quorum hostceph1,hostceph2,hostceph3 (age 17m)
" H! {& U0 T$ g3 j. _+ B    mgr: hostceph2(active, since 3M), standbys: hostceph1, hostceph34 v" K, g# k5 x+ \
    osd: 34 osds: 33 up (since 20s), 34 in (since 3M)5 R+ _; ]) i# l; [% F) I! N3 `
8 Y$ G! |5 [- C. y. I
  data:7 E* V! l7 f; X% |6 K
    pools:   9 pools, 5760 pgs
- @, S* T3 j+ n: [4 T5 V/ `    objects: 3.11M objects, 12 TiB
4 w( ]9 |- _9 E- R- B  Q0 L9 B    usage:   33 TiB used, 92 TiB / 126 TiB avail
6 X9 w( }( {, p    pgs:     0.417% pgs unknown
7 P0 O! H, W- {( |' x, I- ?2 X, l0 L             4.010% pgs not active
/ }& V. k* J/ ~3 D0 K) p. W             300823/7651894 objects degraded (3.931%)# A! b0 x; O4 Z( ~. r$ ], r
             5182 active+clean
7 E$ f4 A7 {, ^3 X+ G             234  active+undersized+degraded
3 u0 {! B, q. f" @             231  undersized+degraded+peered
- b9 z, V' _5 l0 t             88   active+undersized
, ]0 `% n7 g1 j" ?, x             24   unknown2 e4 @, f$ `3 s' t9 S6 I0 W
             1    active+clean+scrubbing+deep
5 [1 G8 H- Y' i
; R+ V& ]# S# r* p' g1 ?3 u% E  io:
8 `: E7 U; V# I& {    client:   66 KiB/s rd, 19 MiB/s wr, 30 op/s rd, 542 op/s wr
" P; z9 c8 W$ o/ M$ X6 U& p
回复

举报

返回列表 发新帖
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

本版积分规则

返回首页|Archiver|手机版|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )

GMT+8, 2026-6-12 00:06 , Processed in 0.055115 second(s), 26 queries .

Powered by Discuz! X5.0

© 2001-2026 Discuz! Team.

快速回复 返回顶部 返回列表