浏览此站
联系我们相册切换到窄版 Language

 找回密码
 注册
易陆发现论坛»论坛 › 云计算开源区 › ceph分布式存储 › HEALTH_ERR 1 pgs inconsistent; 1 pgs repair; 1 scrub ...
返回列表 发新帖
查看: 613|回复: 1

HEALTH_ERR 1 pgs inconsistent; 1 pgs repair; 1 scrub errors pg 1.141e is active+

[复制链接]
admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
发表于 2023-2-28 09:58:29 | 显示全部楼层 |阅读模式
HEALTH_ERR 1 pgs inconsistent; 1 pgs repair; 1 scrub errors1 s+ N7 i; E- _" N" D$ ?! H* T
pg 1.141e is active+clean+scrubbing+deep+inconsistent+repair, acting [86,26,85]" ~- v- r( k7 N4 }$ k8 v" L
1 scrub errors6 B7 \. A* r; ^1 V
0 i% T8 g) O: a

" W% w: _  n% a. a  O$ r[root@cn09 ~]# ceph pg deep-scrub 1.141e
0 ]4 e* i6 w, u) Z% _# T6 `) Yinstructing pg 1.141e on osd.86 to deep-scrub) I) r$ A9 Y. r
[root@cn09 ~]# ceph pg repair 1.141e0 L) E6 |4 ]! p
instructing pg 1.141e on osd.86 to repair- ]6 y/ W- k0 W: W2 Z" Y8 K) c
[root@cn09 ~]# ceph pg repair 1.141e
9 M# N" x$ |' g; R. [: {9 @3 cinstructing pg 1.141e on osd.86 to repair
. F- c6 J& b# G3 V8 j[root@cn09 ~]# ceph pg repair 1.141e
1 [( k; d9 S! _6 g% a/ t2 _3 q* binstructing pg 1.141e on osd.86 to repair
6 F, Z  s- e" o5 F[root@cn09 ~]# ceph health detail
0 r7 u2 `( t* c4 [HEALTH_ERR 1 pgs inconsistent; 1 scrub errors3 u4 D% A& b8 Z, W: M
pg 1.141e is active+clean+inconsistent, acting [86,26,85]
& P2 Y& W4 j$ c1 \2 q1 scrub errors8 i/ z% X+ i& @

3 S9 o/ e- G. N: ^6 B$ t% r
, U6 {0 \! S4 u# n[root@cn09 ~]# ceph osd set noout
( |& `, C/ Q! _" i( ~set noout
# G4 y$ j6 z2 {5 f0 n" W[root@cn09 ~]# ceph -s( m: e2 C2 M) _, l; z( i3 H) N4 K: \
    cluster d385bef6-6778-43cc-8755-4e1d5ef5485e6 X. f6 l2 H" K6 O  w
     health HEALTH_ERR
0 c( g' A3 Z. ~, c6 P. c2 R            1 pgs inconsistent
& P. V/ z4 }. X: V# L6 E  R! C            1 scrub errors3 H" E! J3 ]  [7 }2 L1 U, z
            noout flag(s) set
  d2 I; N- H5 B$ D( J3 n4 Z  `     monmap e3: 3 mons at {}8 c# ]6 d$ q" O( T( x+ c* _/ K
            election epoch 10, quorum 0,1,2 % u: T1 A7 `) ~( T
     osdmap e219: 90 osds: 90 up, 90 in
9 d( J7 I6 \- g+ i8 ~            flags noout,sortbitwise,require_jewel_osds
, k/ s. N6 `4 W( e      pgmap v40230148: 8192 pgs, 1 pools, 29512 GB data, 7460 kobjects
! g& P$ w4 p- V& E- K  E; A) B            88344 GB used, 241 TB / 327 TB avail0 O# j3 Q! A$ D
                8185 active+clean, k  s) O" a$ G
                   6 active+clean+scrubbing+deep) W. M% d& t2 v: l1 C- z+ M' o8 j
                   1 active+clean+inconsistent7 Y! n* c* G+ u; K6 [: J& k
  client io 484 MB/s rd, 40044 kB/s wr, 8192 op/s rd, 11982 op/s wr$ x! t" r6 k4 n- Z

9 g, R% F6 H9 o) M+ x[root@cn09 ~]# systemctl stop ceph-osd@86.service " i% X: J2 x6 w! }9 b
[root@cn09 ~]# systemctl status ceph-osd@86.service , b' N- u% m4 b$ I2 S0 o! I* \2 T1 H
● ceph-osd@86.service - Ceph object storage daemon2 p* q" }2 F5 i+ V9 Q' I
   Loaded: loaded (/usr/lib/systemd/system/ceph-osd@.service; enabled; vendor preset: disabled)
3 y8 u7 I: f, h/ h/ L' ^   Active: inactive (dead) since Tue 2023-02-28 09:33:18 CST; 3s ago
, a& P* ]' L0 M: z6 ~" f1 M3 N Main PID: 19110 (code=exited, status=0/SUCCESS)
3 h: f* W  ]9 `- p
$ G' W) e: \. f$ l. L6 `; \Feb 27 19:31:09 cn09 ceph-osd[19110]: 2023-02-27 19:31:09.098552 7fddf529b700 -1 log_channel(cluster) log [ERR] : 1.141e shard 26: soid 1:782c65a9::...read error
9 k& a1 [9 ]0 l  g$ C- }+ q/ ^Feb 27 19:31:46 cn09 ceph-osd[19110]: 2023-02-27 19:31:46.357585 7fddf1c96700 -1 log_channel(cluster) log [ERR] : 1.141e deep-scrub 0 missing, 1 inc...nt objects
3 k2 K% W; ~. t4 s. _Feb 27 19:31:46 cn09 ceph-osd[19110]: 2023-02-27 19:31:46.357597 7fddf1c96700 -1 log_channel(cluster) log [ERR] : 1.141e deep-scrub 1 errors$ C0 r/ m" P+ W, r
Feb 28 09:33:14 cn09 ceph-osd[19110]: 2023-02-28 09:33:14.304486 7fdde4e85700 -1 osd.86 219 *** Got signal Terminated ***
$ ^5 B- {0 q8 f; h4 D( h  a- |: Z: MFeb 28 09:33:14 cn09 systemd[1]: Stopping Ceph object storage daemon...* E% P; G5 p* X( B; u
Feb 28 09:33:14 cn09 ceph-osd[19110]: 2023-02-28 09:33:14.397327 7fdde4e85700 -1 osd.86 219 shutdown
/ N$ y' n( k  m7 [/ E: }& qFeb 28 09:33:18 cn09 systemd[1]: Stopped Ceph object storage daemon.
" m+ s' F: [2 E0 |Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
* m7 `& y3 P- C$ r5 |3 N: bHint: Some lines were ellipsized, use -l to show in full.
) t( @/ M0 _2 }[root@cn09 ~]# systemctl start ceph-osd@86.service
( G; b+ c- X9 Z  `/ ^* T7 T[root@cn09 ~]# systemctl status ceph-osd@86.service
& @+ x" s; {, d0 U● ceph-osd@86.service - Ceph object storage daemon
* q2 z4 I/ u* X0 H$ T   Loaded: loaded (/usr/lib/systemd/system/ceph-osd@.service; enabled; vendor preset: disabled)
0 I1 k! o( l2 l9 X( q' L* K   Active: active (running) since Tue 2023-02-28 09:33:26 CST; 2s ago! D9 j  J9 t, q# U6 z; r
  Process: 2460810 ExecStartPre=/usr/lib/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id %i (code=exited, status=0/SUCCESS)" e! A* E6 o2 o
Main PID: 2460821 (ceph-osd)
4 M, ~2 `) O7 {5 Y7 z1 B$ }9 i   CGroup: /system.slice/system-ceph\x2dosd.slice/ceph-osd@86.service
8 x/ j" \! B$ c" ~0 c/ b           └─2460821 /usr/bin/ceph-osd -f --cluster ceph --id 86 --setuser ceph --setgroup ceph, c& @2 C0 r# `# {) [* p

' _4 D$ u% e3 WFeb 28 09:33:26 cn09 systemd[1]: Starting Ceph object storage daemon...
5 W+ B+ {7 F2 d; OFeb 28 09:33:26 cn09 systemd[1]: Started Ceph object storage daemon.
6 \9 T& K/ U0 |& `1 ?' s" iFeb 28 09:33:26 cn09 ceph-osd[2460821]: starting osd.86 at :/0 osd_data /var/lib/ceph/osd/ceph-86 /var/lib/ceph/osd/ceph-86/journal
  Q2 U2 G7 F. \7 j[root@cn09 ~]# systemctl status ceph-osd@86.service 9 _) W0 S4 H  k, J% ^: [. v, v
● ceph-osd@86.service - Ceph object storage daemon; x' g5 K' R  @0 K/ [+ }
   Loaded: loaded (/usr/lib/systemd/system/ceph-osd@.service; enabled; vendor preset: disabled)* W  x' o' p7 Y% `2 S) H- {
   Active: active (running) since Tue 2023-02-28 09:33:26 CST; 3s ago
2 u. A& h) C2 c  Process: 2460810 ExecStartPre=/usr/lib/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id %i (code=exited, status=0/SUCCESS): `+ P% `; d8 @, U. Q
Main PID: 2460821 (ceph-osd)( t+ E3 |, {$ @' V" A6 V) I
   CGroup: /system.slice/system-ceph\x2dosd.slice/ceph-osd@86.service
/ \$ L4 t; q$ ^5 Z           └─2460821 /usr/bin/ceph-osd -f --cluster ceph --id 86 --setuser ceph --setgroup ceph
+ l$ f/ [/ y7 c7 C8 E1 o9 h; a& Q( c5 E5 g9 ]
Feb 28 09:33:26 cn09 systemd[1]: Starting Ceph object storage daemon...& G) k; g. z/ v; h1 s+ S$ f
Feb 28 09:33:26 cn09 systemd[1]: Started Ceph object storage daemon.& U+ M3 n5 c* e6 P; A
Feb 28 09:33:26 cn09 ceph-osd[2460821]: starting osd.86 at :/0 osd_data /var/lib/ceph/osd/ceph-86 /var/lib/ceph/osd/ceph-86/journal" T' H, }: c- u
[root@cn09 ~]# ceph -s: U1 W7 U5 B/ n3 \3 M$ b4 t' ^
    cluster d385bef6-6778-43cc-8755-4e1d5ef5485e
. c6 n( ?0 ~3 v% [/ F% ?     health HEALTH_ERR
& ]& v: h: F  b, S1 i            240 pgs degraded; N! T2 P! `  q4 B, s
            1 pgs inconsistent: Y+ F3 B9 _% f& X# g# K9 V
            26 pgs stuck unclean7 |3 Z  b( S- ?0 d
            240 pgs undersized0 L, g  u0 S; y
            recovery 223763/22917261 objects degraded (0.976%)
: c9 R/ y) S& U) M2 [& `( l  ]% f            1 scrub errors
; L6 e" M; Q, [- @" E! z4 ?1 `            1/90 in osds are down1 y2 i/ M) \7 G6 i+ V( Q( K+ V
            noout flag(s) set, K/ O3 f: o. W) K% P: y- f  C
     monmap e3: 3 mons at {}
4 X$ j4 r1 i% i+ V( o# u# a% U6 t            election epoch 10, quorum 0,1,2 + X6 I" I$ _$ O; u
     osdmap e223: 90 osds: 89 up, 90 in; 240 remapped pgs
2 M" _7 G1 x4 {            flags noout,sortbitwise,require_jewel_osds- N' {. j8 f$ x
      pgmap v40230185: 8192 pgs, 1 pools, 29512 GB data, 7460 kobjects! p) b" v. g6 L, m. E
            88344 GB used, 241 TB / 327 TB avail4 n* B: g/ K) G, S0 q4 T
            223763/22917261 objects degraded (0.976%)- j9 \% ?4 V1 a6 i) h
                7949 active+clean
" Z( M- l" ~7 X1 Y* b                 239 active+undersized+degraded" @0 B) K$ h/ e/ h8 f
                   3 active+clean+scrubbing+deep
2 g3 Q  i6 N( X& F                   1 active+undersized+degraded+inconsistent
( ], k% M5 v, u- v) ]3 w  client io 16286 kB/s rd, 29898 kB/s wr, 3339 op/s rd, 7408 op/s wr* V, ~8 T, ?$ `& g
[root@cn09 ~]# watch ceph -s1 Q; Y8 A  i  S, a3 m
[root@cn09 ~]# systemctl status ceph-osd@86.service
9 D* D  e  d/ W4 T7 O5 k5 \  X● ceph-osd@86.service - Ceph object storage daemon
) u1 z4 o6 |$ c) S   Loaded: loaded (/usr/lib/systemd/system/ceph-osd@.service; enabled; vendor preset: disabled)
6 x$ j* B& a9 l' V' v   Active: active (running) since Tue 2023-02-28 09:33:26 CST; 8min ago
0 l. C9 q7 {( s( c4 `7 ?3 x4 i4 s  Process: 2460810 ExecStartPre=/usr/lib/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id %i (code=exited, status=0/SUCCESS)
' k3 B* X* U% V4 e Main PID: 2460821 (ceph-osd)
3 B' t& Y: u3 d- k( P   CGroup: /system.slice/system-ceph\x2dosd.slice/ceph-osd@86.service- M9 B. i9 c6 R  i" T3 u* @
           └─2460821 /usr/bin/ceph-osd -f --cluster ceph --id 86 --setuser ceph --setgroup ceph
% u$ |- b0 G6 [3 N: |
+ ]# u  L; p/ ^6 @Feb 28 09:33:26cn09 systemd[1]: Starting Ceph object storage daemon...5 k6 }8 K+ o4 F1 a4 P( _5 Y3 O8 X
Feb 28 09:33:26 cn09 systemd[1]: Started Ceph object storage daemon.
) o7 i$ M) N* m6 ~* p/ z( d1 V# R" QFeb 28 09:33:26 cn09 ceph-osd[2460821]: starting osd.86 at :/0 osd_data /var/lib/ceph/osd/ceph-86 /var/lib/ceph/osd/ceph-86/journal
7 o) @, u$ i8 b/ [0 Z$ DFeb 28 09:33:45 cn09 ceph-osd[2460821]: 2023-02-28 09:33:45.106009 7fe7b91d2f80 -1 leveldb: Compacting leveldb store...
! S5 S3 V9 H3 q+ }. GFeb 28 09:33:46 cn09 ceph-osd[2460821]: 2023-02-28 09:33:46.428126 7fe7b91d2f80 -1 leveldb: Finished compacting leveldb store
% {) i) U; m% L: J( `0 HFeb 28 09:33:50 cn09 ceph-osd[2460821]: 2023-02-28 09:33:50.066050 7fe7b91d2f80 -1 osd.86 219 log_to_monitors {default=true}' I) K; ~8 l# A# t/ ^: l  g
[root@cn09 ~]# watch ceph -s2 C- ?9 z3 ?! x$ Z
[root@cn09 ~]# ceph osd unset noout
' I' f, W, |3 l- e& J8 d. Cunset noout: G$ V* u! w& o: R
[root@cn09 ~]# watch ceph -s
6 r3 Y0 [6 x4 }
2 P9 o& h- j) y. Q% u+ w) w% [: A) D* C. T9 B! J% l

7 k. O' A" p* T
+ h7 V$ T6 p  T& ^; d
回复

举报

admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2023-11-24 00:06:43 | 显示全部楼层
解决过程，发现无发正常同步，通过检查调整参数，达到修复的目的：
+ J! _- e6 X6 B& j[root compute1 ~]# ceph daemon osd.0 config show |egrep "osd_recovery_max_active|osd_recovery_op_priority|osd_max_backfills" , u+ ~5 }2 _% R+ S# U
    "osd_max_backfills": "1",3 s5 h1 l/ y0 s  p- Y( Y- B
    "osd_recovery_max_active": "1",0 X: F; ~) d7 J
    "osd_recovery_op_priority": "0",
0 j, P9 s1 M. q/ h"osd_recovery_op_priority": "0",  默认是10
5 o( u( e4 \: m+ h* p, u
  F7 q* |; h  u修改为默认值10  8 d# ?4 G8 v+ l* r" ?4 X
, W# i- R. `* \* v
[root compute1 ~]# ceph tell osd.* injectargs osd_recovery_op_priority=10
) G2 C- S7 y0 Q, Nosd.0: osd_recovery_op_priority = '10' (unchangeable) 8 s$ L( \8 A6 k9 R7 b
osd.1: osd_recovery_op_priority = '10' (unchangeable) 1 c$ l1 K- t  N) N$ b5 K
osd.2: osd_recovery_op_priority = '10' (unchangeable)
3 B  i9 E6 g& Nosd.3: osd_recovery_op_priority = '10' (unchangeable)
. C" ^; J) U0 I3 f9 b/ a) ~9 N8 X9 ]osd.4: osd_recovery_op_priority = '10' (unchangeable)
  z- @9 s% y- V4 Iosd.5: osd_recovery_op_priority = '10' (unchangeable) . _  ~' l# |  q, {. H$ p' A
osd.6: osd_recovery_op_priority = '10' (unchangeable) 8 J! y4 @0 i# Y  k
osd.7: osd_recovery_op_priority = '10' (unchangeable)
7 r5 r& U# C+ S- u5 _! c2 h* ~osd.8: osd_recovery_op_priority = '10' (unchangeable) 8 i+ Q& i  z% T$ Q& l0 r1 h
osd.9: osd_recovery_op_priority = '10' (unchangeable) 7 O: U- u4 q* f2 n$ a, g; V- m: c
osd.10: osd_recovery_op_priority = '10' (unchangeable) % Q. ?7 ]% u, T  i
osd.11: osd_recovery_op_priority = '10' (unchangeable) 2 {& j6 D7 h& `4 r: Q5 _9 I
osd.12: osd_recovery_op_priority = '10' (unchangeable) 0 F+ m7 w5 m' P# y# R" y
osd.13: osd_recovery_op_priority = '10' (unchangeable) 8 l' B' Q) R4 d6 x
osd.14: osd_recovery_op_priority = '10' (unchangeable) 9 s8 @8 q7 _/ f, Z
osd.15: osd_recovery_op_priority = '10' (unchangeable)
2 \0 h& Z. v  S+ H8 N- d+ Fosd.16: osd_recovery_op_priority = '10' (unchangeable) / i3 r3 v9 \3 n0 V9 K. k. D3 n# U
osd.17: osd_recovery_op_priority = '10' (unchangeable) 3 ^9 D6 B: _' I6 x' U1 V7 e
osd.18: osd_recovery_op_priority = '10' (unchangeable) / k& x) H* x5 j% S; @( F
osd.19: osd_recovery_op_priority = '10' (unchangeable)
1 c; {7 X. P& josd.20: osd_recovery_op_priority = '10' (unchangeable) : @0 w7 }: M  r8 @6 s
osd.21: osd_recovery_op_priority = '10' (unchangeable) 9 ~; f/ y- t+ Y. s1 e
osd.22: osd_recovery_op_priority = '10' (unchangeable) 8 U, y8 i* {" A! I- f3 M0 u
osd.23: osd_recovery_op_priority = '10' (unchangeable)
" F, `/ b) [1 Z9 b( iosd.24: osd_recovery_op_priority = '10' (unchangeable)
5 n5 S" J2 a9 R" O4 x$ B* }7 wosd.25: osd_recovery_op_priority = '10' (unchangeable)
/ e9 ~5 U& a/ josd.26: osd_recovery_op_priority = '10' (unchangeable) & R( X8 K2 K9 D9 H& I, a
osd.27: osd_recovery_op_priority = '10' (unchangeable)
# f3 e1 J3 h& {' iosd.28: osd_recovery_op_priority = '10' (unchangeable) " f1 v- g! V/ w
osd.29: osd_recovery_op_priority = '10' (unchangeable)
6 G1 \" u& ~- [+ v' nosd.30: osd_recovery_op_priority = '10' (unchangeable)
. o8 z' I/ Q8 T' W  w& Rosd.31: osd_recovery_op_priority = '10' (unchangeable)
+ g. l3 [- u  X# b. V" n' h  ^7 fosd.32: osd_recovery_op_priority = '10' (unchangeable) , u2 r: I5 F) k- L5 k
osd.33: osd_recovery_op_priority = '10' (unchangeable)
8 `* C! {/ D! j% y) `6 h' Dosd.34: osd_recovery_op_priority = '10' (unchangeable)
. ]+ A, A" h0 p1 Tosd.35: osd_recovery_op_priority = '10' (unchangeable)
! o* m) I* a& dosd.36: osd_recovery_op_priority = '10' (unchangeable) 7 J! q( ^0 Y  S. V: J) i
osd.37: osd_recovery_op_priority = '10' (unchangeable) . T7 i! B* H0 ~) ]9 a6 v4 `3 ~9 C
osd.38: osd_recovery_op_priority = '10' (unchangeable)
7 K) U" x# E0 t$ @; c6 Q$ [osd.39: osd_recovery_op_priority = '10' (unchangeable)
& @0 R! _% Q/ Cosd.40: osd_recovery_op_priority = '10' (unchangeable)
( F. a/ j, n# _* u/ |% Y) e, ~# {osd.41: osd_recovery_op_priority = '10' (unchangeable)
/ T% S$ l9 v; G6 josd.42: osd_recovery_op_priority = '10' (unchangeable)
7 R3 x' }4 Y- W+ Q9 ]3 |3 q3 bosd.43: osd_recovery_op_priority = '10' (unchangeable) , ^' T  J% Y+ J( q7 c9 v
osd.44: osd_recovery_op_priority = '10' (unchangeable) # O" v$ Q6 Y+ ~. E5 l
osd.45: osd_recovery_op_priority = '10' (unchangeable)
' U* K; G+ ]9 [8 v1 A9 J& N: D! ~osd.46: osd_recovery_op_priority = '10' (unchangeable)
& }2 B5 q5 l6 F/ \4 R: P7 ?* l5 cosd.47: osd_recovery_op_priority = '10' (unchangeable)
  z" ^+ q, Q# i* N1 Cosd.48: osd_recovery_op_priority = '10' (unchangeable)   G4 x) S. D! V
osd.49: osd_recovery_op_priority = '10' (unchangeable) & V; Z( X3 }4 A) z
osd.50: osd_recovery_op_priority = '10' (unchangeable)
& W6 ]; D, d% L6 M' Aosd.51: osd_recovery_op_priority = '10' (unchangeable)
, u- W8 f. K, v' ?% _9 l6 H. |# fosd.52: osd_recovery_op_priority = '10' (unchangeable) 0 a* ?9 r0 @7 K- i- U' z7 p8 o; h
osd.53: osd_recovery_op_priority = '10' (unchangeable) 7 [3 F7 O. _& Q+ C- ]
Error ENXIO: problem getting command descriptions from osd.54
$ n$ i5 U3 U# k. {. Mosd.54: problem getting command descriptions from osd.54% O) Z  S" [4 n( q
osd.55: osd_recovery_op_priority = '10' (unchangeable)
) k) K: Y3 l" x/ E$ X+ Uosd.56: osd_recovery_op_priority = '10' (unchangeable)
5 D6 C( I3 Q' r+ h0 }4 o+ josd.57: osd_recovery_op_priority = '10' (unchangeable) , Q6 X+ |4 Q- H& a0 X! ^! u
osd.58: osd_recovery_op_priority = '10' (unchangeable) : ]4 w9 u. S4 j/ J5 ~
osd.59: osd_recovery_op_priority = '10' (unchangeable)
9 L0 ^' Y) Y" J; x6 vosd.60: osd_recovery_op_priority = '10' (unchangeable)
  R0 Q8 j+ Y% N9 O7 ?osd.61: osd_recovery_op_priority = '10' (unchangeable)
" X8 i5 I4 C6 Z! M& N: C- `osd.62: osd_recovery_op_priority = '10' (unchangeable) 8 g( N4 F! n+ `' z8 U9 W
osd.63: osd_recovery_op_priority = '10' (unchangeable) 3 {& {3 m/ m6 U  }# b6 K1 |9 k
osd.64: osd_recovery_op_priority = '10' (unchangeable)
1 ^( f! L. X9 `* Gosd.65: osd_recovery_op_priority = '10' (unchangeable) 8 [1 W* D  L" N7 C$ H) B* O1 M, S
osd.66: osd_recovery_op_priority = '10' (unchangeable)
& f, P) A( P9 ]8 \" Zosd.67: osd_recovery_op_priority = '10' (unchangeable)
& h) y7 w9 c: Y7 g6 rosd.68: osd_recovery_op_priority = '10' (unchangeable)
& ?$ T6 I+ g/ f' ^* losd.69: osd_recovery_op_priority = '10' (unchangeable) 5 c( g# y. K% M% B* i. }2 j8 j
osd.70: osd_recovery_op_priority = '10' (unchangeable)
8 a, F6 B  k1 q: Oosd.71: osd_recovery_op_priority = '10' (unchangeable)
/ I& ]6 q; U, E0 yosd.72: osd_recovery_op_priority = '10' (unchangeable) , [. j: Y3 n7 {! r/ [( S6 ]
osd.73: osd_recovery_op_priority = '10' (unchangeable) 7 ^+ o( Z; d8 Q! }, I2 {
osd.74: osd_recovery_op_priority = '10' (unchangeable)
, ?, i9 p" ]2 l/ c6 c0 s3 Bosd.75: osd_recovery_op_priority = '10' (unchangeable) & A/ w6 H5 g* A' i
osd.76: osd_recovery_op_priority = '10' (unchangeable)
: }" w0 L( V/ C( S/ Xosd.77: osd_recovery_op_priority = '10' (unchangeable) ' {9 `4 E/ q+ X- }) y- g
osd.78: osd_recovery_op_priority = '10' (unchangeable) 0 ~7 {: Z0 Y3 d/ l6 J( x
osd.79: osd_recovery_op_priority = '10' (unchangeable) 1 E3 j: `% k0 F9 A
osd.80: osd_recovery_op_priority = '10' (unchangeable)
, A- O6 o6 W" Q6 g" \5 ~; Losd.81: osd_recovery_op_priority = '10' (unchangeable)
( e" e! ^- k/ y, N( j$ E# ]( _osd.82: osd_recovery_op_priority = '10' (unchangeable) " O$ r! `8 N: S" v$ H
osd.83: osd_recovery_op_priority = '10' (unchangeable)
. @3 X' w! |4 q" `9 |5 tosd.84: osd_recovery_op_priority = '10' (unchangeable) ( p$ W/ V2 |' F9 ?- S/ k  Y
osd.85: osd_recovery_op_priority = '10' (unchangeable) + ]0 e  M" b3 |8 U. y% M8 g
osd.86: osd_recovery_op_priority = '10' (unchangeable) ; x9 d$ i* h! p3 b9 I+ ^
osd.87: osd_recovery_op_priority = '10' (unchangeable) # {! Z* Z5 U% A8 u
osd.88: osd_recovery_op_priority = '10' (unchangeable)   f, N$ R5 X! e3 d' N
osd.89: osd_recovery_op_priority = '10' (unchangeable)
8 a; C: d1 l- \+ u! R0 V* Xosd.90: osd_recovery_op_priority = '10' (unchangeable) - u( y, q$ ?! i
osd.91: osd_recovery_op_priority = '10' (unchangeable) 0 M8 ]" V% Z8 m- X
osd.92: osd_recovery_op_priority = '10' (unchangeable)
9 P# W) f) T- F2 c! a) Qosd.93: osd_recovery_op_priority = '10' (unchangeable)
4 p3 r* j8 U1 y' T( _6 W! H" q& i. Uosd.94: osd_recovery_op_priority = '10' (unchangeable) 8 G8 C; q- G( U5 W
osd.95: osd_recovery_op_priority = '10' (unchangeable) 8 Q* r! K  c  i8 C1 S6 P
osd.96: osd_recovery_op_priority = '10' (unchangeable) 5 T3 x0 A+ F: z3 e$ j+ I/ D
osd.97: osd_recovery_op_priority = '10' (unchangeable)
( Q- t4 ]+ {9 ^  _/ y7 josd.98: osd_recovery_op_priority = '10' (unchangeable) 1 k% R# S# m2 X) i
osd.99: osd_recovery_op_priority = '10' (unchangeable) : Z( E. @2 P6 T& a4 {" }
osd.100: osd_recovery_op_priority = '10' (unchangeable) 8 t2 g) d, z$ D! {
osd.101: osd_recovery_op_priority = '10' (unchangeable) ' K' s+ v; l" x# v2 _
osd.102: osd_recovery_op_priority = '10' (unchangeable) 5 {+ I2 _8 r, ?# B. b
osd.103: osd_recovery_op_priority = '10' (unchangeable)
$ W) o7 [* N5 ^5 }/ mosd.104: osd_recovery_op_priority = '10' (unchangeable)
) ]% s3 ?2 S: u/ sosd.105: osd_recovery_op_priority = '10' (unchangeable)
* ~4 f. }6 ~1 S% cosd.106: osd_recovery_op_priority = '10' (unchangeable)
% o% l0 S( S* x6 u$ ?) [osd.107: osd_recovery_op_priority = '10' (unchangeable) ' H& R. q6 `( E
osd.108: osd_recovery_op_priority = '10' (unchangeable) 7 j- p9 \8 K" X1 j
osd.109: osd_recovery_op_priority = '10' (unchangeable) $ ]9 ~% c6 U2 C  }
osd.110: osd_recovery_op_priority = '10' (unchangeable)
9 V# e6 B: P/ \# W: T6 ^osd.111: osd_recovery_op_priority = '10' (unchangeable)
# @; t& X& F, o2 z6 A: Yosd.112: osd_recovery_op_priority = '10' (unchangeable) ! k! Q5 Q! r$ y) A' b9 K2 {
osd.113: osd_recovery_op_priority = '10' (unchangeable) ( {/ Y& C, J. O2 r8 n- g0 b
osd.114: osd_recovery_op_priority = '10' (unchangeable) 6 P7 R' f0 _8 h
osd.115: osd_recovery_op_priority = '10' (unchangeable) 7 M, c1 n$ F) U" w8 W0 r
osd.116: osd_recovery_op_priority = '10' (unchangeable) + l( I+ h+ T1 ~' z' M% B* W: Z
osd.117: osd_recovery_op_priority = '10' (unchangeable)
: d6 P" a1 I" v$ c4 ]osd.118: osd_recovery_op_priority = '10' (unchangeable)
4 V9 W: ?! k, Eosd.119: osd_recovery_op_priority = '10' (unchangeable)
  v0 P) p& p8 q1 v$ l; Aosd.120: osd_recovery_op_priority = '10' (unchangeable)
; z9 E7 ?1 {" a0 Nosd.121: osd_recovery_op_priority = '10' (unchangeable)
: o$ ?; ?& Z% W9 a% [osd.122: osd_recovery_op_priority = '10' (unchangeable)
% ^. g& w+ J5 ?9 ]# Posd.123: osd_recovery_op_priority = '10' (unchangeable) 6 W# _! I1 k. }' t) A8 i4 T
Error ENXIO: problem getting command descriptions from osd.1247 L$ w3 L2 o) y! V- u, l
osd.124: problem getting command descriptions from osd.124$ r9 u' h8 @- x. |( I" C
osd.125: osd_recovery_op_priority = '10' (unchangeable)
8 R* Z" c( E2 O# f3 bosd.126: osd_recovery_op_priority = '10' (unchangeable)
; ~1 x1 f, V; I! ?) r" @Error ENXIO: problem getting command descriptions from osd.127
! q1 T6 O" f& _5 v& \2 D) E1 qosd.127: problem getting command descriptions from osd.127# `4 m  O1 c- D! M$ o7 \: Z" ?
osd.128: osd_recovery_op_priority = '10' (unchangeable) * o0 u) C+ V+ j2 l/ B$ O% X
osd.129: osd_recovery_op_priority = '10' (unchangeable) ; w4 M  V! ^" }$ b( h8 a
osd.130: osd_recovery_op_priority = '10' (unchangeable) ! }0 X4 g. P- o/ \& [8 F
You have new mail in /var/spool/mail/root7 S7 Y9 o% ?' T! ]

/ y" p4 x) Z  g+ y# y所有的osd都修改：3 S6 ?7 x) V' {, B2 S2 y

# ?- z1 Q1 H; L3 {  I# c8 Y执行过ceph pg repair pg-id
) _) q6 g$ [& L
2 o5 U- V) L, ^6 }& R* [. e8 R+ D; }" ^; N$ S5 i9 o- n( H+ L
状态出现修改过程：4 z0 U! R6 v3 K* ]  \
[root compute1 ~]# ceph s0 z0 v$ x5 P& N( h
    cluster 70d27aec742e4a95b000-cf37ebba35d0
) n. ]3 L7 {8 v% c     health HEALTH_ERR
5 r: f5 A# Z9 D7 y2 f            1 pgs inconsistent
$ d- ^8 _+ I) C6 i8 g& J8 R            1 pgs repair
! n5 D0 a0 ]$ _4 ]9 L( ]            1 scrub errors* u' f8 m$ ~# q: f
     monmap e3: 3 mons at {compute1=176.12.132.5:6789/0,compute2=176.12.132.6:6789/0,compute3=176.12.132.7:6789/0}
6 w: E3 ?, ?- e7 s8 q+ z4 I6 s            election epoch 332, quorum 0,1,2 compute1,compute2,compute3- y7 L1 U! ~! q
     osdmap e26725: 131 osds: 128 up, 128 in7 G1 @# c  p. b: O( X% ?7 O) |- I
            flags sortbitwise,require_jewel_osds
( f3 |6 l( N1 h* @6 ?* a      pgmap v169370679: 10240 pgs, 1 pools, 103 TB data, 27242 kobjects4 D8 {" o" S, `& M5 P
            309 TB used, 155 TB / 465 TB avail; G* D/ `' R0 z9 F2 e
               10229 active+clean
: J1 {- A: V& e5 ]4 ~                   9 active+clean+scrubbing+deep
; r2 J1 j' D: L4 [8 u                   1 active+clean+scrubbing: p% \: ^- s; a6 N- ~1 w
                   1 active+clean+scrubbing+deep+inconsistent+repair
& W$ [7 d. n$ ~" }/ l  client io 91086 kB/s rd, 67615 kB/s wr, 3119 op/s rd, 3569 op/s wr
) F% b9 C+ E+ ~, H[root compute1 ~]# ceph s! k! A# k. C! V3 `
    cluster 70d27aec742e4a95b000-cf37ebba35d08 G3 j+ B. S# C  e
     health HEALTH_ERR
1 z1 P# T+ W$ e( |& n- Z4 E            1 pgs inconsistent( l; h1 Q% N& V# X/ o2 A
            1 pgs repair( l. M* ]  z3 }
            1 scrub errors
0 K% L, V- J. S  |     monmap e3: 3 mons at {compute1=176.12.132.5:6789/0,compute2=176.12.132.6:6789/0,compute3=176.12.132.7:6789/0}
& }: o0 v( [' E( f) p) }            election epoch 332, quorum 0,1,2 compute1,compute2,compute3: ^) q- x5 i' W! E# z3 b
     osdmap e26725: 131 osds: 128 up, 128 in
$ [; X7 Q7 G6 A8 y- l            flags sortbitwise,require_jewel_osds2 U: u  E7 v) k: h, v4 L, w
      pgmap v169370681: 10240 pgs, 1 pools, 103 TB data, 27242 kobjects
0 [; q6 C; ~3 T' p0 w            309 TB used, 155 TB / 465 TB avail
  z/ W2 h7 Q% N: P! D/ w               10230 active+clean
* B! u$ ?- y' T1 _3 h7 l- N                   8 active+clean+scrubbing+deep+ _# h4 ~% k6 |% g
                   1 active+clean+scrubbing9 ^  a4 \% O/ D" k
                   1 active+clean+scrubbing+deep+inconsistent+repair
3 _. e2 `  C0 i6 ?# n0 ]. r  client io 104 MB/s rd, 67033 kB/s wr, 3479 op/s rd, 5013 op/s wr
6 p1 B# i& u/ L4 F[root compute1 ~]# ceph s
# k% X/ g' G6 w6 }4 t5 q$ H    cluster 70d27aec742e4a95b000-cf37ebba35d09 K1 A1 G$ A- T8 P" i' X! {
     health HEALTH_ERR! Y* O! C/ r0 `2 R
            1 pgs inconsistent
/ n4 x, j2 i5 [            1 pgs repair/ W2 }3 Q/ k  o, o, p/ _0 X
            1 scrub errors  o2 C9 K' h9 }6 H; h' P" I
     monmap e3: 3 mons at {compute1=176.12.132.5:6789/0,compute2=176.12.132.6:6789/0,compute3=176.12.132.7:6789/0}! q$ ~, h* V2 `- w  r) [
            election epoch 332, quorum 0,1,2 compute1,compute2,compute3
% G% S( p" Q; b( A$ h5 ^     osdmap e26725: 131 osds: 128 up, 128 in& s; D  P& v$ z$ D
            flags sortbitwise,require_jewel_osds
2 u, J; W) P3 m% U' D6 U7 ~      pgmap v169370783: 10240 pgs, 1 pools, 103 TB data, 27242 kobjects# }* z) a; m; Z* Y# `7 n5 Y, {
            309 TB used, 155 TB / 465 TB avail
. w) ?+ l- {9 g" _* W  `3 k               10232 active+clean
- n, @/ W" ^6 w9 I$ ]8 K, s                   6 active+clean+scrubbing+deep
: _4 _+ m* G2 m* j                   1 active+clean+scrubbing! A+ J4 s  |2 Y1 t) d! D
                   1 active+clean+scrubbing+deep+inconsistent+repair5 C  @0 e2 ~; i
  client io 147 MB/s rd, 57692 kB/s wr, 4584 op/s rd, 5944 op/s wr7 Y& g" z. k) D! T8 _3 ]. Q
You have mail in /var/spool/mail/root
) s2 o1 T; p! i7 ^3 P[root compute1 ~]# ceph s
2 ?; g. o6 k5 X$ _    cluster 70d27aec742e4a95b000-cf37ebba35d0
) G! _2 w' j# ?  H! S' ~! r     health HEALTH_ERR
; a' v8 O9 R8 q' C% Z9 S6 K            1 pgs inconsistent
, ~; f& e2 Z- r- M- U            1 pgs repair
9 y- k# g2 H4 n( J" R1 v9 P1 Z( [            1 scrub errors
% I# \7 _( q# o! H) w     monmap e3: 3 mons at {compute1=176.12.132.5:6789/0,compute2=176.12.132.6:6789/0,compute3=176.12.132.7:6789/0}
+ z+ m3 Y( n6 D: ]$ Z  W  s            election epoch 332, quorum 0,1,2 compute1,compute2,compute3
" H  a# }+ F, f% \0 E5 C     osdmap e26725: 131 osds: 128 up, 128 in- w2 [" T! g- f7 v+ D5 G$ j3 X
            flags sortbitwise,require_jewel_osds
0 X9 N4 c+ L) h) F& P! [. j      pgmap v169370785: 10240 pgs, 1 pools, 103 TB data, 27242 kobjects
% H1 k, T3 y. l/ C! J; \            309 TB used, 155 TB / 465 TB avail: x( E  r$ ?) Q# e8 Y2 P) Y
               10232 active+clean# A7 {* K4 B3 g/ C9 \9 f
                   6 active+clean+scrubbing+deep
/ ?2 L1 V0 l! Z0 [6 n9 ]                   1 active+clean+scrubbing2 ^" p0 l( M: X. y
                   1 active+clean+scrubbing+deep+inconsistent+repair
5 v2 g# o, |5 U) ~  client io 104 MB/s rd, 49581 kB/s wr, 2830 op/s rd, 3282 op/s wr
  ~0 g+ l$ _' P' q4 j( p: w9 [[root compute1 ~]# ceph s
) G$ p* A5 ?' |- n6 I3 _    cluster 70d27aec742e4a95b000-cf37ebba35d01 u# Q# O6 k3 a- P' z( }% U3 h
     health HEALTH_ERR
9 A$ |5 ]' J* M' Z/ a9 A3 Q0 \8 g+ k+ b            1 pgs inconsistent6 |$ H4 L1 w) w6 j5 H$ @- U1 p
            1 pgs repair0 R1 L1 T  w6 B
            1 scrub errors8 U6 W( L! {0 b4 w
     monmap e3: 3 mons at {compute1=176.12.132.5:6789/0,compute2=176.12.132.6:6789/0,compute3=176.12.132.7:6789/0}
, R- h0 Z$ R$ L( M) Y! _            election epoch 332, quorum 0,1,2 compute1,compute2,compute38 T/ _. K6 e! J' d+ H" Y' Q* A
     osdmap e26725: 131 osds: 128 up, 128 in
) \: h) Z0 U) p$ l  w            flags sortbitwise,require_jewel_osds
7 R2 N7 n, e) O9 w/ n      pgmap v169370786: 10240 pgs, 1 pools, 103 TB data, 27242 kobjects
( b# G( o& d% ]% Y  O+ l            309 TB used, 155 TB / 465 TB avail1 q( G, M* F2 X# y* }+ s
               10232 active+clean
0 X, V2 ]. N/ F3 z                   6 active+clean+scrubbing+deep6 X( t& l9 f/ Z7 P5 b. s
                   1 active+clean+scrubbing% M2 M6 C- P' Z8 {; c5 i7 w/ C0 {
                   1 active+clean+scrubbing+deep+inconsistent+repair( p( z+ s# X$ P2 R, i9 m# ^$ R
  client io 95762 kB/s rd, 44372 kB/s wr, 2258 op/s rd, 2660 op/s wr
9 p/ Z( L  |3 G5 |/ Q" a- c/ y# y: K4 Y: A: Q* F/ p: m  O
- P/ j/ b* i- t4 h$ X* q
[root compute1 ~]# ceph daemon osd.0 config show |egrep "osd_recovery_max_active|osd_recovery_op_priority|osd_max_backfills"
7 E2 R* Q9 M) K    "osd_max_backfills": "1",, u0 X) ?5 c! o& z; F3 @
    "osd_recovery_max_active": "1",
) d4 `/ P" k! |' p    "osd_recovery_op_priority": "10",
* G7 a1 q5 r8 T7 C; J4 v: E; A3 X[root compute1 ~]# ceph daemon osd.0 config show |egrep "osd_recovery_max_active|osd_recovery_op_priority|osd_max_backfills" 9 c0 y! L" p5 B
    "osd_max_backfills": "1",
. I3 y/ w/ G5 f2 O8 s0 |    "osd_recovery_max_active": "1",  i" k$ z/ j1 x0 Z4 {& S8 c& J
    "osd_recovery_op_priority": "10",
7 \- ]) y) I7 r( u[root compute1 ~]# ceph s# O/ h9 J) y/ `# h9 U  t  ^/ }
    cluster 70d27aec742e4a95b000-cf37ebba35d0" h, q& f0 T$ h- ?2 p# i" q
     health HEALTH_ERR% E8 P8 P4 Z+ K7 J
            1 pgs inconsistent+ ?  S1 X! }5 u
            1 pgs repair0 g8 y, u$ h! u: ^& ~8 z8 t9 a
            1 scrub errors; E% z" Y& j( V9 J$ y
     monmap e3: 3 mons at {compute1=176.12.132.5:6789/0,compute2=176.12.132.6:6789/0,compute3=176.12.132.7:6789/0}
) K4 s( |/ v/ Y; K            election epoch 332, quorum 0,1,2 compute1,compute2,compute3
  ?1 ~, S( s$ ~1 v2 L' I1 p3 |  r) y     osdmap e26725: 131 osds: 128 up, 128 in5 O8 x. `2 x. t
            flags sortbitwise,require_jewel_osds
: U" K4 b. c: ~# U$ _0 g( Y      pgmap v169370799: 10240 pgs, 1 pools, 103 TB data, 27242 kobjects% J3 j5 L# I  w0 s& _
            309 TB used, 155 TB / 465 TB avail
" ]( r* E4 Q% a+ b0 p               10232 active+clean0 {5 N0 |$ l0 d. P
                   6 active+clean+scrubbing+deep
- B' M. A% g% c" h+ U( I6 N7 X  n                   1 active+clean+scrubbing
  u: `+ U+ F8 F0 B& ?! x                   1 active+clean+scrubbing+deep+inconsistent+repair
9 _0 B% b( }& m4 U, _# q  client io 134 MB/s rd, 117 MB/s wr, 3865 op/s rd, 4949 op/s wr0 M2 B& ?5 A  Y. ?! M
5 Q; m: ?# f3 Z6 x% D
& X% g1 Y6 N4 v# J/ K
[root compute1 ~]# ceph daemon osd.0 config show |egrep "osd_recovery_max_active|osd_recovery_op_priority|osd_max_backfills" " \9 b# q: ?8 {+ [! x
    "osd_max_backfills": "1",7 B. T  p: @# ]$ Z( H: s
    "osd_recovery_max_active": "1",
" Q% ?2 ~$ q9 X    "osd_recovery_op_priority": "10",* e# D! t# k, y
# m) K1 {) h8 ]
1 d  R  x0 p. Z4 y- Z5 M5 L+ x$ T

  ^+ K# {) [6 [) K) y; L# l+ m[root compute1 ~]# ceph s
% i% Y) p' J- Z9 X. m: F    cluster 70d27aec742e4a95b000-cf37ebba35d08 h4 u2 }; y! c- r2 W
     health HEALTH_OK
1 O2 O/ \0 ?/ K  c! O/ H3 |     monmap e3: 3 mons at {compute1=176.12.132.5:6789/0,compute2=176.12.132.6:6789/0,compute3=176.12.132.7:6789/0}8 K& Q& @- ~: s: d% I" q
            election epoch 332, quorum 0,1,2 compute1,compute2,compute33 ]( M7 s, ~; b1 F6 \1 j! i
     osdmap e26725: 131 osds: 128 up, 128 in$ j* F% O/ D- ]& E: V" K" h
            flags sortbitwise,require_jewel_osds& y+ ^0 b' U) b6 b- O
      pgmap v169370916: 10240 pgs, 1 pools, 103 TB data, 27242 kobjects
2 S5 A. \8 M% r& |            309 TB used, 155 TB / 465 TB avail1 I4 S0 e# P2 @: I' ]" x
               10233 active+clean( Z2 o" Q0 k7 T; q) t: J# N
                   6 active+clean+scrubbing+deep
' R2 v& e2 p1 d) F9 H                   1 active+clean+scrubbing+ y/ `8 R5 J" ~: t7 j3 S
  client io 195 MB/s rd, 234 MB/s wr, 4404 op/s rd, 5993 op/s wr
; f' Y, c1 Y4 u- R6 V5 E) }You have mail in /var/spool/mail/root' {  z7 G5 h6 p. Q

, ^# }, D- l% n9 a3 s" u  B[root compute1 ~]# ceph s) H! \- }. M/ V5 X
    cluster 70d27aec742e4a95b000-cf37ebba35d0
# x3 z1 ?% M7 m- r7 N/ G, y     health HEALTH_OK) v9 |9 Q; [2 D9 J3 O" [2 f* O
     monmap e3: 3 mons at {compute1=176.12.132.5:6789/0,compute2=176.12.132.6:6789/0,compute3=176.12.132.7:6789/0}* H1 p& K1 I  @4 j$ @$ Z
            election epoch 332, quorum 0,1,2 compute1,compute2,compute3
0 {; w/ A6 z1 x9 C- `' q     osdmap e26725: 131 osds: 128 up, 128 in
; q2 D0 P0 S# s            flags sortbitwise,require_jewel_osds
5 @4 ^, C6 d4 x  g" z      pgmap v169370921: 10240 pgs, 1 pools, 103 TB data, 27242 kobjects- N" h" D3 _2 z' [* Q. T5 i
            309 TB used, 155 TB / 465 TB avail- j. Q. V9 @; y* _: k( z
               10233 active+clean  `+ O& u5 J& _$ R: c/ q
                   6 active+clean+scrubbing+deep
% V1 y; f" B* G5 V0 k                   1 active+clean+scrubbing0 _" d* [3 L7 @3 o8 l
  client io 257 MB/s rd, 358 MB/s wr, 5025 op/s rd, 6587 op/s wr- r& y, x, A. |# {9 S$ s. i# u& L
" |9 Q, [# G; r0 `+ q
恢复正常：
& _- }1 z. A* r, _2 q2 L! C[root compute1 ~]# ceph s
: v+ d: U+ }& g/ j0 o- r2 _( V( b4 ]    cluster 70d27aec742e4a95b000-cf37ebba35d0
% J4 X: k9 X# Q; S1 T7 K; [& N1 t     health HEALTH_OK8 O3 c/ p! D; _1 D- V- }" B0 y7 e4 G
     monmap e3: 3 mons at {compute1=176.12.132.5:6789/0,compute2=176.12.132.6:6789/0,compute3=176.12.132.7:6789/0}2 j  W7 |- ?# \
            election epoch 332, quorum 0,1,2 compute1,compute2,compute3
3 |" j: C0 i. Q0 m8 g5 E     osdmap e26725: 131 osds: 128 up, 128 in
0 n8 j# |  f3 n7 w            flags sortbitwise,require_jewel_osds$ d2 }5 A" u0 z4 f" a4 c/ G
      pgmap v169370922: 10240 pgs, 1 pools, 103 TB data, 27242 kobjects% I% K  Z4 P6 s0 x) U# P6 o8 Y' K
            309 TB used, 155 TB / 465 TB avail1 ~$ H+ ~' N7 [# a% k- U3 U% q
               10233 active+clean" _0 }) g$ F: |0 |  L0 G
                   6 active+clean+scrubbing+deep
( g" S9 C( S" y0 Z# }! u                   1 active+clean+scrubbing7 M0 b! e7 v% v; @8 ?
  client io 254 MB/s rd, 390 MB/s wr, 5522 op/s rd, 6826 op/s wr
1 b. t6 S; w$ A- r% L: i
. u: f" y. b3 S2 R- N( a. @8 Y9 y) U8 W. h9 }) p0 f6 [
回复

举报

返回列表 发新帖
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

本版积分规则

返回首页|Archiver|手机版|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )

GMT+8, 2026-6-12 00:09 , Processed in 0.020824 second(s), 23 queries .

Powered by Discuz! X5.0

© 2001-2026 Discuz! Team.

快速回复 返回顶部 返回列表