[WRN] PG_DEGRADED: Degraded data redundancy: 64 pgs undersized

admin

   [WRN] PG_DEGRADED: Degraded data redundancy: 64 pgs undersized

health: HEALTH_WARN  too many PGs per OSD (342 > max 250)
, L: m3 D( [- W3 \5 {  _$ j

ceph --admin-daemon /var/run/ceph/4c1f752a-ed1a-11eb-8ce5-0025908471d6/ceph-mon.controller.asok config get mon_max_pg_per_osd
{
    "mon_max_pg_per_osd": "1000"
}
5 S& a  H. z0 D" n' D& h% M( l
ceph --admin-daemon /var/run/ceph/4c1f752a-ed1a-11eb-8ce5-0025908471d6/ceph-osd.0.asok config get osd_max_pg_per_osd_hard_ratio
{
9 V0 _% G3 ~6 |    "osd_max_pg_per_osd_hard_ratio": "3.000000"
% O5 A, O% ^3 o& Z/ K; \4 A, p}

8 K5 x7 U6 A- J) ^  S2 j调整pg数即可。

" w& m4 D+ e% t* s" _  e# y, K

admin

[global]

mon_max_pg_per_osd = 800                              # < depends on you amount of PGs
osd_max_pg_per_osd_hard_ratio = 10                # < default is 2, try to set at least 5. It will be
mon_allow_pool_delete = true                           # without it you can't remove a pool

admin

osd_max_pg_per_osd_hard_ratio = 10

admin

[root@controller ~]# ceph health detail
* R9 o. G4 w: n9 X) uHEALTH_WARN Degraded data redundancy: 64 pgs undersized
# |0 K  h5 g* G6 L: @1 r+ i[WRN] PG_DEGRADED: Degraded data redundancy: 64 pgs undersized
' _3 `; X& B: t5 _6 Y    pg 9.d is stuck undersized for 115s, current state active+undersized, last acting [2,1]
. c1 s, h- ~: @$ Q% R& n3 q* C    pg 9.e is stuck undersized for 115s, current state active+undersized, last acting [2,1]
+ N. |3 Y9 p; P" a2 T! u6 Q    pg 9.f is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.10 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.11 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
7 p/ {; S- C* N- ^    pg 9.12 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
! C" l! _2 ~/ N/ f% w. r. j, U    pg 9.13 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
: n# N$ b. g1 ~, B: c! g9 s/ W5 Q    pg 9.14 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.15 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.16 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
1 p7 k: C, m7 @) @( e5 Q  N    pg 9.17 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.18 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
( ^6 W1 i1 N& a1 e8 ^7 N    pg 9.19 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.1a is stuck undersized for 115s, current state active+undersized, last acting [1,2]
' R# P& o/ X. u1 S. j' `3 U    pg 9.1b is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.1c is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.1d is stuck undersized for 115s, current state active+undersized, last acting [0,2]
; k' f: {7 `  U7 J    pg 9.1e is stuck undersized for 115s, current state active+undersized, last acting [0,2]
4 L2 E) V! l, s7 m    pg 9.1f is stuck undersized for 115s, current state active+undersized, last acting [1,2]
) V: M/ L+ U$ l    pg 9.20 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
% x' |$ l5 ?/ M$ l    pg 9.21 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.22 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
) w& K; T3 U' }6 T" |2 u9 z9 v* Q: K    pg 9.23 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
) x% X. a; i  U  {( f2 R    pg 9.24 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.25 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.26 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
5 ?1 y, `6 Q* r# y    pg 9.27 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
% k0 e4 j; m, z3 X    pg 9.28 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.29 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.2a is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.2b is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.2c is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.2d is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.2e is stuck undersized for 115s, current state active+undersized, last acting [2,0]
! [0 q8 b. K- S1 Q, L    pg 9.2f is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.30 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.31 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
. a& B, K; I% Y+ F  B# b    pg 9.32 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
$ {3 h5 p+ q$ j4 S    pg 9.33 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
3 o! o2 B1 o9 Q. y, s    pg 9.34 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
) }% N9 E9 ?1 Y6 k0 y& j" \" x; |7 f    pg 9.35 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.36 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.37 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
- c" |3 d" ?" d5 a6 W( f    pg 9.38 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
3 X; B) A9 g( l& z2 d. q    pg 9.39 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.3a is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.3b is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.3c is stuck undersized for 115s, current state active+undersized, last acting [2,0]
! X3 h  X3 {9 ]4 K9 s# m, h+ ^    pg 9.3d is stuck undersized for 115s, current state active+undersized, last acting [2,1]
' d" I. c/ ?& `6 a    pg 9.3e is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.3f is stuck undersized for 115s, current state active+undersized, last acting [1,2]
[root@controller ~]# ceph pg dump |grep remapped
# t! w$ i( S% _9 p+ rdumped all
1 L2 h1 O8 x, d$ N[root@controller ~]# ceph osd pool ls
images
[root@controller ~]# ceph osd pool ls detail
5 \( c/ Z6 m! `+ ?5 Kpool 9 'images' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode on last_change 7458 flags hashpspool stripe_width 0 application rbd
- b! v- s: v$ m0 ?! m
总结：
$ @1 W  z' C9 @& E' P
原因大致可以定位为是副本数设置有问题，因为本环境就两台设备，副本数size设置为3，导致同步失败。根据设备数设置相应的副本数，否者就会报此类错误。