[WRN] PG_DEGRADED: Degraded data redundancy: 64 pgs undersized

admin

   [WRN] PG_DEGRADED: Degraded data redundancy: 64 pgs undersized

health: HEALTH_WARN  too many PGs per OSD (342 > max 250)


ceph --admin-daemon /var/run/ceph/4c1f752a-ed1a-11eb-8ce5-0025908471d6/ceph-mon.controller.asok config get mon_max_pg_per_osd
7 e6 c/ l# s$ y0 I# A8 f' w  J{
    "mon_max_pg_per_osd": "1000"
}

ceph --admin-daemon /var/run/ceph/4c1f752a-ed1a-11eb-8ce5-0025908471d6/ceph-osd.0.asok config get osd_max_pg_per_osd_hard_ratio
- E+ r- X& V) u# ^7 t{
    "osd_max_pg_per_osd_hard_ratio": "3.000000"
}

. u9 @! n7 r3 I调整pg数即可。
% o4 h7 [! V! b8 s, A& w; r
- E: U. w( j( y! x2 I1 G7 ?& w

admin

[global]

mon_max_pg_per_osd = 800                              # < depends on you amount of PGs
4 X; D) E; \! D5 X* losd_max_pg_per_osd_hard_ratio = 10                # < default is 2, try to set at least 5. It will be
mon_allow_pool_delete = true                           # without it you can't remove a pool

admin

osd_max_pg_per_osd_hard_ratio = 10

admin

[root@controller ~]# ceph health detail
+ V7 N$ u8 @! P: f% kHEALTH_WARN Degraded data redundancy: 64 pgs undersized
[WRN] PG_DEGRADED: Degraded data redundancy: 64 pgs undersized
    pg 9.d is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.e is stuck undersized for 115s, current state active+undersized, last acting [2,1]
0 R9 x6 V& a! O    pg 9.f is stuck undersized for 115s, current state active+undersized, last acting [2,1]
9 r  b+ X+ a  s& d' r8 o    pg 9.10 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
$ _$ K/ c; ]1 H/ @+ e2 `* C    pg 9.11 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
) @7 f' U0 q8 N! E- ^2 ^    pg 9.12 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
: F6 v; X6 F% T    pg 9.13 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
$ y& n* I* s) q1 C    pg 9.14 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
1 l3 j8 {  O- p* k- h5 j! |: L* G    pg 9.15 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
2 i( f+ [" ^5 ~5 c    pg 9.16 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.17 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
0 t! K  N1 C% g/ I5 T0 F    pg 9.18 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.19 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
1 L8 V4 l5 U8 I) u    pg 9.1a is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.1b is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.1c is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.1d is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.1e is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.1f is stuck undersized for 115s, current state active+undersized, last acting [1,2]
7 I% D$ u7 Q2 ?6 o4 v+ F    pg 9.20 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
$ }: M5 e. L7 C+ A. E. {    pg 9.21 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.22 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
( U" T7 p& J4 Z8 n/ T( G    pg 9.23 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.24 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
& P* `" w! j1 U/ t2 r" I8 {8 H    pg 9.25 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.26 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
4 S; {, k' q$ U5 V9 X4 M    pg 9.27 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.28 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.29 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
# U: [9 @# e$ G4 H) t    pg 9.2a is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.2b is stuck undersized for 115s, current state active+undersized, last acting [2,0]
5 y2 y' ?, x" F% X+ T: O. A$ g  l; P    pg 9.2c is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.2d is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.2e is stuck undersized for 115s, current state active+undersized, last acting [2,0]
2 ?# _/ J' i+ i% z% c; Q    pg 9.2f is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.30 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.31 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.32 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
6 }* }1 n0 A& d3 G1 q    pg 9.33 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.34 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.35 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.36 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.37 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.38 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.39 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.3a is stuck undersized for 115s, current state active+undersized, last acting [0,2]
0 s( V  |$ W1 v/ v    pg 9.3b is stuck undersized for 115s, current state active+undersized, last acting [1,2]
8 U& ^+ M% X# \. u. M    pg 9.3c is stuck undersized for 115s, current state active+undersized, last acting [2,0]
* J! ~/ a2 @1 f2 {    pg 9.3d is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.3e is stuck undersized for 115s, current state active+undersized, last acting [1,2]
7 E* x  r6 R/ u    pg 9.3f is stuck undersized for 115s, current state active+undersized, last acting [1,2]
[root@controller ~]# ceph pg dump |grep remapped
- Y: a5 E4 R3 W5 Y; ~dumped all
/ l. }# I: G- B; c[root@controller ~]# ceph osd pool ls
/ K5 c  t5 h9 x" ]! Oimages
. c# d, b2 ]0 n[root@controller ~]# ceph osd pool ls detail
- v0 {; P' a1 D$ T' n; Y& fpool 9 'images' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode on last_change 7458 flags hashpspool stripe_width 0 application rbd
% l& g) a) x7 n: F: o7 }
总结：
2 R* ~1 _5 L5 d! I5 ?! }
原因大致可以定位为是副本数设置有问题，因为本环境就两台设备，副本数size设置为3，导致同步失败。根据设备数设置相应的副本数，否者就会报此类错误。