[WRN] PG_DEGRADED: Degraded data redundancy: 64 pgs undersized

admin

   [WRN] PG_DEGRADED: Degraded data redundancy: 64 pgs undersized

; d/ k* ?' y3 x2 H2 n+ vhealth: HEALTH_WARN  too many PGs per OSD (342 > max 250)
; ]+ h2 Z$ e7 y3 m0 w/ G

' l4 K: _! _, S0 ^) E1 {# }* {7 w' y& {ceph --admin-daemon /var/run/ceph/4c1f752a-ed1a-11eb-8ce5-0025908471d6/ceph-mon.controller.asok config get mon_max_pg_per_osd
9 m( Q6 Z# J& ]1 c5 {# i{
9 ~1 R: h( @2 X    "mon_max_pg_per_osd": "1000"
1 {8 [8 m, [& s. P# \}
7 t& O5 _3 q# P$ w" \
ceph --admin-daemon /var/run/ceph/4c1f752a-ed1a-11eb-8ce5-0025908471d6/ceph-osd.0.asok config get osd_max_pg_per_osd_hard_ratio
( y7 j" S- f7 g{
9 O- \7 x7 @0 x% h    "osd_max_pg_per_osd_hard_ratio": "3.000000"
7 X3 @/ S/ O! e5 A1 @7 b1 a}

调整pg数即可。
1 }; l: `' C# _$ [1 p8 s4 ?2 D# s

admin

[global]

mon_max_pg_per_osd = 800                              # < depends on you amount of PGs
osd_max_pg_per_osd_hard_ratio = 10                # < default is 2, try to set at least 5. It will be
mon_allow_pool_delete = true                           # without it you can't remove a pool

admin

osd_max_pg_per_osd_hard_ratio = 10

admin

[root@controller ~]# ceph health detail
9 i3 W" G# h$ s# J% wHEALTH_WARN Degraded data redundancy: 64 pgs undersized
[WRN] PG_DEGRADED: Degraded data redundancy: 64 pgs undersized
    pg 9.d is stuck undersized for 115s, current state active+undersized, last acting [2,1]
; M0 q: w. x% d# G    pg 9.e is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.f is stuck undersized for 115s, current state active+undersized, last acting [2,1]
' K/ a$ S6 K5 e4 A. Z2 d) k3 ^# B    pg 9.10 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
! M6 |$ q- v2 K$ ?; f$ i, E0 Z" }    pg 9.11 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.12 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
4 r+ s' i6 I3 N* Y    pg 9.13 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.14 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.15 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.16 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
& l2 z- d/ M6 [  Z# m# J    pg 9.17 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
0 H0 ]) e* Q( n' {    pg 9.18 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.19 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.1a is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.1b is stuck undersized for 115s, current state active+undersized, last acting [0,2]
8 ^! x# D+ {5 R. f+ K) Z& |    pg 9.1c is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.1d is stuck undersized for 115s, current state active+undersized, last acting [0,2]
4 m+ N; |0 m4 a- d" u    pg 9.1e is stuck undersized for 115s, current state active+undersized, last acting [0,2]
  U9 ^* f, g# _- f& [+ w1 Z    pg 9.1f is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.20 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
( N& L2 H  }+ g/ E    pg 9.21 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
2 O0 h" s0 Y: m! V) T$ ~! @2 E' q    pg 9.22 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
7 _5 G/ D, s, x# o' u% _* E    pg 9.23 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.24 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.25 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
: v" O6 \+ U! U) t4 Z    pg 9.26 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
& R: W* f1 f3 v6 Z4 \    pg 9.27 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.28 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.29 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.2a is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.2b is stuck undersized for 115s, current state active+undersized, last acting [2,0]
1 U4 [( u- D- a  c4 ^" t! G    pg 9.2c is stuck undersized for 115s, current state active+undersized, last acting [1,2]
! E, b+ y( V$ ]5 e7 ~3 r    pg 9.2d is stuck undersized for 115s, current state active+undersized, last acting [0,2]
1 ?! l/ }7 k% t/ f- u6 i  {    pg 9.2e is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.2f is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.30 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
5 g- w+ _" @% [5 \* e' r* l7 Y    pg 9.31 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
' S( x4 [: d2 f6 h. S3 M    pg 9.32 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
9 ?9 q/ G8 N5 J8 J# Y* r  V4 N5 s1 z    pg 9.33 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.34 is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.35 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
    pg 9.36 is stuck undersized for 115s, current state active+undersized, last acting [1,2]
4 i% X# l+ _" b) i    pg 9.37 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
8 c, u( J7 f& j' T4 N7 @4 S    pg 9.38 is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.39 is stuck undersized for 115s, current state active+undersized, last acting [2,0]
    pg 9.3a is stuck undersized for 115s, current state active+undersized, last acting [0,2]
    pg 9.3b is stuck undersized for 115s, current state active+undersized, last acting [1,2]
  X' p7 i; r$ i! H  F+ P; V, m7 ~    pg 9.3c is stuck undersized for 115s, current state active+undersized, last acting [2,0]
+ c# m3 J5 {3 w1 `! t    pg 9.3d is stuck undersized for 115s, current state active+undersized, last acting [2,1]
    pg 9.3e is stuck undersized for 115s, current state active+undersized, last acting [1,2]
: p( y, p+ Z, H! `4 t& N+ b6 p& b    pg 9.3f is stuck undersized for 115s, current state active+undersized, last acting [1,2]
: r& `" O  E3 i; r/ L[root@controller ~]# ceph pg dump |grep remapped
, S! s" x7 P- X8 e: H' N: Z* U3 ^: f# Cdumped all
[root@controller ~]# ceph osd pool ls
images
- t, r+ a  y- _: c6 X. w[root@controller ~]# ceph osd pool ls detail
2 b. w* `0 c4 ^0 o% W/ e7 }5 I3 Bpool 9 'images' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode on last_change 7458 flags hashpspool stripe_width 0 application rbd

总结：

原因大致可以定位为是副本数设置有问题，因为本环境就两台设备，副本数size设置为3，导致同步失败。根据设备数设置相应的副本数，否者就会报此类错误。