ceph health clock skew detected

admin

MON_CLOCK_SKEW: clock skew detected on mon.ch-mon-1, mon.ch-mon-2
/ L- M* u2 }$ Z* L1 q8 z+ n2 bceph -s                                                                       Fri Sep 28 13:57:25 2018
  cluster:
    id:     e6d7621d-4b97-4791-9d9b-92829a6f3044
/ i2 I9 K. _2 X& w) }6 U0 K7 y    health: HEALTH_WARN
            clock skew detected on mon.ch-mon-1, mon.ch-mon-2
6 |7 }- @8 b, Q# s  services:
! i  ^  A! n( }  T! ?    mon: 7 daemons, quorum ch-osd-1,ch-osd-2,ch-osd-3,ch-osd-4,ch-mon-1,ch-mon-2,ch-mon-3
    mgr: ch-mon-1(active)
/ B8 D" {/ @! D, [( @( H    osd: 12 osds: 12 up, 12 in
  data:
# J: ^7 D2 V6 U, t: u2 _) D: w    pools:   0 pools, 0 pgs
    objects: 0 objects, 0B
: v) p- j, v9 \- D, M+ L. ^    usage:   12.1GiB used, 1.16TiB / 1.17TiB avail
; T' w7 O: I3 e. m    pgs:
; Q4 v% ^5 }% \# b

admin

ceph health detail
5 b( r( B3 s; VHEALTH_WARN clock skew detected on mon.ceph2, mon.ceph3, mon.ceph4
MON_CLOCK_SKEW clock skew detected on mon.ceph2, mon.ceph3, mon.ceph4
    mon.ceph2 addr 192.168.90.86:6789/0 clock skew 0.0630122s > max 0.05s (latency 0.00304483s)
    mon.ceph3 addr 192.168.90.87:6789/0 clock skew 0.076804s > max 0.05s (latency 0.00364158s)
) Q/ [+ o. {- e# ]$ T$ D    mon.ceph4 addr 192.168.90.88:6789/0 clock skew 0.115598s > max 0.05s (latency 0.00468623s)
1 R* P2 U0 F) Z

解决办法是：
" L( P# x, n  U6 T3 Y3 u* Z停掉服务ntp
# systemctl stop ntpd.service
" f. W  p- q9 ?9 n; m4 @同步时间：
% h% t1 ^/ f* q1 B* b' m  H1 E+ y) n ntpdate -u 192.168.90.85
! C4 |) c: I; }& H" C$ ?29 Sep 15:32:31 ntpdate[4396]: adjust time server 192.168.90.85 offset 0.034117 sec
启动ntpd服务
systemctl start ntpd.service
" [- s6 R* H& Z
ceph health detail
+ Q8 i' }, Z. C2 ]HEALTH_WARN clock skew detected on mon.ceph3, mon.ceph4
2 \3 K3 `  U! @! t1 n3 JMON_CLOCK_SKEW clock skew detected on mon.ceph3, mon.ceph4
* d5 L* Q" X2 s! V( r/ W    mon.ceph3 addr 192.168.90.87:6789/0 clock skew 0.0640733s > max 0.05s (latency 0.00336378s)
1 U7 ]' g$ _; M- T% h    mon.ceph4 addr 192.168.90.88:6789/0 clock skew 0.115242s > max 0.05s (latency 0.00423552s)

admin

systemctl restart ceph-mon.target
如果还是出现这样的问题，重启下ceph的mon服务
ceph health detail
. f: B0 |! U: C! l8 m, V0 ]5 f5 rHEALTH_OK
[root@ceph1 ~]# ceph -s
  cluster:
    id:     9b8bcc5e-a0cf-4617-9e14-78acaf79e690
# I8 V6 w- K2 N# r5 t    health: HEALTH_OK
8 V$ K# m8 u, p2 ^) {4 ]
1 e5 v% B3 I4 d7 e4 R  services:
    mon: 4 daemons, quorum ceph1,ceph2,ceph3,ceph4
" j2 W; ^9 |  T& E3 M    mgr: ceph1(active), standbys: ceph4, ceph2, ceph3
    osd: 8 osds: 8 up, 8 in
' G8 w8 r( `- i) f( M# y, G
2 i' n9 n1 I. `/ L  data:
    pools:   5 pools, 448 pgs
5 F1 ]: a4 t) Y    objects: 0 objects, 0B
5 t- l" U5 w/ U2 d8 b! I3 E    usage:   876MiB used, 799GiB / 800GiB avail
    pgs:     448 active+clean


然后再启动ntpd
3 m/ D7 V' u4 X* f( L" Bsystemctl start ntpd.service
1 ]) U0 f8 ?* G