ceph 存储librbd: image has watchers - not removing Removing image: 0% complete...f

admin

# rbd ls -p rbd |grep bak
. d6 V3 |  j0 Y3 _5 s0 Wvolume-72615737-3638-4b84-82d1-e9fcaf717cb7-bak
- r/ X- X( K* U2 e0 Z; cvolume-727d6443-0586-4f36-bcd8-5c967eb49de3-bak2
* r( P: @) F% u6 O$ W1 Xvolume-8d78d08a-06ff-492f-a4f0-1bc66f425f04-bak
/ w9 h. g1 U" ]- A$ t% jvolume-cd4d3190-0d51-4e81-aa2d-4354868361f8-bak2
volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak
* o+ k) a. l, a: G2 a8 L. i3 D; EYou have mail in /var/spool/mail/root
# N' k9 Y! ?' [& m" e& F; S# rbd rm rbd/volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak
  ]# }5 g+ p( T+ F* a' b' }: {# Y  l2024-05-12 08:38:39.614826 7f822a362d80 -1 librbd: image has watchers - not removing
" \# N4 C- j: X; H; ARemoving image: 0% complete...failed.
rbd: error: image still has watchers
This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout.
# rbd unmap rbd/volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak
( |$ _* ?% G- W  O# K: qrbd: rbd/volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak@-: not a mapped image or snapshot
5 W( c! k- P* g' E3 Lrbd: unmap failed: (22) Invalid argument
You have mail in /var/spool/mail/root
+ B6 [$ W9 t  B! l
9 T( w# s9 @. K# rbd status rbd/volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak
$ X, O/ _+ f& q" cWatchers:
        watcher=12.24.14.5:0/3111163022 client.15216805 cookie=140337922182464
You have mail in /var/spool/mail/root
& F& ]" g% }9 z* s1 l
0 y9 p5 g3 ]' ~9 h( b8 ~/ V
3 a! k8 U& ?0 }+ i: p- s# ceph osd blacklist ls
listed 0 entries
# ceph osd blacklist add 12.24.14.5:0/3111163022
8 g+ y: P9 q% w5 }5 b6 D0 G7 @blacklisting 12.24.14.5:0/3111163022 until 2024-05-12 09:41:59.089772 (3600 sec)
# T( c8 ^2 C' t. ^* B3 kYou have mail in /var/spool/mail/root
# ceph osd blacklist ls
3 L; B6 C5 _/ K. Q9 G+ Clisted 1 entries
2 n0 D" l( C+ B7 e8 e9 K12.24.14.5:0/3111163022 2024-05-12 09:41:59.089772
: y; b* V) k- D0 d# rbd rm rbd/volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak
Removing image: 100% complete...done.
; C$ M" V( V4 D" ?0 x$ K& h" ?5 Q5 qYou have mail in /var/spool/mail/root
# rbd rm rbd/volume-72615737-3638-4b84-82d1-e9fcaf717cb7-bak
& s0 t6 B% Z4 Q; Z& bRemoving image: 100% complete...done.
: f) _* m. `' @, cYou have mail in /var/spool/mail/root
# ceph osd blacklist ls
listed 1 entries
$ d! R/ h9 f) o' K8 Z& P( v7 }" ?12.24.14.5:0/3111163022 2024-05-12 09:41:59.089772
You have mail in /var/spool/mail/root
# ceph osd blacklist rm  12.24.14.5:0/3111163022
2 V- w2 V% V9 z: S5 Wun-blacklisting 12.24.14.5:0/3111163022
0 s: `; d, q: M8 a6 \# ceph osd blacklist ls
listed 0 entries


2 [+ r3 M' G' }! s
; b: u7 \& c5 r问题解决。

: ~; s+ y, t, b2 X3 k9 G6 U( y  N# P