ceph 存储librbd: image has watchers - not removing Removing image: 0% complete...f

admin

# rbd ls -p rbd |grep bak
volume-72615737-3638-4b84-82d1-e9fcaf717cb7-bak
volume-727d6443-0586-4f36-bcd8-5c967eb49de3-bak2
0 t9 E# n. U; g& T0 n% A7 Jvolume-8d78d08a-06ff-492f-a4f0-1bc66f425f04-bak
% S- F3 I) T* W9 R: [8 \) ]volume-cd4d3190-0d51-4e81-aa2d-4354868361f8-bak2
! c# q# G9 J; Hvolume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak
You have mail in /var/spool/mail/root
. L/ H1 U; X  P# p: y# rbd rm rbd/volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak
2024-05-12 08:38:39.614826 7f822a362d80 -1 librbd: image has watchers - not removing
Removing image: 0% complete...failed.
rbd: error: image still has watchers
This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout.
# rbd unmap rbd/volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak
1 U; Q% f: W) c0 Y# H2 b" P$ u5 \rbd: rbd/volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak@-: not a mapped image or snapshot
rbd: unmap failed: (22) Invalid argument
You have mail in /var/spool/mail/root
" b5 ^% o. @+ ^
# rbd status rbd/volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak
Watchers:
6 l6 S3 H8 m# M, y2 g4 ]. v        watcher=12.24.14.5:0/3111163022 client.15216805 cookie=140337922182464
# ]5 ]3 O# x" U  A1 }5 Q% Q& x8 gYou have mail in /var/spool/mail/root

% `/ W8 M: W" O& H  E; ~% x4 f
# ceph osd blacklist ls
$ `# C6 b7 \6 e: i  w/ ulisted 0 entries
" R( R7 O9 a9 I9 m  S# ceph osd blacklist add 12.24.14.5:0/3111163022
+ Z+ [& P/ w7 dblacklisting 12.24.14.5:0/3111163022 until 2024-05-12 09:41:59.089772 (3600 sec)
1 [+ a' _8 ]9 W; P# `5 fYou have mail in /var/spool/mail/root
# ceph osd blacklist ls
$ S4 |0 b4 {& f( O  t& f8 z4 qlisted 1 entries
" p) h1 D, v" c1 `; r3 s8 h12.24.14.5:0/3111163022 2024-05-12 09:41:59.089772
, C3 N3 x4 X" N6 ~# rbd rm rbd/volume-e46ede5a-a8a6-4ca6-9df5-b69a73e7ed2d-bak
Removing image: 100% complete...done.
2 A$ z2 W9 A4 R" XYou have mail in /var/spool/mail/root
# rbd rm rbd/volume-72615737-3638-4b84-82d1-e9fcaf717cb7-bak
6 k( e6 S7 L, `Removing image: 100% complete...done.
3 l) P5 x. W, i: ]4 P' z8 {. ZYou have mail in /var/spool/mail/root
# ]0 u1 W9 K! U3 X8 i$ Z/ p# ceph osd blacklist ls
listed 1 entries
12.24.14.5:0/3111163022 2024-05-12 09:41:59.089772
You have mail in /var/spool/mail/root
# ceph osd blacklist rm  12.24.14.5:0/3111163022
un-blacklisting 12.24.14.5:0/3111163022
# ceph osd blacklist ls
listed 0 entries
7 @6 B( K/ h$ f4 t# G


问题解决。