找回密码
 注册
查看: 453|回复: 0

一次rbd删除过程处理记录Removing image: 0% complete...failed. rbd: error: image still has

[复制链接]

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
发表于 2022-12-27 14:00:01 | 显示全部楼层 |阅读模式
[root@ceph1 ~]# rbd rm ocs/csi-vol-da9f88a0-843e-11ed-b1b5-0a580a800692
. I, u' w. c5 J) |* A3 U6 h2022-12-27 13:37:29.839 7f2307c9e700 -1 librbd::image::PreRemoveRequest: 0x55d6e9458420 check_image_watchers: image has watchers - not removing' M2 ~$ u* x0 L: w- o5 q5 F
Removing image: 0% complete...failed.# h) `7 O% h( \& @9 Z) f8 L
rbd: error: image still has watchers
" g( H* T7 Z: l* ?, wThis means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout.
, R& c4 F/ t4 C1 ]6 [[root@ceph1 ~]# rbd status ocs/csi-vol-da9f88a0-843e-11ed-b1b5-0a580a800692
1 p: ?4 c: a9 A$ C$ q' HWatchers:
2 ?' E" X) N- `# M: m$ g  I2 _        watcher=192.168.0.230:0/1015775234 client.654399 cookie=18446462598732841000
& O5 Z* t/ g$ o: o0 g$ v[root@ceph1 ~]# ceph osd bl- [5 B& T; h8 R" ?+ M# }1 V
blacklist   blocked-by  ' p' o1 ?" X5 n' E1 [3 T1 T) N
[root@ceph1 ~]# ceph osd blacklist add 192.168.0.230:0/1015775234 : [' A' [( }; z, |
blacklisting 192.168.0.230:0/1015775234 until 2022-12-27 14:42:22.899893 (3600 sec)0 A: Q  A, L8 d" A) f2 B6 Z3 F
[root@ceph1 ~]# rbd rm ocs/csi-vol-da9f88a0-843e-11ed-b1b5-0a580a800692; j3 |9 X+ h6 R3 H& b5 v- v
Removing image: 100% complete...done.
9 g' [5 Q2 e! l2 E5 G[root@ceph1 ~]# for i in `rbd ls -p ocs`;do rbd info ocs/$i;done
  `, g, ], }9 w0 Z) j0 hrbd image 'csi-vol-1ed75de5-7d12-11ed-b1b5-0a580a800692':
; q* [. x& n. }$ J; o+ C        size 40 GiB in 10240 objects4 `: i! M4 [$ u/ I; o
        order 22 (4 MiB objects)
2 S+ b1 O: w7 `# E' [        snapshot_count: 0
3 R6 w( ~8 k2 |- J* g) V3 P! P        id: 9e35c93c18ba8, _. b  f! h1 k+ W8 j2 q1 t7 @
        block_name_prefix: rbd_data.9e35c93c18ba8
4 |! S$ n7 e, j        format: 21 ]- U4 G" o, Q3 @  `  e) W* h- c! p  K
        features: layering9 p) O4 [* D1 o
        op_features:
' @' k& F) Q2 I3 C4 o* ]        flags: $ H. F8 d; r3 J6 u$ Q( F
        create_timestamp: Fri Dec 16 15:20:33 2022
9 ^! `7 y/ X$ ^3 P  q( B        access_timestamp: Fri Dec 16 15:20:33 2022
7 `% d& l$ t! P7 z2 l/ q. T! l        modify_timestamp: Fri Dec 16 15:20:33 20227 h$ P& p; K  M9 F9 O0 `( Z" v
rbd image 'csi-vol-1edb5543-7d12-11ed-b1b5-0a580a800692':
; U, y& Y- r/ I% n6 v, h- _; E, Q        size 40 GiB in 10240 objects
7 E) P: B3 W7 L9 P, C! I. S        order 22 (4 MiB objects)& ?" A# [! T( I1 P8 e! O
        snapshot_count: 0, c* p- w1 o( V
        id: 9e35c396259f8
7 F- H! c% r8 q4 ^3 u        block_name_prefix: rbd_data.9e35c396259f8. A: ]6 y7 A. c' C# h
        format: 2" V+ Z: O# `! n/ R; e
        features: layering
. E1 n) N& w% t: `7 R' l3 N        op_features:
0 D. ^8 d( y: _        flags: 4 y- A2 V! \' \. {7 \
        create_timestamp: Fri Dec 16 15:20:33 2022
0 T( ]' n2 J$ v1 Y3 L        access_timestamp: Fri Dec 16 15:20:33 2022
$ {7 b! N; O+ n: ?3 B! Z6 H' O7 f        modify_timestamp: Fri Dec 16 15:20:33 2022- }2 ~0 v0 w: O) p% s
rbd image 'csi-vol-1ee04fee-7d12-11ed-b1b5-0a580a800692':
6 _! Y; q$ [. O' W        size 40 GiB in 10240 objects
  Z# d6 K* a8 l        order 22 (4 MiB objects)1 a* ^' r$ e7 p. i
        snapshot_count: 0
# m8 G2 ]  t7 ?/ J1 E4 ]6 w        id: 9e35ce42c2481
& S& x% \" {0 N: _/ [        block_name_prefix: rbd_data.9e35ce42c2481
- {+ N3 I4 E: E! ~3 Z        format: 2% r. Y( w6 j. H  ^
        features: layering
7 }) a8 s* h* Z        op_features:
0 k4 k6 n  V7 V+ Q5 a. N        flags:
% w" S1 i& N. M+ j        create_timestamp: Fri Dec 16 15:20:33 2022
& b% w. A& J5 ]$ X! N0 }        access_timestamp: Fri Dec 16 15:20:33 20226 z0 V5 H$ [# w9 ~9 d
        modify_timestamp: Fri Dec 16 15:20:33 2022
, O9 p; ~' E4 s* G9 ~3 wrbd image 'csi-vol-7ff1c218-8501-11ed-b1b5-0a580a800692':3 }7 g5 T5 O$ s& Y' E
        size 4 GiB in 1024 objects
" D, ~9 S& b/ S        order 22 (4 MiB objects)
! Y( B& X2 _" a; n3 i* n        snapshot_count: 0  {* n8 I; L3 B
        id: 9e35c4740e3238 B) ]9 z' |0 f4 v7 K1 ^
        block_name_prefix: rbd_data.9e35c4740e3236 m/ c6 {( W" _) d1 M8 u
        format: 2
' i9 U  Y6 B- C) ^1 C        features: layering; _# o! u- {$ x, ~; [! `, x) e  k
        op_features:
9 ^$ p! x: j* D/ `5 |+ u% g5 j* G        flags: 3 R- m! E1 x5 T& {% W" U
        create_timestamp: Tue Dec 27 13:42:32 2022# e5 j/ Z' u0 m! A2 X* _
        access_timestamp: Tue Dec 27 13:42:32 2022
8 a9 t& C9 G) L* q& t5 `: N* i        modify_timestamp: Tue Dec 27 13:42:32 2022& q5 R* z/ @; B" Y+ v
2022-12-27 13:42:34.062 7ff9177fe700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory0 H. T: P$ ^& a: J- `
rbd: error opening image csi-vol-7ff1e39f-8501-11ed-b1b5-0a580a800692: (2) No such file or directory8 D4 x$ M6 L/ H' p# o. V
2022-12-27 13:42:34.194 7fb9637fe700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory' u" ]  S8 r% b. s
rbd: error opening image csi-vol-80018531-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
* M! M- U. f+ z8 b+ }2022-12-27 13:42:34.323 7f0476ffd700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory
) ?; I; ]0 ?* l2 }8 vrbd: error opening image csi-vol-8001d354-8501-11ed-b1b5-0a580a800692: (2) No such file or directory% k2 N: B& D- q/ ~) r/ a
2022-12-27 13:42:34.456 7fec9b7fe700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory; m4 ]4 e- W4 E1 w" y
rbd: error opening image csi-vol-8012d801-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
' ^9 I0 c& R+ J: T+ x+ Frbd image 'csi-vol-80143c1c-8501-11ed-b1b5-0a580a800692':
! v; y1 r, Y0 X7 ]2 D$ e        size 4 GiB in 1024 objects/ c  m- M: H8 k! `  w
        order 22 (4 MiB objects)
5 q3 ~, ~6 e2 d( S0 P: Q; X        snapshot_count: 04 K0 P  v& G( V  N  Q% S5 m4 s
        id: 9e35c547b0a51  k3 M8 Y: W7 z1 @
        block_name_prefix: rbd_data.9e35c547b0a51
- `& r& t# [4 Q. }8 o* H* R) B, L        format: 2
4 K5 [: `* m( e. d        features: layering
- m! E3 q  }+ U* }$ y( ?- Y+ }6 n        op_features:
% D+ k, a3 e4 ^5 e: _        flags: ( h, b+ U2 s; _* z1 f
        create_timestamp: Tue Dec 27 13:42:32 2022! g* |+ }$ @6 W, G
        access_timestamp: Tue Dec 27 13:42:32 20223 y* \7 N# m0 w* |+ T6 z
        modify_timestamp: Tue Dec 27 13:42:32 2022* x7 n* N( ]+ u- @/ d
rbd image 'csi-vol-804ce691-8501-11ed-b1b5-0a580a800692':- E* o( I4 B6 R
        size 10 GiB in 2560 objects$ {0 _2 N8 K% o( j- a4 o) d
        order 22 (4 MiB objects)
- t1 F, O) Q2 \0 u3 |; U& ]        snapshot_count: 0  f+ y3 [0 @; n2 h! O) Z, i
        id: 9e35ca5f63f68
8 S% i) {+ X7 t        block_name_prefix: rbd_data.9e35ca5f63f683 h, q1 X1 c3 F
        format: 29 ^- P% z2 o3 _! [9 i  f/ }3 \: C
        features: layering
8 B& X; V0 b4 x5 z1 c& r$ {        op_features:
3 i2 D' v$ l$ T        flags: ( f- ~" M4 C$ h- g3 y
        create_timestamp: Tue Dec 27 13:42:32 2022
8 n, N) A# Y: n. Z        access_timestamp: Tue Dec 27 13:42:32 2022- ~- ?8 w/ ?) d' d) R1 I" f9 d, j( t
        modify_timestamp: Tue Dec 27 13:42:32 2022! V8 }/ @' D; c$ O$ s; T5 V0 |
rbd image 'csi-vol-90363ffc-7b57-11ed-b1b5-0a580a800692':6 |1 {7 F% e+ O+ C
        size 50 GiB in 12800 objects
' u, T) n: P+ o' y% \        order 22 (4 MiB objects)
$ O& M! s* c1 Q; {1 {        snapshot_count: 0
+ l$ B: P- P( b        id: 9e35c7b3518d4
! a2 B" I# A8 N  t6 J0 X        block_name_prefix: rbd_data.9e35c7b3518d4
+ J7 K* S+ ]# T+ T        format: 2
% P: N) q6 b! D- J7 V        features: layering
. ?' V' R, P4 C: n( ?) }        op_features:
( f5 r8 [6 x# A5 Y) g9 a        flags: + P% ~2 l" C6 _3 y+ R
        create_timestamp: Wed Dec 14 10:32:33 20229 B1 k: M! w4 s; W4 `+ [8 @
        access_timestamp: Wed Dec 14 10:32:33 2022
& N, j! \. e' k! o        modify_timestamp: Wed Dec 14 10:32:33 2022
9 [4 ~* B$ N; x* h  Q+ a- Vrbd image 'csi-vol-a6c73cfc-80e1-11ed-b1b5-0a580a800692':
+ }, ^$ J6 W! Y* Y% \) O        size 1 GiB in 256 objects6 ^: z3 {( V5 O; v6 f
        order 22 (4 MiB objects)0 i' Z) R2 u9 Q7 |! ?4 w, B
        snapshot_count: 0
  L  O3 B9 j* u, |" ]  a        id: 9e35c7aad9b1
" V$ L, _. c1 W6 R        block_name_prefix: rbd_data.9e35c7aad9b1
5 u6 K" F0 ^7 A" Y        format: 24 Y8 i0 u$ Z/ r( m& B- N. e
        features: layering
; F+ x' P0 s. ^9 P3 O% t- f        op_features: " V8 K4 r. m' }; s' ]
        flags: $ {4 |4 m% v3 J
        create_timestamp: Wed Dec 21 11:43:47 2022. {2 K# p7 a) W
        access_timestamp: Wed Dec 21 11:43:47 2022
7 {  b0 v8 S6 [" c- c        modify_timestamp: Wed Dec 21 11:43:47 2022& O' I6 ^& z% Y* A
rbd image 'csi-vol-a6f0a199-80e1-11ed-b1b5-0a580a800692':
( M9 P/ C; S/ r& ?- |        size 1 GiB in 256 objects1 c, q7 _4 S0 v1 X
        order 22 (4 MiB objects)4 o6 `; T/ `2 H. |( u5 G- Z! E
        snapshot_count: 0
% q2 {0 p7 L" B; O4 D3 k/ I+ I        id: 9e35cc806ac3c
4 h7 c/ @8 J4 Q) _& J* Y        block_name_prefix: rbd_data.9e35cc806ac3c4 J; v8 b1 Z: f1 R
        format: 2  ?" h+ c6 f, ]
        features: layering
8 \+ a! }  M+ }+ b* W        op_features: 8 d% J' q( X; r* E$ p% }# i- \
        flags:
$ c/ r5 h% @" b- d        create_timestamp: Wed Dec 21 11:43:47 2022) K1 r- X* j5 o7 B7 `$ s2 D) ^
        access_timestamp: Wed Dec 21 11:43:47 2022# G% k2 G+ O2 X7 b3 X8 C+ v% G
        modify_timestamp: Wed Dec 21 11:43:47 20227 |2 N; d5 N1 X" J2 G/ j) ^
rbd image 'csi-vol-a6f486a3-80e1-11ed-b1b5-0a580a800692':- @8 c0 l5 E7 o, z
        size 1 GiB in 256 objects* R  `& z, D3 f' P3 |" p
        order 22 (4 MiB objects)
0 ]  K8 P9 _( J/ }/ m  g0 R0 `$ b' P        snapshot_count: 0
" l7 }. _( U3 F7 N) b, b        id: 9e35ca298b8c4
. }# [$ }- U) }; h( m: f        block_name_prefix: rbd_data.9e35ca298b8c4' z1 I9 X2 W. ~) T7 f/ [& ^# U
        format: 2
1 \; r- b& {* W' ^. \7 f" G        features: layering
" x: z7 Q/ m: h" t9 w" c( a        op_features: 8 B8 M* H" Q3 r5 o% |1 T! y; q9 i
        flags:
5 L2 K6 i" V, A, y: J        create_timestamp: Wed Dec 21 11:43:47 2022
% D$ F9 X/ M/ E7 f) J4 G' S7 A2 j        access_timestamp: Wed Dec 21 11:43:47 2022
1 t% |- I* K, l" t& d: F  |# z3 Z        modify_timestamp: Wed Dec 21 11:43:47 2022: ~# J2 h' k" B0 v% o- n
rbd image 'csi-vol-a71f7bad-80e1-11ed-b1b5-0a580a800692':
2 T( ~# J. I# V; d' D3 q        size 1 GiB in 256 objects3 q3 q2 N* x! k2 d- I
        order 22 (4 MiB objects)! S9 O& M. \9 H5 b; w3 Q2 [& F
        snapshot_count: 0+ L+ O: h& C! C+ C
        id: 9e35ce5ecd93
: g3 L: @* m% O8 ^0 }% z* J2 V        block_name_prefix: rbd_data.9e35ce5ecd93# e$ P. {# v: ^( V
        format: 2
2 H2 C% e" r7 B9 y        features: layering3 S5 n" V; i7 e" g% _; c  x
        op_features: * G; N/ u: x' `
        flags:
% L. X7 N9 Q$ ~8 H        create_timestamp: Wed Dec 21 11:43:47 2022
( z1 l$ `+ s8 i$ p: c        access_timestamp: Wed Dec 21 11:43:47 2022
- d+ W: {1 o( @* m0 c6 G        modify_timestamp: Wed Dec 21 11:43:47 20226 q7 W: r- |/ o. T9 B* g5 [
rbd image 'csi-vol-a97a9e7c-7b56-11ed-b1b5-0a580a800692':
+ s/ ?, v. B( n$ I- {6 c* C7 C        size 40 GiB in 10240 objects1 n# `7 t# ~: T4 M3 o1 H0 q8 a9 _
        order 22 (4 MiB objects)
( H7 C) u) j4 ]* R$ @) f$ ?        snapshot_count: 08 S% j# m" ^6 i0 \
        id: 9e35c7ad4560e
0 `$ i9 \) E) Q, o0 k7 D6 w        block_name_prefix: rbd_data.9e35c7ad4560e& K: ~# w! K# Q6 M: L* w
        format: 2
$ d9 \, E+ m5 |0 }; D        features: layering
6 k. c  V8 x$ Q! ~5 Y; J        op_features:
1 f2 i/ ~: m; Y# I8 v. U, q% G2 P        flags: 6 i) @# F$ L8 K- w
        create_timestamp: Wed Dec 14 10:26:05 2022( `4 S8 H* W$ ^0 |( ]; a
        access_timestamp: Wed Dec 14 10:26:05 2022) b! i( e0 [$ \# n- l. |/ g
        modify_timestamp: Wed Dec 14 10:26:05 2022/ K  _( ?1 ]0 O; _
rbd image 'csi-vol-a97cf33b-7b56-11ed-b1b5-0a580a800692':3 j0 c. q! O3 A  F
        size 40 GiB in 10240 objects3 _+ L& n0 p* i: l
        order 22 (4 MiB objects)- I& a+ Q: l0 b# o
        snapshot_count: 0% Q, N9 E. T& F3 g+ f/ D
        id: 9e35c6820a438
4 x6 m. [( @* I; s+ ^- K# C2 j        block_name_prefix: rbd_data.9e35c6820a438/ B) q6 ~; V' c  Q9 f
        format: 2
& p4 C5 I, v9 x  X3 L        features: layering
$ f! K! k' B" t7 t; J- g        op_features:
: j' I3 P) v# f; W        flags:
4 S3 C5 Q; {7 x2 v: d        create_timestamp: Wed Dec 14 10:26:05 2022
3 L' i. D' o" I& S' T$ Z/ B  A; K3 o, g        access_timestamp: Wed Dec 14 10:26:05 2022; f- N+ r6 w: E  w. _# x
        modify_timestamp: Wed Dec 14 10:26:05 2022
0 p7 W7 P- d. s- E. O+ J2022-12-27 13:42:35.852 7f837f7fe700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory" S6 G. ^! M! _/ R9 U
rbd: error opening image csi-vol-b2f19b24-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
' q( f  o8 `* @  Erbd image 'csi-vol-b2f2129f-8501-11ed-b1b5-0a580a800692':
, ?# l2 @& k+ _* |8 A" c# C# _; ]        size 4 GiB in 1024 objects, Y' z4 l: _" r: l  Y
        order 22 (4 MiB objects)" d: l! `" p$ V% \2 j2 U% B
        snapshot_count: 0
1 A, b; h% {" Q  D) F) ?# i7 E4 U/ ^        id: 9e35c4964b54e
/ [% t2 h# O0 V        block_name_prefix: rbd_data.9e35c4964b54e
% |# b; f3 c+ W: p2 \; e        format: 2  u+ P; u% Q; R  c& s  l% w& a2 X
        features: layering3 @) \* I( I/ ?* o3 n+ e, O
        op_features: 7 F% z7 r2 g2 D7 c1 K; ?- R
        flags:
( r+ T+ l4 _% L0 Q        create_timestamp: Tue Dec 27 13:42:32 20220 f! B: w* P+ O& `: Y  x+ O
        access_timestamp: Tue Dec 27 13:42:32 20227 T) d7 d1 z% k. g1 }" _) U. x+ m
        modify_timestamp: Tue Dec 27 13:42:32 2022( g+ g# S: Z; H  O1 C
2022-12-27 13:42:36.117 7f6104fa0700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory7 S+ _  r" }1 E/ D1 ]
rbd: error opening image csi-vol-b3029e8f-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
; h7 \6 }$ |  E5 ]0 y( ]% U# r2022-12-27 13:42:36.243 7f23557fa700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory" A2 Z7 k# |  P' k1 K: |+ Q
rbd: error opening image csi-vol-b303459c-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
/ x9 C6 l: o7 t8 h# A! X2022-12-27 13:42:36.370 7f7bc17fa700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory; x% x5 v; V- F5 D" t+ ?  p
rbd: error opening image csi-vol-b30eb6f2-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
8 s) p9 o; [9 o6 N* `( [! z2022-12-27 13:42:36.500 7f819a7fc700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory% ]3 s; K- x1 b
rbd: error opening image csi-vol-b32e8f9f-8501-11ed-b1b5-0a580a800692: (2) No such file or directory% T7 j2 {3 `1 F$ i, A
2022-12-27 13:42:36.623 7fa6ccff9700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory
5 \, C1 Z& p5 n: F5 Y) orbd: error opening image csi-vol-b34e85cb-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
9 `; U) v$ R8 P2022-12-27 13:42:36.758 7f7460ff9700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory+ K; k; r8 d) I: _7 \
rbd: error opening image csi-vol-baf82adf-8593-11ed-b1b5-0a580a800692: (2) No such file or directory
. D- W  {* }3 A4 I2 D! D2022-12-27 13:42:36.898 7f0604ff9700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory: D% l; K' `8 ?  `$ _# O
rbd: error opening image csi-vol-bb047f67-8593-11ed-b1b5-0a580a800692: (2) No such file or directory
1 @. E; m* J% M) drbd image 'csi-vol-bb2b265e-8593-11ed-b1b5-0a580a800692':) d" c1 q! W8 U( a6 e) D
        size 1 GiB in 256 objects
, x* w9 s2 M; n% \* ~# m        order 22 (4 MiB objects)  _$ ?2 p, m- R  Y2 u- [
        snapshot_count: 0
+ k! D  ^5 ?3 M9 x2 ]        id: 9e35c58d96058/ ?( B3 j+ k9 m" ?" I; n
        block_name_prefix: rbd_data.9e35c58d960581 F6 P% E  k6 d5 R
        format: 2" m# P; z- n+ k+ ^
        features: layering
6 S, R$ I% P; g% F, ?% F        op_features: ( g% ^2 t: p% L- M( K( s* X
        flags:
  t; s$ A+ @$ t. l" e7 M2 K        create_timestamp: Tue Dec 27 13:42:32 2022
4 S/ k+ u, j5 l. W4 [        access_timestamp: Tue Dec 27 13:42:32 2022" S) {2 H1 q: O( x( r
        modify_timestamp: Tue Dec 27 13:42:32 2022
# M. p0 [! A) Q+ b/ F& ?rbd image 'csi-vol-bb6e5aa3-80e1-11ed-b1b5-0a580a800692':
/ N+ R7 X8 l4 _7 p! l* t        size 1 GiB in 256 objects
- \: }' N0 l5 J        order 22 (4 MiB objects)
9 Q: o$ r9 ?: ]& O  ^0 J; o/ [        snapshot_count: 0
7 k7 Q4 t/ x* g+ b; B        id: 9e35cc330328b
$ M; H5 Z  v. u- Y( H& h. E+ a        block_name_prefix: rbd_data.9e35cc330328b6 H% i. u) N. q: H8 ]
        format: 26 @/ j5 Y2 A3 |( p' c  j+ t, f
        features: layering# I0 V% V0 ^. m
        op_features:
$ S4 _1 Q. k' v6 {; M        flags: 7 I- Y$ @$ v. r
        create_timestamp: Wed Dec 21 11:44:21 2022
1 C; y  r7 }/ e. a+ s* k* m7 v        access_timestamp: Wed Dec 21 11:44:21 20224 M6 E* h1 H8 h  E3 ]
        modify_timestamp: Wed Dec 21 11:44:21 2022' j$ @8 b# `& s
rbd image 'csi-vol-bc05b624-80e1-11ed-b1b5-0a580a800692':% I% U9 {* e0 n, H  `
        size 1 GiB in 256 objects, q& @- q: z' \6 `" N
        order 22 (4 MiB objects)
( E6 j# A) I$ [/ ?& x; N0 Y% c, w3 }( J        snapshot_count: 0
! ?4 i" t+ S6 Q" J: s# ^% R        id: 9e35c555b66a1- B0 a/ @# d9 X
        block_name_prefix: rbd_data.9e35c555b66a15 I! r7 ]. d+ ]: K# W/ q4 R
        format: 2( g7 q0 x4 C6 T) B; G3 o& a
        features: layering9 d; o# P/ s% b$ v# }# X% N
        op_features:
! n* B# ?; V& ^1 J$ C* ]" n+ t        flags:
6 l3 K/ [& m) B  D6 v3 I3 ?% y        create_timestamp: Wed Dec 21 11:44:22 2022  Y, n" ~' E* K8 j
        access_timestamp: Wed Dec 21 11:44:22 2022) R) O7 k& W0 \( |
        modify_timestamp: Wed Dec 21 11:44:22 2022
5 R& e8 @. b0 k3 B2 ], grbd image 'csi-vol-be3e584d-80e1-11ed-b1b5-0a580a800692':$ K1 L% h  b! T- z
        size 1 GiB in 256 objects+ `( L' L$ Z8 Z+ l7 n( @
        order 22 (4 MiB objects)* x( ~  P% h! M: ]
        snapshot_count: 0$ L  Y) }! @6 A( o% b3 L( D
        id: 9e35c5807bea6
  O& `% Q! [! Z+ v$ e        block_name_prefix: rbd_data.9e35c5807bea6( w; O0 D4 ?5 v
        format: 2; ]1 ~- t3 \1 M% T9 F2 I0 P7 p; M/ w
        features: layering
7 d' `) T7 f5 `% F6 ]/ T6 e2 U        op_features: ; l1 ?4 w) V$ q. X! ]
        flags:
- W* @( t5 p: G  t2 d2 X        create_timestamp: Wed Dec 21 11:44:26 2022, a2 x. D4 j1 p
        access_timestamp: Wed Dec 21 11:44:26 2022; F$ w/ T0 k2 i: C# q3 m
        modify_timestamp: Wed Dec 21 11:44:26 2022
4 Q) I8 ]1 k" G/ [* ?rbd image 'csi-vol-bea2af04-80e1-11ed-b1b5-0a580a800692':
9 L5 D) w2 `# B& m        size 1 GiB in 256 objects  q  U- {/ ~% y/ G: }
        order 22 (4 MiB objects)& d3 v" g+ d1 g2 B0 {
        snapshot_count: 0. p# [5 x- |- @
        id: 9e35c5e845f7f' {9 \4 U& c/ S5 h5 c0 V
        block_name_prefix: rbd_data.9e35c5e845f7f
# Q7 f8 c+ }7 ?+ H. E* K* Q        format: 23 i+ r* a- x" _, E0 ^
        features: layering* R. D! h3 _' n& @
        op_features: ! n9 F" N. i; e3 j  S
        flags:
  i: X6 q2 U: ?6 H1 S: D        create_timestamp: Wed Dec 21 11:44:27 2022
7 N+ B7 V/ q5 x5 v0 _. n        access_timestamp: Wed Dec 21 11:44:27 2022
) L& I8 ?4 z2 K" C8 o% Z        modify_timestamp: Wed Dec 21 11:44:27 2022
' p9 a7 K5 ~# s& erbd image 'csi-vol-da4243db-843e-11ed-b1b5-0a580a800692':
7 M2 t: b/ }( p2 `! k& s        size 1 GiB in 256 objects0 j. G4 O5 `$ D( q# ]
        order 22 (4 MiB objects)
& m& q& a8 D7 E3 I3 h) m        snapshot_count: 09 }* h% f5 q0 a  W1 p, g
        id: 9e35c6661fbcb7 D! I% r5 b. K0 _) r. @. w
        block_name_prefix: rbd_data.9e35c6661fbcb
, [, [5 O# }# V1 A3 M$ U7 v0 w        format: 2. Y2 r% I* k/ B% o# R; D
        features: layering
# h  f' r. e9 ]( N  u7 I        op_features: - b' G! z4 _  m- K4 L$ n4 i
        flags: 9 T8 [8 x0 X6 P3 v8 J1 A
        create_timestamp: Sun Dec 25 18:28:36 2022! a  p, U# x$ v
        access_timestamp: Sun Dec 25 18:28:36 2022" b) r7 m* f* f: M, U3 K
        modify_timestamp: Sun Dec 25 18:28:36 2022" |. D; ]4 u  m4 d
rbd image 'csi-vol-da51cb65-843e-11ed-b1b5-0a580a800692':1 I0 X( {- y2 A6 R0 }! ?2 e# }) ?
        size 1 GiB in 256 objects% S% [! t1 |) x1 K) `
        order 22 (4 MiB objects)2 }8 U/ ^& `" @# A; F: R9 _! u
        snapshot_count: 0
% f  z7 y+ u0 V! y" ?$ e        id: 9e35c87f2899e
7 O! I, V1 H+ P$ p4 h, c        block_name_prefix: rbd_data.9e35c87f2899e
7 E9 c$ f, b- M# I/ D        format: 2- X- |. o" D: A
        features: layering1 m* ?8 Z, l2 S  F* l6 A
        op_features:
4 \0 ?$ E0 N# J+ z: ]% a$ P; d        flags: % Y$ f" P) ~& l  K
        create_timestamp: Sun Dec 25 18:28:36 2022
6 e2 L* Y/ t0 I: d0 k1 M        access_timestamp: Sun Dec 25 18:28:36 20227 F* Z1 k* j1 ]- }- P, K" @. o
        modify_timestamp: Sun Dec 25 18:28:36 2022
. y& w: b  M. a' K$ a5 D) I* Lrbd image 'csi-vol-da62a26b-843e-11ed-b1b5-0a580a800692':8 c6 v: _7 F0 N* x! ]. L) O) o
        size 1 GiB in 256 objects
. a5 `9 Q4 ]. v( h6 ^+ Q        order 22 (4 MiB objects)- T6 `3 z9 l7 U5 m
        snapshot_count: 0
$ h5 v9 _1 G" P        id: 9e35c5ba862f62 e& @) }6 L' O' {4 ?
        block_name_prefix: rbd_data.9e35c5ba862f6( W: e$ z1 L8 @
        format: 2
, G* e& R4 O8 Y1 w        features: layering
+ T8 i( q& M/ A/ O        op_features:
3 L! m% B, T5 X. w- p' k) X        flags:
) E' z7 L2 `' P. l$ _        create_timestamp: Sun Dec 25 18:28:36 2022& @# B' G3 J/ N7 h
        access_timestamp: Sun Dec 25 18:28:36 2022$ U/ \1 P& H4 U# ]* M) @
        modify_timestamp: Sun Dec 25 18:28:36 2022- [- H# t; q) j1 @. U+ I4 F: D
rbd: error opening image csi-vol-ea1d1132-84fe-11ed-b1b5-0a580a800692: (2) No such file or directory
! K( R( f- \) C4 F/ f/ ^' qrbd image 'csi-vol-ea1d1212-84fe-11ed-b1b5-0a580a800692':7 k+ r" \5 _( }1 H% V  e) \1 u
        size 1 GiB in 256 objects
. M* t8 t+ t7 |/ d  Q. G        order 22 (4 MiB objects)
( q1 n3 {/ j, {1 a2 H$ v( l3 s        snapshot_count: 0
8 ^" i- g# d- J3 J+ y0 ~6 c& m7 Y        id: 9e35c8129cb71
1 g! a5 S* H1 c& c        block_name_prefix: rbd_data.9e35c8129cb71) I( a, \: L- t* M' O' g% |: B
        format: 2
7 Y: d# E+ l$ d; l( U        features: layering+ _' V& E) A0 K
        op_features:
+ R  Q4 s( m' v/ m  z' {        flags:
. H/ O$ D6 Z# \        create_timestamp: Tue Dec 27 13:42:33 20229 S2 O  i" X5 |& U! R6 E7 O
        access_timestamp: Tue Dec 27 13:42:33 20222 K6 I+ r; I' N/ W
        modify_timestamp: Tue Dec 27 13:42:33 20226 Z) Q. T5 F0 I
rbd image 'csi-vol-ea2d24c2-84fe-11ed-b1b5-0a580a800692':
4 {! y0 l" ?1 G2 ^  c2 @        size 1 GiB in 256 objects( ~* E, a; C- {$ @5 A
        order 22 (4 MiB objects)
& U' F! k- ^; [2 t9 v        snapshot_count: 0! w7 H, i" ~& q, e7 Q/ F
        id: 9e35c9d7b40a9
: T. k( S, P: M* D8 r        block_name_prefix: rbd_data.9e35c9d7b40a9% @) R0 H8 |8 s6 h: ]6 n- V
        format: 2
7 F% m2 l" m* l+ Z+ p: O; @# {3 ?        features: layering& K$ y* u2 x* {7 R! H! w, J' [
        op_features:
: G4 X# D  R5 L& B% R1 z        flags: * h( {( l4 J5 {) {# E0 z
        create_timestamp: Tue Dec 27 13:42:32 2022
. `) G; A& ^2 X$ q8 N        access_timestamp: Tue Dec 27 13:42:32 2022
' D% W8 @' B' Q; e( U, D        modify_timestamp: Tue Dec 27 13:42:32 2022' G" d9 n* m$ W8 K7 n! G
2022-12-27 13:42:38.583 7fc4527fc700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory
' P' f/ d* ?& wrbd: error opening image csi-vol-ea2f7183-84fe-11ed-b1b5-0a580a800692: (2) No such file or directory
( s7 H4 ]9 j( M8 h, F' K9 u2 vrbd: error opening image csi-vol-ea3d95e6-84fe-11ed-b1b5-0a580a800692: (2) No such file or directory* c) m" p" v9 k1 P1 q% [8 _- r
rbd image 'csi-vol-ea3fa785-84fe-11ed-b1b5-0a580a800692':
0 b  V8 @% I% G1 U( [! H        size 1 GiB in 256 objects
. Y4 A# A% s6 _+ R. o& B        order 22 (4 MiB objects)
  D8 k% V- \/ X  i2 r+ s& ]7 v        snapshot_count: 0  C* T: Z3 q$ ]* K; a6 u
        id: 9e35ca590c586" K( y# D4 d& A3 S* I7 E
        block_name_prefix: rbd_data.9e35ca590c586
2 ^; H9 ^5 }# \3 H" O7 g5 P        format: 2- \7 V( E( O! @, ^- z! ^* |5 [
        features: layering& \# Q7 ^# [6 [7 A0 v5 ]
        op_features: 1 \) q, a. U: d
        flags: 0 g; L5 C# r4 T6 v0 M6 O4 S
        create_timestamp: Tue Dec 27 13:42:32 20226 E: V0 d1 z! R- L
        access_timestamp: Tue Dec 27 13:42:32 2022# {$ d: v, b% W: K6 F: c% R- G. a0 N
        modify_timestamp: Tue Dec 27 13:42:32 2022
2 p) T- F8 n/ c2022-12-27 13:42:38.994 7f4bb3fff700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory
7 Z+ }8 U0 O4 S4 ?4 Zrbd: error opening image csi-vol-ea79cdf8-84fe-11ed-b1b5-0a580a800692: (2) No such file or directory& N+ k7 L  }$ O! L5 ^
rbd image 'csi-vol-ef1ea188-8598-11ed-b1b5-0a580a800692':% R4 L3 P: ?3 W0 d7 {4 g6 t0 m
        size 2 MiB in 1 objects7 }# w% C$ O; [7 V4 [- D
        order 22 (4 MiB objects)8 R* }: {3 g+ U. u9 A1 S4 ^9 g. R6 Z
        snapshot_count: 0" f! I0 |% W5 {1 P# Z% _+ x2 s
        id: 9e35cc813ac84
1 e0 V: K# G% _; }4 p. v7 |  \        block_name_prefix: rbd_data.9e35cc813ac84
4 f! Q* _: ]1 V        format: 2
. a( p" @, p; `- P+ n        features: layering
9 E# ]" r, w1 M$ t" z( z2 M        op_features:
# V: S% ~$ `! k8 {4 M* x        flags:
, W# J4 i: f/ t' w        create_timestamp: Tue Dec 27 13:42:32 2022
) K2 N" a) b. H3 ~8 o, v* l) X        access_timestamp: Tue Dec 27 13:42:32 2022
, M* ?$ V0 J) l5 _        modify_timestamp: Tue Dec 27 13:42:32 2022% r$ S2 D# `! p5 n  F8 f0 ^
[root@ceph1 ~]# rbd rm ocs/csi-vol-ea3fa785-84fe-11ed-b1b5-0a580a800692   q5 r9 m3 W0 ]' ?( L! l, {
Removing image: 100% complete...done.* b( `) M/ Z% B; Y
[root@ceph1 ~]# for i in `rbd ls -p ocs`;do rbd info ocs/$i;done8 g3 b& N# B& L- p5 l; ?- C
rbd image 'csi-vol-1ed75de5-7d12-11ed-b1b5-0a580a800692':
  p7 c) q" O" e        size 40 GiB in 10240 objects
) v9 B2 _$ M  Q        order 22 (4 MiB objects)
$ n# V$ y( @& L: h        snapshot_count: 0% Q1 `9 B5 \1 k) Q2 v. S
        id: 9e35c93c18ba8+ R  @2 N) ~  I: i: [
        block_name_prefix: rbd_data.9e35c93c18ba8
  ~' r! X3 X% b/ r# O        format: 2
0 L1 K) ^+ \) a5 Y: D& W0 m6 _        features: layering
; W1 D2 V) y: D% v0 a- x. D        op_features:
& ?; p; K$ ~8 j& z1 e! m5 W        flags:
. [( a- T/ G9 H- l        create_timestamp: Fri Dec 16 15:20:33 2022! A7 G3 \$ G, U9 s' [" |
        access_timestamp: Fri Dec 16 15:20:33 2022/ V7 D: a4 L" B" V% k- k$ ~& G: Q
        modify_timestamp: Fri Dec 16 15:20:33 2022
' I$ M1 N, |& t$ Yrbd image 'csi-vol-1edb5543-7d12-11ed-b1b5-0a580a800692':- E1 o2 Z8 A9 O0 j, x
        size 40 GiB in 10240 objects
# a2 e. k. ]' l0 L( @        order 22 (4 MiB objects)' N/ g5 t" P* a' I( d6 {: A8 L# z
        snapshot_count: 0( q* J0 g+ F1 ^$ x7 W( D
        id: 9e35c396259f8. u& d3 ~, d$ a, h) K# n7 H2 i
        block_name_prefix: rbd_data.9e35c396259f8
  z+ G  Q- m; g+ S5 l; |        format: 2
+ z; U  z4 v2 W% C  H        features: layering# }1 x# m; P; }! F# o3 _
        op_features:
4 r$ U5 |9 q5 v! ^        flags:
, x  z3 X6 T. A0 u0 h/ h3 U  ^( z        create_timestamp: Fri Dec 16 15:20:33 20229 s4 N: R! u6 ~( n% H! ~# S% v
        access_timestamp: Fri Dec 16 15:20:33 20222 e: `) a0 h# O6 T0 b' _6 @! H
        modify_timestamp: Fri Dec 16 15:20:33 2022
( x, S$ t2 r3 Q# N0 Rrbd image 'csi-vol-1ee04fee-7d12-11ed-b1b5-0a580a800692':. K4 R6 A+ r/ R: x- n! |: X
        size 40 GiB in 10240 objects! Z7 v6 ?/ S) n* b; E4 H% {) O/ F  X" B
        order 22 (4 MiB objects)
) s! {3 S! r. `* q. Y# F& x        snapshot_count: 0
6 l! ?6 M, K2 G8 e# W; N* h        id: 9e35ce42c2481" H% k9 q3 N6 W! |. w6 B3 @( W
        block_name_prefix: rbd_data.9e35ce42c24811 j- `* |' {6 m5 _( M, w' H
        format: 2, v+ w0 b1 O) W  N
        features: layering( f5 \+ J6 V  C6 K) V: E5 o" J
        op_features: - c# L7 c" u! n- d, Z2 M7 V- J
        flags:
% C1 ]* f5 a! v3 {' |% T5 j        create_timestamp: Fri Dec 16 15:20:33 2022
8 }3 _* J" k% y+ B! u  S4 s! G        access_timestamp: Fri Dec 16 15:20:33 2022: S6 r3 }7 j! s  f( A1 ^
        modify_timestamp: Fri Dec 16 15:20:33 2022
2 B2 @* o6 J5 P; ]* prbd image 'csi-vol-7ff1c218-8501-11ed-b1b5-0a580a800692':& }0 r+ W/ c% Q8 y% P
        size 4 GiB in 1024 objects7 g4 u6 w  r! G, w
        order 22 (4 MiB objects)
9 f6 f2 x! E( x  I3 E5 x7 L        snapshot_count: 03 z; n3 l. u2 C+ V+ p8 e. m
        id: 9e35c4740e323) O& v, A3 G* T7 {0 O# X
        block_name_prefix: rbd_data.9e35c4740e323- w6 `& @! x8 R0 o8 Z& R9 d/ U
        format: 2. U8 i. x3 ~. k  I, x
        features: layering
; J. o- T& a; T6 E% F+ i; e: A* y        op_features:
8 X0 U% [. ^% u3 ~1 f% R        flags:
9 N6 J. @6 H5 Y$ Y2 D: }* S/ o        create_timestamp: Tue Dec 27 13:42:32 2022
9 U. H$ }2 x+ {$ h; U* I$ }+ V        access_timestamp: Tue Dec 27 13:42:32 2022
; d' R8 {& ]0 c1 g) W2 }        modify_timestamp: Tue Dec 27 13:42:32 2022
: b1 X/ L8 h( j; n2022-12-27 13:43:18.407 7faaaf7fe700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory7 ]8 x" @2 Y2 @. S- q$ f5 y3 Q
rbd: error opening image csi-vol-7ff1e39f-8501-11ed-b1b5-0a580a800692: (2) No such file or directory; W. Z* N8 E+ s$ v" _2 [" ]; K
2022-12-27 13:43:18.540 7f2ac57fa700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory: B8 h5 J# G, e# O
rbd: error opening image csi-vol-80018531-8501-11ed-b1b5-0a580a800692: (2) No such file or directory2 g+ r+ g) Q# h
2022-12-27 13:43:18.675 7ff4727fc700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory3 V4 ~$ z/ ^" u) f3 g3 _
rbd: error opening image csi-vol-8001d354-8501-11ed-b1b5-0a580a800692: (2) No such file or directory6 }+ Q6 M3 t! y! I
2022-12-27 13:43:18.801 7fc0f3fff700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory
% P' w, x! ?% D- h9 c0 k- C7 Krbd: error opening image csi-vol-8012d801-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
2 H3 \( I( R0 D; n, }! brbd image 'csi-vol-80143c1c-8501-11ed-b1b5-0a580a800692':1 }  I: n2 a* S$ G( Y$ G) }
        size 4 GiB in 1024 objects- a; v, b8 R, H9 N
        order 22 (4 MiB objects)
3 \4 R' G& S  e; \2 g4 }  z        snapshot_count: 0! J1 J) V4 s+ t! q' W4 R
        id: 9e35c547b0a51
, Q) w8 F9 t; A! k+ W        block_name_prefix: rbd_data.9e35c547b0a51
( Y% A/ ]& E3 C1 J/ p        format: 2. U& Y# V" C' Q3 E2 j( E
        features: layering! n+ J& v. U% N( V
        op_features: 0 ~2 w& c4 [( C4 d1 z& k
        flags:
! v- |2 c% ^& d+ ?' K! f0 }: k        create_timestamp: Tue Dec 27 13:42:32 2022
  z& }. K5 T: `4 @1 f- W0 v% @        access_timestamp: Tue Dec 27 13:42:32 2022
+ ~' ~* _1 j5 h9 T, S9 Q* u6 L        modify_timestamp: Tue Dec 27 13:42:32 2022: D( }. s, i  H: w
rbd image 'csi-vol-804ce691-8501-11ed-b1b5-0a580a800692':6 B$ v0 ^9 f7 M
        size 10 GiB in 2560 objects
' e* I8 r2 l: ~9 v- `        order 22 (4 MiB objects). D. h$ X" r% h9 ?- K3 I
        snapshot_count: 0) c& U1 q0 Y0 M+ C+ d9 G
        id: 9e35ca5f63f68
& V) b  x9 V- |8 \1 @+ b- c, S; @        block_name_prefix: rbd_data.9e35ca5f63f68+ H' N' X4 @# \1 R4 j+ O
        format: 2  h; s8 o+ Y2 h
        features: layering$ A8 Q9 B/ ^  ~/ H
        op_features:
9 X1 b( J" I" [# X        flags: # v+ P2 L, X7 k4 g: j8 c7 M! E
        create_timestamp: Tue Dec 27 13:42:32 2022$ @- p' v2 ~5 l# ]6 B
        access_timestamp: Tue Dec 27 13:42:32 2022
- m. t/ q- u, q& F# @8 \6 C        modify_timestamp: Tue Dec 27 13:42:32 2022) b1 |- n) B4 @8 m
rbd image 'csi-vol-90363ffc-7b57-11ed-b1b5-0a580a800692':
) `! w  _# c0 s4 j        size 50 GiB in 12800 objects: C, Y8 o9 c) D3 F# ~4 g
        order 22 (4 MiB objects)6 y4 B/ R/ U: V. S
        snapshot_count: 0
; t6 s& X/ S; u7 x5 d1 a9 s        id: 9e35c7b3518d4
& Q" y. F  i7 n7 ^/ w        block_name_prefix: rbd_data.9e35c7b3518d4
2 a8 E4 W+ Y6 `) O        format: 2
: k7 j. M2 P5 I! B; h& {5 b        features: layering
  W8 P3 d- b6 b# A        op_features:
4 d2 N' V1 p# l: q: A% o0 n        flags:
$ N, l, d( w1 \) `+ Y( }$ q        create_timestamp: Wed Dec 14 10:32:33 2022
: F& J6 r* A' N9 v1 W. R& W% F" k        access_timestamp: Wed Dec 14 10:32:33 20220 V" D6 J; \* V, z2 A/ ^
        modify_timestamp: Wed Dec 14 10:32:33 2022
* o2 S1 F/ a) e- E. srbd image 'csi-vol-a6c73cfc-80e1-11ed-b1b5-0a580a800692':9 d1 q% q" {5 U9 @0 s# b
        size 1 GiB in 256 objects6 F/ h4 _' x/ q
        order 22 (4 MiB objects)
+ w4 t" W7 Y* \- d        snapshot_count: 05 K6 h6 R9 o8 e  ~& r+ ^8 k
        id: 9e35c7aad9b1
0 z& Q  ^4 j2 v  H1 S5 I        block_name_prefix: rbd_data.9e35c7aad9b1: T) r* L5 N! _
        format: 2, Q: B; b+ k" W: Z7 @
        features: layering( D/ ]8 ], O- ]" [
        op_features:
0 `" g  X. D+ i5 F  h8 _& }( n" N        flags: $ g( n8 u4 ]0 Q. d
        create_timestamp: Wed Dec 21 11:43:47 2022* l5 t; F8 ^. o# n" q: [- @* c
        access_timestamp: Wed Dec 21 11:43:47 2022# f2 L( q$ Y6 Z9 W+ q, Y$ `
        modify_timestamp: Wed Dec 21 11:43:47 20227 D+ C! s3 n* Z; Z3 {7 L/ Y
rbd image 'csi-vol-a6f0a199-80e1-11ed-b1b5-0a580a800692':
/ o+ I, n: Q# b2 |        size 1 GiB in 256 objects8 [7 j1 u$ r7 y, d1 P$ p, G# B5 j
        order 22 (4 MiB objects)' D: J+ z7 r# l, @7 j* K; y
        snapshot_count: 0
0 M' s( O& q6 h" n- p! Q, a1 v; |        id: 9e35cc806ac3c/ |7 \: P7 G/ k8 a7 x
        block_name_prefix: rbd_data.9e35cc806ac3c4 m; |' I) a  g/ p. ^/ B
        format: 2# O! Q/ @2 V' K. c# M; z
        features: layering
0 c4 ~7 v9 x8 t  f3 {; U' C2 T        op_features:
% x" J3 D' q0 b6 o5 [) V1 m. {        flags: + w% b9 H+ f3 l+ _
        create_timestamp: Wed Dec 21 11:43:47 2022
4 @! h! E7 |" [; b        access_timestamp: Wed Dec 21 11:43:47 2022
+ l3 N, j; o# Q8 a        modify_timestamp: Wed Dec 21 11:43:47 2022; D5 l. y2 _* p0 _, n! E
rbd image 'csi-vol-a6f486a3-80e1-11ed-b1b5-0a580a800692':' q/ `) [$ v+ R2 t7 z3 D( F
        size 1 GiB in 256 objects
+ @: C7 _3 ^# q" i3 K6 b        order 22 (4 MiB objects)7 P0 r: w, {. [! S, k5 Q
        snapshot_count: 0
* U* Y. ^+ \; y* g6 {) v        id: 9e35ca298b8c4% M6 r4 Z0 G1 m2 h; B5 U1 q3 e
        block_name_prefix: rbd_data.9e35ca298b8c4. ?: M5 R6 U0 @* b5 O: B
        format: 2
# Y6 l" U% ~$ S; e& w& D7 I( @4 u        features: layering( A+ f- O! x3 [
        op_features:
0 }6 |' y$ z! J        flags:
1 \  D# H2 O1 Y" ]        create_timestamp: Wed Dec 21 11:43:47 20221 f3 Y  q8 t9 E# u( O5 Z7 V
        access_timestamp: Wed Dec 21 11:43:47 2022: F; {; _' G# u1 a% `
        modify_timestamp: Wed Dec 21 11:43:47 2022
. K; u) @3 @: ~! N8 erbd image 'csi-vol-a71f7bad-80e1-11ed-b1b5-0a580a800692':; Q' z$ b$ D+ K3 ^* f
        size 1 GiB in 256 objects- q' |2 T7 J' K' x1 m: v
        order 22 (4 MiB objects)" e0 G! u$ ^1 u/ h0 l- T* {) T
        snapshot_count: 0/ U3 k8 M' P! t' H
        id: 9e35ce5ecd93: S( D3 b3 L/ d" t! V, e& l
        block_name_prefix: rbd_data.9e35ce5ecd935 [* @' I9 p/ @4 |+ i# Q
        format: 2( b  o" q. x$ g" h
        features: layering( F" v; R# ]* U+ D. ~* l, Z7 U
        op_features: 4 o6 n+ o' h) m! I. J
        flags: # g1 d/ J# T" W& ~8 F! g9 {
        create_timestamp: Wed Dec 21 11:43:47 2022' |" r% N, I7 h' O7 y7 v
        access_timestamp: Wed Dec 21 11:43:47 2022
8 L! e8 e! K3 i+ A        modify_timestamp: Wed Dec 21 11:43:47 20229 p1 n# F. z2 y' T" K* M7 I/ w
rbd image 'csi-vol-a97a9e7c-7b56-11ed-b1b5-0a580a800692':
: U6 E9 Z, B/ u) B4 [. m6 k        size 40 GiB in 10240 objects
5 ~; }8 t, ~: I( B( f2 f/ P        order 22 (4 MiB objects)# n$ e. F; p- a) u. {7 }0 m
        snapshot_count: 0* I  T+ x# l. Q: \# A
        id: 9e35c7ad4560e
  u' |1 l% C' f( {  j        block_name_prefix: rbd_data.9e35c7ad4560e4 R: R/ b$ v' `
        format: 2" A$ M- A1 b+ ^! ~# c2 w/ ^, C6 Q
        features: layering
3 g# l9 ~9 z/ F% |5 x8 j& E        op_features: ) G% K7 R- B: g- E. d: L
        flags: * r" v" G6 ^6 d, _- r6 e, ~! v5 N
        create_timestamp: Wed Dec 14 10:26:05 2022
+ X- o2 [+ f+ F# d8 Z        access_timestamp: Wed Dec 14 10:26:05 2022
1 {, R0 k1 q4 g2 |, Z6 X        modify_timestamp: Wed Dec 14 10:26:05 2022
7 o( b4 ?$ Z( [  x; ^7 X, Prbd image 'csi-vol-a97cf33b-7b56-11ed-b1b5-0a580a800692':% A) n9 T8 \% {$ I  B% n& e3 l
        size 40 GiB in 10240 objects
: I0 v4 y7 n+ B( D. l        order 22 (4 MiB objects)
' K5 R1 \0 @8 x5 B0 P        snapshot_count: 0
% z: a& E! @  O8 m6 v* P0 _        id: 9e35c6820a438
8 @9 `; e( Z$ a: O        block_name_prefix: rbd_data.9e35c6820a438
, }4 D* f+ W5 Q* S- `+ d        format: 2. I+ ^$ r0 C2 l$ v$ m- T( a
        features: layering- W$ G5 U) q' T- q9 {! C# g3 V
        op_features: 2 w% X& x$ [5 C: X$ p* f1 A
        flags:
. G, _0 P' I) X8 P& ]- q& Q5 h        create_timestamp: Wed Dec 14 10:26:05 2022& R% ^! m7 v9 \, V7 s
        access_timestamp: Wed Dec 14 10:26:05 2022# \% d) K' H0 A6 C+ G* s
        modify_timestamp: Wed Dec 14 10:26:05 2022
8 n! j" _) u$ l* g9 U0 Z, t7 A$ Z2022-12-27 13:43:20.183 7f9f797fa700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory% l$ {  b* \! O+ m+ M
rbd: error opening image csi-vol-b2f19b24-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
2 G& ^) v8 V2 K$ B7 r% h6 @2 Z- w3 Brbd image 'csi-vol-b2f2129f-8501-11ed-b1b5-0a580a800692':
  _& O/ j4 s: i" F* }% _3 y  M' i        size 4 GiB in 1024 objects
- h  |. C, {: g# T        order 22 (4 MiB objects)  c0 [$ {( _, X
        snapshot_count: 0; {( o- W* i. P, v3 N' H
        id: 9e35c4964b54e( U6 q7 E: ]  A0 @+ L
        block_name_prefix: rbd_data.9e35c4964b54e
  `! ]+ A8 [9 v- j/ a        format: 2
% B1 I: f5 p% o6 j8 S! l5 r        features: layering
; ?9 D4 K" v/ o- ?/ m$ X  S        op_features: 8 B& g& C1 _3 ?% L
        flags: 6 z, [9 P- D4 T8 W  p
        create_timestamp: Tue Dec 27 13:42:32 2022) L6 _8 |& ]! d4 g; j/ M
        access_timestamp: Tue Dec 27 13:42:32 2022
, G7 i9 U; c7 W/ C% P5 P; [        modify_timestamp: Tue Dec 27 13:42:32 20226 ^$ Y' W# ]) k# C% h
2022-12-27 13:43:20.451 7fae7bfff700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory! W. B8 [2 ~- k2 u# l
rbd: error opening image csi-vol-b3029e8f-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
  H9 X: x3 G8 r9 h  ^2022-12-27 13:43:20.578 7fdb2cff9700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory! w/ T* w& i& A  c
rbd: error opening image csi-vol-b303459c-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
# I8 g1 R2 S3 M9 K$ D2022-12-27 13:43:20.712 7f8c20ff9700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory6 X% ^* Z1 p' i; o
rbd: error opening image csi-vol-b30eb6f2-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
" E; V. o1 j! _7 O2 K2022-12-27 13:43:20.842 7f85c97fa700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory0 _) _  C' z2 C: `. @! Q; I
rbd: error opening image csi-vol-b32e8f9f-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
& {  F9 h# U$ V( S2 h# c2022-12-27 13:43:20.969 7f6275ffb700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory
4 x- v& b- G  s6 U- M2 @rbd: error opening image csi-vol-b34e85cb-8501-11ed-b1b5-0a580a800692: (2) No such file or directory
6 u$ J$ k8 S5 T2022-12-27 13:43:21.100 7f87a1ffb700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory8 C; o; i+ l$ D
rbd: error opening image csi-vol-baf82adf-8593-11ed-b1b5-0a580a800692: (2) No such file or directory) D7 X" r8 \7 a2 ^1 l- }
2022-12-27 13:43:21.232 7f2bb5ffb700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory
, r- y+ ]7 V; t; lrbd: error opening image csi-vol-bb047f67-8593-11ed-b1b5-0a580a800692: (2) No such file or directory
! j: |0 @. Q7 ^1 s- srbd image 'csi-vol-bb2b265e-8593-11ed-b1b5-0a580a800692':. {( e) l" [* u+ ^/ @) `
        size 1 GiB in 256 objects+ X0 A+ z! E1 }
        order 22 (4 MiB objects)
: S3 a( H+ G6 r1 V        snapshot_count: 06 ]1 A# W' g+ T; m3 |# i5 m3 j* e
        id: 9e35c58d96058: S( p) R# @# |: `) C
        block_name_prefix: rbd_data.9e35c58d96058
* O* W, ~/ D% i9 }% L& h; j        format: 2/ y* }6 L3 s4 u- i3 ~
        features: layering
# q! q- Z3 Q' A) E6 P4 ]7 c6 J        op_features:
9 g" z# F" Q" [/ c        flags:
8 _$ Z$ t% ]' w! R& j& T        create_timestamp: Tue Dec 27 13:42:32 2022
" e' ], Q' j8 m- [        access_timestamp: Tue Dec 27 13:42:32 2022
) q: Q9 g- ]1 Y- j, ?6 d0 R        modify_timestamp: Tue Dec 27 13:42:32 20224 C: H1 \! L9 N
rbd image 'csi-vol-bb6e5aa3-80e1-11ed-b1b5-0a580a800692':
; f9 A/ F3 ^0 A6 V        size 1 GiB in 256 objects. [8 z0 P7 g9 i, R3 p
        order 22 (4 MiB objects)8 d. a( n4 w: }. G5 V; e4 p
        snapshot_count: 0
; D+ F( b# W$ c( F0 O        id: 9e35cc330328b3 H4 |( S2 K! Z2 O
        block_name_prefix: rbd_data.9e35cc330328b
% F# w, V$ u! k  m8 D7 w        format: 2. q0 h7 u. b$ _2 @: p& a. k8 S) Q
        features: layering
5 y; t! A& u/ H. W/ M1 S7 t        op_features:
2 [. m* ~3 b5 ?' s8 u6 a        flags:
8 V7 J3 c, `, A# F        create_timestamp: Wed Dec 21 11:44:21 2022; S0 }9 Y% q/ Z( F; d7 D. f1 c
        access_timestamp: Wed Dec 21 11:44:21 2022
! m" c& E7 s' t/ v& C- V  b0 z        modify_timestamp: Wed Dec 21 11:44:21 2022
* O6 X4 V4 B$ brbd image 'csi-vol-bc05b624-80e1-11ed-b1b5-0a580a800692':
; T9 ^2 m2 T! e& ]( h        size 1 GiB in 256 objects
& @3 z6 ?+ `5 f% ~: W) g% g6 p        order 22 (4 MiB objects)
2 C) o- j3 }1 c) k2 }        snapshot_count: 0' P' T- d7 j! c8 q, Z+ \; J
        id: 9e35c555b66a16 }6 t$ e) s! X; r1 O( V; ^3 m
        block_name_prefix: rbd_data.9e35c555b66a1
; M( i# Q0 Q( i% U5 c; j+ y* b. o        format: 2  i" r  i. ?. U! M3 d/ G
        features: layering
" ?# b" c6 ?6 Y        op_features:
+ y# `- x5 o; Q" S( k1 y& `        flags: ( @6 t3 X+ y* p9 [( i7 k5 U! [' I4 X
        create_timestamp: Wed Dec 21 11:44:22 2022! ]7 u% m2 ^$ r0 Y2 J) C, t$ O; |9 O
        access_timestamp: Wed Dec 21 11:44:22 2022
. p& C4 `! X1 O/ s7 g        modify_timestamp: Wed Dec 21 11:44:22 2022
3 _# V% v( S% v1 h' Rrbd image 'csi-vol-be3e584d-80e1-11ed-b1b5-0a580a800692':
" _% p3 A6 F  ?/ i- y        size 1 GiB in 256 objects3 R0 _# h; q$ q# v3 p0 ?
        order 22 (4 MiB objects)
7 g9 r$ R8 a/ `+ \- }. W        snapshot_count: 0
! s' N# _. `" N; T  l5 \        id: 9e35c5807bea6
" ~4 ~1 J# ]' J" s3 H( y        block_name_prefix: rbd_data.9e35c5807bea6
0 e! b) g* }# m! J$ A: I3 X        format: 2$ Q. ^; L$ `0 Q+ S1 e4 c% F2 ?
        features: layering
/ a  ~/ [  H( i3 f* _: J" T+ ]) t+ x        op_features:
9 b2 D# p8 y( G  ?        flags:
  h+ S4 t- X" @: Y" N8 ~        create_timestamp: Wed Dec 21 11:44:26 2022
1 B: T0 _4 _+ W) `; l        access_timestamp: Wed Dec 21 11:44:26 2022' _  L- B# R+ }1 }9 ]' Y
        modify_timestamp: Wed Dec 21 11:44:26 2022+ l6 c) e. L; d* P9 C+ f- {
rbd image 'csi-vol-bea2af04-80e1-11ed-b1b5-0a580a800692':9 o: y' r. Y2 L: q% N: x) k' b
        size 1 GiB in 256 objects3 C/ ^/ q* }4 G2 @9 M
        order 22 (4 MiB objects)% N, z9 ?$ k* M* ^0 Y6 I1 ?
        snapshot_count: 03 p" R! x# [! y# K7 u
        id: 9e35c5e845f7f
- l' b3 I. y% s4 S* p+ B        block_name_prefix: rbd_data.9e35c5e845f7f
5 Z( w1 r3 L4 P3 ]        format: 2
, C) U# b. w% E: m        features: layering
/ ~2 U) g" W, f        op_features: + j& o) D. ?. [8 r
        flags: # ?2 Z* H$ {1 l% s8 M" n: z
        create_timestamp: Wed Dec 21 11:44:27 20224 @, n' t( v" W6 ~$ ~7 w
        access_timestamp: Wed Dec 21 11:44:27 2022
3 V$ y$ O) E- Q6 |- t        modify_timestamp: Wed Dec 21 11:44:27 2022
" W6 e" L) {9 y4 erbd image 'csi-vol-da4243db-843e-11ed-b1b5-0a580a800692':; p9 {  J, G/ s( A2 P$ Y
        size 1 GiB in 256 objects: l$ u/ c9 _; q; }* l% V1 L
        order 22 (4 MiB objects)- x6 [- Y) O, b7 \/ R
        snapshot_count: 0
% j; v0 S! `; o9 c1 m! T2 |& w        id: 9e35c6661fbcb
- L8 D6 C+ T) X        block_name_prefix: rbd_data.9e35c6661fbcb
4 E/ X5 }9 L9 P" e* }2 i. Y% D        format: 2; \4 W8 G" Y3 ^9 o+ g6 ?
        features: layering. Q# @! M4 |0 ^( f0 O8 l  y% x! _
        op_features: % e) G/ l  G) {; m3 W' k. q" |
        flags: 3 C( B7 q5 c2 d; p
        create_timestamp: Sun Dec 25 18:28:36 2022
) g' l0 N! e  G7 N# X- U        access_timestamp: Sun Dec 25 18:28:36 2022
* D/ d0 s- {3 J3 J$ G  I        modify_timestamp: Sun Dec 25 18:28:36 2022) T0 Z9 p& {% G% O$ u3 f! \
rbd image 'csi-vol-da51cb65-843e-11ed-b1b5-0a580a800692':
$ o& E; M) _! X, F        size 1 GiB in 256 objects2 s: o4 C9 e" F( _6 j# G( C
        order 22 (4 MiB objects)
5 ]) x2 `6 B2 |$ f  ]        snapshot_count: 04 b  n- s5 F2 J& h$ {' g8 C
        id: 9e35c87f2899e
; y8 r( Y2 G$ c3 X  t- N7 t        block_name_prefix: rbd_data.9e35c87f2899e/ t0 g# N: m; R( R7 M' W
        format: 2# e. Y) P+ H4 O0 s( @) l
        features: layering
6 v8 P$ y1 f7 [! m        op_features: " i+ @% A; z) u
        flags:
4 Q5 {9 i2 I. _" D) D" z        create_timestamp: Sun Dec 25 18:28:36 2022, @* Y- X' U  n, e; e1 d
        access_timestamp: Sun Dec 25 18:28:36 2022
! N; U4 e4 t# m* t+ t5 @: t+ G4 }  j        modify_timestamp: Sun Dec 25 18:28:36 2022
8 h. z  V3 L  ]rbd image 'csi-vol-da62a26b-843e-11ed-b1b5-0a580a800692':- ?/ h% G3 X- y" N0 D
        size 1 GiB in 256 objects
' m+ {8 G# ?) n0 I9 f1 a        order 22 (4 MiB objects)
: U( k$ ]0 x4 K/ `% A- _2 ~        snapshot_count: 0" C! p) U! z+ c8 H+ N1 }" g1 d
        id: 9e35c5ba862f6
' b- l% W! J8 x& `  E! E. @        block_name_prefix: rbd_data.9e35c5ba862f6
6 g( Q0 P# I" A: n& ?        format: 2& H* b/ L) |7 C$ ?5 s
        features: layering
+ l6 @) Y9 c# I) I  Y  u' _% W$ E        op_features: + z4 N0 N" N  r* [
        flags: 2 F0 n- @- X  o3 {; y
        create_timestamp: Sun Dec 25 18:28:36 2022
6 u' C) x5 ?& h+ T+ J  F0 B        access_timestamp: Sun Dec 25 18:28:36 2022
% U" P  o6 e$ S$ V+ k  D) R  S! C        modify_timestamp: Sun Dec 25 18:28:36 2022! J' S! ]1 g1 v
rbd: error opening image csi-vol-ea1d1132-84fe-11ed-b1b5-0a580a800692: (2) No such file or directory1 t# ~2 W+ {- r
rbd image 'csi-vol-ea1d1212-84fe-11ed-b1b5-0a580a800692':3 G( w8 f# Y* q" d
        size 1 GiB in 256 objects
" z! N+ T1 o& h        order 22 (4 MiB objects)
. ^- R- N3 l* U5 m  x; v2 x5 k        snapshot_count: 01 L% E0 X7 w. Q5 |7 M
        id: 9e35c8129cb71# ^# z. `; t9 \; n3 J* b. z) a7 v  q
        block_name_prefix: rbd_data.9e35c8129cb71+ F% j. O- {1 D- u* }
        format: 2) x) _7 E* k1 Z5 U
        features: layering6 }% o: \9 {+ }" O$ H2 y
        op_features: $ E# G( R7 B8 ^. d9 K
        flags:
9 q  p( l  o+ J( A+ G        create_timestamp: Tue Dec 27 13:42:33 20227 R  t  w2 G" t5 R
        access_timestamp: Tue Dec 27 13:42:33 2022( G1 @' F5 S' T: o+ j
        modify_timestamp: Tue Dec 27 13:42:33 2022! y0 I% ^1 a3 h: f
rbd image 'csi-vol-ea2d24c2-84fe-11ed-b1b5-0a580a800692':4 Z. a2 Y, W2 D" {* H2 u8 A
        size 1 GiB in 256 objects. o% |8 u* c- o# H
        order 22 (4 MiB objects)" ^' W3 p' h! Z2 F
        snapshot_count: 0
6 E* u% ^" w9 E        id: 9e35c9d7b40a9
. v2 L2 q/ L/ B  J        block_name_prefix: rbd_data.9e35c9d7b40a95 l; m: [! h2 o1 n6 N, l+ h. C$ P
        format: 2, N; V; |) @1 F7 Y, s% c
        features: layering" Y0 ]& O& s# f* B/ S
        op_features: 1 k  r; J, m! y/ h1 b$ F5 h
        flags:
! z- ~, e, R# \& T        create_timestamp: Tue Dec 27 13:42:32 2022( L0 {' _# p( u( k# ^$ ]& G7 D
        access_timestamp: Tue Dec 27 13:42:32 2022
7 `# y/ G- Z( a& Y        modify_timestamp: Tue Dec 27 13:42:32 2022+ L* x/ F$ ?6 i/ k  M
2022-12-27 13:43:22.865 7f6ecf7fe700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory
) m% r; Q8 Q' I  b7 Y* ^! [rbd: error opening image csi-vol-ea2f7183-84fe-11ed-b1b5-0a580a800692: (2) No such file or directory3 `" K8 F% S: ~9 |( `
rbd: error opening image csi-vol-ea3d95e6-84fe-11ed-b1b5-0a580a800692: (2) No such file or directory
+ _! U2 @6 @0 H, R( v2022-12-27 13:43:23.122 7efe32050700 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No such file or directory! Y2 s# T3 L( |2 i9 Z$ k; {5 u" _) n
rbd: error opening image csi-vol-ea79cdf8-84fe-11ed-b1b5-0a580a800692: (2) No such file or directory9 E$ f9 @, g& `4 C+ R
rbd image 'csi-vol-ef1ea188-8598-11ed-b1b5-0a580a800692':' i$ o" A, k: m5 h) s, s. T9 `. ^
        size 2 MiB in 1 objects; ^3 L+ _. i9 s2 b
        order 22 (4 MiB objects)3 |5 g* n3 W2 F$ a  ?+ O
        snapshot_count: 0, Y: m+ m" L9 M9 h- {
        id: 9e35cc813ac84' v9 Y& s, j! M/ B$ {
        block_name_prefix: rbd_data.9e35cc813ac845 J/ k, \5 `- F% d3 a, ~# I
        format: 2
( _; W. J' v; U2 l% h2 Y        features: layering3 Q( |- Z1 o- T0 ?0 N1 ]/ M
        op_features:
) }# y% P' p7 C& G  M! L4 W        flags: $ O8 h( m5 D9 H# A. |- J
        create_timestamp: Tue Dec 27 13:42:32 2022
; k3 G( \8 b( G! g% l- i! F! L9 G        access_timestamp: Tue Dec 27 13:42:32 2022
2 k, e) P4 {# b  R        modify_timestamp: Tue Dec 27 13:42:32 2022
$ p2 y7 g- j- j0 x7 t- s  y6 m[root@ceph1 ~]# rbd rm ocs/csi-vol-ea2d24c2-84fe-11ed-b1b5-0a580a8006924 a( d8 b7 P3 M7 O& a4 K
Removing image: 100% complete...done." ~) M! E: E- ^% h: K* w3 C
[root@ceph1 ~]# rbd rm ocs/csi-vol-ea1d1212-84fe-11ed-b1b5-0a580a800692
. L7 r1 O/ m" q, {1 ~6 GRemoving image: 100% complete...done.6 M0 e* b$ s' q0 `& L. B) k
[root@ceph1 ~]# rbd rm ocs/csi-vol-da62a26b-843e-11ed-b1b5-0a580a800692
- |6 N/ i5 a, L) B/ D2022-12-27 13:44:16.570 7f3c92c45700 -1 librbd::image::PreRemoveRequest: 0x55b76f658880 check_image_watchers: image has watchers - not removing& X( J0 m, ^# c& ]& q6 S. @% p
Removing image: 0% complete...failed.
) i- `5 U3 E- Y% X3 X5 arbd: error: image still has watchers
  i7 W; s$ }( n& d* {This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout.
; y8 b9 E  p$ w1 R; ?# b. a' D6 O" X# L$ v6 N! _8 w. F

* I$ G# c/ a$ C; |( s! `
您需要登录后才可以回帖 登录 | 注册

本版积分规则

返回首页|Archiver|手机版|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )

GMT+8, 2026-6-12 00:13 , Processed in 0.019832 second(s), 22 queries .

Powered by Discuz! X5.0

© 2001-2026 Discuz! Team.

快速回复 返回顶部 返回列表