关闭新创建卷的exclusive-lock功能 ceph 创建的镜像保留layering

admin

关闭新创建卷的exclusive-lock功能
如果是用Ceph Deploy进行的部署，则需要将配置文件分发到各个节点，在ceph.conf中增加rbd_default_features，写明你创建的卷需要哪几种属性。
[global]
! x! P/ a! H% |# q0 O, c- l
) j. W3 ?. D1 A- i5 s6 t5 w& yrbd_default_features = "layering, deep-flatten"
! {: r0 V$ d; h9 u# ~

4 G3 P( F* S8 C$ o9 b4 F/ B; E或者只保留
0 P8 J2 ]6 b, Trbd_default_features = "layering"
5 E& ?- _. J- ?
ceph-deploy --overwrite-conf config  push host09 host10 host11 compute06 compute07 compute08 compute09
  S: B) j. E! b( a% ]8 P
- {# I; `. a# y
此时再使用rbd create创建的卷默认就是这两种属性了
  {4 d8 W( m9 N[root@host09 deploy]# rbd create -p images testimage --size 5G
8 y  o- Z, b( @4 h: G2 v+ r0 a7 M5 t[root@host09 deploy]# rbd info images/testimage
8 z; F1 q8 _) `- nrbd image 'testimage':
, ?, c0 [3 p7 D size 5 GiB in 1280 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 68b1eebfa9994b
6 v' j) t$ L. b  R! y5 |/ Y9 O1 C block_name_prefix: rbd_data.68b1eebfa9994b
format: 2
features: layering
op_features:
* R4 O; y+ \8 \. T/ d8 {3 J flags:
create_timestamp: Tue Dec 28 10:45:15 2021
4 Z9 `& ]; q% I, E access_timestamp: Tue Dec 28 10:45:15 2021
% _9 t1 Y% `: Q! r" B9 | modify_timestamp: Tue Dec 28 10:45:15 2021


最后还需要对OpenStack各个模块的ceph进行更新，如果使用kolla更新，则替换所有配置文件，并重启容器。
+ Q! v' l* V( |4 ^0 z2 ?) z[root@host09 deploy]# scp ceph.conf controller1:/etc/kolla/config/glance/
ceph.conf                                                                                                                                                                      100%  595     1.2MB/s   00:00   
[root@host09 deploy]# scp ceph.conf controller1:/etc/kolla/config/nova
+ W/ q- }8 s# I1 cceph.conf                                                                                                                                                                      100%  595     1.2MB/s   00:00   
, g% p9 G7 {+ B9 H  a& K[root@host09 deploy]# scp ceph.conf controller1:/etc/kolla/config/cinder
ceph.conf                                                                           

. z- M$ r7 }8 s6 `* `) ~kolla-ansible -i multinode reconfigure

需要重启cinder相关服务
6 M+ M, H, T3 j7 U! j0 c1 N+ S

. u2 i  ^0 v- Y- C) U/ w& u
" _$ ]8 s$ U7 d* |9 E, \+ o[root@host09 deploy]# rbd info volume-5764f3d4-6654-4d5d-ad7c-2c36d03d1ccb -p pool-ssd-2
rbd image 'volume-5764f3d4-6654-4d5d-ad7c-2c36d03d1ccb':
$ e) d8 R0 l$ ? size 10 GiB in 2560 objects
' Y9 k( T( D/ ?9 k& C order 22 (4 MiB objects)
snapshot_count: 0
id: 8b52d05df0f51e
2 C6 H/ }; j+ {0 w$ u block_name_prefix: rbd_data.8b52d05df0f51e
' e$ H# {: N4 c' m8 E format: 2
features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
op_features:
$ U  k' f: f- [( U& e flags:
create_timestamp: Tue Dec 28 14:02:52 2021
access_timestamp: Tue Dec 28 14:02:52 2021
$ a: K- ]% ~+ c7 Q$ e modify_timestamp: Tue Dec 28 14:02:52 2021
; b3 i) r& N6 D5 R9 b- E* }1 F6 i. Y parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB

& r' A+ M& |& Y" d, r+ q- K[root@controller1 ~]# docker restart cinder_volume cinder_backup cinder_scheduler cinder_api
0 r9 @, F2 x$ C# B* Z7 @cinder_volume
* T! k7 l* y; g! ~cinder_backup
cinder_scheduler
cinder_api

) [* Y& e& M8 `+ @
[root@host09 deploy]# rbd info volume-5764f3d4-6654-4d5d-ad7c-2c36d03d1ccb -p pool-ssd-2
' m* ^  `- v( Hrbd: error opening image volume-5764f3d4-6654-4d5d-ad7c-2c36d03d1ccb: (2) No such file or directory
% w0 R# x* \  ]9 @4 \5 ?% o( Q[root@host09 deploy]# rbd info volume-94e28573-bfb9-4092-8d81-34f1e4059d97 -p pool-ssd-2
rbd image 'volume-94e28573-bfb9-4092-8d81-34f1e4059d97':
size 10 GiB in 2560 objects
order 22 (4 MiB objects)
5 t4 e8 A- r& ^3 H- ] snapshot_count: 0
7 N. ?: y8 L3 F+ E id: 8b576837a8afd1
6 ^; Y( ]+ z- n: [7 f block_name_prefix: rbd_data.8b576837a8afd1
, E1 G4 Z) m, u7 ^ format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 28 14:07:46 2021
access_timestamp: Tue Dec 28 14:07:46 2021
6 x3 v( A. p7 V0 k( Q- Y0 j/ ?6 @* h modify_timestamp: Tue Dec 28 14:07:46 2021
% S; Q1 s' k" T% O parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB

2 `9 M* P! n8 B. ^
2 |- g, `6 E5 h2 X" n2 s6 B
关闭exclusive-lock功能
通过查看rbd info，获取当前卷是否开启了exclusive-lock
# ?, Y/ j6 s- {4 h( i  Z0 Q0 X[root@compute201 ~]# rbd info volumes/volume-cad6425c-4453-4489-b2d1-45050b062bd2


关闭exclusive-lock功能，这里必须要和object-map或journaling一起关闭才能生效
) U$ j) h% b* k0 mrbd feature disable volumes/volume-cad6425c-4453-4489-b2d1-45050b062bd2 exclusive-lock,object-map
3 f# p( n! N) P" o% q
再次查看功能列表，features只剩下layering和deep-flattern
[root@host09 ~]# rbd info volumes/volume-cad6425c-4453-4489-b2d1-45050b062bd2
rbd image '27cea94c-9351-462f-a8ab-2cc84c9c2373':
" w9 T' \. q/ p$ y4 A; f$ `" z size 12 GiB in 1536 objects
) H9 |) `  _( P$ ^: d5 j order 23 (8 MiB objects)
snapshot_count: 1
- F/ _4 k( T& y4 t8 S id: 6761d8e16f525e
4 E( B; M1 P7 K; x1 u* r5 u/ S block_name_prefix: rbd_data.6761d8e16f525e
format: 2
features: layering, deep-flatten
op_features:
flags:
; V4 N5 K$ i5 @* B& I create_timestamp: Tue Dec 21 14:41:18 2021
, a: e0 n- L. p9 Y# E access_timestamp: Tue Dec 21 14:41:18 2021
modify_timestamp: Tue Dec 21 14:41:18 2021

8 y9 d2 f) G( B  n批量关闭所有卷的exclusive-lock


for i in $(rbd ls -p images );do rbd feature disable images/$i exclusive-lock,object-map,deep-flatten ;  rbd info images/$i ;done
6 l2 t& \* g8 t/ J+ \
* L1 ]* z7 w& l6 j6 N



' h0 J1 W" Y  T

admin

ceph支持 layering,striping exclusive lock, object map,fast diff ,deep-flatten 等新的new features
1 b. i8 ?3 Z0 a; F* ?& h* I: Mlayering
5 ~2 ?/ f; A$ j" `6 Yimage的克隆操作。可以对image创建快照并保护，然后从快照克隆出新的image出来，父子image之间采用COW技术，共享对象数据。

striping v2
条带化对象数据，类似raid 0，可改善顺序读写场景较多情况下的性能。

exclusive lock
保护image数据一致性，对image做修改时，需要持有此锁。这个可以看做是一个分布式锁，在开启的时候，确保只有一个客户端在访问image，否则锁的竞争会导致io急剧下降。 主要应用场景是qemu live-migration。

object map
此特性依赖于exclusive lock。因为image的对象分配是thin-provisioning，此特性开启的时候，会记录image所有对象的一个位图，用以标记对象是否真的存在，在一些场景下可以加速io。

fast diff
1 T! v" @5 N$ P& n: Z) M# H6 r+ e此特性依赖于object map和exlcusive lock。快速比较image的snapshot之间的差异。

deep-flatten
layering特性使得克隆image的时候，父子image之间采用COW，他们之间的对象文件存在依赖关系，flatten操作的目的是解除父子image的依赖关系，但是子image的快照并没有解除依赖，deep-flatten特性使得快照的依赖也解除。

journaling
依赖于exclusive lock。将image的所有修改操作进行日志化，并且复制到另外一个集群（mirror)，可以做到块存储的异地灾备。这个特性在部署的时候需要新部署一个daemon进程，目前还在试验阶段，不过这个特性很重要，可以做跨集群/机房容灾。

创建image的时候，jewel默认开启的特性包括: layering/exlcusive lock/object map/fast diff/deep flatten

Exclusive Lock
从上面可以看出，很多特性都依赖于exclusive lock，重点介绍一下。

exclusive lock 是分布式锁，实现的时候默认是客户端在第一次写的时候获取锁，并且在收到其他客户端的锁请求时自动释放锁。这个特性在jewel默认开启后，本身没什么问题， 客户端可以自动获取和释放锁，在客户端crash后也能够正确处理。

admin

[root@host09 deploy]# for i in $(rbd ls -p pool-ssd-2);do rbd feature disable pool-ssd-2/$i exclusive-lock,object-map,deep-flatten ;  rbd info pool-ssd-2/$i ;done
8 _: P8 I5 k* y: Urbd image 'volume-09fba6c8-5105-4ad5-9baf-2edc9c51fac7':
size 50 GiB in 12800 objects
* G/ n; W2 y! I order 22 (4 MiB objects)
snapshot_count: 0
id: 6764efb2270ebd
block_name_prefix: rbd_data.6764efb2270ebd
2 x! `6 g  ?* ?1 _5 @; @ format: 2
4 L1 A- [; ]! H* X) ~' K1 G features: layering
op_features:
$ b+ p# A0 M5 h% _- Q  E flags:
" _/ x' Q" {) \ create_timestamp: Tue Dec 21 14:26:04 2021
, {9 c8 H) _' X% G8 ^3 S+ S! U access_timestamp: Tue Dec 21 14:26:04 2021
modify_timestamp: Tue Dec 21 14:26:04 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
. n; q* N& T( Q. @9 W3 Urbd image 'volume-0d4b255b-5d7a-41a4-a29a-4b088f2abd7d':
size 200 GiB in 51200 objects
2 K1 b! q' j5 J6 o5 q. F) V order 22 (4 MiB objects)
( x1 g  K/ v- \4 v# ~, s$ S snapshot_count: 0
9 w# Z0 `) l) m$ g  f. i id: 76655d32817107
block_name_prefix: rbd_data.76655d32817107
, b$ r& V$ E/ f; A format: 2
9 v9 m; i  i' [' N features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:07:26 2021
  O* a/ R6 c" l access_timestamp: Tue Dec 21 15:07:26 2021
( Q0 n/ I* N+ x. T" t7 C1 y$ g* | modify_timestamp: Tue Dec 21 15:07:26 2021
) k: i( R( a0 N) g4 @rbd image 'volume-0e9a7ecb-4cb0-4f89-8831-da02a3fb23c6':
size 50 GiB in 12800 objects
1 y6 }! k" w7 N order 22 (4 MiB objects)
! k% R" }! C7 s: i, r snapshot_count: 0
9 `2 n( M* _. r! N  m" N) _ id: 767423573973d5
3 I) {. a; Y# T) s- y0 ? block_name_prefix: rbd_data.767423573973d5
( Z/ G" X. M5 L: `. Y8 ~9 O format: 2
4 W" r# K* w4 Y7 E/ {: K features: layering
9 L) s7 i8 U4 b8 I op_features:
  Q0 E/ z2 I7 R5 c; P4 j flags:
create_timestamp: Tue Dec 21 14:25:33 2021
  S; J! e! t+ X2 G% ~: v+ n1 ^ access_timestamp: Tue Dec 21 14:25:33 2021
modify_timestamp: Tue Dec 21 14:25:33 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
4 Z$ n  I+ Z$ t$ |/ K1 ^) S overlap: 3 GiB
rbd image 'volume-1a39ac81-4359-4e8c-b7b2-f5b8499c1136':
& o# X: W' R/ H* { size 50 GiB in 12800 objects
- M4 z) @' d7 d. F+ v; [6 N order 22 (4 MiB objects)
+ D  C4 W0 |0 w$ w3 h3 q) {3 u snapshot_count: 0
id: 7649ce2516e319
block_name_prefix: rbd_data.7649ce2516e319
5 f# ?% @$ s! |9 J format: 2
features: layering
: C% V/ J; M+ q5 N: ? op_features:
flags:
create_timestamp: Tue Dec 21 16:03:06 2021
; m3 w2 {/ ^5 e% N8 G access_timestamp: Tue Dec 21 16:03:06 2021
- x- B  e' f- x8 P! F: B* q4 D4 x modify_timestamp: Tue Dec 21 16:03:06 2021
* v& c1 {5 E- O7 N parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
( y, i9 {7 N  L4 {+ i; L8 K overlap: 3 GiB
rbd image 'volume-1e7c9937-a00b-411a-b79b-d31d2a37f2cb':
size 300 GiB in 76800 objects
& M- g% A8 W$ C, Z+ `, J! m order 22 (4 MiB objects)
2 K7 \5 R& C# N' r9 c' _  n' n snapshot_count: 0
2 V+ y, Z$ R# k id: 76c7001d371b6d
. N" J/ y8 F6 b% y8 k$ x( B9 ~ block_name_prefix: rbd_data.76c7001d371b6d
format: 2
, Q# S5 H' G# L( M' e, A features: layering
op_features:
! R' c0 Z3 h" K- J# \2 C flags:
: w% N4 {; n2 e; o2 k& F create_timestamp: Tue Dec 21 16:55:37 2021
access_timestamp: Tue Dec 21 16:55:37 2021
modify_timestamp: Tue Dec 21 16:55:37 2021
rbd image 'volume-24f9176e-7e23-407e-9e1d-d10598df72e4':
" N$ x' o6 m3 y! Q: f: V size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
% T/ C* P3 ?. v7 Q: J" \ id: 764a9a39902847
$ }( {2 }4 K$ F5 E6 ?2 g block_name_prefix: rbd_data.764a9a39902847
format: 2
* o# s( o1 N/ h features: layering
op_features:
flags:
! Z4 k! B& u' A7 F" ]8 o9 C" d create_timestamp: Tue Dec 21 16:03:35 2021
access_timestamp: Tue Dec 21 16:03:35 2021
" ~" I' z, T- q5 M modify_timestamp: Tue Dec 21 16:03:35 2021
' A9 b' x2 }$ ~# w! b$ X parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
. U/ R9 g* @/ jrbd image 'volume-297f6c84-8653-4e62-96c1-60bc93ab2d5f':
size 50 GiB in 12800 objects
. j" f+ `# J0 u4 d order 22 (4 MiB objects)
8 E: O4 `3 ~! `, e) G snapshot_count: 0
" ^1 t  Y- e0 G; _: i7 z9 H9 O( t7 J5 Z) E id: 764e686c9e848a
$ s6 k  E( N  h: | block_name_prefix: rbd_data.764e686c9e848a
format: 2
features: layering
. k+ n3 X9 D2 s4 O# w: q  J( h op_features:
* I3 z% Y) [3 Q5 n, t flags:
create_timestamp: Tue Dec 21 14:25:34 2021
) I; C, n& _$ A4 k6 C! u% z& } access_timestamp: Tue Dec 21 14:25:34 2021
' U; I- d8 }! i+ u4 \- r modify_timestamp: Tue Dec 21 14:25:34 2021
) d  M4 z5 p  F7 g; L/ N' N; B# o parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
$ ^8 d. m. W" e8 E1 h9 h# D" R- B overlap: 3 GiB
  z; n/ h7 |3 g7 v+ Qrbd image 'volume-2b0f3d5a-63ee-464e-a5a6-9f1ee639596b':
! F5 v' e9 ^9 A size 50 GiB in 12800 objects
order 22 (4 MiB objects)
" s* y& y8 \  P; N% N" s snapshot_count: 0
$ l' Q# k9 `1 W9 r, I0 Y- c5 W) B id: 76839f1e2b2b2b
block_name_prefix: rbd_data.76839f1e2b2b2b
format: 2
, d, B4 n# y" |  Q4 V7 t3 P features: layering
op_features:
5 \( e# g  {6 g4 k% z flags:
5 w9 l% b7 T( r3 m% T+ }+ ~0 q create_timestamp: Tue Dec 21 16:03:00 2021
access_timestamp: Tue Dec 21 16:03:00 2021
* \2 r6 \, |( E* F3 p  ? modify_timestamp: Tue Dec 21 16:03:00 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-2c99bf04-bf03-405d-a628-559451192a24':
6 r: R* [7 O% w6 m size 200 GiB in 51200 objects
order 22 (4 MiB objects)
1 h( i8 _5 x6 ^2 I* W snapshot_count: 0
5 K: Y0 ~$ o1 S# R6 |" z id: 762c34716910bc
% _- [6 W, f9 z/ W7 m2 R1 e block_name_prefix: rbd_data.762c34716910bc
format: 2
features: layering
; V+ s. k6 ?2 ?! p op_features:
flags:
& n& i$ q* [5 c% L2 J2 Z create_timestamp: Tue Dec 21 15:07:28 2021
; N& I" J5 Q1 {6 @1 h access_timestamp: Tue Dec 21 15:07:28 2021
modify_timestamp: Tue Dec 21 15:07:28 2021
rbd image 'volume-33537697-c9c4-47de-8a06-912d35b7a681':
size 50 GiB in 12800 objects
0 y7 `. Q& Z/ n1 [" h) ^ order 22 (4 MiB objects)
snapshot_count: 0
* a' e% k+ u) m8 a, T/ B id: 7649a12f5bd696
6 z4 Y) j& D7 y1 h( K0 L block_name_prefix: rbd_data.7649a12f5bd696
' @) ]9 u1 }9 b0 E: ?4 A format: 2
features: layering
, ]" J% J" t3 p$ c* A# l op_features:
flags:
: y) q, l0 i2 u7 N( y+ N7 ` create_timestamp: Tue Dec 21 16:02:57 2021
access_timestamp: Tue Dec 21 16:02:57 2021
7 H/ ?+ l4 I8 ^0 }5 \4 V modify_timestamp: Tue Dec 21 16:02:57 2021
  @7 y4 r) S! y+ O parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
- @) |  `7 ]4 V- _) Z overlap: 3 GiB
rbd image 'volume-3496b392-f1b0-4d04-a1ff-dbe4195ab53d':
- m% W9 o, M7 m0 e, i- | size 200 GiB in 51200 objects
4 x: O: t: _' G) E( Q" Z5 Q order 22 (4 MiB objects)
7 ~; Q6 }1 z! _7 _* c6 s snapshot_count: 0
id: 762aea3188652e
) D9 A- E, B3 I2 S4 u block_name_prefix: rbd_data.762aea3188652e
9 J$ Q0 c/ L, T) S+ u* S format: 2
0 l: W3 w% @% u8 v/ \& g) s features: layering
& b  y& l4 k% {5 h( { op_features:
flags:
create_timestamp: Tue Dec 21 15:05:26 2021
access_timestamp: Tue Dec 21 15:05:26 2021
  r( @1 T  S* m; o: k! m5 d. X/ } modify_timestamp: Tue Dec 21 15:05:26 2021
1 _9 Q& K; c6 xrbd image 'volume-3d0f3268-ae7a-4495-9024-c35eae56e408':
& R4 B% O3 P6 z1 w$ n: `$ f: [7 b size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
. |% W9 u2 A4 L: H3 g id: 764a102ec950ae
3 O# Q3 S: o# s: \+ i block_name_prefix: rbd_data.764a102ec950ae
format: 2
$ K6 r% \' F" k: f- G features: layering
$ M& p9 K. J/ `8 j9 d1 r! G op_features:
8 R; W# \# k; X4 g$ f  a flags:
8 m, z2 C  I* w2 x# k4 I create_timestamp: Tue Dec 21 16:03:14 2021
! `: a3 c' Q! ]5 M- |, |' \ access_timestamp: Tue Dec 21 16:03:14 2021
modify_timestamp: Tue Dec 21 16:03:14 2021
) `  M* S! K2 J2 i1 l+ s6 z parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
+ ~# {4 n* Q5 C1 }6 c8 Erbd image 'volume-4292ad38-b702-4efc-8c78-1640ef035dc1':
size 300 GiB in 76800 objects
, q* h- X- ]  M% I; z2 _ order 22 (4 MiB objects)
snapshot_count: 0
: w" G4 N6 \0 z9 M9 [( M id: 76a0221ac5a494
# C: i( ?- g' z; ~. b* ] block_name_prefix: rbd_data.76a0221ac5a494
( b# G5 d0 p& b* b( ` format: 2
% D  ^+ j% ~  g; d# B features: layering
op_features:
* i( v2 a6 C9 ^7 H flags:
create_timestamp: Tue Dec 21 16:55:29 2021
access_timestamp: Tue Dec 21 16:55:29 2021
1 A3 z) i* ^) X! g7 p modify_timestamp: Tue Dec 21 16:55:29 2021
rbd image 'volume-4462eabd-ca96-49e1-9441-cbdbd3ca5545':
size 800 GiB in 204800 objects
4 r4 @1 |- U, z' I6 o! K order 22 (4 MiB objects)
snapshot_count: 0
7 F$ w1 }! w  h1 p" E id: 7667c83f695d0d
! w6 T3 P; o/ R4 u, T  }2 n+ p block_name_prefix: rbd_data.7667c83f695d0d
* Y4 j8 V- S, n+ E format: 2
. \3 m6 |1 z3 V" B$ g) F) J) Q/ u features: layering
" s, T! [- P8 f% d0 ~- ] op_features:
flags:
) T" T  ~2 U' b- | create_timestamp: Tue Dec 21 16:57:06 2021
: d* R- p' H- M- E! A" M access_timestamp: Tue Dec 21 16:57:06 2021
modify_timestamp: Tue Dec 21 16:57:06 2021
rbd image 'volume-44b8b50b-da58-4f87-b763-2e486db57c40':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
9 m  I9 t  m" j) O9 S) r. D id: 76a03465b93493
, G) m. J* c( T" c6 ^ block_name_prefix: rbd_data.76a03465b93493
! @) }+ f- N: |& J format: 2
& C1 q/ ^& I& r* @. Z( H features: layering
$ N. b3 r" b- @/ H% C5 w0 u op_features:
# x2 H' s- {5 Y2 r flags:
7 g6 F5 I! y- O create_timestamp: Tue Dec 21 16:55:32 2021
; u  V- f' I; k access_timestamp: Tue Dec 21 16:55:32 2021
modify_timestamp: Tue Dec 21 16:55:32 2021
! M$ m% \, X1 W/ e4 srbd image 'volume-56bbe515-a46f-4032-b83d-4c550984c221':
7 B( q5 ]+ y5 r9 D& a: X% E+ I size 50 GiB in 12800 objects
9 S$ w; f' G6 n  N$ H1 s1 C2 B' o order 22 (4 MiB objects)
snapshot_count: 0
3 f0 `$ ]% [) w: ?7 m id: 67683abfd264bb
0 _. R0 D1 r- f5 H block_name_prefix: rbd_data.67683abfd264bb
" c5 N. p% I5 @& }# O- m6 W7 h format: 2
  g7 L, G8 n% S! p" N features: layering
op_features:
4 t2 W* ?# x% J flags:
create_timestamp: Tue Dec 21 16:03:03 2021
3 ^1 S1 W1 u  N) a- p access_timestamp: Tue Dec 21 16:03:03 2021
- a% R3 `3 x( s  M modify_timestamp: Tue Dec 21 16:03:03 2021
- a  r  \1 `) S( L: a parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
7 v- T3 s( o% @( L' x5 p  irbd image 'volume-5977cc4e-e74a-4c1e-9633-143300fad25c':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
5 `' e0 z. M) O3 }9 {" E' ?& L id: 764a5854b54223
block_name_prefix: rbd_data.764a5854b54223
* ]+ m5 ?* R+ i; n+ ] format: 2
2 e( \( ^9 R$ i0 P4 j features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:23 2021
access_timestamp: Tue Dec 21 16:03:23 2021
# Z2 m1 O3 a2 k& p modify_timestamp: Tue Dec 21 16:03:23 2021
; j, e' A; m1 w9 q8 [0 B2 [) J$ s parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
+ m+ M" N% }% U8 ] overlap: 3 GiB
rbd image 'volume-5df5a07d-32d7-468c-bfe4-eaa8ce1bfe2b':
  J( s- M" D: J5 R size 300 GiB in 76800 objects
' S9 j, p5 g, y: W( }4 o order 22 (4 MiB objects)
snapshot_count: 0
id: 76683d768f7399
* T% S( _/ v6 P7 p  O8 _* O block_name_prefix: rbd_data.76683d768f7399
" W% U4 J) g7 `7 O. T" h! n3 [ format: 2
; d/ I" d' D. _/ [ features: layering
! d- X( u7 E" j5 h" h. ?$ f) _+ R op_features:
/ a. }) S; V5 R flags:
create_timestamp: Tue Dec 21 16:57:41 2021
! V* i% u6 g4 X; k& [6 O access_timestamp: Tue Dec 21 16:57:41 2021
modify_timestamp: Tue Dec 21 16:57:41 2021
rbd image 'volume-6bb44053-a438-46f5-b716-7be5e117f4a2':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
0 W4 Z' ?, x# y9 [! U2 k* V) P snapshot_count: 0
id: 765bd35e155cdb
" V! }  f+ x2 x* S block_name_prefix: rbd_data.765bd35e155cdb
format: 2
features: layering
) m6 |+ e. k; W& L1 v op_features:
flags:
create_timestamp: Tue Dec 21 14:50:07 2021
access_timestamp: Tue Dec 21 14:50:07 2021
modify_timestamp: Tue Dec 21 14:50:07 2021
parent: images/27cea94c-9351-462f-a8ab-2cc84c9c2373@snap
* t8 ]: l& s1 B! V. E) } overlap: 12 GiB
# h6 i3 n+ B) e+ X3 Mrbd image 'volume-6ef2c4bd-6dbd-45f3-8c4a-85d9bb5096c7':
6 c& A% L+ x3 n! z( X" A+ j size 200 GiB in 51200 objects
8 d' Q5 W  u5 Q5 Z  q order 22 (4 MiB objects)
snapshot_count: 0
id: 768c1d3a46efa1
block_name_prefix: rbd_data.768c1d3a46efa1
3 F: |0 [$ _; Z; ? format: 2
features: layering
op_features:
& \  Z, O3 q' u3 `8 K2 L flags:
create_timestamp: Tue Dec 21 15:07:33 2021
1 a0 E  m" g) G1 J6 P access_timestamp: Tue Dec 21 15:07:33 2021
& n5 K% x, ~% z+ p6 n+ q0 z modify_timestamp: Tue Dec 21 15:07:33 2021
! l2 E4 }9 |5 trbd image 'volume-7112c816-6e1f-478c-9662-84022148b452':
size 1000 GiB in 256000 objects
! N8 [! E: c4 }! z order 22 (4 MiB objects)
snapshot_count: 0
! b$ V' d* w4 Q id: 76649a1ff835b9
block_name_prefix: rbd_data.76649a1ff835b9
) m; m( X' x$ s! ?3 d! H  d format: 2
features: layering
op_features:
& y- K$ R; `0 g/ r6 c0 _0 E flags:
create_timestamp: Tue Dec 21 15:06:06 2021
access_timestamp: Tue Dec 21 15:06:06 2021
modify_timestamp: Tue Dec 21 15:06:06 2021
rbd image 'volume-7ac3c10a-3bd5-47e1-b72d-a4d489d9463c':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76155d2dcd247a
/ r- O% i, C+ E- H block_name_prefix: rbd_data.76155d2dcd247a
. `/ T; z: y% L1 e+ N format: 2
features: layering
+ z. I2 y. n' K! [8 I* ` op_features:
flags:
create_timestamp: Tue Dec 21 14:25:56 2021
access_timestamp: Tue Dec 21 14:25:56 2021
modify_timestamp: Tue Dec 21 14:25:56 2021
) M3 `4 H  C+ K+ G: z0 @5 w parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
6 U& [. \# d/ L, @* ?, A6 h7 _ overlap: 3 GiB
; g; |3 q: b) _  y0 trbd image 'volume-7de50d45-4d09-48ff-a852-fd37ae7a52a4':
) t" \% s/ p' w. g2 \ size 500 GiB in 128000 objects
- N, k. F0 B! q/ T* f order 22 (4 MiB objects)
snapshot_count: 0
1 w( E. }6 h/ W- S6 i0 B5 ?" U. \2 @ id: 768af72c0cea68
" C4 e, _, h& v block_name_prefix: rbd_data.768af72c0cea68
! i, f/ U/ o; q format: 2
6 F0 b3 J. L/ E- l, \. d features: layering
* D$ c- x% a* `# @ op_features:
8 U; e5 d9 ?" @) d flags:
create_timestamp: Tue Dec 21 15:05:51 2021
access_timestamp: Tue Dec 21 15:05:51 2021
/ |6 d2 p' J! d5 @* ], s# \ modify_timestamp: Tue Dec 21 15:05:51 2021
* P( s& p* M6 ?/ U. b3 V3 Y- Jrbd image 'volume-7eca33cd-9496-45da-a002-08bfd3b9c03c':
8 x" T  t! r. S0 [ size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7649f56b7c40d7
, r; |/ ?; I' e block_name_prefix: rbd_data.7649f56b7c40d7
format: 2
% x( Z* J0 l5 ^6 L2 W9 w features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:08 2021
+ c1 O2 y4 z; V9 S' L access_timestamp: Tue Dec 21 16:03:08 2021
modify_timestamp: Tue Dec 21 16:03:08 2021
- j* ?4 ?) z4 A7 J parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
' B+ e  o" F/ r( L1 u' i1 a overlap: 3 GiB
2 T& y* J+ N, @: ^* Trbd image 'volume-80f9c548-d859-4179-ba43-c4fdec3452aa':
size 50 GiB in 12800 objects
6 Q" m$ N7 b7 n3 E! X! C order 22 (4 MiB objects)
snapshot_count: 0
id: 761590277f00cd
block_name_prefix: rbd_data.761590277f00cd
format: 2
features: layering
op_features:
flags:
4 y( z1 Z- V3 `. \; M create_timestamp: Tue Dec 21 14:26:08 2021
access_timestamp: Tue Dec 21 14:26:08 2021
modify_timestamp: Tue Dec 21 14:26:08 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-82c1ab08-9ddc-461b-8138-673673e838a8':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
: ?' k4 b7 p2 v snapshot_count: 0
id: 6761512d939d64
% X. ^! G) F4 s( }. T1 M block_name_prefix: rbd_data.6761512d939d64
# x, ^. u! {+ k$ ?$ T, b format: 2
features: layering
op_features:
flags:
' m9 f) M$ c& W9 r% ~ create_timestamp: Tue Dec 21 14:25:44 2021
access_timestamp: Tue Dec 21 14:25:44 2021
modify_timestamp: Tue Dec 21 14:25:44 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
0 X! e7 M% v) L" Y- b5 e overlap: 3 GiB
, m# O9 k6 R2 U  o5 crbd image 'volume-88639cfc-006b-4122-bf79-3d365f7dd61e':
- u) ~( D! V6 B# l5 Z# z' t3 M0 L: p size 50 GiB in 12800 objects
) g' b! \+ a# ] order 22 (4 MiB objects)
snapshot_count: 0
* K% x5 v- X+ H1 i: E8 @ id: 7614fa6c44421e
block_name_prefix: rbd_data.7614fa6c44421e
) J: q. L. C+ Q# f0 X; w9 O4 T format: 2
& V! G: M* J. c( Y" Y2 X features: layering
op_features:
3 z9 D2 q& Z- c. ]3 e5 R flags:
create_timestamp: Tue Dec 21 14:25:37 2021
( [5 k1 f; N( F# D access_timestamp: Tue Dec 21 14:25:37 2021
: X7 w$ D5 E' J2 e modify_timestamp: Tue Dec 21 14:25:37 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-938b9eef-d356-4e5d-9426-8294308b7ecf':
size 50 GiB in 12800 objects
$ k& L9 e7 h3 h; t order 22 (4 MiB objects)
snapshot_count: 0
/ ~0 S' h1 H# Q- D; j id: 6768435708b0de
block_name_prefix: rbd_data.6768435708b0de
/ b, q& `# Y$ F% q4 u format: 2
features: layering
op_features:
! a* `( R5 o& L% B! F& w+ K flags:
( m# c! w2 ~& ~ create_timestamp: Tue Dec 21 16:03:29 2021
access_timestamp: Tue Dec 21 16:03:29 2021
/ g& P/ t$ t, \, s7 D0 R modify_timestamp: Tue Dec 21 16:03:29 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
! F6 U2 q. \3 s% P+ ~+ ?, B  c overlap: 3 GiB
rbd image 'volume-95b875c4-b19f-472d-b96f-a960f6f8ff9e':
5 {, \2 K9 f) o$ a! d8 q size 50 GiB in 12800 objects
order 22 (4 MiB objects)
# p* o+ Y8 h1 b0 Q snapshot_count: 0
id: 764ebf7edc1ffb
block_name_prefix: rbd_data.764ebf7edc1ffb
format: 2
1 H- f" I& ]% g3 s features: layering
6 \- g  _  S) V* k' m' a7 B op_features:
flags:
create_timestamp: Tue Dec 21 14:25:52 2021
, U! }: \0 E7 | access_timestamp: Tue Dec 21 14:25:52 2021
modify_timestamp: Tue Dec 21 14:25:52 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-9644fae0-c650-496a-90d7-4fff86cd07ea':
size 100 GiB in 25600 objects
, J* b+ }" D7 Q9 Q order 22 (4 MiB objects)
snapshot_count: 0
id: 67629faddb27d7
/ B8 a+ d( ~; H block_name_prefix: rbd_data.67629faddb27d7
( V, ]$ m* \; R) e. | format: 2
features: layering
op_features:
flags:
; }/ y! n/ _* \4 x% b! R5 Q create_timestamp: Tue Dec 21 15:03:45 2021
access_timestamp: Tue Dec 21 15:03:45 2021
; B& n' [5 j( d) F) w& s2 v& y/ q modify_timestamp: Tue Dec 21 15:03:45 2021
rbd image 'volume-99a12832-9533-43b4-8c5e-f8cc22743fcc':
3 w7 u7 v' @: {8 r" U! E; |  j size 50 GiB in 12800 objects
  D0 p% c2 a, d2 ]  h& N order 22 (4 MiB objects)
snapshot_count: 0
id: 6764a255c03488
block_name_prefix: rbd_data.6764a255c03488
format: 2
features: layering
) `$ r0 J2 T5 v6 k; \) A# M op_features:
flags:
create_timestamp: Tue Dec 21 16:03:17 2021
+ ]3 m" q. s; U. [6 A access_timestamp: Tue Dec 21 16:03:17 2021
modify_timestamp: Tue Dec 21 16:03:17 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
6 D; ]' G) E+ r: P) i overlap: 3 GiB
rbd image 'volume-9e8b1bd5-5f9a-4ab4-a850-0ff6dfb17812':
# a: Y" |1 q: T/ V! D. N size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 6764ee913a8d51
block_name_prefix: rbd_data.6764ee913a8d51
format: 2
% r$ T% {3 ~7 T9 U' \3 K  c  ? features: layering
: ~& G2 \; ^* }" p2 s! G( ^ op_features:
, Z* j4 B& P0 O" z8 E0 A# k flags:
$ n% H2 c9 S  N create_timestamp: Tue Dec 21 14:25:59 2021
access_timestamp: Tue Dec 21 14:25:59 2021
modify_timestamp: Tue Dec 21 14:25:59 2021
& C9 H8 L4 m" H/ r$ m3 M% { parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-a0ec6af3-dc17-4350-8512-f54b8174f846':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7667fb7ecb6a2d
block_name_prefix: rbd_data.7667fb7ecb6a2d
( b; L: h" |7 p+ k2 v format: 2
( B6 n# Y! {' u7 P features: layering
op_features:
flags:
1 J! j( M6 s* s7 j/ A: | create_timestamp: Tue Dec 21 16:57:27 2021
6 k* c0 S# h4 H' c7 Q- ? access_timestamp: Tue Dec 21 16:57:27 2021
modify_timestamp: Tue Dec 21 16:57:27 2021
* R2 d7 I" S0 L% H& @. v' M& Prbd image 'volume-a22d3c0b-2a37-4b44-8786-e7e118c8d420':
size 200 GiB in 51200 objects
order 22 (4 MiB objects)
9 {9 w2 s4 W5 Y4 w5 }6 a( c; E snapshot_count: 0
id: 768be1577139e0
block_name_prefix: rbd_data.768be1577139e0
format: 2
6 L( h# o" |2 ]( U' o2 ~" g features: layering
3 \8 e+ L% ]7 X1 c op_features:
! v7 d3 W4 K5 p- |. X  T flags:
create_timestamp: Tue Dec 21 15:07:21 2021
4 x" j' O% N; |6 S- Z% z/ h  @ access_timestamp: Tue Dec 21 15:07:21 2021
' ~0 r. n7 o# d4 s2 U modify_timestamp: Tue Dec 21 15:07:21 2021
rbd image 'volume-a3fdc982-9b86-4630-913f-77c2b3bce265':
' Y1 ?3 d3 l1 I( W) W size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
1 q( e( H/ z' B8 [) h$ W6 ]2 n9 t id: 76152a17b25c38
/ H2 G( |4 z- W) U, C4 y& h& F block_name_prefix: rbd_data.76152a17b25c38
format: 2
. h8 T# o$ q9 |3 V2 F features: layering
op_features:
flags:
+ N) E2 F# X, T" }+ X9 Z8 i create_timestamp: Tue Dec 21 14:25:49 2021
access_timestamp: Tue Dec 21 14:25:49 2021
; _& Y& Q! N( g- G' h modify_timestamp: Tue Dec 21 14:25:49 2021
( V! q4 W. {4 N- i$ z$ C parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
, H$ u' l5 {4 N. r$ ^: d8 K. D1 T5 Urbd image 'volume-a5075012-cb83-44d5-8b8d-48da26f651ef':
) u  L6 K! ^" T size 300 GiB in 76800 objects
5 ~  x" W' ]* K" a4 W3 G7 ?' D order 22 (4 MiB objects)
snapshot_count: 0
$ {9 x- x7 k3 k: H id: 76c6f156306791
- A8 Y8 A9 I3 H% `3 R block_name_prefix: rbd_data.76c6f156306791
format: 2
, f- \( f9 [( |) O7 p1 x) K features: layering
# i5 @0 d+ n7 `! b# R op_features:
- C/ o  E% [2 M# z, Q( V flags:
create_timestamp: Tue Dec 21 16:55:35 2021
2 I3 |  I& R  Q access_timestamp: Tue Dec 21 16:55:35 2021
; e' n) I- W1 _+ c. q3 _ modify_timestamp: Tue Dec 21 16:55:35 2021
& O+ m& H7 ~; q& H" irbd image 'volume-a6f435a4-5365-4959-af97-2b332d4043c0':
- {, S: X, q3 ?$ D size 50 GiB in 12800 objects
order 22 (4 MiB objects)
7 I* @6 B# C( T0 ~9 M snapshot_count: 0
id: 6765bfd302d612
+ i4 t& r  a# J' q, S5 w- E, D block_name_prefix: rbd_data.6765bfd302d612
3 I6 ?2 c* U; N! G* v. L format: 2
features: layering
op_features:
  c1 [: q( Y$ c/ O! }2 S2 n+ [0 q! }+ X flags:
/ ?, F! s! ~9 A" W! z7 {( b5 w create_timestamp: Tue Dec 21 14:50:16 2021
+ ^; s% `+ z+ |+ a access_timestamp: Tue Dec 21 14:50:16 2021
modify_timestamp: Tue Dec 21 14:50:16 2021
4 M: y7 {+ O8 N# X parent: images/27cea94c-9351-462f-a8ab-2cc84c9c2373@snap
overlap: 12 GiB
7 D0 A( m2 |! @/ ]rbd image 'volume-a6fbd219-2954-49e5-a1f3-31fb5dd367b0':
- Z. W* L' n( W4 l4 ]3 j6 O size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 764eaa37d57693
, ^$ E0 ~* Y- L block_name_prefix: rbd_data.764eaa37d57693
3 C# }! ?" p( u( ^0 j* ~+ ]0 d* p4 D format: 2
9 {, ^2 \: U% S features: layering
op_features:
2 q/ W# f4 J1 i flags:
+ x4 H3 S' [3 S; s3 _ create_timestamp: Tue Dec 21 14:25:46 2021
access_timestamp: Tue Dec 21 14:25:46 2021
modify_timestamp: Tue Dec 21 14:25:46 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
6 W) |8 }" G/ M4 l7 C8 T overlap: 3 GiB
rbd image 'volume-a77c496b-3cce-40d5-9599-8db25bbaae6b':
' i9 |2 z( W  }& p8 \ size 200 GiB in 51200 objects
order 22 (4 MiB objects)
) X& M+ y0 }4 S; y9 q snapshot_count: 0
3 A5 |& X2 S) F6 z+ Y' f id: 762c5563f65e63
block_name_prefix: rbd_data.762c5563f65e63
format: 2
features: layering
, [0 a& h3 D! V, a2 C5 d6 B op_features:
flags:
" ~+ U* V% n2 p create_timestamp: Tue Dec 21 15:07:36 2021
4 j4 p% K0 C/ o5 p, \9 q access_timestamp: Tue Dec 21 15:07:36 2021
modify_timestamp: Tue Dec 21 15:07:36 2021
) D9 S% O" p/ j9 Drbd image 'volume-a89d9954-8bfa-4a5c-9311-4a8a48c9fc34':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
6 |& W1 j5 W6 u snapshot_count: 0
0 x! T! q# u3 e( a: n id: 76817050826b7b
- n( `% j9 z+ O9 @8 y! [3 F2 a+ R3 _ block_name_prefix: rbd_data.76817050826b7b
format: 2
' ]- p' W/ D5 y4 o" Y8 s features: layering
/ C- h4 S8 H5 x4 `5 ?8 B8 j8 @5 M. o op_features:
flags:
: ?; Y9 j+ m, Y3 H7 m create_timestamp: Tue Dec 21 14:49:13 2021
. A( ^$ g1 _3 X& R& {3 G; J access_timestamp: Tue Dec 21 14:49:13 2021
/ V; y6 p. q5 q modify_timestamp: Tue Dec 21 14:49:13 2021
& A8 s$ H# l& _, I1 I parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
# Y; _9 g/ I: y overlap: 3 GiB
' v" D" V( M+ T  u" R7 v, orbd image 'volume-a93290f8-d97e-4650-9b8c-9e6ccdc64eaa':
2 x. ~7 F& ]4 Z1 ]& M size 50 GiB in 12800 objects
! i+ C$ d& F; J8 o* l3 H order 22 (4 MiB objects)
5 l( ^! `6 q  @8 c1 ~ snapshot_count: 0
id: 764f197a9ea6a4
3 g$ E1 }" l4 z! x$ e3 A block_name_prefix: rbd_data.764f197a9ea6a4
* i4 r. U8 i! ~9 F format: 2
features: layering
8 k' v+ _% Z3 b+ q op_features:
flags:
create_timestamp: Tue Dec 21 14:26:10 2021
5 ]0 @, o! E' y( x& W access_timestamp: Tue Dec 21 14:26:10 2021
: }3 O1 n9 n/ ?& I9 m# X2 r1 ]9 l modify_timestamp: Tue Dec 21 14:26:10 2021
. f) W; r# Q7 `- m; Y$ q' S parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
/ O, C/ m: c6 E( orbd image 'volume-a9e1f522-6381-4f46-8e4d-89f0903c69fd':
5 H4 v. Y+ K! p8 ]+ \7 g size 50 GiB in 12800 objects
( h% k( x, p4 m) K order 22 (4 MiB objects)
" q% @# ^% u' k7 e snapshot_count: 0
id: 67615033e84ba7
& k$ P+ c+ u2 i. ]8 U block_name_prefix: rbd_data.67615033e84ba7
1 N( c; `4 H. f+ D format: 2
features: layering
* t6 ?& u& \* f1 T op_features:
% P! ?8 D7 e& J1 V( E9 a flags:
create_timestamp: Tue Dec 21 14:25:40 2021
access_timestamp: Tue Dec 21 14:25:40 2021
* u( i6 d# o( M+ }% p; s6 D modify_timestamp: Tue Dec 21 14:25:40 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
7 T1 z; Y( |5 _4 Y5 Frbd image 'volume-ab893b99-b16a-4bb2-9267-057f837dc3e8':
size 800 GiB in 204800 objects
order 22 (4 MiB objects)
; B5 A. T9 f# {, V snapshot_count: 0
& R  D4 s0 C( O6 u+ [7 N/ ]$ ^ id: 76b58e343acc17
5 N+ q1 l0 k7 @; _ block_name_prefix: rbd_data.76b58e343acc17
format: 2
. ~1 c  F( P" ?, D- f6 a1 ? features: layering
- H' A3 o" p3 N. e op_features:
2 q& ~: t4 S$ Q flags:
1 p5 g; x' m, K  U2 x: y- x/ p create_timestamp: Tue Dec 21 17:33:39 2021
access_timestamp: Tue Dec 21 17:33:39 2021
9 A- L" @( u3 A3 b+ a9 l" X; Q" o modify_timestamp: Tue Dec 21 17:33:39 2021
# c/ A5 r, s5 `& g( x6 y  |rbd image 'volume-b873845e-5531-4e20-b03d-f4804e36ea30':
size 300 GiB in 76800 objects
& S/ A1 p  i4 V4 M order 22 (4 MiB objects)
snapshot_count: 0
id: 676c709d6a8f9a
block_name_prefix: rbd_data.676c709d6a8f9a
4 D# X. Z! {* b8 e. K format: 2
& t% s- d( G1 {" M features: layering
8 `6 @2 F# k' i9 c! u+ r4 } op_features:
& y- n, H# u* J# J, t5 V' q0 o, k. r flags:
8 N/ a; w! U! H4 J create_timestamp: Tue Dec 21 16:55:41 2021
access_timestamp: Tue Dec 21 16:55:41 2021
modify_timestamp: Tue Dec 21 16:55:41 2021
rbd image 'volume-bdef9eb8-24d1-4e9e-8fbb-c934a65ad9db':
. u* }; o1 g- A+ `+ k2 w size 200 GiB in 51200 objects
0 t4 V# @: W2 z4 e$ i order 22 (4 MiB objects)
0 W$ ~3 F' \4 @3 J6 `. w snapshot_count: 0
* ]7 j! y5 p( D; h$ @' L; @ id: 762c3d74495521
block_name_prefix: rbd_data.762c3d74495521
format: 2
5 s7 g0 t8 m/ K- @0 @& l0 a features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:07:31 2021
access_timestamp: Tue Dec 21 15:07:31 2021
# i9 |! }# I; s% z% i! A; S0 n3 D) |6 { modify_timestamp: Tue Dec 21 15:07:31 2021
rbd image 'volume-be8c6b33-cf02-43b4-9747-99b85cd34420':
size 50 GiB in 12800 objects
' ]6 G+ e  F  x6 p$ R order 22 (4 MiB objects)
8 K0 H) C' d- ] snapshot_count: 0
' C- D2 k* X$ } id: 764a4073521264
# C4 ]( L6 p1 g6 o- H block_name_prefix: rbd_data.764a4073521264
format: 2
features: layering
op_features:
flags:
0 m3 u4 {- x! k3 Z' G7 Z create_timestamp: Tue Dec 21 16:03:20 2021
access_timestamp: Tue Dec 21 16:03:20 2021
modify_timestamp: Tue Dec 21 16:03:20 2021
! `: F8 [0 _$ d0 q" @ parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
2 ?5 E& S9 M  ]5 E( Brbd image 'volume-cda2c070-56e5-48e6-b842-bdf0eb77011c':
. b; `" k2 r9 m& B5 x: s size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
3 d8 }% x$ H6 \) w: | id: 76670549b0bdc7
block_name_prefix: rbd_data.76670549b0bdc7
' z  _* x1 B- M+ D8 m3 E: v$ J format: 2
2 P( H0 t7 K, s3 v! _ features: layering
" d( n* ^; P5 J2 \+ A" ] op_features:
) s; e) t* L6 h# f4 ]! |, h4 g flags:
create_timestamp: Tue Dec 21 16:55:43 2021
access_timestamp: Tue Dec 21 16:55:43 2021
modify_timestamp: Tue Dec 21 16:55:43 2021
rbd image 'volume-d7df52f9-e093-4221-b0a8-6169d0222fa8':
+ f! p0 ~8 W& K3 v size 50 GiB in 12800 objects
+ X2 L& O. {1 ^& v: n& i order 22 (4 MiB objects)
4 n) u& I$ h1 i. h+ Q4 V snapshot_count: 0
- a" x8 G5 s9 O* C5 K id: 6764a0194b60bd
block_name_prefix: rbd_data.6764a0194b60bd
8 G+ L, b0 D3 ?; ]+ _* e4 ^ format: 2
features: layering
op_features:
: G9 ^7 L0 V+ G- H0 t# w6 K! O( Y4 s flags:
create_timestamp: Tue Dec 21 16:03:11 2021
) m& c4 T0 R& p+ d2 ~ access_timestamp: Tue Dec 21 16:03:11 2021
4 i- z% U" y. K7 O. Y3 ? modify_timestamp: Tue Dec 21 16:03:11 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
; u$ \0 u" ^( y: q6 x overlap: 3 GiB
rbd image 'volume-d8ec53b6-c759-4b3c-a737-a6f389ef8350':
size 300 GiB in 76800 objects
  p" D& W7 z, G- A* U order 22 (4 MiB objects)
snapshot_count: 0
. ]+ D: m5 i3 [* m2 D id: 76c6ca1fb6d17d
block_name_prefix: rbd_data.76c6ca1fb6d17d
' U$ A* T8 C4 x, f format: 2
features: layering
! U4 y3 N4 ?# K/ Q& y op_features:
( [! l! Y& N$ {- |" W0 H' @( s flags:
5 C( x5 b- m/ f8 _ create_timestamp: Tue Dec 21 16:55:27 2021
access_timestamp: Tue Dec 21 16:55:27 2021
3 H( m# y7 Z- @( e9 m modify_timestamp: Tue Dec 21 16:55:27 2021
rbd image 'volume-e1438141-7eba-4f51-bc94-415357c7d9f5':
size 50 GiB in 12800 objects
! M. D1 \2 p& s; |2 Q* e order 22 (4 MiB objects)
snapshot_count: 0
id: 76b19447a4e2de
9 K/ I% l! b8 W% f block_name_prefix: rbd_data.76b19447a4e2de
format: 2
8 i% q0 w7 `& ?6 `) U" C& W features: layering
op_features:
flags:
2 ?" j( M$ h: J3 O; x create_timestamp: Tue Dec 21 16:15:52 2021
$ P; s) W; M3 r' a$ k access_timestamp: Tue Dec 21 16:15:52 2021
modify_timestamp: Tue Dec 21 16:15:52 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
5 Q* W/ T* t/ ^) {  B. b overlap: 3 GiB
9 H& \+ Z! E+ s4 Yrbd image 'volume-e7009ca3-3464-411e-929f-4908c6d9e0bf':
size 500 GiB in 128000 objects
order 22 (4 MiB objects)
3 M+ j( l0 n. [3 U$ b* v snapshot_count: 0
# [8 |% M5 O  N9 ]* y& [; p# ~- X. N id: 762b2c42063fd7
block_name_prefix: rbd_data.762b2c42063fd7
format: 2
: V1 `' n5 t4 @* @ features: layering
  m2 c, m. r" o: z% d2 [- }6 J op_features:
flags:
3 G. H; }8 `- z# F# [2 n, m create_timestamp: Tue Dec 21 15:05:54 2021
access_timestamp: Tue Dec 21 15:05:54 2021
; C& |, H% W% c3 j" _: i. o8 W modify_timestamp: Tue Dec 21 15:05:54 2021
rbd image 'volume-e8deaee0-94dc-4b97-8e85-8a834c6e3105':
size 200 GiB in 51200 objects
order 22 (4 MiB objects)
/ w/ K1 X, l7 r1 ?3 A snapshot_count: 0
id: 762c28603b89fa
, U* i; |3 n4 N( V. }0 y block_name_prefix: rbd_data.762c28603b89fa
* F, b. K% `# g4 a( u( E format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:07:24 2021
. G0 q% Y4 b% v" z8 } access_timestamp: Tue Dec 21 15:07:24 2021
) h( g. {8 d- C5 E6 `. U modify_timestamp: Tue Dec 21 15:07:24 2021
rbd image 'volume-e9f69e5c-944a-4575-87bc-b39303ab180f':
: {$ h; S( Y$ h1 h" g5 f# X size 300 GiB in 76800 objects
, `3 F2 F* x  [( s order 22 (4 MiB objects)
snapshot_count: 0
8 Z! N2 e- l9 C) C1 I  T id: 676671dbaa29c6
2 j" B$ g$ G& | block_name_prefix: rbd_data.676671dbaa29c6
format: 2
features: layering
op_features:
; Q& T* J; q/ z; v) U# P6 r& G flags:
create_timestamp: Tue Dec 21 16:55:51 2021
- x0 a4 Y( R+ T& `! p access_timestamp: Tue Dec 21 16:55:51 2021
modify_timestamp: Tue Dec 21 16:55:51 2021
rbd image 'volume-eab97070-36a0-4e21-b9bf-ff62667f57b7':
size 300 GiB in 76800 objects
. g0 w  l: f1 ]; @. G  | order 22 (4 MiB objects)
& X- V! d7 J2 j' D snapshot_count: 0
id: 76a05e1312c292
block_name_prefix: rbd_data.76a05e1312c292
format: 2
features: layering
% |4 o. S' H) M! E' S. Y8 A op_features:
* c3 J) u: w9 D6 h# e6 P. L2 @ flags:
4 s" ]5 j/ ~3 V- g+ c create_timestamp: Tue Dec 21 16:55:46 2021
1 a$ H7 _4 L  B9 D5 g access_timestamp: Tue Dec 21 16:55:46 2021
4 @7 d8 V5 q8 H4 x6 R) S, b modify_timestamp: Tue Dec 21 16:55:46 2021
rbd image 'volume-ee0c41d7-0eca-47c5-8c65-0e85ce0cd3e3':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
) n3 A" W5 U: ] snapshot_count: 0
4 [/ O9 R6 o& B# B7 J& v; i1 ?/ v id: 76842942f7b9b8
block_name_prefix: rbd_data.76842942f7b9b8
format: 2
features: layering
7 t. Y& O( N5 C: O# M! k  x5 E op_features:
& {# G5 c& r4 E4 g# b flags:
6 R+ r: }6 D' v+ Z create_timestamp: Tue Dec 21 16:03:26 2021
access_timestamp: Tue Dec 21 16:03:26 2021
modify_timestamp: Tue Dec 21 16:03:26 2021
7 v6 b/ C) |4 |8 g parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
4 ~2 O/ h, a; {rbd image 'volume-f0716fa2-8864-4b29-ae24-8afc9380d6f9':
size 300 GiB in 76800 objects
9 j; W* ~; d) _ order 22 (4 MiB objects)
snapshot_count: 0
* w7 [. `, U+ W: U5 d! K( k id: 676a190347ba9c
' Y' o: h$ w$ u: G9 a block_name_prefix: rbd_data.676a190347ba9c
format: 2
" o, s) o2 A! z* n features: layering
op_features:
7 ?5 i( ?7 \0 |+ X* q: D: X5 ~ flags:
create_timestamp: Tue Dec 21 16:57:44 2021
- R0 g% s3 z$ j' b/ _" T access_timestamp: Tue Dec 21 16:57:44 2021
modify_timestamp: Tue Dec 21 16:57:44 2021
rbd image 'volume-f38923e0-bba4-4c57-be10-c04246c6f7a7':
/ U- ^0 ^# @) F) b size 1000 GiB in 256000 objects
order 22 (4 MiB objects)
snapshot_count: 0
. r  J3 Y& V/ y/ X$ } id: 7664ac1069eb97
$ ~# v. ]. C, E. P block_name_prefix: rbd_data.7664ac1069eb97
1 O9 c) y" F4 z1 E format: 2
, M0 y" a% `2 k, Q7 x6 q. |3 T& F- n features: layering
) \, ^7 B% [6 g: w+ A2 r op_features:
4 F. z- A# b7 f1 h( r# D, a2 x flags:
) d/ D9 s; {! Y3 i, W8 D- U/ n create_timestamp: Tue Dec 21 15:06:10 2021
" e- h* A5 L1 p/ Y1 m% F8 c8 S access_timestamp: Tue Dec 21 15:06:10 2021
modify_timestamp: Tue Dec 21 15:06:10 2021
% ?' K% v0 u3 I1 ~rbd image 'volume-f45e5cca-0a25-4f00-afab-ad9438c18415':
+ z: ~1 g) @  J5 _  `7 B9 g% X size 300 GiB in 76800 objects
order 22 (4 MiB objects)
' _9 b& M. h7 i# K snapshot_count: 0
id: 7667177732beee
+ A7 y9 P) S+ m, q* ~; S3 M block_name_prefix: rbd_data.7667177732beee
3 e3 f( b/ _7 k! a- a  ^/ N) ] format: 2
features: layering
  }2 Y1 I" C1 s$ N: R4 S9 S1 z op_features:
flags:
6 E/ |: |4 K0 u) s9 R$ m create_timestamp: Tue Dec 21 16:55:48 2021
access_timestamp: Tue Dec 21 16:55:48 2021
modify_timestamp: Tue Dec 21 16:55:48 2021
' l# }  C$ k, w' I2 ?* G

admin

涉及的nova模块也需要重启。
- A+ ?6 ^% M) d1 ^" O控制节点：
docer restart  nova_api          nova_conductor    nova_consoleauth  nova_novncproxy   nova_scheduler
* M6 K% e+ l, _计算节点：
4 m) Q* t4 U- y$ @3 p  Q7 O- o! i! _docer restart  nova_compute  nova_libvirt  nova_ssh

admin

docker restart nova_api nova_conductor nova_consoleauth nova_novncproxy nova_scheduler

admin

docker restart cinder_volume cinder_backup cinder_api cinder_scheduler