|
1、SJ-6-Cloud121 192.168.170.121 操作 创建ceph 磁盘类型 cinder type-create sata02 cinder type-key sata02 set volume_backend_name=CEPH02_SATA cinder type-create sata03 cinder type-key sata03 set volume_backend_name=CEPH03_SATA
( z6 }% w8 }& w配置cinder文件 mkdir /etc/ceph/ceph02/ mkdir /etc/ceph/ceph03/ scp 192.168.170.36:/etc/ceph/ceph.conf /etc/ceph/ceph02/ scp 192.168.170.36:/etc/ceph/ceph.client.admin.keyring /etc/ceph/ceph02/ scp 192.168.170.41:/etc/ceph/ceph.conf /etc/ceph/ceph03/ scp 192.168.170.41:/etc/ceph/ceph.client.admin.keyring /etc/ceph/ceph03/ enabled_backends=sata02,sata03 [sata02] volume_driver=cinder.volume.drivers.rbd.RBDDriver volume_backend_name=CEPH02_SATA rbd_pool=volumes rbd_ceph_conf=/etc/ceph/ceph02/ceph.conf rbd_user=cinder rbd_secret_uuid=62b1ed02-5de2-4a53-be1e-0477d1b385ae rbd_max_clone_depth=10 rbd_flatten_volume_from_snapshot = false rbd_store_chunk_size=4 J/ J- l: ]' I
[sata03] volume_driver=cinder.volume.drivers.rbd.RBDDriver volume_backend_name=CEPH03_SATA rbd_pool=volumes rbd_ceph_conf=/etc/ceph/ceph03/ceph.conf rbd_user=cinder rbd_secret_uuid=62b1ed02-5de2-4a53-be1e-0477d1b385ae rbd_max_clone_depth=10 rbd_flatten_volume_from_snapshot = false rbd_store_chunk_size=4
$ B; ~; p* G4 q4 y192.168.170.121 获取cinder glance key 获取默认ceph cinder glance 认证key scp /ect/ceph/ceph.client.cinder.keyring 192.168.170.36:/etc/ceph/ scp /ect/ceph/ceph.client.glance.keyring 192.168.170.36:/etc/ceph/
! v! U' {. K2 a7 K+ _% k; L4 ^ssh 192.168.170.36 导入ceph02 auth key 删除 ceph auth import -i ceph.client.cinder.keyring ceph auth import -i ceph.client.glance.keyring 更新权限ceph ceph auth caps client.glance mon 'allow r' osd 'allow class-read object_prefix rbd_children, allow rwx pool=volumes, allow rwx pool=images'
$ R z- k) `+ y+ F3 n1 g, e, B& \: h192.168.170.121 获取cinder glance key 获取默认ceph cinder glance 认证key scp /ect/ceph/ceph.client.cinder.keyring 192.168.170.41:/etc/ceph/ scp /ect/ceph/ceph.client.glance.keyring 192.168.170.41:/etc/ceph/ & k2 o; @9 e2 {
ssh 192.168.170.41 导入ceph03 auth key 删除 ceph auth import -i ceph.client.cinder.keyring ceph auth import -i ceph.client.glance.keyring 更新权限ceph ceph auth caps client.glance mon 'allow r' osd 'allow class-read object_prefix rbd_children, allow rwx pool=volumes, allow rwx pool=images' 重启cinder服务服务 openstack-service restart openstack-cinder-api openstack-service restart openstack-cinder-scheduler openstack-service restart openstack-cinder-volume 配置完此处之后，glance从镜像启动创建磁盘时，rabbitmq消息，多个后端cinder-volume都有可能接收到；此时应该指定默认的类型来接收；
% ~$ C. S0 B; B: T" t[url=] [/url]
1 A/ _* W* t( u7 E9 R1 故障2 3 消息4 Build of instance 9865bdf5-12e5-4147-b1cf-d0e33a5ae88d aborted: Failure prepping block device.5 编码6 5007 详情8 File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2235, in _do_build_and_run_instance filter_properties) File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2349, in _build_and_run_instance 'create.error', fault=e) File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__ six.reraise(self.type_, self.value, self.tb) File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2319, in _build_and_run_instance block_device_mapping) as resources: File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2458, in _build_resources reason=msg) [url=][/url]
# Z% p" {# I8 l, K+ y- B+ j
{4 g6 D$ n% C9 b& R5 |* z+ C1 k+ k1 `. g6 }( z+ \
cinder配置多ceph后端：并指定默认pool3 @+ g& z8 k# H) |9 V
创建type： cinder type-create XXX8 X. r) g/ K3 |1 H5 T1 H6 e
cinder type-list
7 d( F9 M7 [2 P9 j+-------------------------------------------------------+--------+
) G$ I0 C- G/ c| ID | Name |
; Q0 K+ O" P. q( y, P7 U$ |; ^+-------------------------------------------------------+--------+
7 M% l/ C7 d8 H8 x6 f! M) Y! H/ Q| 1908f00c-a865-472c-8f90-c44d29361bd3 | sata03 |
% L( c2 l, H* h, q| 3b6e978f-839b-4164-b5e5-8e6e2d63fdde | sata |9 A/ p: `& y8 q* P( l
| ead23626-0bb9-4515-9906-0b5e6f41320a | sata02 |3 ^. @& ?& ?, }- y% U& z
+-------------------------------------------------------+--------+) C& x$ ^) } }
0 {" C; e; r0 h4 I
指定extra-specs：cinder type-key XXX set volume_backend_name=CEPH_XXX5 g2 E3 H n5 l% U: H; E6 B# @
cinder extra-specs-list; S; a4 x$ x( i# p2 t0 B- |
+------------------------------------------------------------+--------+------------------------------------------------------------+
o9 X1 ~' c2 \" V| ID | Name | extra_specs |
# T; {8 Y1 X; D; t/ W0 q+------------------------------------------------------------+--------+------------------------------------------------------------++ g& \% ?/ u8 `& {- ^8 e
| 1908f00c-a865-472c-8f90-c44d29361bd3 | sata03 | {u'volume_backend_name': u'CEPH03_SATA'} |! |4 {# Y' _3 T0 y' }- C
| 3b6e978f-839b-4164-b5e5-8e6e2d63fdde | sata | {u'volume_backend_name': u'RBD_SATA'} |
7 Y0 s' ^! \( K( V4 ]1 B| ead23626-0bb9-4515-9906-0b5e6f41320a | sata02 | {u'volume_backend_name': u'CEPH02_SATA'} |
( }+ Q: B+ ^! d) e8 l3 s+------------------------------------------------------------+--------+------------------------------------------------------------+: R s- l" {0 Z# e I
9 ]3 {0 q) o( S/ q2 G' [
修改cinder.conf:3 x, t" ^% q) z# X+ P; S
在DEFAULT段下指定default_volume_type = XXX: O6 p) w1 G: ^
$ `5 Z* [. a+ T& f- @
[DEFAULT]
* h+ M8 P0 K0 P...
# F8 ?1 n9 R" o$ P! odefault_volume_type=XXX #glance创建的磁盘将位于此处: Z. X' ~8 F4 @- o
enabled_backends=sata02, XXX
2 {4 T( l2 ]) P5 ~) W( n' _/ E" Z
4 W% E: o, g# d% E[XXX]6 U( B& ]# y& J
volume_driver=cinder.volume.drivers.rbd.RBDDriver9 u$ I0 Q: D' S6 w
volume_backend_name=CEPH_XXX% B0 f5 x9 Z9 d3 c" ?6 J" j
rbd_pool=volumes& v. I+ D5 E/ C2 }
rbd_ceph_conf=/etc/ceph/ceph02/ceph.conf9 q& d9 u3 V; G
rbd_user=cinder
' y+ z4 s2 M; Erbd_secret_uuid=62b1ed02-5de2-4a53-be1e-0477d1b385ae
, Q, U$ h5 ^" G `0 p+ orbd_max_clone_depth=10
+ F0 X- _- m V/ f3 [* | s/ trbd_flatten_volume_from_snapshot = false
7 z" E! m5 ^4 T; arbd_store_chunk_size=4 | 
发表于 2020-11-25 15:12:12