ERROR nova.scheduler.utils qemu unexpectedly closed the monitor

admin

2022-10-20 10:45:08.266 37 ERROR nova.scheduler.utils [req-035fc933-de6b-448a-978e-c15ae171daeb a3cfa6f70675429985132daa6d3b906e 0c915a0d7601493cb1ecfd904b09f54c - default default] [instance: 52baa020-426b-4800-9492-0654b834ef2a] Error from last host: compute07 (node compute07): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1863, in _do_build_and_run_instance\n    filter_properties, request_spec)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2143, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 52baa020-426b-4800-9492-0654b834ef2a was re-scheduled: internal error: qemu unexpectedly closed the monitor: 2022-10-20 10:44:54.063891 7fded43821c0 -1 Errors while parsing config file!\n2022-10-20 10:44:54.063897 7fded43821c0 -1 parse_file: cannot open /etc/ceph/ceph.conf: (13) Permission denied\n2022-10-20T02:44:54.292119Z qemu-kvm: -drive file=rbd:hdd-8T-volumes/volume-41da2d70-d3bd-4187-9f60-8b262286f292:id=cinder:auth_supported=cephx\\;none:mon_host=192.168.0.75\\:6789\\;192.168.0.77\\:6789\\;192.168.0.79\\:6789\\;192.168.0.86\\:6789\\;192.168.0.89\\:6789,file.password-secret=virtio-disk0-secret0,format=raw,if=none,id=drive-virtio-disk0,serial=41da2d70-d3bd-4187-9f60-8b262286f292,cache=none,discard=unmap: error reading header from volume-41da2d70-d3bd-4187-9f60-8b262286f292: No such file or directory\n']
( p' G8 d) ^; l4 q; v- }
* ~% D3 j# M3 x1 E
应该是ceph中pool池的权限问题
; l4 k  E% v  @. d- F# e/ f

admin

[root@controller1 src]# ceph auth caps client.nova mon 'allow r' osd 'allow class-read object_prefix rbd_children,allow rwx pool=images,allow rwx pool=ssd-volumes,allow rwx pool=hdd-2.4T-volumes,allow rwx pool=hdd-8T-volumes,allow rwx pool=nova-vms,allow rwx pool=backups'
; s" z  p& c* W# {% ]updated caps for client.nova

admin

0
8 w4 y4 _, [) X7 L; ~4 R

As noted in Openstack docs [1], rebuild is not supported for volume-based VMs.
  R: i1 ~- n$ k+ d8 d4 r
Assuming you are trying to rebuild the VM with a fresh image ("factory reset"), a slightly "hacky" solution is to replace the underlying volume with the fresh image while keeping the same pool/path.
6 n. \" h! l# c
For Ceph based backend, it would be something like

) i$ g& q$ k. Oopenstack volume show <...> => Get pool/path from rbd backend
- n6 Q$ d2 _: x! ^$ \% h! Q# vopenstack image show <...> => Get pool/path from rbd backend
$ n& R: C5 @* a& h8 Y, vopenstack server stop <VM> => Stop the VM

$ U( `+ S  `6 P8 B: s) P8 Yrbd -p <POOL NAME> mv <VM VOLUME UUID>  <VM VOLUME UUID>.old
rbd -p <POOL NAME> cp <IMAGE VOLUME UUID> <VM VOLUME UUID>
& P. e% I! F) QOnce the copy finishes, start the VM

openstack server start <VM>

admin

Nova:
. c, _, k/ i1 D9 OList of instances
! F, `0 U  u' [: B1
openstack server list
2
$ @: ^! U( E$ o- _  `+ C) [' hnova list
Details on a specific instance
# ?5 A7 O$ @8 J- I/ Q; I8 W/ y1
openstack server show <server id>
2
nova show <server id>
7 j+ T$ I7 P7 }/ v6 WRebuild an instance
1
openstack server rebuild --image <image-id> <server-id>
' o" \+ F! E" D# H2
nova rebuild <server-id> <image-id>
! J9 O: _6 n7 lRebuild an instance with metadata
1
openstack server set --property <meta> <server-id>
2
5 ?. Z* d# e: F' Bnova meta <server-id> set <meta>
3
nova rebuild --meta <meta> <server-id> <image-id>
Attach a port to an instance
1
- N0 F1 W, t! O) \3 T# y  Unova interface-attach --port-id <port id> <instance id>
Create a instance from a availability zone
1
1 u$ A5 F1 }* E2 t, x  A  q2 }nova boot --availability-zone nova:metal01:<ironic-id> --flavor <flavor-id> --image <img-id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> <name>
0 O* c) V; k9 {2
openstack server create --availability-zone nova:metal01:<ironic-id> --flavor <flavor-id> --image <img-id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> <name>
, j5 h0 ?0 v6 m" qCreate a instance with meta property, sec group, fixed ip, ssh-key
1
, W5 f" J1 s8 T) ]openstack server create --image <image id> --flavor <flavor id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> --property <meta-data> --security-group <security group id> --key-name <keypair name> vmname
8 v" x& Q/ M8 I9 j3 Y. {Create a instance
& q+ M* H, H& p6 e4 P; A  u1
openstack server create --image <image id> --flavor <flavor id> vmname
Remove error state from instance
1
; p4 B) k3 y1 V( N" Gnova reset-state --active <server-id>
" y: K; S+ Y- G! ]" Z& G' lChange the flavour (resize)
1
openstack server resize --flavor <flavor> <ID>
Neutron:
2 J- e; u' R+ A$ m5 m" w/ i6 RList of subnets and network ID
7 l. z2 L! a9 \1
% s; s0 V- v+ N- Yopenstack network list
8 ?/ a6 [( E  @' w1 v2
! ]3 p  o! P' f7 U4 t$ Dneutron net-list
* r1 ]+ Y6 l9 j1 }8 T9 kList of subnets, their IDs and allocation pools:
7 l+ }2 z: D7 Y$ _& B( i' Y1
1 c0 H2 d# n6 C: X' q3 R+ G! A" @/ dopenstack subnet list
9 d- }$ M2 h6 z7 S, }- w5 L' t9 i/ t2
neutron subnet-list
. ~) Z* J8 g' ~$ T" K6 W: _0 K$ C8 ]List ports
+ U, F5 a6 ]4 r, z4 [. I4 x; G. _1
8 g( I/ |' |5 H( Q6 t! a7 ^openstack port list
2
neutron port-list
) J* `! z# X( m2 s- P+ yCreate port
2 i% c. m6 b. m! X1
$ s, b: L9 F" {openstack port create --network <network id> --fixed-ip subnet=<subnet id>,ip-address=<ip-address>
( s1 C9 R/ C: z# C) r5 C0 n- G2
+ e& f0 X+ a0 |1 O7 X& |( G6 dneutron port-create --fixed-ip subnet_id=<subnet id>,ip_address=<X.X.X.X> <network id> <name>
. z- V7 t' `* x7 WUpdate or Set/Unset port
' ^4 r* E; q, u* Q1
neutron port-update --fixed-ip subnet_id=<subnet id>,ip_address=<ip-address> --fixed-ip subnet_id=<subnet id>,ip_address=<X.X.X.X> <port id>
2
+ L& j' i7 w0 Q0 C. Ropenstack port set --fixed-ip subnet=<subnet>,ip-address=<ip-address> <port id>
3
( r3 K  @' z) w+ `9 A) o% Z9 Bopenstack port unset --fixed-ip subnet=<subnet>,ip-address=<ip-address> <port id>
) O% [2 f5 K- G* wGet details on a port
! w/ F! [- p  N6 r2 h2 Y" K1
. t$ e6 k& w0 L7 K" |4 Aopenstack port show <port id>
2
neutron port-show <port id>
- _: X9 M8 \6 [Allowed address pairs - (Allows one port to add additional IP/MAC address pairs on that port to allow traffic that matches those specified values.)
1
neutron port-update <port-uuid> --allowed-address-pairs type=dict list=true ip_address='0.0.0.0/0'
Glance:
List images
4 N- c. C1 [. @$ H# W1
openstack image list
2
glance image-list
, d9 u( L/ z! O) i7 I. Y+ tGet details on an image
1
glance image-show <image id>
Upload a image
( ]# {0 \' _; E& \! c3 _& L1
openstack image create --disk-format qcow2 --container-format bare --public --file ./centos7.qcow2 centos7-image
Delete
! L& m% r9 g1 S) N$ Z0 n. d  j1
openstack image delete <ID>
Download a image
1
/ i) f! o2 O' n: s, s9 ~/ Uglance image-download <img-id> --file img.qcow2
6 r- W8 s1 [4 C3 ^Change state
, P2 D5 j0 z4 N$ n7 S) g4 j% d1
8 f3 i' l' S* d" C9 ^cinder reset-state --state in-use <id>
Other:
$ _. I# c0 e3 N0 L" g9 Y6 X$ S% _List flavors
7 M/ H/ j2 T$ W6 P, e: A7 K' b1
openstack flavor list
4 B2 M) P% l! NList keypairs
1
openstack keypair list
* q' }& y8 N7 q. E7 x9 YList Security groups
- N  G5 @5 s. F. t: X1
+ j  A& o  L& k' D! n0 W- v7 q$ @openstack security group list
Cinder
1
openstack volume set --state error <id>
- h7 E7 Y5 R  @$ u- f+ e3 R" NStop a migraion
* u3 X( d$ C, H% p6 ?
Remove the active volume from the migration state
8 q( q% p6 B) k  s3 I
# L4 _: |& S+ h1
cinder reset-state <id> --reset-migration-status
9 d0 Q4 Z' G6 g4 m4 \4 _find the volume in the attaching state and remove it
& x3 F* c( t8 N( `4 a2 K9 _
1
7 J8 \8 C; F8 S0 Iopenstack volume list
4 H4 k- V% M, n( }1
, P2 b* o1 u& H8 N  Q  t$ h0 O8 Xcinder reset-state <id> --state error
1
5 e% S1 ]& L- a* V( ^% \cinder reset-state <id> --reset-migration-status
7 G3 c; X% H, Vopenstack volume delete <id>
9 O: z7 w9 e, ~* k8 B1
& }, z: a4 m( }  K3 w8 [openstack volume delete <id>