ERROR nova.scheduler.utils qemu unexpectedly closed the monitor

admin

2022-10-20 10:45:08.266 37 ERROR nova.scheduler.utils [req-035fc933-de6b-448a-978e-c15ae171daeb a3cfa6f70675429985132daa6d3b906e 0c915a0d7601493cb1ecfd904b09f54c - default default] [instance: 52baa020-426b-4800-9492-0654b834ef2a] Error from last host: compute07 (node compute07): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1863, in _do_build_and_run_instance\n    filter_properties, request_spec)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2143, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 52baa020-426b-4800-9492-0654b834ef2a was re-scheduled: internal error: qemu unexpectedly closed the monitor: 2022-10-20 10:44:54.063891 7fded43821c0 -1 Errors while parsing config file!\n2022-10-20 10:44:54.063897 7fded43821c0 -1 parse_file: cannot open /etc/ceph/ceph.conf: (13) Permission denied\n2022-10-20T02:44:54.292119Z qemu-kvm: -drive file=rbd:hdd-8T-volumes/volume-41da2d70-d3bd-4187-9f60-8b262286f292:id=cinder:auth_supported=cephx\\;none:mon_host=192.168.0.75\\:6789\\;192.168.0.77\\:6789\\;192.168.0.79\\:6789\\;192.168.0.86\\:6789\\;192.168.0.89\\:6789,file.password-secret=virtio-disk0-secret0,format=raw,if=none,id=drive-virtio-disk0,serial=41da2d70-d3bd-4187-9f60-8b262286f292,cache=none,discard=unmap: error reading header from volume-41da2d70-d3bd-4187-9f60-8b262286f292: No such file or directory\n']

% C3 ~: q* n7 E5 L  n
应该是ceph中pool池的权限问题

admin

[root@controller1 src]# ceph auth caps client.nova mon 'allow r' osd 'allow class-read object_prefix rbd_children,allow rwx pool=images,allow rwx pool=ssd-volumes,allow rwx pool=hdd-2.4T-volumes,allow rwx pool=hdd-8T-volumes,allow rwx pool=nova-vms,allow rwx pool=backups'
' E0 j) c' w- f' h4 v) a3 _1 Dupdated caps for client.nova

admin

0


3 _9 \# ], n9 L, I5 e# `' LAs noted in Openstack docs [1], rebuild is not supported for volume-based VMs.

Assuming you are trying to rebuild the VM with a fresh image ("factory reset"), a slightly "hacky" solution is to replace the underlying volume with the fresh image while keeping the same pool/path.
( q4 o/ v9 _, c# c6 `# k8 j
! p9 L  l) q# l# pFor Ceph based backend, it would be something like
6 m4 U9 [+ y1 k) W9 `
3 J" p& G- d, V8 ^; F. {openstack volume show <...> => Get pool/path from rbd backend
openstack image show <...> => Get pool/path from rbd backend
8 u1 ?& T+ G- @, G3 oopenstack server stop <VM> => Stop the VM

. v7 _8 [; b, t* C& [6 m5 crbd -p <POOL NAME> mv <VM VOLUME UUID>  <VM VOLUME UUID>.old
! ]0 |  b/ |$ arbd -p <POOL NAME> cp <IMAGE VOLUME UUID> <VM VOLUME UUID>
Once the copy finishes, start the VM

openstack server start <VM>

admin

Nova:
List of instances
1
% Z: z( ]! p7 z( A( {, i( E6 sopenstack server list
2
3 ?9 g0 H6 v1 Y& |, e5 Rnova list
Details on a specific instance
) x1 A, `8 h: w! m1
  c5 m! B4 k# W, Y* s  @openstack server show <server id>
6 I1 K% W4 t) Z2
( [. x* j  Y8 J0 `; T) G" fnova show <server id>
Rebuild an instance
0 @, X; J8 V# P0 o1 O* o1 R2 c0 S# ~$ ?1
openstack server rebuild --image <image-id> <server-id>
( g* q: M7 \0 d. r' U$ t2
  L& O: m3 R7 {; X: w# k, ]! `/ vnova rebuild <server-id> <image-id>
Rebuild an instance with metadata
7 O6 X* O8 R6 S0 \1
openstack server set --property <meta> <server-id>
% `" J0 o8 \+ i- Y2
7 ?9 l" z9 a1 F4 lnova meta <server-id> set <meta>
5 L( y9 \: a% S3
nova rebuild --meta <meta> <server-id> <image-id>
, K' H" C  m8 x& u# B2 ^Attach a port to an instance
% U+ D5 g0 q: U& n! q1
nova interface-attach --port-id <port id> <instance id>
Create a instance from a availability zone
1
8 L8 K$ d3 z/ x8 V6 qnova boot --availability-zone nova:metal01:<ironic-id> --flavor <flavor-id> --image <img-id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> <name>
2
openstack server create --availability-zone nova:metal01:<ironic-id> --flavor <flavor-id> --image <img-id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> <name>
Create a instance with meta property, sec group, fixed ip, ssh-key
1
openstack server create --image <image id> --flavor <flavor id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> --property <meta-data> --security-group <security group id> --key-name <keypair name> vmname
+ D$ G7 z0 n: @9 V7 G  a( DCreate a instance
1
openstack server create --image <image id> --flavor <flavor id> vmname
Remove error state from instance
1
" }$ v% z  T4 q, C& Inova reset-state --active <server-id>
Change the flavour (resize)
  g! S9 w% L- u$ {1
1 g8 d7 F8 g* X- l7 Sopenstack server resize --flavor <flavor> <ID>
/ a8 A9 }% ^! bNeutron:
0 T" M# J4 p+ D9 TList of subnets and network ID
- ^6 T( t4 e. n0 p; I1
, Q! U3 Y$ L6 |. h/ Z2 L8 Ropenstack network list
6 P8 E) h0 P) P6 ~0 M2
neutron net-list
7 a$ V: Y) f4 d+ x0 [, U. bList of subnets, their IDs and allocation pools:
2 T: I6 o3 S% l1 _" K6 g1
openstack subnet list
6 R4 _0 U5 f2 j# t9 i" ]: Q2
: X# P0 G1 w% N% V0 O* J; ^+ I; Eneutron subnet-list
/ a' U0 K. n& b: \List ports
1
, N0 s9 c9 \' b, n+ K: D9 Nopenstack port list
( M$ V) V) F% w5 o- Z; x0 c0 T$ A. w! L5 I2
neutron port-list
( ~; l8 t4 g$ \. P& f! f0 _Create port
3 t7 ?' W$ k8 M. e- `* B$ J) W1
openstack port create --network <network id> --fixed-ip subnet=<subnet id>,ip-address=<ip-address>
# r! a9 {# C6 q4 [3 t* Z2
. H8 k0 P4 o2 Y$ O. s/ Uneutron port-create --fixed-ip subnet_id=<subnet id>,ip_address=<X.X.X.X> <network id> <name>
Update or Set/Unset port
1
neutron port-update --fixed-ip subnet_id=<subnet id>,ip_address=<ip-address> --fixed-ip subnet_id=<subnet id>,ip_address=<X.X.X.X> <port id>
2
7 Q4 {. _. g7 Dopenstack port set --fixed-ip subnet=<subnet>,ip-address=<ip-address> <port id>
3
. F+ ]. h( R0 k! ]6 Z6 f) Z/ b8 Topenstack port unset --fixed-ip subnet=<subnet>,ip-address=<ip-address> <port id>
4 l5 I0 O9 e; T8 Y0 v, }Get details on a port
0 ?, x4 Y; ^+ ~9 N7 E0 g9 O0 {1
/ h9 k8 X& J% d1 zopenstack port show <port id>
2
neutron port-show <port id>
Allowed address pairs - (Allows one port to add additional IP/MAC address pairs on that port to allow traffic that matches those specified values.)
6 ~. z/ U" X' P& F) L( a. Q1
- m* [, p, Q6 W6 Mneutron port-update <port-uuid> --allowed-address-pairs type=dict list=true ip_address='0.0.0.0/0'
0 V, g# ]8 S" y+ B0 J" LGlance:
/ Q" Z+ A  W7 b" @: ]" WList images
9 s5 [; \  ^5 N* s1 y1
/ j3 E' t; ~, _7 v/ T4 i: k1 b& ]3 [openstack image list
9 A7 @' Q: B1 W( N2
# ?* A. }- {( _/ I8 y, Fglance image-list
Get details on an image
- l, d! n% ~7 Z1 q& o1
glance image-show <image id>
Upload a image
: r8 @; r+ e3 Z5 P1
openstack image create --disk-format qcow2 --container-format bare --public --file ./centos7.qcow2 centos7-image
Delete
1
7 |# I  D( {# U  F7 ?openstack image delete <ID>
Download a image
0 X& I3 V, b* d6 @8 G7 @1
1 V7 r  K9 t/ k/ o( aglance image-download <img-id> --file img.qcow2
Change state
( N" g9 D" O7 C# `1
cinder reset-state --state in-use <id>
Other:
# ~& w$ l+ I( R- M+ o8 O2 gList flavors
1
# j2 ?  M  u( D" x0 `openstack flavor list
; w3 J- ^( y& G4 y2 GList keypairs
1
openstack keypair list
List Security groups
8 ~7 G) m* r5 m& h3 K1
# S8 o5 ~6 i9 o" A! h4 F6 e6 o3 Q9 Xopenstack security group list
8 w# y/ L' w2 O  ~Cinder
1
openstack volume set --state error <id>
, ]! s) F. e# _1 t8 k8 G1 x$ mStop a migraion

0 C1 h7 k: N* l7 Z/ [; ?& B- DRemove the active volume from the migration state

1
cinder reset-state <id> --reset-migration-status
" _# P2 _, Q. y5 U. F$ kfind the volume in the attaching state and remove it
* N: T  g8 V1 c- c5 m, c# _
1
! v8 O: {" a- l% hopenstack volume list
1
7 x% R: G5 ~+ _cinder reset-state <id> --state error
1
6 x2 v+ }7 g8 F' H8 r( [- scinder reset-state <id> --reset-migration-status
& Z) ~! [9 n* f% y8 Yopenstack volume delete <id>
1
openstack volume delete <id>