ERROR nova.scheduler.utils qemu unexpectedly closed the monitor

admin

2022-10-20 10:45:08.266 37 ERROR nova.scheduler.utils [req-035fc933-de6b-448a-978e-c15ae171daeb a3cfa6f70675429985132daa6d3b906e 0c915a0d7601493cb1ecfd904b09f54c - default default] [instance: 52baa020-426b-4800-9492-0654b834ef2a] Error from last host: compute07 (node compute07): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1863, in _do_build_and_run_instance\n    filter_properties, request_spec)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2143, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 52baa020-426b-4800-9492-0654b834ef2a was re-scheduled: internal error: qemu unexpectedly closed the monitor: 2022-10-20 10:44:54.063891 7fded43821c0 -1 Errors while parsing config file!\n2022-10-20 10:44:54.063897 7fded43821c0 -1 parse_file: cannot open /etc/ceph/ceph.conf: (13) Permission denied\n2022-10-20T02:44:54.292119Z qemu-kvm: -drive file=rbd:hdd-8T-volumes/volume-41da2d70-d3bd-4187-9f60-8b262286f292:id=cinder:auth_supported=cephx\\;none:mon_host=192.168.0.75\\:6789\\;192.168.0.77\\:6789\\;192.168.0.79\\:6789\\;192.168.0.86\\:6789\\;192.168.0.89\\:6789,file.password-secret=virtio-disk0-secret0,format=raw,if=none,id=drive-virtio-disk0,serial=41da2d70-d3bd-4187-9f60-8b262286f292,cache=none,discard=unmap: error reading header from volume-41da2d70-d3bd-4187-9f60-8b262286f292: No such file or directory\n']

' v/ L9 V7 C. G; t
应该是ceph中pool池的权限问题

admin

[root@controller1 src]# ceph auth caps client.nova mon 'allow r' osd 'allow class-read object_prefix rbd_children,allow rwx pool=images,allow rwx pool=ssd-volumes,allow rwx pool=hdd-2.4T-volumes,allow rwx pool=hdd-8T-volumes,allow rwx pool=nova-vms,allow rwx pool=backups'
updated caps for client.nova

admin

0
$ H. v- K0 O8 n1 \: u/ @
6 y4 z# R) V; z0 K" c2 Z
5 I+ k: \7 R1 p6 ~8 P) }* j: G5 }As noted in Openstack docs [1], rebuild is not supported for volume-based VMs.
$ n( h9 D( V+ A6 Q
Assuming you are trying to rebuild the VM with a fresh image ("factory reset"), a slightly "hacky" solution is to replace the underlying volume with the fresh image while keeping the same pool/path.
5 ?  q7 r2 f: u5 s" w2 `4 j
! ]- b6 j9 `. u( r7 E2 CFor Ceph based backend, it would be something like

openstack volume show <...> => Get pool/path from rbd backend
5 b9 X" D; r8 V5 f* m. V* a# Lopenstack image show <...> => Get pool/path from rbd backend
openstack server stop <VM> => Stop the VM
3 z4 ?) C3 }. Z
rbd -p <POOL NAME> mv <VM VOLUME UUID>  <VM VOLUME UUID>.old
4 [* B3 B( a4 X, Rrbd -p <POOL NAME> cp <IMAGE VOLUME UUID> <VM VOLUME UUID>
Once the copy finishes, start the VM

0 s/ c& C+ ~( a9 hopenstack server start <VM>

admin

Nova:
List of instances
1
5 R5 p- F( t+ X' }* |' sopenstack server list
2
) g7 A1 N; e2 i, ~+ `0 r. _  Dnova list
Details on a specific instance
1
: Z7 {: k, N3 Oopenstack server show <server id>
$ B  u: ^$ F' q  h- @  ?! z. N) W2
# G8 H; H; ?: m7 I4 l- J  v# n8 hnova show <server id>
6 s& C" q- f" u' f' MRebuild an instance
1
openstack server rebuild --image <image-id> <server-id>
2
nova rebuild <server-id> <image-id>
, G4 U# i1 @  a/ ^Rebuild an instance with metadata
* N' E. j$ |' ?" |( ]0 I0 y1
1 k. \  U. u% W" j' y5 m# W6 lopenstack server set --property <meta> <server-id>
2
nova meta <server-id> set <meta>
1 M% v* |7 ^" ~3
nova rebuild --meta <meta> <server-id> <image-id>
Attach a port to an instance
* |9 W( v6 i& r1
nova interface-attach --port-id <port id> <instance id>
  V! ]+ A: K; i9 L; qCreate a instance from a availability zone
$ g9 s; r6 Q' A$ h  x) }. H1
nova boot --availability-zone nova:metal01:<ironic-id> --flavor <flavor-id> --image <img-id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> <name>
2 z, c: R' j# l6 R# W2
' I% b8 Z0 K% X" i# @openstack server create --availability-zone nova:metal01:<ironic-id> --flavor <flavor-id> --image <img-id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> <name>
Create a instance with meta property, sec group, fixed ip, ssh-key
1
openstack server create --image <image id> --flavor <flavor id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> --property <meta-data> --security-group <security group id> --key-name <keypair name> vmname
Create a instance
* M6 _) t8 z7 T% \5 L$ K8 h1
openstack server create --image <image id> --flavor <flavor id> vmname
. W8 l: B" [6 iRemove error state from instance
2 P$ j7 _% Q0 Y9 \, d( w) A- O/ G1
% ^2 x" L/ ]$ G; n2 Onova reset-state --active <server-id>
& g2 H. P" S  [4 E5 i# t# }6 m% rChange the flavour (resize)
1
openstack server resize --flavor <flavor> <ID>
Neutron:
4 V4 I( B! I* u( }. UList of subnets and network ID
1
3 q$ @7 M# _; S) d9 {openstack network list
2
neutron net-list
List of subnets, their IDs and allocation pools:
& c" r0 }) }9 `4 y, I" r: ^1
openstack subnet list
& v* H( R) i4 U, x2
neutron subnet-list
List ports
1
: N+ y1 U) k1 D1 e' f8 x4 `openstack port list
" p& l* I( w( C* e% F2
& b1 J  r" |% H* bneutron port-list
. u5 n- |( H* A: C% dCreate port
8 k; l2 j+ C6 [) `: i+ u) \' u; X1
openstack port create --network <network id> --fixed-ip subnet=<subnet id>,ip-address=<ip-address>
2 u6 V9 S5 u. x/ Q( {9 G% ^& L2
) R7 ^1 a; k: o( J$ |# E) |# hneutron port-create --fixed-ip subnet_id=<subnet id>,ip_address=<X.X.X.X> <network id> <name>
Update or Set/Unset port
! u2 s% s4 N! h" Z3 h+ ]1 x1
neutron port-update --fixed-ip subnet_id=<subnet id>,ip_address=<ip-address> --fixed-ip subnet_id=<subnet id>,ip_address=<X.X.X.X> <port id>
2
openstack port set --fixed-ip subnet=<subnet>,ip-address=<ip-address> <port id>
3
8 r  c7 B& W7 d% Q' ropenstack port unset --fixed-ip subnet=<subnet>,ip-address=<ip-address> <port id>
9 w+ G5 R5 v3 S# o5 e3 o( N+ r( G9 kGet details on a port
) Q2 P) g0 i7 L/ b8 ^1
' |& j* T/ f! i' Topenstack port show <port id>
; d5 ]  N! z. w% D$ x% k2
# Z' T) w7 q+ D8 g( q1 o+ q7 qneutron port-show <port id>
Allowed address pairs - (Allows one port to add additional IP/MAC address pairs on that port to allow traffic that matches those specified values.)
1
neutron port-update <port-uuid> --allowed-address-pairs type=dict list=true ip_address='0.0.0.0/0'
0 a; V/ f% {1 cGlance:
List images
1
3 F  \3 Y( T; x0 ~: M4 ?openstack image list
+ n/ @' b; {" n( @2
, n' G. l" M/ z- B' D1 Cglance image-list
Get details on an image
1
glance image-show <image id>
Upload a image
1
  y( V4 t' N( E# zopenstack image create --disk-format qcow2 --container-format bare --public --file ./centos7.qcow2 centos7-image
6 [0 s$ U) \" a2 sDelete
; q5 V: ~3 Q( B& g6 i+ c% k8 [6 Q! W1
openstack image delete <ID>
Download a image
1
$ ~- d3 e, X) Q$ Z/ S1 z8 ^  Zglance image-download <img-id> --file img.qcow2
# T/ w" W! r2 QChange state
1
cinder reset-state --state in-use <id>
# C, `: `, T$ V+ x0 x1 EOther:
List flavors
$ u) [' P- \0 C& D3 |) @6 n1
openstack flavor list
( o3 y$ ~# \* G5 I. Q# C" _List keypairs
! U" c& ~9 f; f1 T6 n, v7 P1
openstack keypair list
List Security groups
/ C& |; Z2 \9 n! H6 G# x1
openstack security group list
! I. Z+ f1 s8 L& N+ K. M! [Cinder
8 n. {  h& l) @8 U9 n8 K/ H1
openstack volume set --state error <id>
7 g* N3 O2 N: ]0 }Stop a migraion
3 @0 [3 K1 [  [
Remove the active volume from the migration state
( D4 S" @. W2 r4 T1 o4 M
1
cinder reset-state <id> --reset-migration-status
find the volume in the attaching state and remove it

1
( C5 x! E4 s* t0 R& `* k& \2 r. Gopenstack volume list
& s# N' q9 p4 D  ]3 [1
cinder reset-state <id> --state error
1
cinder reset-state <id> --reset-migration-status
openstack volume delete <id>
" y/ E, f/ W+ L* y4 M6 v1
openstack volume delete <id>