错误：实例热迁移到主机"compute06"失败 Failed to compute_task_migrate_server: Unacce

admin

2022-06-21 14:47:33.988 25 WARNING oslo_config.cfg [req-b990f037-8329-4f82-aba0-2ad6df0942d8 ef9faa1589a945ec9764b05c1c433b57 6f0124196ea74eb79fbcf370add3ca7e - default default] Option "os_region_name" from group "placement" is deprecated. Use option "region-name" from group "placement".
6 C4 J4 }5 Q$ F/ a5 L+ U& \2022-06-21 14:47:36.470 25 WARNING nova.scheduler.utils [req-b990f037-8329-4f82-aba0-2ad6df0942d8 ef9faa1589a945ec9764b05c1c433b57 6f0124196ea74eb79fbcf370add3ca7e - default default] Failed to compute_task_migrate_server: Unacceptable CPU info: CPU doesn't have compatibility.

/ o, a- E+ q/ k: Y! U! T0
: V- d3 d: {* e: \
1 d. E. g" Q0 y  ~Refer to http://libvirt.org/html/libvirt- ... virCPUCompareResult
. R1 k9 V! F4 L# sTraceback (most recent call last):
& e# a: t% l: |" {5 F
) r8 y1 p. v. E) Q0 ?  File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 166, in _process_incoming
    res = self.dispatcher.dispatch(message)

  File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch
; S+ _& i9 s: l) L0 u1 j0 e' a; `& O    return self._do_dispatch(endpoint, method, ctxt, args)

  File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch
    result = func(ctxt, **new_args)

; G6 ]7 N7 f% @5 H$ \- u  File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 76, in wrapped
/ v4 }) G: a$ `. b0 h# l/ H    function_name, call_dict, binary)
  T' W5 d+ F+ p
  File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
0 f# T) _4 m, v5 J    self.force_reraise()
4 G! P) \5 x: O6 F( ]3 O
; `& K: }; y+ _/ c  P5 O  File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
. m, ?+ W8 e- R    six.reraise(self.type_, self.value, self.tb)

  File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 67, in wrapped
9 N* L$ t/ E4 t8 k3 o    return f(self, context, *args, **kw)
, ~! }: @8 b" V1 Y0 u- u
' {  d1 X8 m+ E  File "/usr/lib/python2.7/site-packages/nova/compute/utils.py", line 1000, in decorated_function
    return function(self, context, *args, **kwargs)
7 g8 Y4 X& h8 H1 `- _, w3 E0 C
; k' t+ h" d7 i/ {: U' y( l  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 215, in decorated_function
    kwargs['instance'], e, sys.exc_info())

* N- b8 v; Y8 w  File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
$ C% I, n0 M, {' p) K$ q7 J* ^" r7 q    self.force_reraise()

  File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
    six.reraise(self.type_, self.value, self.tb)
  T+ V* o, j3 c4 o# p6 D; k- z8 z
& t% j! l/ }$ ?# t2 n. l' Z  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 203, in decorated_function
& S/ L/ X1 ?4 ~7 G; @' D    return function(self, context, *args, **kwargs)

6 J7 i! B+ s1 k: k  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 5971, in check_can_live_migrate_destination
% F0 M3 I& V1 R) S0 E$ j    disk_over_commit)
: s# a! `3 O% A8 l
% u% j! F4 v8 [0 s4 |/ w  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 5982, in _do_check_can_live_migrate_destination
" c" @5 }( f, E9 X    block_migration, disk_over_commit)
0 \7 R* Z" `: _: n5 t: H
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 6570, in check_can_live_migrate_destination
    self._compare_cpu(None, source_cpu_info, instance)

# g3 [& G  }9 g0 ?  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 6841, in _compare_cpu
, z8 d+ \$ w1 l2 l+ B    raise exception.InvalidCPUInfo(reason=m % {'ret': ret, 'u': u})
6 D: G9 z: J7 O. [' q
: W3 I+ \' y: ]; ?, M1 tInvalidCPUInfo: Unacceptable CPU info: CPU doesn't have compatibility.
# q2 c# a( e/ k/ ]
0

; r. i1 I8 @$ d& C* E7 cRefer to http://libvirt.org/html/libvirt- ... virCPUCompareResult
! e0 j& ^/ t* W: InvalidCPUInfo_Remote: Unacceptable CPU info: CPU doesn't have compatibility.
" a: N  ^$ z5 a. @4 P& W- o2022-06-21 14:47:36.472 25 WARNING nova.scheduler.utils [req-b990f037-8329-4f82-aba0-2ad6df0942d8 ef9faa1589a945ec9764b05c1c433b57 6f0124196ea74eb79fbcf370add3ca7e - default default] [instance: 4e781528-c494-45fe-8c67-15763fd5650c] Setting instance to ACTIVE state.: InvalidCPUInfo_Remote: Unacceptable CPU info: CPU doesn't have compatibility.

admin

Live migration fails with 'Unacceptable CPU info: CPU doesn't have compatibility' between non-rebooted and rebooted compute nodes after in-place OpenStack Platform major upgrade
SOLUTION UNVERIFIED - 已更新 2018年四月23日15:25 - English
环境
+ O1 ?4 J6 n7 m8 M- }% {6 XRed Hat OpenStack Platform after major upgrade.
Red Hat Enterprise Linux (RHEL) 7 on overcloud nodes.
microcode_ctl-2.1-22.5.el7_4.x86_64 and linux-firmware-20170606-58.gitc990aae.el7_4.noarch installed as part of the upgrade.
+ x: S6 m0 b1 I- PNon-rebooted source compute node is running microcode version 59 and rebooted target is running microcode version 58.
& F9 ]) |  K. M) ~1 `9 A/ PThe IBPB CPU model is in use on the source node but not the target node.
问题
After an in-place OpenStack Platform major upgrade, live migration fails with the following error when the source node has not been rebooted and the target node has:
9 z( V( f2 J0 I4 J7 D* f9 |
Raw
Unacceptable CPU info: CPU doesn't have compatibility
决议
+ g+ i/ z. \" Q2 jWe recommend working with your respective silicon/hardware vendors in order to upgrade target nodes to version 59 of the CPU microcode or later (whichever is recommended by your silicon/hardware vendors).

( ?- b0 S( t9 \' |After updating, confirm whether virsh capabilities reports that microcode version 59 or later is installed on target node and that the IBPB CPU model is in use. If this is the case, then test live migration on a non-production guest first.
- J; y6 Y5 |8 V
Following this, complete similar microcode updates on all of the other hosts within the OSP environment.

5 C: W' f# G: _# W! U2 @8 b  q. n5 n; p根源
9 G9 f( B& c2 H+ R8 p! oIf Red Hat distributed microcode_ctl and linux-firmware packages are downgraded to microcode version 58 during a major upgrade, the microcode downgrade will only take effect on each node after a reboot.
" d. T- `- N4 g+ O8 ^
The latest microcode_ctl and linux-firmware packages from Red Hat do not include resolutions to CVE-2017-5715 (Spectre variant 2) exploit. Red Hat is no longer providing microcode to address Spectre variant 2, due to instabilities introduced that are causing customer systems to not boot. The latest microcode_ctl and linux-firmware packages are reverting these unstable microprocessor firmware changes to versions that were known to be stable and well tested, released prior to the Spectre/Meltdown embargo lift date on January 3rd 2018. The following article provides more detail in relation to this:

+ f7 p2 {3 ~7 p7 J, _' X• What CPU microcode is available via the microcode_ctl package to mitigate CVE-2017-5715 (variant 2)?
5 v; X* p% i: U
In certain scenarios (for example if compute nodes are not rebooted during the major upgrade procedure and then target nodes are later rebooted post upgrade but source nodes are not), source nodes could be running microcode version 59 or later whereas rebooted target nodes could be running microcode version 58.

As such, live migrations would then fail with the Unacceptable CPU info: CPU doesn't have compatibility error, because the target node would lack support for required CPU features.

5 o2 e3 z+ q- o诊断步骤
To check which microcode version is actually running on each node, one option would be to run virsh capabilities and review the microcode version= parameter within the output. For example:

Raw
% `. c2 C/ ?3 V6 K<microcode version='58'/>
9 H8 S' V5 i* X6 U. jAlternatively, /proc/cpuinfo provides the microcode version in hexadecimal format. For example:

2 F. J& M  d! }8 Y" t6 Q( LRaw
$ grep -is '^microcode' /proc/cpuinfo | head -1
* ~# x7 r" ~8 B  ?5 B7 K+ `microcode   : 0x3a
We can see that the above example reports microcode version 58 is running:
( J7 }- a$ k5 s) ]
Raw
  N+ l, @. n% F* d$ echo "ibase=16;3A" | bc
58

admin

Live Migration Fails With Error: "Unacceptable CPU Info: CPU Doesn't Have Compatibility.
4 Q0 w1 F+ V0 Q( m3 N4 _& EProblem
* D) ?7 A0 {$ IAttempts to perform a live migration of an instance fail with the following error.
2 _9 {, ?2 S3 X( C( l; Z  v6 M
Unacceptable CPU info: CPU doesn't have compatibility.
$ l1 W% S- @% \; j3 b, R+ I3 S) uCopy
Environment
5 ]8 E' r. m& BPlatform9 Managed OpenStack - v3.6.0 and Higher
Cause
4 d8 n; _" ^# S: N9 bThis error presents itself when CPU model/architecture differ between the source host and destination host even slightly.

Resolution
  l% N2 `9 S  rRun the following command on the host where the VM currently resides to create an XML with the full CPU description.
* h6 z/ k" {$ _4 l' z- R# virsh capabilities > virsh-caps-[originHostname]-full.xml
Copy
Edit the XML file you've generated deleting everything above "[cpu]" and everything below "[/cpu]".
4 Y3 ]" L. ?) A4 @Move the file to the destination host and run the following command which will tell you if there is a legitimate mismatch and on which side it lies.
6 j% K+ ~5 ]6 _) c# virsh cpu-compare virsh-caps-[originHostname]-full.xml
Copy
To determine the specific features that must be masked out, run the following command.
# virsh cpu-baseline virsh-caps-[originHostname]-full.xml
9 ^% c- j7 F' w2 |4 b/ a1 H5 vCopy
Mask out the features that do not appear in the output of the command in Step #4 and attempt to migrate the VM again.