找回密码
 注册
查看: 24|回复: 1

libvirtError: Unable to decode message payload 启动虚机报错记录

[复制链接]

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
发表于 2025-1-7 15:02:37 | 显示全部楼层 |阅读模式
2025-01-07 14:59:27.463 11634 INFO nova.scheduler.client.report [req-b6e0a719-ca92-4ba4-8633-939bfdee4820 8c4ddcc3e636480bab36ba528221d326 a8aaa5f07b9e4d8ba2ccb2b8e7a088e8 - - -] Compute_service record updated for ('yz-cloud-prod-compute2.ksc', 'yz-cloud-prod-compute2.ksc')
" o+ i9 W4 h2 n- C8 y: Q2025-01-07 14:59:27.467 11634 ERROR oslo_messaging.rpc.dispatcher [req-b6e0a719-ca92-4ba4-8633-939bfdee4820 8c4ddcc3e636480bab36ba528221d326 a8aaa5f07b9e4d8ba2ccb2b8e7a088e8 - - -] Exception during message handling: internal error: Unknown CPU model cpu64-ksyun
; k) p. E& k! N" `. A5 |2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
# c5 m8 s9 f# }9 N9 _2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply" b6 N  y- u/ R& P# F$ r! E4 H
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     executor_callback))
5 _5 B7 D+ K4 X7 b2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch  ~+ ^! D8 E6 ~
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     executor_callback)( p9 w$ S: b8 I7 U
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch  ~5 w( [3 I! t; k* ~2 d
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
- \2 G$ ^7 T  p: x) u2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 7613, in start_instance
  i% n# g2 I; _" W9 }- H2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     return self.manager.start_instance(ctxt, instance): `# N& y1 v6 N  h) i! l3 d4 ~) a
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in wrapped
, S  ^- P$ ]1 l7 F$ E% f7 @2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     payload); V/ v+ s4 \. \! l2 r
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
  D3 _3 \8 z; g! r5 e2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)" I+ e1 a& M( D0 d3 }
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in wrapped
3 \2 ]3 M* X6 O( f, w+ l+ W2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     return f(self, context, *args, **kw)
( S: P2 C7 Z; g$ K2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 351, in decorated_function
# P3 O+ t. d+ w3 m$ ]# A2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     LOG.warning(msg, e, instance_uuid=instance_uuid)0 i" P% O3 k* I, }1 F& x
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
3 q. x5 z" s/ Y$ [2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
4 d' d9 w) u  v2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 322, in decorated_function
: ^/ w5 e& u; I$ l5 U, o2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
* m. u$ ^! z2 \5 q2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 401, in decorated_function
, z1 W: t: j* n% y8 g2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)6 `& W/ J* ?/ b3 K+ b8 Y7 _
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 379, in decorated_function! @# c$ U1 C& P; k, _4 Q- u# ~: e$ k
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     kwargs['instance'], e, sys.exc_info())6 s, c* B2 @1 S9 _2 D
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
, P' L0 P& x3 Q' L1 ], I2 e6 v( S2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
7 M* N% @: G% O) v$ i! l, t2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 367, in decorated_function
7 I% U4 w+ u! e% Z* R% g& t6 a# ]2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
8 m' Y5 ^' i" ~8 g2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 3134, in start_instance
/ }3 k) g% G' U( |; v" m6 c2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     self._power_on(context, instance)
! D, W5 H5 Z) y6 w! B2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 3122, in _power_on
% U$ N% x: x* R: \0 n/ M2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     block_device_info)
8 C) J( E: i- r2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2219, in power_on  c% `% ~: P6 R3 E/ V' W% M" h
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     self._hard_reboot(context, instance, network_info, block_device_info), L& ^9 d3 ?0 D. `( U9 l
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2108, in _hard_reboot3 D. ?) }1 w6 v5 q/ g
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     vifs_already_plugged=True)
6 r0 x( ?6 o" q' f# L2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4492, in _create_domain_and_network' j# D9 E; x% Q8 Q+ B, ~* J
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     power_on=power_on)
! Q4 c5 e1 Z$ w# S0 ~2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4423, in _create_domain/ B' D2 ]1 w3 I: h% ]2 ?9 W& ?  j
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     LOG.error(err)2 v0 Y3 H4 v& Z% W8 H( o
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
$ \- \' F/ t- K7 ~: p  W2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)" F0 Y8 B  K2 p+ \0 A
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4413, in _create_domain
; C3 u* k1 v0 S4 x; Q1 G" \2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     domain.createWithFlags(launch_flags)
" ^, H8 x# E9 m2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 183, in doit  H- L2 k  L, o9 q/ B/ y3 |! Z
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     result = proxy_call(self._autowrap, f, *args, **kwargs). ~/ D3 r) W/ x; b+ w* B
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 141, in proxy_call
5 x. _4 m/ X/ N/ m, A0 `9 f2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     rv = execute(f, *args, **kwargs)
" N6 Q9 c' z$ Z2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 122, in execute
& k  e% K$ T4 g( C- o) w( O) ~) h2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     six.reraise(c, e, tb)
( u; T; q* ], K7 }0 f0 Y8 [2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 80, in tworker( d! i5 z9 @- [
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     rv = meth(*args, **kwargs)6 Y7 B- Y. b+ U4 E* C. D
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib64/python2.7/site-packages/libvirt.py", line 734, in createWithFlags/ F8 {( D4 L3 [; W. m
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher     if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
( I( }7 K: j) a% X! T/ \2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher libvirtError: internal error: Unknown CPU model cpu64-ksyun- Z! n8 d6 T+ e; I) U
2025-01-07 14:59:27.467 11634 TRACE oslo_messaging.rpc.dispatcher
3 X# ]2 w' Y/ G  N; d2025-01-07 14:59:33.999 12115 INFO nova.compute.resource_tracker [req-95546975-91f8-4d85-aa63-d055e60b8cda - - - - -] Auditing locally available compute resources for node yz-cloud-prod-compute2.ksc
2 m: L) j- A! a% `4 |6 C# b2025-01-07 14:59:34.004 12115 ERROR nova.openstack.common.periodic_task [req-95546975-91f8-4d85-aa63-d055e60b8cda - - - - -] Error during ComputeManager.update_available_resource: Unable to decode message payload3 h% ^4 v7 D4 L/ U
2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task Traceback (most recent call last):
6 k( @# o: f; I9 B2 e( k2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task   File "/usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py", line 224, in run_periodic_tasks: o7 s% a6 y8 M- H! n
2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task     task(self, context): M( f; M; A. U, u; y5 c
2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6895, in update_available_resource
$ X& B" Z  ~7 x, D. N, |: j2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task     rt.update_available_resource(context)
6 z+ G. ~+ I, I+ }# `2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 376, in update_available_resource
% H( h* t2 o) X- o1 ?5 A! l2 I2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task     resources = self.driver.get_available_resource(self.nodename)8 R" b: o0 C, ^6 S7 W# v; M, \3 [
2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4997, in get_available_resource
; b+ Y/ `3 C, e; o6 T! l* g, x3 V% j- [2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task     data["memory_mb"] = self._get_memory_mb_total()) w% ^) d2 O2 ^3 \; I( o0 |
2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4593, in _get_memory_mb_total
6 m& b( M) c6 \3 t) J  N2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task     return self._conn.getInfo()[1]" P3 E$ Q% R9 y2 h7 q7 ]
2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 183, in doit
: v- u* S$ x7 o$ h% F" i2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task     result = proxy_call(self._autowrap, f, *args, **kwargs)( a- i6 ?0 g9 \, K6 W1 p6 D$ W
2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 141, in proxy_call
( M6 H$ q. B7 q. x$ O8 @2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task     rv = execute(f, *args, **kwargs)
* u9 H; S+ H2 b2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 122, in execute
0 ^$ i, K& l/ {5 U2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task     six.reraise(c, e, tb)
# B+ N- p  d. ?; B* M7 Z2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 80, in tworker
2 h' x( N7 ?+ \' B2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task     rv = meth(*args, **kwargs), F$ K9 ~$ n# V) a, \
2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task   File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3691, in getInfo
5 g+ l; F  B* o- g7 r' N2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task     if ret is None: raise libvirtError ('virNodeGetInfo() failed', conn=self)
- Y7 w- H3 d" Y2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task libvirtError: Unable to decode message payload
) ]) g% u3 x+ p* v1 h3 S! @2025-01-07 14:59:34.004 12115 TRACE nova.openstack.common.periodic_task
" D1 o- q- c9 v6 a+ g6 b0 Z/ _0 z* k3 X8 _* V

! J; L& s' w3 V% ]# Q  {
5 e* m5 _- K/ n, |8 e8 g4 S2 X9 w  O4 P1 P8 T& u% }8 r
, J5 S- n+ q: {
systemctl status libvirtd.service 7 K3 H: p; {( H" I9 Z5 G
● libvirtd.service - Virtualization daemon' s- R2 K0 x% j
   Loaded: loaded (/usr/lib/systemd/system/libvirtd.service; enabled; vendor preset: enabled)5 I: [( k. m0 I$ L5 k. t) }. z
   Active: active (running) since Mon 2021-10-18 19:35:52 CST; 3 years 2 months ago) \4 K  a+ f' a9 [/ p5 J
Main PID: 3615 (libvirtd)
0 U, x1 x  Z& \7 x   CGroup: /system.slice/libvirtd.service- y8 ~' O7 v( C4 q7 ^) E
           └─3615 /usr/sbin/libvirtd --listen7 f/ |; w5 O& ~0 F' s' [$ d

( o; ]' n# {$ V1 J1 ~Jan 07 14:53:31 compute2.ksc libvirtd[3615]: 2025-01-07 06:53:31.358+0000: 3618: error : x86ModelFromCPU:1100 : internal error: Un...4-ksyun6 j+ q$ w4 F, d; V
Jan 07 14:53:31 compute2.ksc libvirtd[3615]: 2025-01-07 06:53:31.358+0000: 3618: error : virNetSocketNewConnectUNIX:712 : Failed t...refused
, @7 Z5 B! m5 _. ^Jan 07 14:54:05 compute2.ksc libvirtd[3615]: 2025-01-07 06:54:05.943+0000: 3621: error : x86ModelFromCPU:1100 : internal error: Un...4-ksyun$ D( ]* d. \( C8 u
Jan 07 14:54:05 compute2.ksc libvirtd[3615]: 2025-01-07 06:54:05.943+0000: 3621: error : virNetSocketNewConnectUNIX:712 : Failed t...refused/ H' U. |- |9 y* h! f; `. h) u9 a
Jan 07 14:54:22 compute2.ksc libvirtd[3615]: 2025-01-07 06:54:22.316+0000: 3618: error : x86ModelFromCPU:1100 : internal error: Un...4-ksyun( ]2 I# |. f' \! H, _1 M2 D
Jan 07 14:54:22 compute2.ksc libvirtd[3615]: 2025-01-07 06:54:22.316+0000: 3618: error : virNetSocketNewConnectUNIX:712 : Failed t...refused/ U7 p7 z  H8 X8 u3 q
Jan 07 14:58:25 compute2.ksc libvirtd[3615]: 2025-01-07 06:58:25.368+0000: 3622: error : x86ModelFromCPU:1100 : internal error: Un...4-ksyun/ X1 E" F+ x( m  o; i; _, B
Jan 07 14:58:25 compute2.ksc libvirtd[3615]: 2025-01-07 06:58:25.368+0000: 3622: error : virNetSocketNewConnectUNIX:712 : Failed t...refused
( ]' x9 H& m0 C0 d3 Z/ E$ {Jan 07 14:59:27 compute2.ksc libvirtd[3615]: 2025-01-07 06:59:27.207+0000: 3618: error : x86ModelFromCPU:1100 : internal error: Un...4-ksyun
6 l' F! m9 @, j# a( B9 B* k3 r+ IJan 07 14:59:27 compute2.ksc libvirtd[3615]: 2025-01-07 06:59:27.207+0000: 3618: error : virNetSocketNewConnectUNIX:712 : Failed t...refused
: l$ O; K7 Y& J8 n3 ]1 T2 E4 d6 \& s$ v0 X6 S4 f
+ v# f* V; {9 u- @0 q0 l6 {/ O7 b

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2025-1-7 15:04:33 | 显示全部楼层
初步怀疑是libvirtd服务有问题。但生产环境暂时无法去重启服务解决问题。只能先观察问题。
您需要登录后才可以回帖 登录 | 注册

本版积分规则

返回首页|Archiver|手机版|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )

GMT+8, 2026-6-12 00:58 , Processed in 0.031979 second(s), 22 queries .

Powered by Discuz! X5.0

© 2001-2026 Discuz! Team.

快速回复 返回顶部 返回列表