将设为首页浏览此站
开启辅助访问 天气与日历 收藏本站联系我们切换到窄版

易陆发现论坛

 找回密码
 开始注册
查看: 55|回复: 1
收起左侧

ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Except

[复制链接]
发表于 2022-9-7 14:02:45 | 显示全部楼层 |阅读模式

马上注册,结交更多好友,享用更多功能,让你轻松玩转社区。

您需要 登录 才可以下载或查看,没有帐号?开始注册

x
[root@controller1 ~]# tail -f /var/lib/docker/volumes/kolla_logs/_data/cinder/cinder-volume.log
1 A! F- P9 u) h6 ^2022-09-07 11:36:22.698 245 INFO cinder.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Initiating service 32 cleanup
2 H& o; ?+ @) E2022-09-07 11:36:22.706 245 INFO cinder.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Service 32 cleanup completed.: [8 P$ \/ O1 w2 `+ z* n0 e
2022-09-07 11:36:22.834 245 INFO cinder.volume.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
& t( N, Z) s2 [8 V+ H7 q4 x. P) O) V2022-09-07 11:36:23.670 34 INFO cinder.volume.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Driver initialization completed successfully.( [( ]" c5 Y$ h
2022-09-07 11:36:23.683 34 INFO cinder.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Initiating service 12 cleanup
' A$ v; A# h! J, F9 C0 d2022-09-07 11:36:23.691 34 INFO cinder.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Service 12 cleanup completed.% ]" N' e7 \1 ~; D* I3 L* N
2022-09-07 11:36:23.812 34 INFO cinder.volume.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
( h4 {3 W$ D! Z1 n" e0 B& C% b3 w2022-09-07 11:36:26.016 245 INFO cinder.volume.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Driver post RPC initialization completed successfully.3 t# \8 M' m; r) d
2022-09-07 11:36:27.696 49 INFO cinder.volume.manager [req-3e8b1d22-3d32-4d94-93a8-5d1ad0375ae1 - - - - -] Driver post RPC initialization completed successfully.
7 {! c2 q  `7 k& z$ V7 }) @2022-09-07 11:36:27.937 34 INFO cinder.volume.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Driver post RPC initialization completed successfully.% S$ i: O: b: _/ |, A. q8 u( B
& Y# i% F& H+ L9 H

( l$ k0 t; f- r; T* r$ y' n/ ~5 L. R$ U5 I- h$ H" Y2 E) I. M) G& n3 d
: N; p- {) I5 z
2 G/ R- c+ x. ~1 E4 A' ?
2022-09-07 11:46:35.171 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 8.71 sec4 N, s9 `5 J6 e. s* i+ x
2022-09-07 11:46:36.142 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 0.22 sec5 o" y9 K4 c8 P; p
2022-09-07 11:46:36.142 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 0.07 sec7 e$ _' X0 }* @8 G
2022-09-07 11:46:37.424 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 10.17 sec4 x4 I8 v( y- S3 ?7 a; n- c1 @
2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
# c( u8 `# Q. p1 H0 _2 L2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
8 ~: ?& J: A: V( S) `- L) |. |! U2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
7 c- l# y/ _4 t1 Q' g2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
7 L( M; a$ X0 ?# E) }! j2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
# k; X- a+ T  E/ Q. R4 t; g  Y5 v2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")+ Y2 p2 v7 i! \; _7 s7 X
2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
" q6 b; h7 B8 A* [& y/ c: T2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters
) K' {9 Q( i: j7 c1 G' \. @4 h2022-09-07 11:46:42.166 330 WARNING py.warnings [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:
1 G9 `: s, a% T3 p9 m <class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed/ [, ^1 X4 W) E  `+ l) P
$ y# M/ J- j2 h& l
  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1]))& P0 ^2 u/ x! U  d$ s3 \% j6 a: I
: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
' f$ l1 i! t4 [. k* N2022-09-07 11:46:42.167 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
+ E% R1 O: y8 j% w2022-09-07 11:46:42.167 330 ERROR cinder.service Traceback (most recent call last):( H0 b2 P! {9 A9 Z* l2 c5 ]
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state) B5 c+ Y; w1 }9 @
2022-09-07 11:46:42.167 330 ERROR cinder.service     service_ref.save()" Q5 e$ p4 |! E3 i6 f' p
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save. i! P0 A( _8 V% Y/ \! Z/ f
2022-09-07 11:46:42.167 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)
0 Z$ p$ @9 H( Z. b7 O2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update: y! O: [$ ~3 y2 |) k
2022-09-07 11:46:42.167 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
2 G: V* e/ V4 z* B2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper3 W; O3 ~! @- C# l: f8 B
2022-09-07 11:46:42.167 330 ERROR cinder.service     return f(*args, **kwargs)
, T1 Q% I" x# R) w. v2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper
4 \2 W; K. p, ?, a8 k2022-09-07 11:46:42.167 330 ERROR cinder.service     ectxt.value = e.inner_exc
+ Q6 v" n: q( G/ F; Z2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__* ~( s; w% l2 f: ]
2022-09-07 11:46:42.167 330 ERROR cinder.service     self.force_reraise()1 k% V4 [5 I$ x: h, p
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise4 i# a: r# Q, A0 y/ X( `% g, b
2022-09-07 11:46:42.167 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb); G5 Z$ f5 C! r" ^
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper( {9 l( b: I0 C, t& B, I
2022-09-07 11:46:42.167 330 ERROR cinder.service     return f(*args, **kwargs)
2 j) |# B- I( T! ^; f8 h+ d2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update" ], e& e* O# e' G& j$ l4 p6 e" [
2022-09-07 11:46:42.167 330 ERROR cinder.service     result = query.update(values)
( t+ m3 [0 ^; f% A! h! \: R+ c8 x2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update1 |; x0 e, ]* q* V: B& @5 v
2022-09-07 11:46:42.167 330 ERROR cinder.service     update_op.exec_()
1 E6 F, _& c6 S. U3 \4 e! c2 |2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_# N# Z8 W$ r& j! H  e8 v
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._do_exec()
: U2 k! B: v, i( L( W/ C$ n! l; J2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec( p+ `4 t3 \$ O, f3 i
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._execute_stmt(update_stmt)
% A2 P3 Y' T) Q6 y* r" `2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt- `8 I% ]- N' }5 a1 ^
2022-09-07 11:46:42.167 330 ERROR cinder.service     mapper=self.mapper)
& R8 }0 H& A  X9 A0 p5 k4 ~2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
9 P& N. ^3 h3 {- Q2022-09-07 11:46:42.167 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
$ \( `* Y" e# X2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
( y2 {1 x) K* o$ b  V/ T$ G2022-09-07 11:46:42.167 330 ERROR cinder.service     return meth(self, multiparams, params)7 Y/ r  W4 p: t5 Y' m
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection! d+ R1 Q# k: d9 R
2022-09-07 11:46:42.167 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)1 Z% k  w' b$ u3 D  {
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
- A) j3 t: @+ A; h) k) z2022-09-07 11:46:42.167 330 ERROR cinder.service     compiled_sql, distilled_params. j7 a, t0 P3 G- W) J' f/ t# `/ h
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context3 Y* [4 F4 s) X# X! {  U% C7 p
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)
( }1 Q$ d9 v" u8 T& a) |& s2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl8 N  l2 l7 O, x2 t5 F% v0 O* K
2022-09-07 11:46:42.167 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:1 ]0 g0 i2 b2 L! e' F4 s& I
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
& Y  M* j7 X) n/ }/ |1 B! d9 |! ]2022-09-07 11:46:42.167 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)+ p" a! p. w+ y" V
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception# u# r% W& Z' b" _
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._autorollback(). l/ O" n- `2 p7 W0 n3 G: F+ F
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__* m' g9 v% h' k& ]- q3 T% N. R
2022-09-07 11:46:42.167 330 ERROR cinder.service     compat.reraise(type_, value, traceback)
2 s# r# o) l, y6 ~+ q- O2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception& c+ l! g4 H- P7 E. b
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._autorollback()
( v, x- t7 G, e9 @5 j7 T2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
' ?  ^) Y; T* l2 m& J9 P9 |2022-09-07 11:46:42.167 330 ERROR cinder.service     self._root._rollback_impl()
' A2 B+ |) ?6 A% d5 S4 _5 K2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl% C5 ]' U5 u& d
2022-09-07 11:46:42.167 330 ERROR cinder.service     self.dispatch.rollback(self)& L" q: Y+ [# u1 C
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
  F# n; T. K, E9 w4 r' I2022-09-07 11:46:42.167 330 ERROR cinder.service     fn(*args, **kw)
" b9 P( j( Z/ c" ?2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx# Z$ [3 g2 ?' n% a3 Y7 p/ K
2022-09-07 11:46:42.167 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)+ \; N; ]5 j3 D% Q+ h' C
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
5 O9 C7 F1 R6 b9 g* Y) u% @" D  v2022-09-07 11:46:42.167 330 ERROR cinder.service     return self.connection.info5 h1 }. Z( G9 T+ F: w. `. Z% o+ K
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection4 {% w& r0 h9 L# J' P9 {
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
6 {& t0 D6 D8 r; v" ?! p7 F6 [- z2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception) o6 k8 t& c) X  Z
2022-09-07 11:46:42.167 330 ERROR cinder.service     exc_info6 Z( b% B/ y1 N6 [% P( N+ ?
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause/ J  E% h& l% |1 m- f+ y
2022-09-07 11:46:42.167 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)/ {8 O+ g6 m. s. S2 @/ T: i. L
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection3 k1 e2 [% y: Z! D
2022-09-07 11:46:42.167 330 ERROR cinder.service     return self._revalidate_connection()
: t" v! C# V9 p. v4 A: i- d6 {3 s5 o2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
% X: r5 j5 j  R! {2022-09-07 11:46:42.167 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
& n% q; J/ q' V$ M& z2 N' p  F) V2022-09-07 11:46:42.167 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
. _1 ^% e" {+ Q! i% k2022-09-07 11:46:42.167 330 ERROR cinder.service
3 i1 z5 m6 f; h) _5 L9 \2022-09-07 11:46:57.813 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 18.91 sec5 Y' }' c* g" n0 G. v. ^
2022-09-07 11:46:57.817 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 11.67 sec
0 _0 `' |. a0 a2 A5 d1 g3 ?2022-09-07 11:47:05.300 34 WARNING oslo.service.loopingcall [req-8fa905ab-6b12-4005-9ef8-bc279b74b2da - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 36.06 sec+ {; f; H& q- K, P: W
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed) F. I' d* [) h' i, o4 e( N) z2 ^* B
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
5 X: x5 |% I& _; U5 p, o; r3 D2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
; G# W* ?, z# s6 p; b8 V$ [2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
) i1 i+ B( Z: h3 K2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection5 z+ o+ a5 C+ m8 [3 G7 {
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
% }; y+ ^  I; r: y2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
! p" g0 P3 ?0 e2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters
5 Q/ w- U( n. R8 A" O/ h; S. _2022-09-07 11:47:05.320 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 10.14 sec# x* H' ?( o7 `# J/ S& j
2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed, z  t/ d. c0 g6 E
2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
. P! D+ U1 G/ r  ]$ D, Q2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
/ H  M7 m. f: y2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
" _* N( C: t6 [2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
" g5 {( l9 d. e) M2 N. Z1 L* Q/ R2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")5 }- Z1 a- X* D' @0 {" a2 G" q1 m
2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
. T; U# Y. U1 i, w( A8 ~2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters
3 x1 ~+ Q8 M0 ~2022-09-07 11:47:05.366 168 WARNING py.warnings [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:5 J  F5 P* G. x0 j
<class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed
9 v" }- ^7 v# w) B) c4 J' Z+ e' q/ f
  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1])). q$ z4 r5 c: K$ U
: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)6 [# X& l) _( F6 _$ ~+ {
2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed+ x* W" x* [  q/ j  s7 v
2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
% w( ^" w' U9 {% c! s0 b& c4 V2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
/ `( R5 y7 L* K, J2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()9 E. |2 u9 x, W0 b" n7 ^; z2 `
2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection5 T4 O: ?9 k0 B5 {
2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
1 X6 Y& r) K; f0 P% T8 [2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
7 P" V0 J" R/ M2 G6 X2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters
% U) M$ G. r' E- g8 m% V4 m2022-09-07 11:47:05.367 168 ERROR cinder.service [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
# [& A* S) H# {. b2022-09-07 11:47:05.367 168 ERROR cinder.service Traceback (most recent call last):
1 }7 b# q7 m$ ^9 z; `2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
7 R% Q. K0 @4 X; W6 i/ S, k7 |2022-09-07 11:47:05.367 168 ERROR cinder.service     service_ref.save(); N% ^4 i" t) L8 y+ v% l  m
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save$ h1 q& m% K+ P5 s3 F  H
2022-09-07 11:47:05.367 168 ERROR cinder.service     db.service_update(self._context, self.id, updates)
; r/ f( Y" z5 @' z! i1 B  D: `2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
! J& L- ]+ c; ]1 o  k2 R/ L% w2022-09-07 11:47:05.367 168 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
: a7 [( w& \) _8 N( c! D2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
; G5 r7 n+ @7 a" D" Y" `, Z! v. \2022-09-07 11:47:05.367 168 ERROR cinder.service     return f(*args, **kwargs)
3 Y/ q: i9 P0 \2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper
- N: T# _: [7 B: u6 d2022-09-07 11:47:05.367 168 ERROR cinder.service     ectxt.value = e.inner_exc
4 l( l9 h/ {: D+ F2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
8 V3 p2 t1 M1 r, j  k+ @( T# s. r2022-09-07 11:47:05.367 168 ERROR cinder.service     self.force_reraise()( \; w+ |7 d+ F' H) L
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
# I2 w3 f* t( K2 `$ A2022-09-07 11:47:05.367 168 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)1 r) i3 g! l6 J7 p% O
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper0 L4 q9 y+ F  e' {' p4 }5 O
2022-09-07 11:47:05.367 168 ERROR cinder.service     return f(*args, **kwargs)
; t, J% L/ x- l, m) X% g2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update# R1 }4 `. I9 _1 s/ _7 d7 b* _
2022-09-07 11:47:05.367 168 ERROR cinder.service     result = query.update(values)7 ~) x0 r; u# o0 Y+ H
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
) e: ?, L$ E& K  c& u6 O$ j2022-09-07 11:47:05.367 168 ERROR cinder.service     update_op.exec_()) h# N% H; U0 F( I
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_! E  q0 z2 Z, k( ~& {8 L/ N
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._do_exec()# ?- v3 ?1 u& w+ b( K7 g  w* S' N( H
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
7 {8 F. X$ ]9 S1 j4 o- j) q2022-09-07 11:47:05.367 168 ERROR cinder.service     self._execute_stmt(update_stmt)
' A; B% B4 p- Z* f: q2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt1 k; x. F7 _1 g: I- H" f- b3 ]- H
2022-09-07 11:47:05.367 168 ERROR cinder.service     mapper=self.mapper)
6 q" W4 T3 @( `6 j; Y) x2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
) s; L: }- C4 X* d3 M. O  _5 K2022-09-07 11:47:05.367 168 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})2 z, O" x4 I# }
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
: u% E; z* c) j: x& A2022-09-07 11:47:05.367 168 ERROR cinder.service     return meth(self, multiparams, params)
9 N+ j) g& `& q6 c# H% S2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection' K& F* T6 q, \! d5 x
2022-09-07 11:47:05.367 168 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params). Y/ @% q6 R$ x4 h7 e$ O* n7 p
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
2 {3 U  y! s* ?& k' M; ?- R8 ^0 H2022-09-07 11:47:05.367 168 ERROR cinder.service     compiled_sql, distilled_params2 A. c3 p- {# |; f/ E/ ]& m; G
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context) n. s3 u5 M3 C) F- j* o/ r
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._root._commit_impl(autocommit=True)6 @! O, O) _5 {
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl% d4 {) x# G' c6 r, B! u% K9 b8 A" R. ^
2022-09-07 11:47:05.367 168 ERROR cinder.service     self.connection._reset_agent is self.__transaction:
' ^( ^# \+ Q1 @$ q/ j9 J: @2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
1 G9 M. V: `. Q2022-09-07 11:47:05.367 168 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None), U3 L3 |  g4 \
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
2 b) [, {. B0 `, y8 T- }- e& R* Q: I2022-09-07 11:47:05.367 168 ERROR cinder.service     self._autorollback()& [- y. l# ~5 t. ^8 o; c9 W
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__1 Q2 K, D# h3 l; S0 f
2022-09-07 11:47:05.367 168 ERROR cinder.service     compat.reraise(type_, value, traceback); J4 r! T- K* ~6 a( i- Q& O
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
" R, k' f7 P* ^; |  e  |: F8 @2022-09-07 11:47:05.367 168 ERROR cinder.service     self._autorollback()$ B3 {1 x/ j8 }) U* V: B
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
" l& i0 \9 Q4 Z$ K) L2022-09-07 11:47:05.367 168 ERROR cinder.service     self._root._rollback_impl()7 j- `  [" D6 b
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl- f7 K9 _: {* Y5 `4 a+ G: R$ G
2022-09-07 11:47:05.367 168 ERROR cinder.service     self.dispatch.rollback(self)
8 b' p& \9 R& q& f/ G6 M) k( V2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__4 m5 k- u3 t. E1 O
2022-09-07 11:47:05.367 168 ERROR cinder.service     fn(*args, **kw)1 s1 \+ x( I( ?, w
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
( }) o) O. X  r6 c3 F7 T2022-09-07 11:47:05.367 168 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
" `- v, s' n) \. w2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
, u8 C! @) H' H2 H/ j2022-09-07 11:47:05.367 168 ERROR cinder.service     return self.connection.info
% O5 P; ~$ l2 a& }2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection% y  e/ L( U/ D2 G0 `2 \, r* x3 \& _
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)# C; G6 E% @" U' G
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception2 C/ W; e" F7 b+ S* T7 r/ P+ @
2022-09-07 11:47:05.367 168 ERROR cinder.service     exc_info
" l; p# {/ `9 l, K! L/ {2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause. O( V+ q/ X5 _3 x5 h! u, w+ u
2022-09-07 11:47:05.367 168 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)( Z5 r! q/ ~8 x0 F8 p" Y  J+ U
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
0 J; M! p0 ?/ x: q2022-09-07 11:47:05.367 168 ERROR cinder.service     return self._revalidate_connection()
/ z1 k4 Z7 Q. b$ C6 A8 Q9 N& x) n2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
5 _; ?, {3 P2 W- Y% p; h2022-09-07 11:47:05.367 168 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
' j) r9 U! D3 \  w2022-09-07 11:47:05.367 168 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi), _% g; D5 w0 c) g1 U# V
2022-09-07 11:47:05.367 168 ERROR cinder.service
1 U2 b  v+ l; L0 p- U6 q2022-09-07 11:47:05.375 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 17.95 sec7 @' Q* O4 y5 `: o: k) y2 M
2022-09-07 11:47:05.428 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 19.28 sec
) h0 t$ I' S' |, ~2 j: {2022-09-07 11:47:05.561 168 ERROR cinder.service [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Recovered model server connection!
) H- J0 ]. V7 d' s$ F* I2022-09-07 11:47:15.330 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!0 e3 t4 j+ f" c4 J5 G7 x" ?
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
3 S. C/ j6 \% l; |" z2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):( ^! F$ c& `9 [
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection6 c; K  }, _$ a6 d$ _3 R1 Q$ m
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()" h7 E+ q- @5 \$ S$ Q8 d
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
2 x. z5 Q, q1 b2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
* [# G- h5 {- }4 j" z" J# u2 o  _2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
+ L2 e/ w. Y* `( i# s* u* W, f+ `4 [2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters ' G- R( |% B, m  t0 A( i2 h
2022-09-07 11:53:39.864 49 WARNING py.warnings [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:
5 T3 V$ ^" h  C+ @ <class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed
- v* T" w" e% F% S( B! {; }
. {% H" {+ b# z0 K  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1]))/ E! ~& h+ j& c( ^; u! z
: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
3 F/ N/ z8 P0 O0 t2 Q7 M* H2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
, \, V, o  {$ U- c2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):  d! i% a7 @! C7 s- D' e: h
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
9 m! \6 g; X5 A+ Y2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()+ [$ Z9 Y6 }1 |7 N5 Y7 ]# }
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection0 \( G  G2 `% t. g
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
& l  b0 ~* O7 y6 m) L& X" I4 Q2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed9 W& G% h$ X" U! N- ^0 x
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters
+ R: C5 L% B7 m6 ]2022-09-07 11:53:39.867 125 WARNING py.warnings [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:/ D5 a4 Q- Y! T6 `. s7 \
<class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed2 I4 h: h9 C& W% h* y

7 f: W. k; X4 A8 |2 L  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1])). j1 b6 J- e& z) O
: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
2 S# h6 P( K+ ]5 c2 u2 X1 x2022-09-07 11:53:39.865 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
* {* N8 n' [# x" V, I4 ~2022-09-07 11:53:39.865 49 ERROR cinder.service Traceback (most recent call last):, E1 M2 l4 m3 v3 p1 M
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state: k( E- K9 n# k$ @. A
2022-09-07 11:53:39.865 49 ERROR cinder.service     service_ref.save()0 @* W+ L9 \/ ?3 c2 I2 x
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
1 g; F7 \. Q4 r4 f7 m2022-09-07 11:53:39.865 49 ERROR cinder.service     db.service_update(self._context, self.id, updates)
) h" K5 o5 _1 J  q! s/ N2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update# P" t! J, X1 R, U2 Q4 O
2022-09-07 11:53:39.865 49 ERROR cinder.service     return IMPL.service_update(context, service_id, values)- ^7 {: H9 D" z! I7 U. N
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper( o& Z- o+ v" d0 R( _  o9 w2 [
2022-09-07 11:53:39.865 49 ERROR cinder.service     return f(*args, **kwargs), Z3 S5 u" w( o3 w7 I
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper" I5 B& R  u7 t
2022-09-07 11:53:39.865 49 ERROR cinder.service     ectxt.value = e.inner_exc
  Y' I: E) Z# Q% ~! ~0 |. ~2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__# l! F' a! W1 j8 Q
2022-09-07 11:53:39.865 49 ERROR cinder.service     self.force_reraise()
, j% O1 k% q$ o7 C$ k- B3 q" s2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise- s& @3 N1 j" F3 z$ m8 c
2022-09-07 11:53:39.865 49 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
8 `9 M( Y* Z9 c, P. [0 I( I5 k2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper5 g. ?& N1 P; E1 \8 s
2022-09-07 11:53:39.865 49 ERROR cinder.service     return f(*args, **kwargs)0 O% u5 F" d% K) |
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
4 ^- X# j) E+ ]7 w/ {2022-09-07 11:53:39.865 49 ERROR cinder.service     result = query.update(values)
) r( |& L: r! Z- K4 n; y. i. V& J% U2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
1 a4 i! g/ f: ?$ a2022-09-07 11:53:39.865 49 ERROR cinder.service     update_op.exec_()
% Y0 }, j7 `4 \/ F" s" o2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_$ d4 q  s5 A0 T1 t3 a, I
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._do_exec()
, a7 h, t: f( k% b6 `( }2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
! R$ _; V6 ~) {+ M+ h2022-09-07 11:53:39.865 49 ERROR cinder.service     self._execute_stmt(update_stmt)8 A1 l, e- b3 m2 N3 \  ~( b
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
, z/ y$ m1 N3 \2022-09-07 11:53:39.865 49 ERROR cinder.service     mapper=self.mapper)' A7 _: R3 ^' F# b2 ?9 Q
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute% O- x8 \5 O: U9 I8 a6 M
2022-09-07 11:53:39.865 49 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
: c! X; U6 Z1 Z7 X0 }2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute3 s( i% B5 O$ G3 e; m3 b
2022-09-07 11:53:39.865 49 ERROR cinder.service     return meth(self, multiparams, params)9 L% V" a% {. n+ L2 h# `3 b
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
+ @, }) p, e# `( y2022-09-07 11:53:39.865 49 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
9 \2 n7 R( @% n3 f' F* l0 k( @2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement% L7 c' X  \- }9 F9 x" b) n# j
2022-09-07 11:53:39.865 49 ERROR cinder.service     compiled_sql, distilled_params
. h" V) Q3 p9 y8 L, O. ~2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context" P; t7 N+ y  C% ~7 S( b
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._root._commit_impl(autocommit=True)) a6 w8 j" N3 C* J) j
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
2 h& {( O7 y2 P2022-09-07 11:53:39.865 49 ERROR cinder.service     self.connection._reset_agent is self.__transaction:# G4 z4 d6 R! n* ^* _! Q
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection- y* A& S# S" e' P6 D( J# X  q
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
; j2 M' ]; h- t" H6 G2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
+ g# o- a! |$ X1 m1 x6 M. s2022-09-07 11:53:39.865 49 ERROR cinder.service     self._autorollback()* O* ]. Z9 g: Z% P2 C/ N+ O
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__: @5 j4 w4 Z  j' h% t# p: y
2022-09-07 11:53:39.865 49 ERROR cinder.service     compat.reraise(type_, value, traceback)3 H: O9 X% V/ V( t
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
2 A: b  R( B! T5 N4 z2022-09-07 11:53:39.865 49 ERROR cinder.service     self._autorollback()5 [  C+ F) f8 g& |, X& o
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback) @6 _) j9 F' A
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._root._rollback_impl()7 {- O$ [, P% F/ J. Z! J
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
3 F2 e3 h1 [! u6 q1 S' c2022-09-07 11:53:39.865 49 ERROR cinder.service     self.dispatch.rollback(self); E/ q0 R0 Q2 u. A: [
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
9 o# u% }( R+ c% @3 `2022-09-07 11:53:39.865 49 ERROR cinder.service     fn(*args, **kw)
; O6 n6 i+ S( }; R8 q2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
. K- Z2 r9 q- p- u3 q2022-09-07 11:53:39.865 49 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
! m9 b1 [: E! }2 g: f; \2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info2 D# _; l  M0 z# c" G/ D$ W
2022-09-07 11:53:39.865 49 ERROR cinder.service     return self.connection.info! ?+ ^( S( S4 j' F
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
9 @0 G1 v: w' k# s/ K2022-09-07 11:53:39.865 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)" y& y% q# [" q' k5 S/ l; k
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
9 E# k* A: P  M* n# J) c2 L2022-09-07 11:53:39.865 49 ERROR cinder.service     exc_info
( A7 r: h3 b) s2 \; V# k2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
$ F4 \& ^& y* Y8 }% x2022-09-07 11:53:39.865 49 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
8 L1 R# p9 R0 ~, y2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection* q0 v- B+ X3 f# M4 {
2022-09-07 11:53:39.865 49 ERROR cinder.service     return self._revalidate_connection()3 _  v& t- k1 z& S0 d0 y' Q4 w4 W
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
9 a( w$ ?' C. C/ ^9 [+ O+ P$ w' r2022-09-07 11:53:39.865 49 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed"). J$ z' c8 y- l
2022-09-07 11:53:39.865 49 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
7 E. G  [0 m2 s/ Z. o" j& k8 L2022-09-07 11:53:39.865 49 ERROR cinder.service ; P6 W2 ?0 H) Y- w% K. w! i8 ]) c6 u4 J
2022-09-07 11:53:39.868 125 ERROR cinder.service [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
5 A; a7 g$ i8 Y8 W2 F2022-09-07 11:53:39.868 125 ERROR cinder.service Traceback (most recent call last):
  V" L. j, B  Y& B; [2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
9 Q' Z" b9 d0 x5 _2022-09-07 11:53:39.868 125 ERROR cinder.service     service_ref.save()
- h. P# n/ g( T9 Y4 A0 J2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
, D3 X* b  C+ S8 n- P2 E2 X9 X! t2022-09-07 11:53:39.868 125 ERROR cinder.service     db.service_update(self._context, self.id, updates)
7 l, Z) r7 t6 V; E3 i2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update# a  n0 M  i; i4 f3 d) b. O
2022-09-07 11:53:39.868 125 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
: H3 r) B! x. G8 _: W2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
: V# z. X8 u; N7 Y& w2 @, B2022-09-07 11:53:39.868 125 ERROR cinder.service     return f(*args, **kwargs)
5 H$ e; l- n# l) [2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper: b9 F) [$ N8 _4 O# C4 w; _
2022-09-07 11:53:39.868 125 ERROR cinder.service     ectxt.value = e.inner_exc+ }4 M! H# y" j) {! m( i
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__2 r, r& I+ o, B- C$ h' `) ~
2022-09-07 11:53:39.868 125 ERROR cinder.service     self.force_reraise()
; T  I/ u) }7 v3 i4 L7 T9 v2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise+ B3 B. m% D/ X! ^
2022-09-07 11:53:39.868 125 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
: I8 g7 G! e5 B. n, P6 I9 C4 o7 ~2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
# Q- A( w- q) J0 _& m4 E9 d2022-09-07 11:53:39.868 125 ERROR cinder.service     return f(*args, **kwargs)
, f4 ?# N  u5 f6 W2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
, S. X+ P8 |. N, {2 z4 ]2022-09-07 11:53:39.868 125 ERROR cinder.service     result = query.update(values)' @+ N* i- p& [/ k' B7 G
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update: ~+ f! }2 J* ?! K8 K
2022-09-07 11:53:39.868 125 ERROR cinder.service     update_op.exec_()
& z/ H+ A. V1 o: r3 G$ x, a# d& K8 O2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_( c% L' t5 k) `$ J4 P) R9 Y
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._do_exec()- C3 w; L5 J; c7 ]+ c; \4 k
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
2 Q5 x, I' _! p/ \2022-09-07 11:53:39.868 125 ERROR cinder.service     self._execute_stmt(update_stmt)" ?' t0 z4 a6 ?  g" t
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt5 H) x( b' L0 K4 q+ j0 k( k
2022-09-07 11:53:39.868 125 ERROR cinder.service     mapper=self.mapper)+ I% h$ c0 q  \
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
; F4 d( z$ s$ C8 U  D2022-09-07 11:53:39.868 125 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
/ Y# B& J/ ^# y) [2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute# W# o; {# [: h- v9 q# `& _
2022-09-07 11:53:39.868 125 ERROR cinder.service     return meth(self, multiparams, params)+ x2 [* e$ Z: R+ k
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection+ Y/ d1 p) q$ f6 q  U9 G( |$ ?
2022-09-07 11:53:39.868 125 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
6 @5 x) c% `; C' L7 r) i2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement$ S% H" v* `& Q* g6 P3 v
2022-09-07 11:53:39.868 125 ERROR cinder.service     compiled_sql, distilled_params2 p. F1 k- S) P7 O" y
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context
& n- @- y  S0 _; w5 J- l0 e  _, x2022-09-07 11:53:39.868 125 ERROR cinder.service     self._root._commit_impl(autocommit=True)( t" x. x3 F- ?! F, L5 _4 {  o3 i
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
& D  `8 P7 o( j& a2022-09-07 11:53:39.868 125 ERROR cinder.service     self.connection._reset_agent is self.__transaction:0 q- }* p- I; h: C" R2 I7 d$ Z
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
2 _% I/ A- S# \% F- U& L: h/ M2022-09-07 11:53:39.868 125 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None). X" g9 a6 {+ M7 O; y
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception# K1 A/ o$ T7 L+ n
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._autorollback()
/ j1 ~" ?& u" M1 @1 M2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
8 n$ W  P- f' h1 A* A6 S8 O) {2022-09-07 11:53:39.868 125 ERROR cinder.service     compat.reraise(type_, value, traceback). f7 _' a# H- |
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception) y" T! F% @" l% k$ p
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._autorollback()0 r) J  h" M) c  `/ T- x9 q
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
* [4 x( {4 V6 z8 A2022-09-07 11:53:39.868 125 ERROR cinder.service     self._root._rollback_impl()( J! d6 n: _8 O
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
7 F7 F: D5 ^+ j" b& f+ X6 S2022-09-07 11:53:39.868 125 ERROR cinder.service     self.dispatch.rollback(self)
- L, F. |' z! ~0 q8 E0 r% ~% \2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
: O; q0 w: i/ l3 d2022-09-07 11:53:39.868 125 ERROR cinder.service     fn(*args, **kw)
9 l4 m7 H2 V3 o( o" f& b2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
' e5 L, y2 _. z% d/ q2022-09-07 11:53:39.868 125 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
/ t/ |3 n) j8 j9 L& d2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info7 [* O0 X; D4 p5 l
2022-09-07 11:53:39.868 125 ERROR cinder.service     return self.connection.info
/ B* I  T1 P' Q0 g; K' l( u2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection# k: M. I" z7 H) c0 ?
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)) ?, Z2 U1 {% O3 e4 F% ~) ]8 p7 \
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception5 @, ]; L3 j9 j4 O4 q4 \
2022-09-07 11:53:39.868 125 ERROR cinder.service     exc_info
! L- a- x) X9 ]  O+ V( Z" e2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause4 d6 t% i" H6 A/ j7 H" S0 a& L0 j* x
2022-09-07 11:53:39.868 125 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)8 G5 l/ S* A4 T% N2 r. `
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection+ X- {. G; @0 @9 |+ K: J& }' L9 T# X4 R
2022-09-07 11:53:39.868 125 ERROR cinder.service     return self._revalidate_connection(), ~3 N6 M; e( `4 v
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection, J. E/ _; Q) ]' T. _8 G. u
2022-09-07 11:53:39.868 125 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")3 ~3 f: Q8 A' T7 E7 _8 l& J) y
2022-09-07 11:53:39.868 125 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)! z  C% S8 e2 A9 H  J1 p
2022-09-07 11:53:39.868 125 ERROR cinder.service
3 X0 p( A- e2 N2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed, Q+ v" j! C8 e* I& d, W
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
1 d; }3 \9 Q1 Y8 F9 I2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection& `+ A* W, k4 B( H  u8 i
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()' @# n; I( ?& M+ R7 j/ v2 x1 c
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
, b6 d. d8 ~% @3 |6 z! A0 }2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
- C: j" x& |3 U" d7 \2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed) c$ M! i/ k3 j9 c- O0 m
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters
# b4 Q  R& p' ?. W2 G; T* |2 d2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
$ b% c$ K9 h+ L3 `) P" r2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):' X0 j$ h" b# V$ D7 g
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
. [, u" ]; `. S8 V5 @, g, \+ O2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
( ]+ C* D* ~& O; C/ b: c2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
/ f! k7 c0 H" a2 [6 A3 P' r, \5 Q# Q2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")) G: e" @1 A6 n; [1 W
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed8 R( T5 _3 c$ E( X* x$ t' |
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters
  a1 X8 M. R  U4 ?" N# r2 X5 h+ K2022-09-07 11:54:06.359 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 7.79 sec& d7 ^, D# F9 o! h' {) E5 x% [
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed8 X; H& @( u) `; t; m  T
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
9 i4 E3 F: i0 m. w2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
( y3 y6 M' r, v& H* I. S, ^2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection(). `9 D; G. A$ U# ^0 F
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection$ @  @* ?/ `  j) m1 T
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")8 j5 O; a& X6 W# Z0 g3 D" n
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
) }% ?! z; B# a2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters , _9 }5 @, ?% n* Z* l" k0 j) m4 K2 L, \
2022-09-07 11:54:16.891 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 0.53 sec
- Y$ W9 m5 `6 s5 P3 m2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed. x( K" J3 r3 b" a) Y& }
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):: d# Q* Y3 B/ k( D) b! x6 A8 G
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection! q9 z2 l$ p; p, M
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()& {4 D: b5 b3 y9 T- k
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection, j- N: X: A) l6 ]3 l) i: T
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
( L1 M4 Z8 `& n2 E2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
5 q8 F/ F/ _5 _) x# v) {5 b6 g2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters
3 z1 ^* A/ Z% S3 ~; b4 j2022-09-07 11:54:16.895 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 9.08 sec
9 i' ^- U4 G- G( {. k2022-09-07 11:54:16.902 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.48 sec0 k+ x9 ~3 N. s7 l$ @; x
2022-09-07 11:54:16.902 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.44 sec7 l  C; a  f; Y! {: x/ h& H
2022-09-07 11:54:16.909 34 WARNING oslo.service.loopingcall [req-8fa905ab-6b12-4005-9ef8-bc279b74b2da - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.17 sec& X+ _  {3 ^6 h' [
2022-09-07 11:54:16.945 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.53 sec4 }2 ]4 k) o& P5 i, E+ h6 D! H
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed8 C4 Q) t* l! d1 X4 l" s
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
# \5 x$ G" d. f" l2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
* p4 ?% ^: ?! ?$ J# ~. E2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
( y2 \$ g/ i) H) f2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection# ?& L6 n2 {" A
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")) j) B$ `" i1 }7 Y- P, Z7 I0 F
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed& \) ?0 R2 V. t8 x" Q- G+ U
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters . u/ G' ~6 A0 z7 S1 Q
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
  g# t& o% L  M+ s' T4 o2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
' f* Q; H; x/ n; Q' f% m2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection9 @( b: T$ x. N% H. `! H3 `, x
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
9 O: ^1 U% V! p+ q2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
6 ?# [6 V: j( j( U" _. d2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed"). j, [  [+ `% k+ I5 U- C
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed6 ~4 t% j! z6 i6 n: U
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters
  g5 s; @  C& P+ C3 U6 w2022-09-07 11:54:29.674 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 2.78 sec
8 @: ~: P- V' d) o2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
2 _( Q2 q  I! ~9 K2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
8 p/ b/ n# J" ~; Q2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection; O8 S: g- D+ [% g3 a) H
2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
. h$ j( M: ~1 `3 A7 A2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
4 K# |5 z; r  P, l+ ]! S* ?2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")# Q. M/ {% |* K( {! c/ t6 i9 t
2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
7 m2 E5 m, m( g: _2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters
! X) ]) X4 ]( Y; e+ b  \2022-09-07 11:54:38.350 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)& r4 B+ n' ~$ O9 s( z
2022-09-07 11:54:38.350 330 ERROR cinder.service Traceback (most recent call last):; `8 P0 G; W* T. B  w  o
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
& O5 M( u. f5 ~% J+ U! `2 x2022-09-07 11:54:38.350 330 ERROR cinder.service     service_ref.save()9 D$ n3 f% X6 \- F% D. g/ `& V
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save2 V' z1 ?4 B+ y0 Y9 Q
2022-09-07 11:54:38.350 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)
2 {4 I, g0 m, @8 b, ]2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
% q# _- [" b* u- u# o% D2022-09-07 11:54:38.350 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
$ F2 `2 r; ^9 G/ `0 x3 m7 a2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper6 v, O1 l; n3 j& D
2022-09-07 11:54:38.350 330 ERROR cinder.service     return f(*args, **kwargs). @1 C6 R* D0 g/ P% W9 U8 E0 O& R
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper
, G+ A% w' k9 B" k% ^/ y+ R2022-09-07 11:54:38.350 330 ERROR cinder.service     ectxt.value = e.inner_exc
) c$ _8 r% t7 m7 y& k# k& a; D2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__/ F1 d/ F- [  r* H. h+ H( r% f
2022-09-07 11:54:38.350 330 ERROR cinder.service     self.force_reraise()6 C! f2 g! d8 n* u+ j1 U
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
/ @; N+ ^+ D7 l9 t) z2022-09-07 11:54:38.350 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
. A! L  t6 {4 S4 f& K$ L0 O2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
: f0 o' F9 o$ j6 A6 T2022-09-07 11:54:38.350 330 ERROR cinder.service     return f(*args, **kwargs)) J/ G7 z; t: J7 o! V" P: S2 k
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update; v9 l# @4 P/ z/ I1 E' s5 J
2022-09-07 11:54:38.350 330 ERROR cinder.service     result = query.update(values)
7 {/ `% v9 @4 c7 {" ~  [5 T2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
. F" W* I# Z3 ~# k2022-09-07 11:54:38.350 330 ERROR cinder.service     update_op.exec_()
: v3 H* R  ]' O- C) h2 ^+ z2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_$ ^! S' i& t9 z4 n
2022-09-07 11:54:38.350 330 ERROR cinder.service     self._do_exec()4 {: {; b( S9 \; p
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
4 }6 e$ W$ U  i& A8 q. [: z) o9 s! ~2022-09-07 11:54:38.350 330 ERROR cinder.service     self._execute_stmt(update_stmt)
, }5 |9 p8 p' m1 a( K1 x2 k& c% H2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt% g0 [+ \) E9 U5 L% P
2022-09-07 11:54:38.350 330 ERROR cinder.service     mapper=self.mapper)
& W1 g& I  ]6 Z: L2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
+ w  w+ y+ G: P. k2022-09-07 11:54:38.350 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
# z& B% M6 o$ N+ O5 s# r$ X2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
  L  L! Z# o4 j, C  {- i2022-09-07 11:54:38.350 330 ERROR cinder.service     return meth(self, multiparams, params)
0 E( P, t" D' n9 D0 o: l2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
; f6 D, f) }2 T! N- R1 n3 F) C& {+ u2022-09-07 11:54:38.350 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)7 v9 |% e% T: s! T* t
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement* D7 t: S. k- D- f% b8 g9 B6 d
2022-09-07 11:54:38.350 330 ERROR cinder.service     compiled_sql, distilled_params
- R- Y7 j" F& r! g: z- q5 Y2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context) i+ J% H  V1 r8 {1 l$ C
2022-09-07 11:54:38.350 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)4 G1 X' U7 R) e# L4 L4 _- J" u7 E, ~
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
8 [& R$ s. j! N1 T0 o8 v. d3 L2022-09-07 11:54:38.350 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:  Z0 j" p+ K2 `! ?
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection& H; H: B& I# J4 K
2022-09-07 11:54:38.350 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
+ e' g3 i0 b1 w2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception9 {0 u2 j6 Q6 a
2022-09-07 11:54:38.350 330 ERROR cinder.service     self._autorollback()
! ~& t0 \4 j3 l2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__- j: d- L5 z- l' p* A
2022-09-07 11:54:38.350 330 ERROR cinder.service     compat.reraise(type_, value, traceback)
) D0 j7 h  o) o) r7 k9 E! Q* z2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
0 M, \1 H6 z$ ~+ e/ Y( x2022-09-07 11:54:38.350 330 ERROR cinder.service     self._autorollback()
9 {3 k$ K: m% y6 u2 c- v( p( v2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback* o) i8 F: c* s
2022-09-07 11:54:38.350 330 ERROR cinder.service     self._root._rollback_impl()
* s4 h2 r4 k5 N( U1 a2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl/ u% [0 ]: [% z, k5 ?6 G
2022-09-07 11:54:38.350 330 ERROR cinder.service     self.dispatch.rollback(self)
8 V. |/ n! S; j' D8 R2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
$ G/ n3 J7 C6 D0 Z) Q7 J6 ]% u2022-09-07 11:54:38.350 330 ERROR cinder.service     fn(*args, **kw)/ l% Y$ \8 c' }/ p6 H; v. T% h
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
. }. }& ]2 Z7 G2022-09-07 11:54:38.350 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
' m0 ~  u+ R% r. ?2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info: ~3 @$ J$ H9 c! c) t0 R) D
2022-09-07 11:54:38.350 330 ERROR cinder.service     return self.connection.info* D# U2 v' a+ [+ f# E& U
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
; ]5 V- Q+ @+ T/ _0 J' r2022-09-07 11:54:38.350 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)- [3 V4 E: r, j& ~% f  E8 f" q8 D
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
- r& S  Y+ X5 n0 J9 G9 ^5 \% y2022-09-07 11:54:38.350 330 ERROR cinder.service     exc_info
! C$ H; ]5 L+ t+ t4 q5 C' g1 Q2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause/ ]) {0 a. c) E
2022-09-07 11:54:38.350 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)% I2 ?5 h5 A; [3 U' N# X( G5 @
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection% N% d. r  V1 n( H
2022-09-07 11:54:38.350 330 ERROR cinder.service     return self._revalidate_connection()
5 a1 g/ K! r5 l, c2 [4 Q2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
. Q& Y! f7 k8 e3 t4 o2 i" ^2022-09-07 11:54:38.350 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")+ U: P- O, B* P1 ^5 Q+ U9 |) {3 J0 H
2022-09-07 11:54:38.350 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)8 }$ R3 o9 ?; A, F* h/ z
2022-09-07 11:54:38.350 330 ERROR cinder.service
% t7 i, O* r0 L. M* H2022-09-07 11:54:38.354 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.45 sec
5 N  f# p! U* P4 z5 V! ?2022-09-07 11:54:38.361 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.45 sec
. o: Q- |4 \* H2022-09-07 11:54:38.361 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 11.41 sec
6 J  `  o9 ]  N# f3 L4 {2 {3 c2022-09-07 11:54:38.362 34 WARNING oslo.service.loopingcall [req-8fa905ab-6b12-4005-9ef8-bc279b74b2da - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.45 sec
" r# |8 `( z9 ]3 d7 g$ p$ S1 ~5 ?2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed8 q% ~8 j0 C; t
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
) g3 A" l$ C' u9 B! v0 q2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection7 ]2 F. q2 W4 P8 ?' v3 j  X
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
$ K6 \7 j; Y$ H( S2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
; W( c' H; A3 f8 J7 [& f2 z2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
9 g+ k7 {/ q2 X3 ~2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed8 J: Y! }9 U" [6 H, n2 c! K
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters . p( ?0 b- @  p1 [3 C3 I
2022-09-07 11:54:38.403 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.51 sec% J# E* I, o2 h
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed* l" H8 b* c* W/ v: I0 t
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
; e0 y8 M. {) H2 r1 x$ q9 f2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection" g8 _+ y6 Y, |' Y) z7 F
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()9 z/ @& A7 o7 a* V$ r
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
8 {8 @7 ?: d  p' q) t2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
3 B* }, ?# o% |$ q% J2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed4 }5 d$ K+ D  Q: s! Q' m
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters
6 w! N+ m$ K+ y" b, u' }# `" G2022-09-07 11:54:38.498 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!  e' ?1 p; I3 f) l6 |/ ^& r
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed2 [" F7 X( v2 f. t5 m- M
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
; E7 c4 G0 I% Q* {6 W+ a  b* f7 S2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
3 J" G2 k& A. O( _( \& q' U' u2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()5 r- S& l' q, Y: r4 v6 K
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
, G, w: Y9 e  f, b9 H2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")/ }# R" k$ h# m# ~
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
, j* W6 E4 m- Z6 x& b; C2 g9 H+ b2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters ; W4 C  {; z$ R1 l, I4 U
2022-09-07 11:54:39.691 125 ERROR cinder.service [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Recovered model server connection!3 u: {6 a* e( S
2022-09-07 11:54:48.421 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Recovered model server connection!
6 v, S% T% h  a3 Y# z2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
8 Z4 ^' M* Z/ `. w& s1 y2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
1 ]  I$ z5 C) H6 e2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection( x; j- ]4 z) j& g6 ?
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()- T- ?  [4 N; Q, ^6 S# s. {
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
- R: z2 S: a, O* S/ u! G5 F, g8 {2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed"), @5 p. G( W( a1 y' u
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed3 c0 M' J: [- H4 q8 W1 t  \% i* n
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters 4 o$ ?" ^0 R. I9 H* Z
2022-09-07 11:55:08.375 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
) x1 N" c) s% {/ D2 i- V  T2022-09-07 11:55:08.375 330 ERROR cinder.service Traceback (most recent call last):; V1 U# g. z- M( x/ [8 `
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
0 a3 l3 B& R- L5 [7 j  R8 M+ V4 W2022-09-07 11:55:08.375 330 ERROR cinder.service     service_ref.save()  s1 }7 Q7 E, P* ~. `$ b( m
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
4 l6 z7 ], G2 f2022-09-07 11:55:08.375 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)0 a" p" K" X* F4 v
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update* U/ |" @# }. p5 T" W
2022-09-07 11:55:08.375 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
  C6 R9 B+ e1 p; d' V2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
- ?8 O! Q' p  C( S- N6 ^2022-09-07 11:55:08.375 330 ERROR cinder.service     return f(*args, **kwargs)
- W/ [! A& e, i1 \3 d! s/ o2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper
% ?: @% Q1 A9 V) |7 K7 K+ V2022-09-07 11:55:08.375 330 ERROR cinder.service     ectxt.value = e.inner_exc4 ?: e- s7 u0 N+ F6 r
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
, a: I% g/ w% T& [& ^6 H2022-09-07 11:55:08.375 330 ERROR cinder.service     self.force_reraise()
/ r1 H8 Z! W- p0 t2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise# p5 A! L4 R5 N' c
2022-09-07 11:55:08.375 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)+ g6 y, |" M$ s' D1 T7 ~" J
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper1 Z) l5 G  t" P" L: t
2022-09-07 11:55:08.375 330 ERROR cinder.service     return f(*args, **kwargs)
" p, c0 d2 l- U) m; q2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
3 o  P5 G+ ?% ]! G( P: X+ ~# x2022-09-07 11:55:08.375 330 ERROR cinder.service     result = query.update(values)$ {" D+ L5 `/ M4 C8 A' u/ n
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update6 a& }3 J8 d% r& C; {! u
2022-09-07 11:55:08.375 330 ERROR cinder.service     update_op.exec_()
; `. k% |- x$ U" \2 L: l2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
/ O4 O- p% [1 J7 M) H2022-09-07 11:55:08.375 330 ERROR cinder.service     self._do_exec()
1 ]  K. q: A; A: Y7 X4 n: w& m2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec+ w+ X1 q& U- Q9 ~; }" t: c
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._execute_stmt(update_stmt)
  {/ m3 P9 {  [+ j5 d3 N2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
! Y" F+ z8 Y; ~  x3 ]2022-09-07 11:55:08.375 330 ERROR cinder.service     mapper=self.mapper)
5 `0 q0 O% S9 l" O* v2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute$ j' U3 D, {: D1 Y1 x4 G$ v
2022-09-07 11:55:08.375 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
; R  H3 \6 p6 M8 G' R' r2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute3 {' ^2 k+ f$ p5 v, n% M
2022-09-07 11:55:08.375 330 ERROR cinder.service     return meth(self, multiparams, params)4 v0 O4 p1 U3 Q8 I% `% X) F
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
" x( x$ X; b1 x/ ]2022-09-07 11:55:08.375 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params): w( m1 J, J; p8 L% h
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement3 g$ o& R6 N& ~2 P$ q8 |) Z; }
2022-09-07 11:55:08.375 330 ERROR cinder.service     compiled_sql, distilled_params% L. q- P. [( w4 J8 _6 p$ |" J
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context7 g" g% E4 m* P0 d  o5 x& g) R
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)
9 Q1 s6 {: u1 P5 Y: M) B; b2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
7 M& w% m, \4 `9 R# P' X/ K2022-09-07 11:55:08.375 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:5 c1 D+ F& C5 w% |$ }% O7 |
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection  k! s! a* u. {( @+ o9 b2 N' V( a
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)* V" {' i2 H. W9 i1 v9 l; q
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception  X$ A, z) _5 P
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._autorollback()0 C/ V% k2 o0 e% o
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
% i5 g% z: X5 }2022-09-07 11:55:08.375 330 ERROR cinder.service     compat.reraise(type_, value, traceback)9 _7 q* j" w+ H; I% o# g
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
. [! z! K! Y' X  O2 h& x+ v2022-09-07 11:55:08.375 330 ERROR cinder.service     self._autorollback()! B. r6 f/ R9 P9 G0 ~! c( H
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
0 u4 m1 D+ w; t3 p2022-09-07 11:55:08.375 330 ERROR cinder.service     self._root._rollback_impl()% [( j; l7 Q$ [( P
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl/ R, b6 j; O; k* m& y& F
2022-09-07 11:55:08.375 330 ERROR cinder.service     self.dispatch.rollback(self)
8 H4 l# f0 R$ I9 z# s+ a2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__6 z9 n, l: _# J4 T' A$ ]$ `: V' I3 J
2022-09-07 11:55:08.375 330 ERROR cinder.service     fn(*args, **kw)
. a  i- {+ ^" W5 Q, U& g- s2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx8 u9 l0 s1 x% w; \
2022-09-07 11:55:08.375 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
" \; d; ?" M; {' _2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
$ K" g5 g. y( t) ]2022-09-07 11:55:08.375 330 ERROR cinder.service     return self.connection.info
- Y8 ?2 I& Y" @* _% G! k2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection! L7 Y9 ~7 [: d( c% k5 h9 l
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
: Q2 ~  h" W8 D  c$ i5 P8 I2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
% z, J/ t3 s' O1 e# W. G. n2022-09-07 11:55:08.375 330 ERROR cinder.service     exc_info
; `1 p/ e4 X3 N8 h8 }/ G& j2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
- v' \  T2 C3 Z5 g9 I: N, T: X7 p2022-09-07 11:55:08.375 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)9 M/ y5 m* J6 `5 N# Q
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
2 F0 \- S, c& H' D2022-09-07 11:55:08.375 330 ERROR cinder.service     return self._revalidate_connection()( p9 l8 g3 b) g' n* W' e
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection$ h- \% G( E* Q/ d0 H
2022-09-07 11:55:08.375 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
$ ]8 Z% M5 e$ s$ Z% i2022-09-07 11:55:08.375 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)8 h& [& t& M. p0 U3 x
2022-09-07 11:55:08.375 330 ERROR cinder.service " A; v8 A5 b) J; ~: Q+ r
2022-09-07 11:55:18.372 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!. w6 v7 \& Q: e
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed# S9 F; L6 ~7 z
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):% g& n4 ^3 o8 H% f1 Z, L
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
9 J1 H' X+ l: }0 p* O- `2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()* U& M5 [. t1 S7 l1 ?6 k  S
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection4 p- k$ g! t: I8 l2 v% }
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")  \- T, O! c) S/ M* N
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed# z$ I3 ?. {+ x2 l( ?; _
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters
! r! U8 ^$ C  s. _5 b2022-09-07 11:55:28.374 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
3 O2 U! }( v& E" a& l# p+ O2022-09-07 11:55:28.374 330 ERROR cinder.service Traceback (most recent call last):" r( w6 x3 E& N/ p0 A, D7 a+ h0 M, W
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
$ H8 A; {) V$ G2 ~, K% M4 S+ c: W2022-09-07 11:55:28.374 330 ERROR cinder.service     service_ref.save()
* P# S+ Y) u0 N2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save4 E% ?. }, n: L: q3 ?. `: a
2022-09-07 11:55:28.374 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)
& ]8 o' s' w" @. c7 ~4 e2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
( S$ Z0 T! Z0 ^7 y9 O5 ?, V4 _' }2022-09-07 11:55:28.374 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)9 F: M( s) S' @
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
: _2 E$ @8 E  z0 z, z+ B' {; o( ~2022-09-07 11:55:28.374 330 ERROR cinder.service     return f(*args, **kwargs)
" G* D& Q+ _7 U# Y4 D2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper
+ J5 M8 K6 a% O4 ]6 ~/ P5 a' _2022-09-07 11:55:28.374 330 ERROR cinder.service     ectxt.value = e.inner_exc; R& g/ n! A2 I1 j" _
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__3 [, A' y. [- @, a/ V' d3 K% Q
2022-09-07 11:55:28.374 330 ERROR cinder.service     self.force_reraise()
6 ]0 w" N8 @% B8 P2 e; b2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
! D* a. @4 ]. \2 S% S2022-09-07 11:55:28.374 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
9 z# [% N+ N! D, V2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
  ?/ M  Z, U# I, [7 |6 I2022-09-07 11:55:28.374 330 ERROR cinder.service     return f(*args, **kwargs)
6 R& }! m: }2 g- R2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
. X% q' |1 r" C$ u# S5 o* p2022-09-07 11:55:28.374 330 ERROR cinder.service     result = query.update(values): k: F3 E/ x; r9 e9 A
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
- V0 ~: s% G, A. [7 J5 t2022-09-07 11:55:28.374 330 ERROR cinder.service     update_op.exec_()" ^% Q! b4 X1 K1 E' |* y( a+ c2 L, g  T
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
1 Y" o2 B9 y; O. X5 p# w, u2022-09-07 11:55:28.374 330 ERROR cinder.service     self._do_exec()" K0 _) R$ {& G% {$ R' |* T
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec, }8 P% ?2 d$ p9 k# \3 R1 @
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._execute_stmt(update_stmt)# V  H3 \2 Q5 s
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt( Q8 k6 O% w, p, U' o2 [( h
2022-09-07 11:55:28.374 330 ERROR cinder.service     mapper=self.mapper)7 s* q) ?+ U9 R  s3 \. _
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
' v+ {! Z) Q' a* x; a4 g2022-09-07 11:55:28.374 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})7 E( L$ R* o. z. S! ^/ p
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
' H" I- l9 p7 W$ R' G8 B# j2022-09-07 11:55:28.374 330 ERROR cinder.service     return meth(self, multiparams, params)
1 r0 S3 T# E; P* U2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection8 s$ T( X' R. s8 [! _, A; A' _
2022-09-07 11:55:28.374 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
5 j, Y5 V/ l1 w, M5 i2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
3 U- {, z5 v2 ]6 O# m$ G2 X2022-09-07 11:55:28.374 330 ERROR cinder.service     compiled_sql, distilled_params7 p3 ]/ b2 j; w4 N
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context
7 I2 p4 ?% }  m4 K& b9 r2022-09-07 11:55:28.374 330 ERROR cinder.service     self._root._commit_impl(autocommit=True): G: g4 A* f& W4 w' d9 h
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl$ n# ]3 [+ @8 G- {: Z* O2 \/ d
2022-09-07 11:55:28.374 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:% G6 I( @, ~; w' A4 t
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
1 {' Z$ |, D7 P* a7 T* K6 R1 k2022-09-07 11:55:28.374 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
# m6 n* H* A, k+ |6 ]6 `4 H2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
# O. S/ j: L  i/ w5 D  X6 O2022-09-07 11:55:28.374 330 ERROR cinder.service     self._autorollback()
2 v0 z) A0 `( G3 `: Z0 x2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
6 k9 ~" _1 W  v/ }! a) V2022-09-07 11:55:28.374 330 ERROR cinder.service     compat.reraise(type_, value, traceback)3 g& Z: |; ]* D& F5 V
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception9 V1 n8 T8 O) @3 b4 E, Z- q9 Y
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._autorollback()
! I- M5 Z7 i+ H8 C4 I# x2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
6 p' Q3 s/ B# ?2022-09-07 11:55:28.374 330 ERROR cinder.service     self._root._rollback_impl()( N/ J' @* A6 C3 O9 f; Q+ \5 J
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl) H0 i" c2 Q7 G9 i, q# o
2022-09-07 11:55:28.374 330 ERROR cinder.service     self.dispatch.rollback(self)/ Y, ?. g; b& d( G# B* p. _
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__, o- P# Z) h9 u( ^4 P6 {* d+ ^
2022-09-07 11:55:28.374 330 ERROR cinder.service     fn(*args, **kw)( E' k0 O3 w/ s- s/ D
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
' j# G# s7 V2 J5 O2022-09-07 11:55:28.374 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)1 n. C/ e6 L6 J1 r
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info: q8 D  R5 I: X1 l: C4 Z, n6 F
2022-09-07 11:55:28.374 330 ERROR cinder.service     return self.connection.info
2 l6 Z+ X' _8 ]2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
: V# Y" J& @; o2022-09-07 11:55:28.374 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)/ E1 z4 \% c0 ~! y: l
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception  K! ~3 f- P5 q* L9 z+ O/ R) O+ e1 ]
2022-09-07 11:55:28.374 330 ERROR cinder.service     exc_info" w, r6 [. k' |4 O$ y
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
2 b3 f6 N3 `6 @( W  U$ W' R5 r+ X2022-09-07 11:55:28.374 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
5 h, W2 Z9 U' Q. `3 ^0 W% N: @2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
3 D" I/ E# D  }  V0 y& F2022-09-07 11:55:28.374 330 ERROR cinder.service     return self._revalidate_connection()
) d1 B, h. m, j! b2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection8 C( {& z; ~& u3 R" c& T- ]
2022-09-07 11:55:28.374 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
: X5 |, X, q  T. n6 b: n+ A; x7 Y2022-09-07 11:55:28.374 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
, w6 D, \( u) I% a, R2022-09-07 11:55:28.374 330 ERROR cinder.service
: r% g0 M8 j' d# \/ `3 l; F9 D0 C7 I2022-09-07 11:55:38.373 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!
# M1 h3 p7 K/ i6 E7 d2022-09-07 13:31:20.753 49 INFO cinder.volume.manager [req-808e7d95-8769-4222-9160-49d2a558ad7b 2d3de65e3f1f46df86c7789341ba4523 5ec1142884724554b1a1257489e624e8 - default default] attachment_update completed successfully.6 B( {+ l% I( f0 C* e
2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed/ c$ e5 c/ T; T, X/ |) J
2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
1 h3 M% Q2 i8 g+ r2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection6 T8 F9 W. ?2 O8 V3 h. b2 Q
2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()  @# [' C8 G/ i6 @1 R: {3 M
2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
8 W; A9 q5 U: o3 e; n9 k2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
& H# X: C9 P) m, h- b) P( \2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed. ^) B1 B. F: J& ]
2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters
0 I1 x" n" h0 p' R3 a/ n2022-09-07 13:33:18.826 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)4 D: m: b$ R" N( k
2022-09-07 13:33:18.826 330 ERROR cinder.service Traceback (most recent call last):
' O  t; f: S$ P5 s# V0 R1 Z/ L) Z2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
$ Z- l/ @0 [# i4 O+ [8 |2022-09-07 13:33:18.826 330 ERROR cinder.service     service_ref.save()
9 J# \% h! a  R. k& Z: Y! M2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
1 F" K' U! x- ~2022-09-07 13:33:18.826 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)
" S' @  I( ~* V2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
. W  r) ~7 j; G0 K0 R. |/ s0 C0 \2022-09-07 13:33:18.826 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)/ I) d8 M2 l) E& e( ~: B
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
, V! X4 z  R! K; Y2022-09-07 13:33:18.826 330 ERROR cinder.service     return f(*args, **kwargs)- C* {. g3 F8 u+ y1 r
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper7 `- I7 R. l* d: z  q- P' t7 z
2022-09-07 13:33:18.826 330 ERROR cinder.service     ectxt.value = e.inner_exc/ g# j4 ?0 v5 F4 X. j) N8 z  g
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
1 [1 g! F  R  C: L2 o2022-09-07 13:33:18.826 330 ERROR cinder.service     self.force_reraise()
, y  R& {) q0 b' o0 a' j% {7 ~; t2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
# l3 s: I- y9 U( c% O, _: m6 _, G3 P2022-09-07 13:33:18.826 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
* _* R) g$ j! c6 V# t2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper% L: X" b9 c# l. Q
2022-09-07 13:33:18.826 330 ERROR cinder.service     return f(*args, **kwargs)- u, _" H: }9 C: v% I+ d
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
* H! S( f9 j1 D) ^& Q7 p2022-09-07 13:33:18.826 330 ERROR cinder.service     result = query.update(values)
- P7 ]8 v8 h6 t- B; Q2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
1 I0 O5 @9 L! C4 {( V/ }; q2 y2022-09-07 13:33:18.826 330 ERROR cinder.service     update_op.exec_()
! {$ |! F6 U$ A! R9 u2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_; W( S7 ^+ y0 |( D8 _4 Y! D
2022-09-07 13:33:18.826 330 ERROR cinder.service     self._do_exec()
  E' ]" v, h2 M' W' ?5 w2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
) X1 [" M6 f+ |5 l2022-09-07 13:33:18.826 330 ERROR cinder.service     self._execute_stmt(update_stmt)
  h4 N' o+ W# X/ u/ S* Y8 L( @* S2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
" c. H9 y5 C$ [( l3 ?2022-09-07 13:33:18.826 330 ERROR cinder.service     mapper=self.mapper)
5 S8 O3 U  c( z, t8 o2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
! Z; b9 r* o! \2022-09-07 13:33:18.826 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})9 E/ n7 H4 D) |8 l; K
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
6 Y! [# I  R6 `; [2022-09-07 13:33:18.826 330 ERROR cinder.service     return meth(self, multiparams, params)+ W' i4 B7 C' S  L5 N; ?
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection& F: z. ?6 ^1 g" m8 T  v0 z
2022-09-07 13:33:18.826 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)8 Q/ l0 ]! o; H  o* q- W% O
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
; X+ v6 ?: q7 i* [5 V, A2 m2022-09-07 13:33:18.826 330 ERROR cinder.service     compiled_sql, distilled_params3 V- K" G. y4 U8 k% L2 M+ p
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context( q9 R5 t) X$ A& k# p& r, q4 j# n
2022-09-07 13:33:18.826 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)
. N; V/ c4 }1 `* P( y  G* e2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
  E9 b+ H* D, i% @) D6 s2022-09-07 13:33:18.826 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:( W. W+ d$ E* t/ @6 Q
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
& t' Y% n- g( p2022-09-07 13:33:18.826 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)6 C# U$ Y! p3 v# _+ n+ K
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
; x: \- {( s1 G6 S: Z6 h1 r2022-09-07 13:33:18.826 330 ERROR cinder.service     self._autorollback(): C( S8 Z+ S' `3 G( d" l
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
( @( i2 V$ K9 p( r2 r2022-09-07 13:33:18.826 330 ERROR cinder.service     compat.reraise(type_, value, traceback); {% F: u# H- D+ p2 J/ {" ~
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
+ l) F5 [, V( ~! T/ Q9 U2022-09-07 13:33:18.826 330 ERROR cinder.service     self._autorollback()
! C/ m& @7 A! |( \- ?2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
; w+ N' R' Q/ ]: k! t* [2022-09-07 13:33:18.826 330 ERROR cinder.service     self._root._rollback_impl()' m1 G, Q% q/ O+ D7 T2 a0 z0 K
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl# U0 M/ Z+ y  u+ [
2022-09-07 13:33:18.826 330 ERROR cinder.service     self.dispatch.rollback(self)
- z' p- d4 S' V6 s! w$ y2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
7 G) }' K/ l- R, \/ T- A1 [2022-09-07 13:33:18.826 330 ERROR cinder.service     fn(*args, **kw)7 E' W0 j! @' ?7 Y
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx- Z3 u- @+ l. c0 [3 S0 x, [
2022-09-07 13:33:18.826 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)4 Q9 e/ O- T+ F0 Z) G0 g- e% N
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
! O; {0 _0 w1 a; K2022-09-07 13:33:18.826 330 ERROR cinder.service     return self.connection.info2 w- ]5 A2 r1 l4 G
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
/ _# |! ], X# \2022-09-07 13:33:18.826 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
$ [2 C3 q& C$ d+ {6 f2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception/ i, A. h# a. R6 C& I, T
2022-09-07 13:33:18.826 330 ERROR cinder.service     exc_info) {& _3 ]+ q0 g0 _( L7 h: @# _& S
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause0 k& d1 M4 ?& I/ p6 x
2022-09-07 13:33:18.826 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
8 B+ P6 A$ g* ^$ W4 i" W0 D2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection1 _4 {  m6 W: D. w) k
2022-09-07 13:33:18.826 330 ERROR cinder.service     return self._revalidate_connection()2 x# r$ h  H- Z4 b
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection+ M7 I9 t' V5 l! c* L$ _% M0 \' A
2022-09-07 13:33:18.826 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")0 u$ j) o+ u  p% M
2022-09-07 13:33:18.826 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi). d9 X/ z$ Q' s* B! T- A  m8 I
2022-09-07 13:33:18.826 330 ERROR cinder.service 6 s% H: n, N- f( U3 k4 d
2022-09-07 13:33:28.822 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!/ B8 v7 m( B. z
2022-09-07 13:35:05.363 49 INFO cinder.volume.manager [req-c7ac38c5-b0a2-48e5-9bc1-1a6abac4f14f 2d3de65e3f1f46df86c7789341ba4523 5ec1142884724554b1a1257489e624e8 - default default] attachment_update completed successfully.) B  k7 e" l9 f9 M9 F: M$ R" y
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
% e8 i0 N& |  c2 _. r2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):$ C0 m1 o$ u5 p
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
/ r- i; j  c, Z5 g1 @2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
/ N* x- V1 f, p* q/ _- J2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
; ]5 n, s, U/ u2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")& r  `. B5 y( k% K) F* n% {
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
- X5 {: k/ f. v; M( G% {2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters
5 Q& w' I" C1 I/ v' G+ u: P2022-09-07 13:42:41.776 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)2 p+ k, }& W5 Y* ?# ^
2022-09-07 13:42:41.776 49 ERROR cinder.service Traceback (most recent call last):. G- v6 ~& s: N' z  z
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
. S7 w# T+ ^8 D8 [2022-09-07 13:42:41.776 49 ERROR cinder.service     service_ref.save()
  y5 G+ c: Z" B" V2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save9 Z! V1 O5 d4 R) N! T/ L
2022-09-07 13:42:41.776 49 ERROR cinder.service     db.service_update(self._context, self.id, updates)/ e' n% b* R! l; C0 G. W
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update6 h) _5 W' \7 V& P- s3 Z
2022-09-07 13:42:41.776 49 ERROR cinder.service     return IMPL.service_update(context, service_id, values)# p% I, u' k% Z
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
2 y$ _" K+ G6 d2022-09-07 13:42:41.776 49 ERROR cinder.service     return f(*args, **kwargs)
: q/ S$ ^' v* |. g# X' [) c2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper
7 b. M/ D+ r9 v& U0 ?8 q2022-09-07 13:42:41.776 49 ERROR cinder.service     ectxt.value = e.inner_exc8 S! k9 p8 Z/ M! z8 ]1 ]
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__. J* N0 E0 I$ V3 A
2022-09-07 13:42:41.776 49 ERROR cinder.service     self.force_reraise()( ~7 O( u# V7 i6 h8 R# N: v
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise$ k" Z. i# Z5 J' A* N
2022-09-07 13:42:41.776 49 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
' O8 @2 }9 F4 O) c2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper1 d) k0 Y2 n7 Q( ?8 Z! ]/ e  Y* L8 u
2022-09-07 13:42:41.776 49 ERROR cinder.service     return f(*args, **kwargs)
2 K! b+ c/ M4 i) h! O) z2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
6 h% t! b3 j( X7 d' [6 j2022-09-07 13:42:41.776 49 ERROR cinder.service     result = query.update(values)
: J3 a2 _/ D& _7 a- r4 X2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update- l/ n! f& O; |3 B" \
2022-09-07 13:42:41.776 49 ERROR cinder.service     update_op.exec_()
- z/ x& ^2 M4 t$ C2 E- Q& H2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
4 C) m3 s# g# x4 g2022-09-07 13:42:41.776 49 ERROR cinder.service     self._do_exec()
/ c+ P9 g& Y& t$ }. m# b2 k2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec& H! ~. m* ]6 K) [
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._execute_stmt(update_stmt)
/ P8 r6 V/ V" e+ v7 U/ x$ z. R2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
, t) P6 ?. n! i2 H2022-09-07 13:42:41.776 49 ERROR cinder.service     mapper=self.mapper)& L+ t! h: b7 ]# A) B: s" H
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
5 q: a' d) K# \' n2022-09-07 13:42:41.776 49 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})% I, y+ N( y  t$ A# `( F
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute: v( ?, B1 A/ L) s) p/ {
2022-09-07 13:42:41.776 49 ERROR cinder.service     return meth(self, multiparams, params)
% J: t' t: M, Q2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
9 h0 f) }' [7 A! k4 F" A2022-09-07 13:42:41.776 49 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)6 j. j8 o. q0 }6 N- ?( Z. c
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement4 Q0 ~2 v  W: {" g
2022-09-07 13:42:41.776 49 ERROR cinder.service     compiled_sql, distilled_params
- @1 H/ s4 X1 t. K" D& t  o! F( h2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context7 ~: j  P: ?4 F* X8 p5 @  c
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._root._commit_impl(autocommit=True)3 @! [6 K0 H$ u' E6 w* j1 M
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl7 M) w$ |% J; p8 Q) j
2022-09-07 13:42:41.776 49 ERROR cinder.service     self.connection._reset_agent is self.__transaction:  U" x' A. j. @3 D: u! x9 s5 n
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection% d& [, B9 j$ i8 b# v2 G8 @; q
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)6 ?" I5 G& K1 G4 h8 g6 a
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
- Y& @7 M0 }; n' Q: \- |5 B1 ]2022-09-07 13:42:41.776 49 ERROR cinder.service     self._autorollback()$ p+ n* A! u$ @6 m$ z7 @) z
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
8 ?- B" q/ O- B' e7 Q2022-09-07 13:42:41.776 49 ERROR cinder.service     compat.reraise(type_, value, traceback)# Z  p; B$ n* e! }& M/ I
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception% e& G% K/ u6 j! ~* b
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._autorollback()8 Z( @  ]  U+ f
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback$ p2 E' F" X3 D3 l7 O
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._root._rollback_impl()
/ O" X" q9 Q: h/ _$ H" P2 I9 r2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
6 b* T6 K0 ?# R6 f9 `2022-09-07 13:42:41.776 49 ERROR cinder.service     self.dispatch.rollback(self)
$ L  m$ |4 e; r1 o. [8 F2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__( u) B$ w* ^% z+ n  D) q1 w: m& q
2022-09-07 13:42:41.776 49 ERROR cinder.service     fn(*args, **kw)
8 V+ _' J) M: w$ P: I8 F2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
) k8 L7 P# B) m. ]. E3 B2022-09-07 13:42:41.776 49 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)  P+ A% Y0 V9 g
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info+ U) f/ K7 ^8 E) L* Y
2022-09-07 13:42:41.776 49 ERROR cinder.service     return self.connection.info) M' _& u  Z! y# J
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection: s& F9 |7 C; o
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
$ p8 u. u# v8 I2 B5 m/ J# z2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception9 k. u6 W. j7 p4 G* ]
2022-09-07 13:42:41.776 49 ERROR cinder.service     exc_info
  S. @) d5 I# L9 f9 h1 I2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
2 Y. v3 @; x9 q$ {8 T+ c: _! x2022-09-07 13:42:41.776 49 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
) y7 Q  U* g& Q' P1 n& _2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection! i' W7 P3 T5 N: g' Y. y
2022-09-07 13:42:41.776 49 ERROR cinder.service     return self._revalidate_connection()
4 D+ z, G  _9 S2 k" U, k2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
! Q0 o1 a6 I$ w% {$ F2022-09-07 13:42:41.776 49 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
6 F6 z5 {" Y2 I& o8 v, G2022-09-07 13:42:41.776 49 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)% _" Y# C- n& P! L- ]5 [
2022-09-07 13:42:41.776 49 ERROR cinder.service 8 y( g* W& X* X; v" r$ @
2022-09-07 13:42:51.713 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Recovered model server connection!
& z- r! I( n2 J" b# h/ w4 S) L0 s: O# J; p. H' P
 楼主| 发表于 2022-9-7 14:09:45 | 显示全部楼层
Things i changed:* o- }6 w1 @, ~

( }6 K7 p1 s7 T" R- n$ IMariaDB [(none)]> show variables like '%timeout%';
, r/ m) F' d' G, R+---------------------------------------+----------+
) X% S. R* R$ h$ E| Variable_name                         | Value    |2 {0 p+ @2 n! R- Q! F2 Q
+---------------------------------------+----------+
$ u* l) i( X3 O% }- r4 \5 w| connect_timeout                       | 120      | <<==== This one, Initially we raised to 30s which has improvement but didn't help and then 60s which had lot of improvement but still saw connect errors.' i2 l: d! e+ Y& V1 }
| deadlock_timeout_long                 | 50000000 |
& Z1 M$ x! }3 ]4 s- n( @1 E| deadlock_timeout_short                | 10000    |
# u9 S; k% r" w9 `0 L0 i| delayed_insert_timeout                | 300      |
% P* ~0 U; W) s6 O0 @8 u: G| idle_readonly_transaction_timeout     | 0        |7 ?% V! F( J( A6 \: d
| idle_transaction_timeout              | 0        |. j. a4 I; o9 W9 E0 ^; ^- R, ]0 W
| idle_write_transaction_timeout        | 0        |
) l" `- t5 K1 n1 N6 z+ i| innodb_flush_log_at_timeout           | 1        |( e( R9 c. n- Y, T
| innodb_lock_wait_timeout              | 120      |<< ==== This one for lock wait timeout.9 }) F9 L: k  q/ j5 z
| innodb_rollback_on_timeout            | OFF      |
0 ]/ a. N& V$ y8 \| interactive_timeout                   | 28800    |1 K; {. [  Y) g3 Z; I% \+ M- h
| lock_wait_timeout                     | 86400    |4 r% ^5 k. M- r, {" E2 d
| net_read_timeout                      | 30       |
: c+ c/ I9 ?2 M| net_write_timeout                     | 60       |
) _0 Y: z# \) q+ p| rpl_semi_sync_master_timeout          | 10000    |
1 Q( J; ^9 d+ l& e| rpl_semi_sync_slave_kill_conn_timeout | 5        |
6 E5 O: p$ L5 ?+ {, C: ?| slave_net_timeout                     | 60       |8 M* k2 \0 s, p; l/ ]% w9 l
| thread_pool_idle_timeout              | 60       |
% e, s6 B# q1 v8 t: Y' v| wait_timeout                          | 28800    |! f* \( e& z* [/ e" J/ x
+---------------------------------------+----------+
5 V' e8 y6 f; A7 @$ N. w) j0 l: ?5 Z6 T% k+ k( O
2 x5 m. |& p3 I9 a: o( j
In Cinder.conf,
2 i' W- E! r4 }3 B# f7 }" q; j
4 q: y& t4 |( ^6 B( iservice_down_time = 300' H; k# ^. o& m* Q4 ?* [: X
report_interval = 30, ]+ o! C$ W9 f% Q  o
rpc_response_timeout = 6005 y0 n! p, t+ u1 r8 v+ K
use_db_reconnect = True
  [; I5 N' @# T: L
! G6 {+ [, n8 H1 FIn nova-compute:5 v, _7 h! P3 P- U6 P7 |5 R

5 V2 q4 |; d+ |* S& m# {, Sblock_device_allocate_retries=2008 ~2 E4 P5 Z0 a! W& d) N
: u% o& W" V. p+ @2 C6 s4 I: I
The above seem to help but there are still occasional mysql timeouts.1 T( E# u. A8 D9 I9 l; ^
您需要登录后才可以回帖 登录 | 开始注册

本版积分规则

关闭

站长推荐上一条 /4 下一条

如有购买积分卡请联系497906712

QQ|返回首页|Archiver|手机版|小黑屋|易陆发现 点击这里给我发消息

GMT+8, 2022-10-4 05:10 , Processed in 0.076605 second(s), 22 queries .

Powered by LR.LINUX.cloud bbs168x X3.2 Licensed

© 2012-2022 Comsenz Inc.

快速回复 返回顶部 返回列表