浏览此站
联系我们相册切换到窄版 Language

 找回密码
 注册
易陆发现论坛»论坛 › 云计算开源区 › ceph分布式存储 › ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a6 ...
返回列表 发新帖
查看: 574|回复: 1

ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Except

[复制链接]
admin

0

主题

0

回帖

9

积分

管理员

积分
9
QQ
发表于 2022-9-7 14:02:45 | 显示全部楼层 |阅读模式
[root@controller1 ~]# tail -f /var/lib/docker/volumes/kolla_logs/_data/cinder/cinder-volume.log
1 S# r/ b" k( a  t' `$ R( V$ Q2022-09-07 11:36:22.698 245 INFO cinder.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Initiating service 32 cleanup
+ u$ d# \) e' D6 ]/ n8 @, N2022-09-07 11:36:22.706 245 INFO cinder.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Service 32 cleanup completed.
2 s% G1 ]7 F' z2 |2022-09-07 11:36:22.834 245 INFO cinder.volume.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
3 v. X2 _' M, W% y. Q2022-09-07 11:36:23.670 34 INFO cinder.volume.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Driver initialization completed successfully.5 ?9 {/ H5 E) y" w# P+ H
2022-09-07 11:36:23.683 34 INFO cinder.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Initiating service 12 cleanup1 {" T" {- I6 h, h
2022-09-07 11:36:23.691 34 INFO cinder.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Service 12 cleanup completed.
- n6 R+ m3 l. i2 F  S2022-09-07 11:36:23.812 34 INFO cinder.volume.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
6 ?8 k( C& E; u/ c) }1 k2022-09-07 11:36:26.016 245 INFO cinder.volume.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Driver post RPC initialization completed successfully.8 y7 E* r) a. [/ c$ C  _$ |3 H
2022-09-07 11:36:27.696 49 INFO cinder.volume.manager [req-3e8b1d22-3d32-4d94-93a8-5d1ad0375ae1 - - - - -] Driver post RPC initialization completed successfully.) v( E; \# d* C1 N2 [( h4 F$ {! ]
2022-09-07 11:36:27.937 34 INFO cinder.volume.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Driver post RPC initialization completed successfully.# Q; i$ j, N" _
. S+ o! B' Q+ [9 z
9 R7 m6 y9 R7 y1 i$ @, [( T+ @. c

; Y! q4 q; ~5 |4 M! [6 B, J1 y6 A& v% ~; R* O+ [( k; i- B9 i

/ h  G1 y6 b1 _) ~9 r2022-09-07 11:46:35.171 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 8.71 sec; {! d- r: [* Q
2022-09-07 11:46:36.142 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 0.22 sec
/ G/ Y; l9 B+ B1 m0 c2 J. d2022-09-07 11:46:36.142 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 0.07 sec
! ~. q+ E' U6 _2 I+ f& n- B2 s* O2022-09-07 11:46:37.424 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 10.17 sec  E% u% _8 l( D* _
2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
$ o5 k6 {, `' M- M2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
8 }+ {) G& R: F- N% H2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection, _  |: }( h" x& J  g9 u
2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()/ ?* g- r* [0 D3 t5 z
2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
% M- ?7 x( c# R- Q6 x2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")  y9 R* Q$ g3 x+ {$ ^& |
2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed/ n6 Y$ }7 S" s( F; \2 B, U
2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters
  v' M9 p! D1 W. Y( ~1 ?2022-09-07 11:46:42.166 330 WARNING py.warnings [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:
! G. e" J& Q2 U <class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed
  `9 K6 L( j8 u1 P' n8 k# ?; ]
  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1]))
* w; [& {& Q$ X. v0 t: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
4 {% \: {4 Q( d/ C. }. p2022-09-07 11:46:42.167 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)7 e8 X% O' a5 Q, u
2022-09-07 11:46:42.167 330 ERROR cinder.service Traceback (most recent call last):
8 t& j- Y" w* Z6 Z  v5 c  E9 C2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
# {- z: }+ l; [- U2022-09-07 11:46:42.167 330 ERROR cinder.service     service_ref.save()3 G2 g* P& g3 Y- O$ w
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
8 L" P1 h( B9 |& P2 M9 p2022-09-07 11:46:42.167 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)$ ^, p. z: r- L+ h6 V5 E
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update6 p+ Y9 M% d( D
2022-09-07 11:46:42.167 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
+ B9 _! N. b- a- D0 y2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
9 o3 j! f( W( T: k- s1 ~2022-09-07 11:46:42.167 330 ERROR cinder.service     return f(*args, **kwargs)* s" p: B. [# ^5 q5 }3 j6 V
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper
, h5 ]$ q1 t6 G" \2022-09-07 11:46:42.167 330 ERROR cinder.service     ectxt.value = e.inner_exc
7 a( K# p( o: f% W2 C) \2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
& D5 H. Q7 h! J! j- k2022-09-07 11:46:42.167 330 ERROR cinder.service     self.force_reraise()
0 i( r1 }( {* S& ]% p# N4 s0 h2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
. j- Q; t5 l# Q. s% v2022-09-07 11:46:42.167 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)* L, G1 Z1 q% v6 P( e& y/ V
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper2 M& o5 B3 W& c8 E
2022-09-07 11:46:42.167 330 ERROR cinder.service     return f(*args, **kwargs)
! W: s# y  V% K8 x2 T; s2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update) r3 W- j; Q8 _' [9 \9 M/ R$ u
2022-09-07 11:46:42.167 330 ERROR cinder.service     result = query.update(values)/ G) i+ ?5 b4 _9 `
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update! G8 J: L( Q  y% Z
2022-09-07 11:46:42.167 330 ERROR cinder.service     update_op.exec_()* p3 C  F: g' H+ [$ J" V% s' ~
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_( T7 A1 ]3 w& K( i6 N8 m: E
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._do_exec()
: I# g- o! j: A( ?' g& Z2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec* |% L2 s3 g( D" s
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._execute_stmt(update_stmt)
- \$ x5 p5 O3 t. D' r2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt) g; F2 T0 p, O$ d
2022-09-07 11:46:42.167 330 ERROR cinder.service     mapper=self.mapper)! u4 U! e3 B+ l- c+ S3 i
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
1 `1 t9 A9 ?$ l% K( R$ x" p% \2022-09-07 11:46:42.167 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
1 z% M# r( b5 K4 g" n0 }; E8 K0 R2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute( \* N- d9 ^0 J' Y
2022-09-07 11:46:42.167 330 ERROR cinder.service     return meth(self, multiparams, params)
. T# \. c( B& n$ K2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
! x- I1 Q4 y& k. R) {2022-09-07 11:46:42.167 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)+ g! i' C- E7 K! j; W
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
/ d2 M, S, F9 s2022-09-07 11:46:42.167 330 ERROR cinder.service     compiled_sql, distilled_params. ~4 J1 U; C9 C( [) E2 z* `) B9 H
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context1 g  e* J3 O, J- a+ P/ g  z
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)/ A% O. [; b8 y5 O0 D
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl9 ]2 @7 K4 x& T7 R
2022-09-07 11:46:42.167 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:
2 M# ^1 D! F5 g# O* V& |2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection. k8 {' Z9 C) j! ]; ?1 ^+ M4 V
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)/ O5 n: c) C, D0 Z1 M+ N3 v
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
) Y; c% S; l% C# J1 K. T2022-09-07 11:46:42.167 330 ERROR cinder.service     self._autorollback()% j5 P# P4 L; q! m
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
5 o. x9 Z  D# j/ T" {8 P" x1 e2022-09-07 11:46:42.167 330 ERROR cinder.service     compat.reraise(type_, value, traceback)
# D( m8 Q! }3 F% q9 Z" k" X2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception" U  v; m4 Y% p- E- R! V
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._autorollback()/ F' J( f& ]* _+ B# B% ~3 D* E
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
/ `  x- R9 {$ T' i3 q2022-09-07 11:46:42.167 330 ERROR cinder.service     self._root._rollback_impl()# S* B4 e4 [! {$ Y& M
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
+ n( F- @: C% {2022-09-07 11:46:42.167 330 ERROR cinder.service     self.dispatch.rollback(self)1 B7 g  d/ [- K+ ^: u
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__% ]6 `0 P, R2 n
2022-09-07 11:46:42.167 330 ERROR cinder.service     fn(*args, **kw)
( f1 ^1 S" X& E1 [2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
) n2 W$ L6 g& {/ k+ d2022-09-07 11:46:42.167 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None); z& w: |2 O9 _# Z
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
9 _* \, H( W" U; z0 k- L2022-09-07 11:46:42.167 330 ERROR cinder.service     return self.connection.info3 Y, K% S+ `. s. G; N  [
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
- h8 L4 u$ L. z  ]4 @* F1 f2022-09-07 11:46:42.167 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
1 J: a3 M: d8 \7 ?2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
6 D4 p, t/ x% l: g; G9 }  ]9 l: n2022-09-07 11:46:42.167 330 ERROR cinder.service     exc_info
* b7 x5 J% `0 w% ~) X; e  s' Y2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
% L2 _$ ?" n$ b  z: f; o2022-09-07 11:46:42.167 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
3 ~* f. {8 E- Q0 r2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection! h3 a" u/ m- `; D
2022-09-07 11:46:42.167 330 ERROR cinder.service     return self._revalidate_connection()2 \! N1 `9 Q; \
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection7 i( E; k6 ~( P7 E0 V: v( K
2022-09-07 11:46:42.167 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")4 P. B/ N$ E1 m8 P) x( V9 f
2022-09-07 11:46:42.167 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
* n. L0 D' j; x  I3 A1 B+ N: |& F2022-09-07 11:46:42.167 330 ERROR cinder.service - p7 [4 N  F) }) s
2022-09-07 11:46:57.813 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 18.91 sec* B1 x+ P& w6 D) \
2022-09-07 11:46:57.817 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 11.67 sec; {# J; g; k& x; ]6 U4 F/ O: s
2022-09-07 11:47:05.300 34 WARNING oslo.service.loopingcall [req-8fa905ab-6b12-4005-9ef8-bc279b74b2da - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 36.06 sec6 Q* F1 X3 P, Z7 T! r
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed6 F! _, s, H# p
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):+ I4 y" a2 R* j& T  ]% g$ \* @4 P* u
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
: A! d  R! D4 I% o( V2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection(); a- ]' b2 r6 g: b5 W( |
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection/ w6 m) a. m5 @8 s
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
6 `; [# u4 w, D1 `, B7 t) B  h1 l5 D2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed- e2 E% D3 h" x9 I1 ]' o2 R
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters 1 V, [! p! F: o2 d' U
2022-09-07 11:47:05.320 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 10.14 sec( s/ j; [' T/ _) j1 J) ]1 W
2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
8 `3 M" S& j* F% U# z" E9 i& U2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):: X1 H! q9 Y. Q" v, s% d( L8 Y
2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
1 a. b9 f9 z0 w3 q0 U3 R4 S3 ?1 e4 S2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
) d" J# i5 T: T: Z0 u3 P8 G- c- f1 M2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection+ T% R9 A" O2 F5 i& u
2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
" r! S, a, z, n2 E5 \( x6 G2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
  C/ o/ J% ~! u) m5 S1 g4 m2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters 3 E& r  [  M6 {: x
2022-09-07 11:47:05.366 168 WARNING py.warnings [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:
) Z1 H* z2 o# q8 V( Z+ N <class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed
  d0 X3 f. x& T/ n
$ S+ B0 V8 U( X- G  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1]))
! A. t" e6 d5 q: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)9 Y0 P( g4 F% S0 L7 u) l
2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
" p0 ~& \4 m, y* K+ J  R2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):0 F; Y0 G8 c9 i5 [
2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
- x# q1 R: e3 r- d. D2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
: t3 U3 E9 r- m1 C5 ]$ G0 s5 N2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection, x; W0 p& E) ~4 J3 x
2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
0 @" {; F9 v1 z5 \2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
+ \) K6 j. S0 Q9 W& A2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters 0 O$ k1 ?+ |# h! p
2022-09-07 11:47:05.367 168 ERROR cinder.service [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)) Y+ A8 C! z2 A+ m- k- m7 E
2022-09-07 11:47:05.367 168 ERROR cinder.service Traceback (most recent call last):
6 V4 c" X5 E& y2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
* B4 V9 ^2 m. E  U$ E2 v4 {9 S2022-09-07 11:47:05.367 168 ERROR cinder.service     service_ref.save()
' X' i+ z7 M: w7 g" L: R3 t) C2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
5 t( ]5 L' l1 S- t$ l+ g* B2022-09-07 11:47:05.367 168 ERROR cinder.service     db.service_update(self._context, self.id, updates)" Q- r7 m( u( h9 a- R; B
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
- r# W8 i# ]7 D% Q2022-09-07 11:47:05.367 168 ERROR cinder.service     return IMPL.service_update(context, service_id, values)' ~; p5 V* @0 m7 o; j8 n# \; @9 J
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
$ }& E. F& M  i, `2022-09-07 11:47:05.367 168 ERROR cinder.service     return f(*args, **kwargs)3 J5 Q( V3 i/ k8 p4 P1 x8 W2 n
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper% A( y, p  O# C# y" I9 g
2022-09-07 11:47:05.367 168 ERROR cinder.service     ectxt.value = e.inner_exc5 h3 c7 c% B0 }
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__' m0 F2 w$ G' ?
2022-09-07 11:47:05.367 168 ERROR cinder.service     self.force_reraise()+ l2 B  y7 O) V0 U! R
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise3 o- @/ `% c0 J& T8 J
2022-09-07 11:47:05.367 168 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)& P, ]5 G8 b, c/ s5 \- x
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper$ _8 B+ G8 G% L
2022-09-07 11:47:05.367 168 ERROR cinder.service     return f(*args, **kwargs)
) i; v/ T2 K! t4 I0 l" C5 k2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update) x5 |; I, [6 a$ m7 ~3 f
2022-09-07 11:47:05.367 168 ERROR cinder.service     result = query.update(values)2 G2 [! d5 [- o. ~- Z0 j, @. ~; O
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
  Z  r9 e2 R$ {+ S+ q/ J' j2022-09-07 11:47:05.367 168 ERROR cinder.service     update_op.exec_()
1 ~/ m( \7 f8 D7 y2 A0 W) K; R2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
) r, r0 U$ q. ?3 a2 l  _2022-09-07 11:47:05.367 168 ERROR cinder.service     self._do_exec()
% {: d( L# Q, O4 e) p1 R. r2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec4 u2 Y- T5 f0 R
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._execute_stmt(update_stmt)
7 \0 U/ C; M, |6 T  p& v2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt: H% F7 R( M; k
2022-09-07 11:47:05.367 168 ERROR cinder.service     mapper=self.mapper)
2 e0 Z: J; u, d; F- d) w6 P0 l2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute. K( y- ~' m# D1 w. `# L) j* J( Y
2022-09-07 11:47:05.367 168 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
! y6 x* t* f. O2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
" I/ Y0 [% h3 h+ L2 C/ a2022-09-07 11:47:05.367 168 ERROR cinder.service     return meth(self, multiparams, params)* k  Z2 l- D" B1 C
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
: q/ x' ~2 z3 V6 X2022-09-07 11:47:05.367 168 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params); i  Q0 W! j/ B# s3 D/ G& @0 g5 x, x
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
' P" ^2 i. _$ z# O% U9 l  D2022-09-07 11:47:05.367 168 ERROR cinder.service     compiled_sql, distilled_params3 {+ s+ \9 h. E9 H
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context
- U2 N4 _7 R( n2022-09-07 11:47:05.367 168 ERROR cinder.service     self._root._commit_impl(autocommit=True)) I% d; A  a: {+ h' P' w5 E
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl9 U- U( B4 n! c: Q
2022-09-07 11:47:05.367 168 ERROR cinder.service     self.connection._reset_agent is self.__transaction:
7 D* E$ v* e  B3 }  Y- c' k- n2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
5 d# o7 t1 A" K, t2022-09-07 11:47:05.367 168 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
' Y3 d% }1 W0 m) V1 X! U( U2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
' |% W$ d/ y  l7 q$ N: k2022-09-07 11:47:05.367 168 ERROR cinder.service     self._autorollback()/ ]+ y. b' a( n6 v  F# d2 z8 q
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
. C- q: t3 I7 |' w+ N2022-09-07 11:47:05.367 168 ERROR cinder.service     compat.reraise(type_, value, traceback): ~# N: t8 z, b8 h3 Z0 u& Z
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
$ c$ t4 U  X3 `# I! u4 n2022-09-07 11:47:05.367 168 ERROR cinder.service     self._autorollback()4 t% Y5 y) Q( O" e
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
- m) K" p/ x4 i7 ]2022-09-07 11:47:05.367 168 ERROR cinder.service     self._root._rollback_impl(); Y$ h) e, j2 c' W' ^
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl9 \2 x6 z0 i. t/ R7 W
2022-09-07 11:47:05.367 168 ERROR cinder.service     self.dispatch.rollback(self)
" T  m/ r8 G1 G2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__4 z# D1 c% R8 _7 f' r
2022-09-07 11:47:05.367 168 ERROR cinder.service     fn(*args, **kw)
+ D! q' H1 B2 `% _% q2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
$ s. b1 H- ^8 |2022-09-07 11:47:05.367 168 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
* P. ~. l- h8 G2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
! {' `- c4 ]9 }1 x* n2022-09-07 11:47:05.367 168 ERROR cinder.service     return self.connection.info. Z! Q5 d$ ~' i6 G' U# x% ]- o0 }9 N
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection# y- U) S) }$ f. O, v  D4 i' u
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)5 u( n( b2 ~# z' t3 }; n# ?; w, G  w
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception" q0 G6 {6 `+ O' j! W' v8 d
2022-09-07 11:47:05.367 168 ERROR cinder.service     exc_info9 i1 _4 `* |( w8 _# K( p# f
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause8 H, g$ ~" ^* m" Y, w
2022-09-07 11:47:05.367 168 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
- }9 F: K% @; w: b$ l2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
% Y6 m( @  Q' q  F6 N2022-09-07 11:47:05.367 168 ERROR cinder.service     return self._revalidate_connection()
% I! _6 D; H+ J2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
% l- ~$ J1 @6 y3 W; n! J, o2022-09-07 11:47:05.367 168 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")+ @8 b; G5 ^  E. h
2022-09-07 11:47:05.367 168 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
: R+ u& e  l2 |2022-09-07 11:47:05.367 168 ERROR cinder.service
3 A4 O- k9 I7 R5 ^% A: T) B2 r2022-09-07 11:47:05.375 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 17.95 sec. w% p5 [7 p$ ~( P+ U3 I5 |4 f
2022-09-07 11:47:05.428 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 19.28 sec
3 E6 `. F3 h/ w; L4 x5 ?+ l2022-09-07 11:47:05.561 168 ERROR cinder.service [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Recovered model server connection!
: G0 M$ w8 @# x4 H) {; I! D2022-09-07 11:47:15.330 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!) {- U, M* d- t. T, y' q: ^
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
* @# `) u  ?  W  ~, h; J# y2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
# @) b* O1 h2 A% u4 B7 _+ y/ w2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection  D+ m9 E" [6 H# H! V2 w7 s2 f' p0 P
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
0 o' z5 C7 ?) z9 g) A3 W+ Y! t6 P2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection; ]! {# Y" Z: g. I( T
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")7 z" ~3 v' j& A9 ~6 [( o' ^
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed& y; C0 f' L, ?! O) _
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters
0 b( k4 J1 o# n5 ^2022-09-07 11:53:39.864 49 WARNING py.warnings [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:
6 i9 N& a. e% _" b2 p2 x, N' K2 K <class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed! V: j0 H- p- l2 X
( M# b5 Y4 |( X  J: L
  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1]))8 f, K, e# r4 S9 Y7 \8 [+ a, q
: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)0 P, O, K9 s! X8 `; T* P2 S, S
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
; D" s3 ^/ s5 z% a+ n* {' D5 J2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
- V. J; O2 I* V7 z' R5 |: x2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection! v$ \5 ~' r. L0 y/ a
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()( i+ i2 @9 C( N
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection& d+ n, i5 y+ W" E
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed"); N5 ]1 W9 ?/ o! P
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
3 F- C3 [6 z/ a2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters
$ |4 p1 D$ U8 ?* A8 I2022-09-07 11:53:39.867 125 WARNING py.warnings [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:3 i, m, ^3 i; u7 M2 M# L' I% V9 q
<class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed# E4 j5 o2 |/ W

% ]1 H  r7 I6 i+ b' ~  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1]))+ a- r% F! i' K) U1 B
: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)" ?. p" O9 q% C5 m/ X: v
2022-09-07 11:53:39.865 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)* s' F5 f: Z) H, z3 o' O4 \9 R8 j
2022-09-07 11:53:39.865 49 ERROR cinder.service Traceback (most recent call last):1 U) W9 {- O! }; ^! ^: i9 W3 q
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state  U8 f" l6 Q- P+ d! P
2022-09-07 11:53:39.865 49 ERROR cinder.service     service_ref.save()( [$ u( s& [$ W8 A' ~+ a5 \
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
+ H5 ?9 C$ E6 m1 W7 u' o) @2022-09-07 11:53:39.865 49 ERROR cinder.service     db.service_update(self._context, self.id, updates)
% b/ f, t2 X% W' h8 _  C; D" r2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update: [. c7 n# J7 x6 A7 c. u2 s
2022-09-07 11:53:39.865 49 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
: e+ K/ d! H( n: p) W4 l2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
2 ^9 \3 I4 m2 ^. W2022-09-07 11:53:39.865 49 ERROR cinder.service     return f(*args, **kwargs)9 {8 c& j7 o9 e& L# e4 A+ A& y- @4 p
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper0 g! y! N4 S3 P- @0 w
2022-09-07 11:53:39.865 49 ERROR cinder.service     ectxt.value = e.inner_exc, l9 K" {7 k1 n# J5 D$ n
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
: z/ F. K1 c2 g- }- j2022-09-07 11:53:39.865 49 ERROR cinder.service     self.force_reraise()
; S  _: t8 M4 D2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise& E& X; [3 Y; j& H0 u- k/ U" s. i: x
2022-09-07 11:53:39.865 49 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
+ P) X0 q( h/ R2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper, `+ c3 w& u- p) g0 n
2022-09-07 11:53:39.865 49 ERROR cinder.service     return f(*args, **kwargs)  l( d0 w* V  Q+ Q8 p/ J. ?
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update" u8 i9 @& i- k% V8 d4 n* H
2022-09-07 11:53:39.865 49 ERROR cinder.service     result = query.update(values)
/ ?* _4 Q; E1 y, w& T2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
$ p( ]- Z- Z; k  X2022-09-07 11:53:39.865 49 ERROR cinder.service     update_op.exec_()# _7 C$ u& P! v0 H& _8 y2 E! t8 L3 a
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_( T3 c. [! \! h5 ?2 Y, I2 u, q  O4 \
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._do_exec()% M: }8 u, B8 ~) i# e/ H
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
" z; s6 R  f: Q7 H+ T! q2022-09-07 11:53:39.865 49 ERROR cinder.service     self._execute_stmt(update_stmt), T6 z0 O$ t7 D
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt1 E9 P" L/ T: Y9 _# d8 X9 C: q
2022-09-07 11:53:39.865 49 ERROR cinder.service     mapper=self.mapper)
" ]4 y0 A" ?# W) r- I9 V9 l, H2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute( v3 Y3 G+ Q# Q% M  t7 J
2022-09-07 11:53:39.865 49 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})* P9 C) Y) y9 ~$ S7 U6 ^" Z/ E5 _
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
: \/ Z6 E: C7 V; N- ^; W# n2022-09-07 11:53:39.865 49 ERROR cinder.service     return meth(self, multiparams, params)
$ @* t8 G- U! F9 w. {* V2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
9 Q7 m7 j; ^4 j: R- }9 ]* i7 G2022-09-07 11:53:39.865 49 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)$ Q2 i4 N2 j4 s5 p" ]" ^& o
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement/ X+ r! u6 |$ l$ ?: T3 h
2022-09-07 11:53:39.865 49 ERROR cinder.service     compiled_sql, distilled_params
7 Q$ V9 v% L+ n* i) y+ v% j2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context5 F: a5 |* u9 X* l# I3 v
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._root._commit_impl(autocommit=True)- ?& d: u  M. U% i
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl5 Q  I4 q. ~! S, X
2022-09-07 11:53:39.865 49 ERROR cinder.service     self.connection._reset_agent is self.__transaction:' D" A8 @- _! n2 Y' [3 S
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection3 I  J  \. [" }' e+ K" m
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)) @' v: @# |7 K: X3 o) t8 @
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception1 Q* b- s; M- o( H& x
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._autorollback()
) a- s0 i9 d7 f& a4 K' l; \2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__, S" z# L3 ?* L# K& H1 w
2022-09-07 11:53:39.865 49 ERROR cinder.service     compat.reraise(type_, value, traceback)& y) U$ q9 ^+ H. S
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
) D+ T/ W& J4 ^2022-09-07 11:53:39.865 49 ERROR cinder.service     self._autorollback()9 z9 O4 O9 V8 x1 p% u, b* |
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
$ f; `# c6 K3 g9 O/ e( c2 _2 _7 \2022-09-07 11:53:39.865 49 ERROR cinder.service     self._root._rollback_impl()
$ a. {/ L5 G+ Q) W& z2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
) I5 B. i7 _/ k  N' R2022-09-07 11:53:39.865 49 ERROR cinder.service     self.dispatch.rollback(self)
( d' m! R. c9 M7 R6 J2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__- f( G; Y: b& O, i  r& p
2022-09-07 11:53:39.865 49 ERROR cinder.service     fn(*args, **kw)  P/ Z4 g1 y5 R2 @
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx) }8 J2 `0 Q9 o( k
2022-09-07 11:53:39.865 49 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
; i. b8 d4 a7 ]" c1 `2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info# `5 y# Y! c5 ~6 h
2022-09-07 11:53:39.865 49 ERROR cinder.service     return self.connection.info- r: A" n* ?( o& ]
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection" v3 \8 M% a8 B# j7 s3 o' d
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
6 J5 H5 l1 \" f+ \' Y2 j3 {2 w$ n2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception0 ?$ F8 V+ v7 u
2022-09-07 11:53:39.865 49 ERROR cinder.service     exc_info
+ X: O- F* E1 _2 t- ]+ o) m3 M2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause2 p/ S! p' h/ Y3 z
2022-09-07 11:53:39.865 49 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)5 y( O* ]0 S, x3 Q- |& @4 F
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection+ U" p7 D+ H0 M! m$ F! j
2022-09-07 11:53:39.865 49 ERROR cinder.service     return self._revalidate_connection()/ {7 w3 I+ r: z1 m" Y$ W* |
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
) U1 z! E2 f* ~: L/ l2022-09-07 11:53:39.865 49 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
$ l4 o9 }: Z, X2 _2022-09-07 11:53:39.865 49 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)# J9 [+ s2 m* G9 G8 }5 f. }
2022-09-07 11:53:39.865 49 ERROR cinder.service
- [, c8 c( i1 T2 Y. c2022-09-07 11:53:39.868 125 ERROR cinder.service [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)6 j" }& K& \; D: f" _, X
2022-09-07 11:53:39.868 125 ERROR cinder.service Traceback (most recent call last):& @7 W3 n# P0 \0 [* w/ `
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
( |7 h. `" G* V4 o, Y% r0 C2022-09-07 11:53:39.868 125 ERROR cinder.service     service_ref.save()$ Z. P) D* Q* p# y' ~" h3 @; a6 {& M
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save% A5 ^5 f* Q, r% u. o% S1 `2 `
2022-09-07 11:53:39.868 125 ERROR cinder.service     db.service_update(self._context, self.id, updates)
+ L! y- S: ?1 a4 w/ x' I9 {' @2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
) D8 J2 I6 t+ c0 T$ P) n2022-09-07 11:53:39.868 125 ERROR cinder.service     return IMPL.service_update(context, service_id, values)# }* h6 Q4 {" f/ \3 p
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper" B1 }! P7 {7 c& m% H& c
2022-09-07 11:53:39.868 125 ERROR cinder.service     return f(*args, **kwargs)
7 g! o, ?0 [& v/ _3 B# p2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper5 n2 O' ~* b# Q+ H. G: L& M# \
2022-09-07 11:53:39.868 125 ERROR cinder.service     ectxt.value = e.inner_exc
0 h+ r4 v+ e; N! g1 i6 m8 Z2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__# e* V4 p. |3 T; y1 p
2022-09-07 11:53:39.868 125 ERROR cinder.service     self.force_reraise()' \1 W9 B0 |/ r4 K( `5 V+ E  b1 Z
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise3 ^, _- f: J$ I
2022-09-07 11:53:39.868 125 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
% \3 J& H+ m) |& T. |+ r8 k2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper& r: X0 I2 C( M7 r/ \/ |( e
2022-09-07 11:53:39.868 125 ERROR cinder.service     return f(*args, **kwargs)
6 a) n& u3 T( l5 ?' K' v. |8 e2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
& ?3 O$ T! s2 i  |& S3 P+ k2022-09-07 11:53:39.868 125 ERROR cinder.service     result = query.update(values)! J. T+ A3 H% ?4 I, n4 r1 m; H
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update0 N& P  T7 n, c+ }6 n5 M% r& f, D
2022-09-07 11:53:39.868 125 ERROR cinder.service     update_op.exec_()1 K1 M! j2 `3 Y: W( o
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
$ k: j- B. b  c1 E2022-09-07 11:53:39.868 125 ERROR cinder.service     self._do_exec()! n! \2 i$ I5 U$ {! `
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
6 k1 J1 A! k( h1 O4 ~2022-09-07 11:53:39.868 125 ERROR cinder.service     self._execute_stmt(update_stmt)
( e: k2 F1 B+ k' Y6 g8 s2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt) M; F* i  X# \1 b0 @( I3 ]: ]
2022-09-07 11:53:39.868 125 ERROR cinder.service     mapper=self.mapper)
  c* ?6 z+ {7 e# U! G$ n$ d2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
& I. b( I' s  e2 X9 F2022-09-07 11:53:39.868 125 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
& |- n' G0 l( w; k1 f' h! q2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
* E8 |* [+ I! I) ~2022-09-07 11:53:39.868 125 ERROR cinder.service     return meth(self, multiparams, params)" c3 u8 h; R/ J, P& E" s
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection' b0 U, W0 s6 B! i- |  |
2022-09-07 11:53:39.868 125 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)+ Y( u3 ^; u, ^
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
+ K6 Y! B1 l' x3 X2022-09-07 11:53:39.868 125 ERROR cinder.service     compiled_sql, distilled_params
; M) B7 W: e) U) s: T- @2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context
4 _  i+ x6 J) U% n# W( T2022-09-07 11:53:39.868 125 ERROR cinder.service     self._root._commit_impl(autocommit=True)
( H+ u' X$ S3 N( n2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
; s' b. p9 J  {2022-09-07 11:53:39.868 125 ERROR cinder.service     self.connection._reset_agent is self.__transaction:
& S+ S" w* g: E  G, h( \2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
" u4 @/ @6 V$ x" X& e2022-09-07 11:53:39.868 125 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
$ u6 }( t9 ^+ @3 t9 ?" a7 j2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception& d( B5 ~) S  A7 b/ e3 e5 U( E
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._autorollback()
' R- i& p# r- m% A2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
) J6 o) e: M8 H$ S' I$ L/ a2022-09-07 11:53:39.868 125 ERROR cinder.service     compat.reraise(type_, value, traceback)
& M5 [/ t9 f* r) z' j2 J8 m2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
9 Q9 j1 {3 q( [5 H* d4 H; X2022-09-07 11:53:39.868 125 ERROR cinder.service     self._autorollback()& M3 R  V7 `  N0 t  N. G5 O' ]) r
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
' u' D6 I* y( e' T, B. [2022-09-07 11:53:39.868 125 ERROR cinder.service     self._root._rollback_impl()0 ]8 z6 D1 `. q
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
( m# ?, m$ ?  |2022-09-07 11:53:39.868 125 ERROR cinder.service     self.dispatch.rollback(self)
# U& A- |( E9 @$ M# U" n9 q2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__, X8 W1 o: A. C3 K- N
2022-09-07 11:53:39.868 125 ERROR cinder.service     fn(*args, **kw)9 i% ]- {# i, _& ^# F: u0 j/ q8 @. N; h
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
; K# |: a4 V# b, U" v4 k  K2022-09-07 11:53:39.868 125 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
7 e, |5 F4 z; A2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info& J- ]* m3 R4 u! h' _9 p
2022-09-07 11:53:39.868 125 ERROR cinder.service     return self.connection.info
, z3 V7 {0 C1 `7 q" x) j0 n' x2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
3 d' z$ `  u# a7 Z9 r0 c2022-09-07 11:53:39.868 125 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
" v2 R) f7 J) [  g2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception8 C- w" l8 h, X/ V2 Y  {2 @
2022-09-07 11:53:39.868 125 ERROR cinder.service     exc_info
8 w( O7 {- S; P+ E- Z& n/ ?4 Z/ r2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause% A% I0 o7 b9 k
2022-09-07 11:53:39.868 125 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
+ }: l/ [# V* r+ o  C0 W2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection8 Q7 L6 L4 U" [  f! Z$ K0 _
2022-09-07 11:53:39.868 125 ERROR cinder.service     return self._revalidate_connection()$ Y: B/ `3 r+ Z  M" o0 s
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
+ ]; S- [3 [7 _4 T3 [! k2022-09-07 11:53:39.868 125 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")3 j$ q8 c" K- n9 w
2022-09-07 11:53:39.868 125 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi): N1 {1 c8 \; R" W0 X
2022-09-07 11:53:39.868 125 ERROR cinder.service ) X0 ]% s5 M: K8 k* D# t/ {
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
4 y6 q& t1 d5 J7 X0 ^, i- {2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):: J& F! E6 K2 J5 v) L
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
; H: U8 G; c* C, f. T! M9 k5 h2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()! y, b8 a/ t" g
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection( t& g* M2 a0 [! ^- d: c) w; o
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed"): Z# x$ J0 ~* ]. k+ y6 u( z
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed7 i# ?& }0 g1 v
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters - B; b9 v; B: Q5 D6 u
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed# L. G% y% c# D
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):" Q/ Q. t, M. e8 O; h% a
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection$ l1 |1 v1 ^1 P/ D8 x
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
- S$ `) \( K7 R8 z6 w2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection1 F6 L( [) ?0 h7 X* ^# d% ]
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
- U; n! y$ t) }, N2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
: J3 A3 F" ]  T: {. G8 ~2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters * ]1 g) T, C  ?
2022-09-07 11:54:06.359 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 7.79 sec
; V" i- n# \: K1 O: ~0 J+ j) W. {0 `; \2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
' M9 B" t! `$ |1 u2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
' `! j" N1 ^' I) }9 D$ @/ @; m" F, C2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection" U( t; q' g1 G
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()  d7 R. t  n( P" N5 Q, q
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection% j5 M2 [0 ^2 r3 n0 G& j" y
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")1 s6 z% _6 x: z* w
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
* D3 z/ F$ `4 g) V3 [- g. O2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters
( m  G5 y- b( j& R  H2022-09-07 11:54:16.891 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 0.53 sec
8 A; N1 q4 q2 b2 A' F, f# e% D* b2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed' H) K) t7 x& o6 F  S
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):1 V# }. {9 W6 q. P6 k9 n; _8 z
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection' X* b$ ?% z' d; N1 a. e3 P2 l
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()8 B) q: K) k2 n% \* {
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
' D8 O/ j2 j& J2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
  M$ E8 [$ p" |2 K/ H' l2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
: m" L3 t  e; m1 m2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters
' I% v% E1 L5 C3 F9 G2022-09-07 11:54:16.895 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 9.08 sec" @5 g1 v: x4 ^$ w- Z3 V
2022-09-07 11:54:16.902 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.48 sec6 K7 y7 A5 |! \; B& E  ]
2022-09-07 11:54:16.902 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.44 sec
+ g. h' U+ i: \# u$ l/ A2022-09-07 11:54:16.909 34 WARNING oslo.service.loopingcall [req-8fa905ab-6b12-4005-9ef8-bc279b74b2da - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.17 sec( p6 |+ u1 V5 j2 W- S0 H  g
2022-09-07 11:54:16.945 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.53 sec- W: C0 h' P$ a) V
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
: l, [$ Y6 e- M2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
' E& z2 ~2 @2 q% y7 @2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
4 N8 b8 ^! K9 {: h; T; `# l, F2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
3 E7 R  N. `" a2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection: c! ^  s, j& b4 R& K1 s( ?6 \
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
7 F5 j8 L7 [0 _# v2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed# U2 ?; L0 `! d8 ^. R
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters / y$ ]5 w# b' T! u3 I- x" I* P
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
4 ?' {; Q4 S" r; K3 _2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
, P. D- a8 ~  @. v2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
8 @7 m# @# R+ ]% Q; x# T2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()! j4 `' O; {6 r* ?
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
  S1 g& z! k/ H+ X2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")* L: ?0 J' p  a% o
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
: N! y0 {$ R) T( H2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters ( |6 f* l- x$ U" l. ~; F& i
2022-09-07 11:54:29.674 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 2.78 sec
( T( ~) r1 F+ t, T! P$ T2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
" H4 v+ O0 ]& f/ q* E5 @' C4 k2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):* G7 B3 o% g4 z; E! e0 Q" S
2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection" E! ]/ J7 i6 S; H2 A! t
2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
- f! F1 `) }- {' g* }( G) r0 Q  ]2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
( R- t! @8 L* R; K8 J& ^; T0 Y. {2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
! q$ o& }6 Z' R& g" r9 W2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
# M: t* Q0 _7 M9 j- ?9 S0 f2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters
5 J) v) o0 F( P0 D2022-09-07 11:54:38.350 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
) i# S" ^- Q0 y2 A, Y; |2022-09-07 11:54:38.350 330 ERROR cinder.service Traceback (most recent call last):
* v! K3 S" `7 s3 ~2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state: V  \, _* r' @
2022-09-07 11:54:38.350 330 ERROR cinder.service     service_ref.save()
  y/ O" f" k2 @; r2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save# c; z% T: k. Y) o6 m
2022-09-07 11:54:38.350 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)
% ]8 c; {9 [& C' h2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
; x) d+ ~2 [8 \8 D  a8 c! F2022-09-07 11:54:38.350 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)% I3 D  c$ R  k# Z; X
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper% t& K5 r# s9 C0 E6 z1 Y
2022-09-07 11:54:38.350 330 ERROR cinder.service     return f(*args, **kwargs)8 H3 p% S; P# [$ ^9 y- ^; V
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper# B' t8 ~9 C4 u4 h0 h2 Q
2022-09-07 11:54:38.350 330 ERROR cinder.service     ectxt.value = e.inner_exc
( }  T$ T8 W' c+ Q( Z4 Z2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__: T1 u. n% n4 V4 i  G/ D
2022-09-07 11:54:38.350 330 ERROR cinder.service     self.force_reraise()
. k' L) M# p5 z4 g: A2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
4 {, a$ U+ t9 F6 ?2022-09-07 11:54:38.350 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
9 A# ~1 Y2 K( Q9 \0 O- a2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
% _% Y; X4 y  i4 \/ D6 ]3 V5 |2022-09-07 11:54:38.350 330 ERROR cinder.service     return f(*args, **kwargs)  C' Y( {9 J- B# {
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update) c/ Y3 }# U! Y* ]* c7 w
2022-09-07 11:54:38.350 330 ERROR cinder.service     result = query.update(values)
/ D/ A9 h" t9 d9 S. N& F8 W2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update% U( N' q- Q7 @& h9 E
2022-09-07 11:54:38.350 330 ERROR cinder.service     update_op.exec_()" X+ Q7 ]- k$ E( l9 a
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
; w# X- u' v# G' o% P8 x2022-09-07 11:54:38.350 330 ERROR cinder.service     self._do_exec()/ n! ]# \9 Q$ f8 U
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec! r9 ~( Y3 V* E" }
2022-09-07 11:54:38.350 330 ERROR cinder.service     self._execute_stmt(update_stmt)5 E! D  f# y' _7 X5 C( W+ G) Y
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
# g) L8 ^' ?. i3 F! S/ _) }" B2022-09-07 11:54:38.350 330 ERROR cinder.service     mapper=self.mapper)* h( `; x% v1 R1 @) ~
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute' C8 r$ f8 v" o- A1 r( E
2022-09-07 11:54:38.350 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})9 X5 g% e% H0 q5 G% z3 [5 ^( u. s
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
* D- V3 ?. }/ A2022-09-07 11:54:38.350 330 ERROR cinder.service     return meth(self, multiparams, params)6 |2 E0 t6 i3 U; H) v3 K- W
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
' {5 D1 d$ e2 D1 p8 E4 ^9 [2022-09-07 11:54:38.350 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
" k6 [2 E9 W+ N0 r# e2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement* q* n5 O9 N, a& j( A' r" J) ~
2022-09-07 11:54:38.350 330 ERROR cinder.service     compiled_sql, distilled_params
$ Z" G, g# x: A9 h( ^) b2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context
4 B6 a- M3 P8 N% ~1 [4 e2022-09-07 11:54:38.350 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)' h" s% e. u# W7 N# W( P( ]
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
. c* p6 {: x# `: b% [+ j( B: _) q% ?( S2022-09-07 11:54:38.350 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:
0 V/ i6 }  I- I: `2 ~2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection4 J* G4 y8 m; o+ q! l: ^% h0 J  f
2022-09-07 11:54:38.350 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)2 y0 V% n' X- Y4 W2 U& C# o+ M9 a) h
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
0 n- L  K3 J/ Z1 a$ L% }2022-09-07 11:54:38.350 330 ERROR cinder.service     self._autorollback()
! u$ Q8 }) q: j; Y, _/ l2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
& f) X% {8 r1 w% T3 m2022-09-07 11:54:38.350 330 ERROR cinder.service     compat.reraise(type_, value, traceback)' j0 K! o  a, S
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
: ]1 ~, d( C! F2022-09-07 11:54:38.350 330 ERROR cinder.service     self._autorollback()
6 W2 o0 ?) K5 y2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
5 V  J) J" ?7 S# f8 x4 q+ `" L( Y  b, w2022-09-07 11:54:38.350 330 ERROR cinder.service     self._root._rollback_impl()
# z# R/ x4 _  I7 q2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl2 X+ p, h& ~. d' g* F( k8 Q! E, M8 a. `
2022-09-07 11:54:38.350 330 ERROR cinder.service     self.dispatch.rollback(self)
! c+ h) |# f9 s2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__5 v6 @0 B$ s) T$ N& j2 V
2022-09-07 11:54:38.350 330 ERROR cinder.service     fn(*args, **kw)
% ~. k$ u8 N4 S& D! y8 p0 g2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
( g( ?- U5 K  k- H; B  _" [/ R2022-09-07 11:54:38.350 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None); h. `: d, L: i5 w$ {
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info* k2 i$ Z4 s9 p" h, L+ }, ?8 N3 q
2022-09-07 11:54:38.350 330 ERROR cinder.service     return self.connection.info+ f& |% v; |- Z8 k8 M
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection+ K) d# t+ s2 \9 D4 X, s
2022-09-07 11:54:38.350 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
. Q$ c4 c3 O: L+ L; T7 N# M; n2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception% _8 k7 f' J4 I1 J- Y' G* S0 o
2022-09-07 11:54:38.350 330 ERROR cinder.service     exc_info
3 l% v3 l; j+ q9 {( {- D2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
/ `* ^2 o; f# m0 Z# w2022-09-07 11:54:38.350 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
, Q2 y) S6 x. w3 r0 Q2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
7 Q8 e, V2 D) Q# t2 L4 E) }' ^# F: q2022-09-07 11:54:38.350 330 ERROR cinder.service     return self._revalidate_connection()% `( g4 W  U* q$ |7 [* ~( S+ P
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
# x6 a" E5 u  F) Z2022-09-07 11:54:38.350 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
# Q3 i8 }& b9 J4 g: g* f2022-09-07 11:54:38.350 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
  i; {2 j, m) W& ^7 o5 Q5 r9 d! j2022-09-07 11:54:38.350 330 ERROR cinder.service
4 v# a6 M/ V$ y# K( L4 V2 D$ G2022-09-07 11:54:38.354 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.45 sec. |; U; \$ K1 s5 L: z, \
2022-09-07 11:54:38.361 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.45 sec
, G6 C5 b7 \( d  m; \2022-09-07 11:54:38.361 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 11.41 sec
, _# f, m9 x. _; M/ g2022-09-07 11:54:38.362 34 WARNING oslo.service.loopingcall [req-8fa905ab-6b12-4005-9ef8-bc279b74b2da - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.45 sec
# l8 `( E/ T6 ]5 n6 v0 Y7 E2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed2 c  z, b- ~; b3 k7 o
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
9 G3 G* H( {& s( p% h$ l8 }' r% C2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection, a- W: D5 J$ Q
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()( L$ Y$ Z; u( c; ^7 T9 L# W7 |+ C
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection9 X9 A2 F2 _& r3 R* g* f
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")  F, n: r7 T3 h2 m
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
6 Q* S/ r* X( k* t, D0 ^/ [2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters
  b/ c' d6 d/ o2 y. y& f5 \# h2022-09-07 11:54:38.403 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.51 sec
( ?, \" u6 Y5 d# m# m2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
9 W9 c; U! I& J" e* z2 Y  M2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):/ q+ Q' Z( J# ]
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection% ^) v) `# Q. G. K
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
- K4 ?& y3 r; e3 ^+ h2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection' @" Z  P1 j8 X
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")" r# q( U. u4 d0 X
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
6 ~: h* l) J4 Z- I2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters
5 O/ p) I! ~7 Y; g' \: W2 q2022-09-07 11:54:38.498 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!1 e" {& y; D* C+ F8 j
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed0 f* Z% ]5 C# O7 c* S1 U" P
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):, m4 p% s! i7 J/ ^' d
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection( ~& N5 z4 I6 Q" \9 F( q' v
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
; @( I+ Q' U% v2 e7 ?2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
3 x# n( l4 F. p! V" {  V2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
; n7 `9 A. B7 }! k  [9 H8 o# a2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed; j0 t! H! z$ r+ J7 b7 \3 i" }
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters
; I+ Y- v! n) ]% Q; N( q2022-09-07 11:54:39.691 125 ERROR cinder.service [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Recovered model server connection!
; @4 F( Q0 m" S& q0 D& T7 B2022-09-07 11:54:48.421 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Recovered model server connection!
2 C, y, `5 N7 t# \7 M) ^2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed/ Y) P0 W% Q  t6 p6 }& w
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):+ ^! ?( P2 B& Z$ `, h6 U4 h
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
% c. o# p7 o. O  K8 X2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
+ j* i1 O4 F) W2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
2 e. @! Y! j1 G0 x3 c0 p2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")9 H0 U: j; i  I. M1 t% n* @& s
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed2 s; d* v! R. e
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters 8 t" ~- v6 \. S2 {  w/ d# @* K' ~( A
2022-09-07 11:55:08.375 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
  n1 S; V5 Z* s; E* L9 E2 ?2022-09-07 11:55:08.375 330 ERROR cinder.service Traceback (most recent call last):+ T# o9 {  t  s' A4 ?4 C
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state6 e2 S- V$ x. ?8 ~& r, l
2022-09-07 11:55:08.375 330 ERROR cinder.service     service_ref.save()
" f6 n) T. t& @3 y  `; u, g2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save% t- V8 W0 C; ], ^# ~+ u7 }
2022-09-07 11:55:08.375 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)1 e. m0 J2 F% D. D0 M' [$ p4 D2 y
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update  T) l& s* D/ w  l! _& k$ ?
2022-09-07 11:55:08.375 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)  n8 t4 u" ?" }3 W
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
1 m7 }. _/ @; f% k2 I5 o2022-09-07 11:55:08.375 330 ERROR cinder.service     return f(*args, **kwargs); a* `/ N: `, A! N' n1 g
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper$ }3 Z5 P- D3 e4 `2 U1 c
2022-09-07 11:55:08.375 330 ERROR cinder.service     ectxt.value = e.inner_exc
% Z3 }" l, z' D! ~2 D2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__* _" S: }  i% g" q; `; h
2022-09-07 11:55:08.375 330 ERROR cinder.service     self.force_reraise()2 E( f" ]& i8 U) r/ r; n  B* n
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise/ e8 G8 I% o6 S  J4 N% @- `
2022-09-07 11:55:08.375 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)5 N) U- \# l$ N3 }8 y
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper8 Q" j5 Z- s0 v8 {8 j4 ]* W% f
2022-09-07 11:55:08.375 330 ERROR cinder.service     return f(*args, **kwargs): q1 c8 h2 [9 H  }' b; q
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
8 Z5 ~2 @* ]: C0 H& J) i2022-09-07 11:55:08.375 330 ERROR cinder.service     result = query.update(values), a' {5 e3 r' B
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
3 ~7 b4 J+ n( Z( p2 c4 H2022-09-07 11:55:08.375 330 ERROR cinder.service     update_op.exec_()0 y% L% z1 Q- D# p, i
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_5 \7 p) T1 i/ }" t+ R! i
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._do_exec()( ^# `2 f& |& ?, P! s+ t
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec3 z$ o" j- q3 _: N; h+ F1 M* e0 a
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._execute_stmt(update_stmt)
7 ]/ Y1 G4 I1 {, \2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt. \: S5 G9 @: m' {6 Z
2022-09-07 11:55:08.375 330 ERROR cinder.service     mapper=self.mapper)! _- {  j) u2 ]# @! O" M
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute. k  R& ?. e. Y9 V: m
2022-09-07 11:55:08.375 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {}); c" k: [$ T% {7 A. r1 y( x- s
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
9 \3 z" O6 X' `! K# j; W+ O2022-09-07 11:55:08.375 330 ERROR cinder.service     return meth(self, multiparams, params)
3 I6 K! V+ w7 J; z" G8 U: I2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection# |; j0 g+ g* A# l
2022-09-07 11:55:08.375 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
: g2 l: X+ `5 ^* K2 j* U1 E5 a% V+ y2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
0 E) Q/ \' w5 t" N7 Y( a9 Y' p& E1 C2022-09-07 11:55:08.375 330 ERROR cinder.service     compiled_sql, distilled_params
) i7 U- S: o9 ^1 y+ X9 v2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context
% R2 E# e- }7 W5 i2022-09-07 11:55:08.375 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)
0 v. r  z% @( B: U/ h) J- O2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
. t( @% u! j. X2022-09-07 11:55:08.375 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:
2 C) ]( G+ d1 N+ K! ^- o* C2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
$ O! ^  B  D; z/ ]2022-09-07 11:55:08.375 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
$ F: f$ y! f& V# o2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception; _' d0 G$ E6 }  z& |  @3 C& y# @: v
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._autorollback()1 l5 r8 N& J; Q% O
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
# X) v6 p1 ~) S+ ]7 |8 Z0 |2022-09-07 11:55:08.375 330 ERROR cinder.service     compat.reraise(type_, value, traceback)
$ `1 g$ j4 N$ Z" F2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception# n4 t: {# L) C6 e
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._autorollback()
+ G" t% O& X! |) {, x) d( @  x2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback+ `, A9 x- a  m5 x9 }/ y  B
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._root._rollback_impl()
2 R+ v% T/ o! s6 [# V2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl3 E  p9 f- p1 Y# b9 R
2022-09-07 11:55:08.375 330 ERROR cinder.service     self.dispatch.rollback(self)
5 k$ d3 S, C% C0 U- Z# x2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__! o0 I5 }" `+ [
2022-09-07 11:55:08.375 330 ERROR cinder.service     fn(*args, **kw)0 D* P! [5 Y- G# k7 s
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
* G& X0 L6 G9 e: f$ T2 `2022-09-07 11:55:08.375 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)( G2 A. @. f+ z4 b2 a# z0 g
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
+ j4 g+ }3 H2 y2022-09-07 11:55:08.375 330 ERROR cinder.service     return self.connection.info7 o. H+ `# G( C  v4 F$ [; G
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
) V4 O6 r& G( v! g" x" [  o2022-09-07 11:55:08.375 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
/ s3 ]6 J( D- H2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
$ _& V9 r0 t0 P) R2022-09-07 11:55:08.375 330 ERROR cinder.service     exc_info. [! u5 c) G& P! q, Y) u
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
4 |% w4 d2 [+ S# ^* }2022-09-07 11:55:08.375 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)6 B5 J; b# p2 J$ ]
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
* L% u, J+ W9 C! ?+ {* t2022-09-07 11:55:08.375 330 ERROR cinder.service     return self._revalidate_connection(). [, z$ P  p: F8 X& [0 W
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection$ b0 P# @0 A6 y( f
2022-09-07 11:55:08.375 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
5 M3 J( o! j; a+ w8 M: C; H$ ^: z2022-09-07 11:55:08.375 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
! J, a4 P9 w' l' w: L$ O, w2022-09-07 11:55:08.375 330 ERROR cinder.service
2 v% W. Y( M" A# O& t5 D1 u2022-09-07 11:55:18.372 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!" i# ]8 `/ s: m; q: s& A
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed- ?; x) y) F! P. M- }1 d  X
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):8 A# N' x3 g3 _6 I$ |- e
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection; q$ v* e2 ]- G2 R
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
9 M% M+ a3 C4 N' u3 r2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection% {" Y4 n) j% {4 n
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
$ B8 i% U* E# c% ^2 ?2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
$ ~: r0 Z; X9 x6 K5 z- A$ d+ `- |2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters
, m8 S; p7 O- A+ P+ X& U6 O' _' r9 O2022-09-07 11:55:28.374 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)$ t  y- x! ~4 B4 r
2022-09-07 11:55:28.374 330 ERROR cinder.service Traceback (most recent call last):8 a# J+ T% A5 V! C5 S# @
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
+ ^$ l/ [" o9 l( ~5 o+ h2022-09-07 11:55:28.374 330 ERROR cinder.service     service_ref.save(): ?& U7 Q$ s9 \4 D/ a
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
3 O* c! w  K7 I. G+ F$ n: Y2022-09-07 11:55:28.374 330 ERROR cinder.service     db.service_update(self._context, self.id, updates). p$ W+ b& R7 r- H- n( G
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
. l; z; U' V9 D5 Q8 m- H0 i2022-09-07 11:55:28.374 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values); T6 A1 N6 }( l+ g/ f! n+ i; F$ a
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper" x3 ]! m# n$ a+ j1 p/ g8 }2 }+ x* H
2022-09-07 11:55:28.374 330 ERROR cinder.service     return f(*args, **kwargs)
+ p5 w1 M" i5 S- L' h' H; t7 b2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper2 T5 x! i( B6 h* S/ Q' a! t# I2 V
2022-09-07 11:55:28.374 330 ERROR cinder.service     ectxt.value = e.inner_exc6 D$ {/ X* s+ u* ~( S
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__7 @- G% K6 r! v& w! Y4 o/ O
2022-09-07 11:55:28.374 330 ERROR cinder.service     self.force_reraise()
' ^2 y' u2 E& }8 @) V2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
, x* t7 J$ `6 B9 B- k% u5 C4 c; P2022-09-07 11:55:28.374 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
. h& ~9 y# N# X# E- A. u7 I2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
. c- S6 T" t/ S2 A2 e: y. A+ L2022-09-07 11:55:28.374 330 ERROR cinder.service     return f(*args, **kwargs)2 z) M' G0 ^, {. d$ m$ E6 ?9 x
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
* [1 d" j$ a  J" O3 t2022-09-07 11:55:28.374 330 ERROR cinder.service     result = query.update(values)% D7 j; Y' v0 e+ d
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update" q, I& W  t: a' c
2022-09-07 11:55:28.374 330 ERROR cinder.service     update_op.exec_()8 W: R% Q' C/ i- E# o6 W; F0 k
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
. N/ q& G0 A$ O2 W0 `2022-09-07 11:55:28.374 330 ERROR cinder.service     self._do_exec()
# y% y7 O5 @; K. }, N2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec+ ^$ Y: j2 o! O2 |+ K; a7 J. e5 k
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._execute_stmt(update_stmt)4 Y9 }0 w6 [! p6 @/ Y
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
- y$ z/ g4 d' r! v2022-09-07 11:55:28.374 330 ERROR cinder.service     mapper=self.mapper), ~/ V* D, k' e2 ~( M
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute$ F9 [1 D# F$ y! n3 s. s/ w
2022-09-07 11:55:28.374 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
" N2 a& s) V$ a- }2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute4 C* K% |. t7 @# _! _3 @: ~( L
2022-09-07 11:55:28.374 330 ERROR cinder.service     return meth(self, multiparams, params)3 l5 |3 P4 P0 z+ g8 A9 a0 b
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection. b7 r# v* S4 \  T' C* j
2022-09-07 11:55:28.374 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
6 @3 H" E4 t/ c) O* H  S5 g6 C2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
) M* k9 W; W! H7 C' m) K2022-09-07 11:55:28.374 330 ERROR cinder.service     compiled_sql, distilled_params
2 S8 A/ B7 V/ g3 C3 N2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context5 Z  K/ X" k  v1 h, m8 i7 g1 _
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)
/ D8 _1 n% g9 K* h$ A2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
  a$ [" J" a  U2022-09-07 11:55:28.374 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:- d: e: l" g  ^# G3 }
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection4 W* P  ^( |" J' [5 M7 {
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
: k  N  ]& r( h0 m4 V/ {! l; r5 [2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception1 K' I8 w9 q- {; }/ w$ X8 i- Y) X
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._autorollback()
" }, U" d4 W5 h5 \) R2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
: O7 X: N6 t- L4 p2022-09-07 11:55:28.374 330 ERROR cinder.service     compat.reraise(type_, value, traceback)
0 T3 w+ W. U5 z$ x; g$ Q2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
" r- M" v& [4 N9 M' _7 U2022-09-07 11:55:28.374 330 ERROR cinder.service     self._autorollback()) V# d4 U' a" B0 h* x
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
9 [% ~1 L& R8 S+ N2022-09-07 11:55:28.374 330 ERROR cinder.service     self._root._rollback_impl(), G: e1 d. w" w1 B6 s0 p
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl& C5 f) ^3 i# o2 S: }9 k6 P! ?
2022-09-07 11:55:28.374 330 ERROR cinder.service     self.dispatch.rollback(self)- W& ^6 ^. n$ ?) S5 j
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__3 K3 X8 m5 m+ H: q8 \" r" k  ]2 B
2022-09-07 11:55:28.374 330 ERROR cinder.service     fn(*args, **kw)* K& ?! F  ]! L( I7 q) s% P) P2 o
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx: T% H+ B5 d4 V/ P8 k/ I
2022-09-07 11:55:28.374 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)* \8 K0 R% W% v2 z! n: o
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info/ n' V7 H  Y/ k
2022-09-07 11:55:28.374 330 ERROR cinder.service     return self.connection.info
0 [0 f9 z' K* J0 @7 k% A8 j% R2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection% {5 X0 V, c* {' F7 d; ?) f' ~
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
1 ?  i5 S# m; ?9 |4 v: d2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception2 N, s9 z& [1 f0 M5 R; I, M; c# N
2022-09-07 11:55:28.374 330 ERROR cinder.service     exc_info
3 D6 m" g4 Y/ d! E8 O4 O2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause+ o& ~" x; S9 P& K7 _3 U
2022-09-07 11:55:28.374 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
% b, p' d" ]$ a- F7 e# [2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
( H- m" x( `3 U& c2 Y# y8 t% ~6 m2022-09-07 11:55:28.374 330 ERROR cinder.service     return self._revalidate_connection()
& V& t# I; J' v2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection6 K' s6 \. P! z$ ?$ T0 A
2022-09-07 11:55:28.374 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")" ?0 m- d; x* Q, z
2022-09-07 11:55:28.374 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
, \7 N2 Z7 ~2 M: L& G2022-09-07 11:55:28.374 330 ERROR cinder.service : p$ c5 s( V. L3 p
2022-09-07 11:55:38.373 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!- H& {! x2 @8 z: v6 l0 \' s0 H5 U
2022-09-07 13:31:20.753 49 INFO cinder.volume.manager [req-808e7d95-8769-4222-9160-49d2a558ad7b 2d3de65e3f1f46df86c7789341ba4523 5ec1142884724554b1a1257489e624e8 - default default] attachment_update completed successfully.1 ^0 t$ @. B# q$ j6 l
2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
3 n1 M: R3 v- d% F( ]* v& I. p2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
1 X. A) A9 H$ ~0 W+ r* V4 o2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
; n. C' b8 L! J/ J) q2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
7 g4 G6 K/ i: `2 b, i2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
4 b! \: z2 O$ e& a  A, |2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
& U7 ~& O5 D* G  E& v2 Z1 ^2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed8 ~4 @/ Z0 M' b. G# M/ I
2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters / n  C' x$ p& h; l  @' S$ q4 h( Z
2022-09-07 13:33:18.826 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)0 Q7 P1 m& y( M3 @- O  Q% g
2022-09-07 13:33:18.826 330 ERROR cinder.service Traceback (most recent call last):
( m* p, [' H/ P! T+ a2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
; ^7 [0 _+ J7 g2022-09-07 13:33:18.826 330 ERROR cinder.service     service_ref.save()0 u/ f% n! r5 G" G) B; ?
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save; a* p  o* ?  ?+ z7 p! p6 I
2022-09-07 13:33:18.826 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)2 A; |: \# i& g/ d$ j
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
$ o8 e2 O  Z( Q; F6 C# [2022-09-07 13:33:18.826 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
2 p$ ]( q  ~0 }5 ~# a; t8 S$ U6 ~2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
( C! L+ L) V- z/ Y2022-09-07 13:33:18.826 330 ERROR cinder.service     return f(*args, **kwargs)3 h& G! J! |9 D; f3 ^$ J
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper
$ t4 i, s5 j% m2022-09-07 13:33:18.826 330 ERROR cinder.service     ectxt.value = e.inner_exc
/ B1 {( U7 R4 @; _, [2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__: g7 |1 Y6 p  a9 u1 B
2022-09-07 13:33:18.826 330 ERROR cinder.service     self.force_reraise()
8 |9 f  I! z& @2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise5 s+ V2 O' O* O
2022-09-07 13:33:18.826 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
2 ~. [& B5 O" f( k2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
# i( Y. v( l7 d( D2022-09-07 13:33:18.826 330 ERROR cinder.service     return f(*args, **kwargs)
1 v( ^& k& T9 d- r2 |2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update9 x5 V! E- w  |. G
2022-09-07 13:33:18.826 330 ERROR cinder.service     result = query.update(values)' D" r- ]. i" D( m/ R2 F
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
( D3 `( M- W2 p4 T! ~2022-09-07 13:33:18.826 330 ERROR cinder.service     update_op.exec_()3 |( M) M6 B$ M- q
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_+ u# C9 G: p7 L
2022-09-07 13:33:18.826 330 ERROR cinder.service     self._do_exec()+ p( \5 w' ?/ X, W$ Q" @' m! _4 y7 h
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec, X3 B; V0 _) _( K8 ^
2022-09-07 13:33:18.826 330 ERROR cinder.service     self._execute_stmt(update_stmt)* @* A! K- u7 x5 B
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
% r3 ^! a# u8 J, L/ C2022-09-07 13:33:18.826 330 ERROR cinder.service     mapper=self.mapper)
: U' J, I1 @: m) u2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
. V- u' q4 r" R6 _+ h5 M7 G: f2022-09-07 13:33:18.826 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {}). T& n/ g6 V+ J% k3 y, e) e
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
. Z1 @2 G% H6 l' l5 [2022-09-07 13:33:18.826 330 ERROR cinder.service     return meth(self, multiparams, params)
1 @5 X1 @1 d" Q- A7 |! `3 w2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
+ X. m; R% z: p8 J1 s; ]& U2022-09-07 13:33:18.826 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)" G8 z2 X( A8 D3 h, P, H
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
0 y. ?0 X: C, ~: u# ^2022-09-07 13:33:18.826 330 ERROR cinder.service     compiled_sql, distilled_params/ Q8 u0 i9 m" y  k( L- ?
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context7 h  p2 I4 p, T8 [7 x* |
2022-09-07 13:33:18.826 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)+ @' j( v1 l- r
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl- p6 G/ b0 G( ^& n
2022-09-07 13:33:18.826 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:
- d9 y( P& l- _: h2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection& s& C, d8 H- T( O3 H  t# U
2022-09-07 13:33:18.826 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
( {! d6 G/ P3 r5 J  F  v6 S* y7 Z2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception7 h  w5 {! Q* S
2022-09-07 13:33:18.826 330 ERROR cinder.service     self._autorollback()& R$ I7 p& [0 ?: C- O  _8 n
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__4 h. K6 y1 Y' P) l- |: B9 P
2022-09-07 13:33:18.826 330 ERROR cinder.service     compat.reraise(type_, value, traceback)
" Z! q9 p8 t7 f( A9 D( }3 L, ]; q2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
0 T$ f1 G  F# h/ B. [2022-09-07 13:33:18.826 330 ERROR cinder.service     self._autorollback()4 v; c2 f2 [- ?3 r9 h+ W
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
* J5 z0 W. I' \4 K1 Q2 x; j2022-09-07 13:33:18.826 330 ERROR cinder.service     self._root._rollback_impl()" q( F" B  f3 y" a+ ?
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
0 j1 o2 ]4 @+ Z1 K- C* q$ \2022-09-07 13:33:18.826 330 ERROR cinder.service     self.dispatch.rollback(self)
6 _- P. z( Y2 T6 X3 r2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
! X6 V* z) ?0 ?  m  r: N2022-09-07 13:33:18.826 330 ERROR cinder.service     fn(*args, **kw)2 C( o# J" \; Q
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
& i( I! \: s& M; R' ~$ a& k2022-09-07 13:33:18.826 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)7 Q/ A  d; V* \$ |- w2 R$ ]
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
# D2 k8 g' l% Q% ]6 [2022-09-07 13:33:18.826 330 ERROR cinder.service     return self.connection.info
6 g4 ]/ M. D: o4 N! D0 ?2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
9 F6 c& P' e& x! Q$ O! S2022-09-07 13:33:18.826 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
1 E4 J, g+ i0 M7 M2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
6 n9 J/ n8 }- q5 k! \7 s5 @1 f2022-09-07 13:33:18.826 330 ERROR cinder.service     exc_info, d5 i# a. Z4 o& G7 n0 Q
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
/ M6 E4 M6 j, V, Z# b# P  k2022-09-07 13:33:18.826 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
- S- o4 O3 r- Z' v; V; R2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
: ]5 v: u# c/ e2022-09-07 13:33:18.826 330 ERROR cinder.service     return self._revalidate_connection()
  z* t7 Q  B3 Z% _8 K' A2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
$ \6 P2 o8 b+ z3 e3 p" |2022-09-07 13:33:18.826 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")7 P$ z8 f& L- q1 {2 H7 V
2022-09-07 13:33:18.826 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)1 X9 D& B8 \2 p
2022-09-07 13:33:18.826 330 ERROR cinder.service 6 @" {0 k, _2 E2 @' [% T  [- w! I2 O% T
2022-09-07 13:33:28.822 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!( ~4 D/ v$ ?( I
2022-09-07 13:35:05.363 49 INFO cinder.volume.manager [req-c7ac38c5-b0a2-48e5-9bc1-1a6abac4f14f 2d3de65e3f1f46df86c7789341ba4523 5ec1142884724554b1a1257489e624e8 - default default] attachment_update completed successfully.3 d/ [+ v1 i# F" S5 g) ^
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed  f* S) N  Q5 Z. M3 F/ m  V  {+ P. j
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
! [2 y0 L# `4 @# p+ @  E+ ]2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
# z4 X9 u5 X! m2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
/ h) I7 Z% f/ ^: s2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
* A3 t: N' ^$ B( S7 h: {2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")) w' {, g) E" o. U' A! H
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed/ Q7 j0 O3 }* R$ Y
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters
: @6 t- }2 d9 P4 ~5 x4 w$ i" l1 i2022-09-07 13:42:41.776 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
* k, t- D7 T% ~: R2022-09-07 13:42:41.776 49 ERROR cinder.service Traceback (most recent call last):
" E3 g: N8 r( I6 b2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
& d/ t6 J, g! G5 j2022-09-07 13:42:41.776 49 ERROR cinder.service     service_ref.save()5 \2 s4 a8 b: k% [
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
( U2 |. o" H7 \7 `( `. ]2022-09-07 13:42:41.776 49 ERROR cinder.service     db.service_update(self._context, self.id, updates)
2 R1 L7 r3 z; \- c2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update/ O8 q* O* e, j( q* J' Q8 d
2022-09-07 13:42:41.776 49 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
& H+ _' C1 l' }, T2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
9 @3 ^! L0 d6 c: R' }2022-09-07 13:42:41.776 49 ERROR cinder.service     return f(*args, **kwargs)
4 `4 ^, [0 i$ I' x9 |8 t" T1 l. S2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper* u" J7 Q3 F3 J( b4 ~6 C5 }
2022-09-07 13:42:41.776 49 ERROR cinder.service     ectxt.value = e.inner_exc
4 T! y4 s5 s8 R# d3 b2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__8 w' v+ e4 [, D1 @; b. u2 ^2 D" O
2022-09-07 13:42:41.776 49 ERROR cinder.service     self.force_reraise()9 h$ r8 B- c# x' o. `- d! l  g
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
; E  m6 D5 h  ~; J- J2022-09-07 13:42:41.776 49 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)5 `, W6 C5 E6 R# A* G7 t4 u
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
( D1 d( a- g' ]) N/ O7 X8 c) L8 Q2022-09-07 13:42:41.776 49 ERROR cinder.service     return f(*args, **kwargs)+ G! n% H1 B% P8 C' P
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update8 a. e+ K: {" P2 c- M, P4 u
2022-09-07 13:42:41.776 49 ERROR cinder.service     result = query.update(values)
8 f9 L4 R5 v2 e' \4 j2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update* l) Z3 x$ S1 E/ K6 W/ j1 t+ r! ^
2022-09-07 13:42:41.776 49 ERROR cinder.service     update_op.exec_()
9 j: f5 ^2 F4 H( s, {* h2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
8 \7 o1 ?0 a2 z2 o2022-09-07 13:42:41.776 49 ERROR cinder.service     self._do_exec()
2 a, ]5 q* \& _2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec# I6 R$ I5 z9 N0 D
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._execute_stmt(update_stmt)( D# M9 i& m  q7 Y( J
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt0 g% S3 u0 F+ D  }& g( q
2022-09-07 13:42:41.776 49 ERROR cinder.service     mapper=self.mapper)
1 j* G: x6 y# [) E0 ~* C+ H/ y2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute% t9 c* k7 R6 m; [# r
2022-09-07 13:42:41.776 49 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
4 J6 j  |" W7 q% e; Z2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
: V, [( U: ~2 y; Z2022-09-07 13:42:41.776 49 ERROR cinder.service     return meth(self, multiparams, params)( a2 b! [4 i+ {. [' W; m
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection8 \9 n, Z, x" a1 a- e  Y5 L
2022-09-07 13:42:41.776 49 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
; x  e# `4 W* h, X+ v2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement' P$ m+ u' ?6 h8 @, c; Z6 f
2022-09-07 13:42:41.776 49 ERROR cinder.service     compiled_sql, distilled_params
0 Z9 P2 I  N% r$ n& K) q' U2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context* {9 G+ r1 ]0 m( f+ i
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._root._commit_impl(autocommit=True)
% D  @9 s/ _' P2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
4 F3 ]5 O: [( J' d% ~3 u2022-09-07 13:42:41.776 49 ERROR cinder.service     self.connection._reset_agent is self.__transaction:
& n. A2 B# d  A1 x4 i* Y  x2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection* V: U" K2 m6 F/ \) E
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
  x* F! i" i# p9 [" Z2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception6 b' F" k  K! S5 b
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._autorollback(); Y1 `. @& [! f0 U8 s
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
& O: U7 o. Q, P2 r; k0 Y2022-09-07 13:42:41.776 49 ERROR cinder.service     compat.reraise(type_, value, traceback)1 \+ D# }8 x+ A! Y& M8 X4 W( H
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
( s6 O6 j& s1 Q! B2022-09-07 13:42:41.776 49 ERROR cinder.service     self._autorollback()
) V2 f/ Q, X6 j1 s8 T2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
) E+ t3 w6 i7 _* N7 }- C2022-09-07 13:42:41.776 49 ERROR cinder.service     self._root._rollback_impl(). a  |/ h; a+ P0 h9 t- `
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl' W$ }" J6 T& O* c) y' [' U
2022-09-07 13:42:41.776 49 ERROR cinder.service     self.dispatch.rollback(self)
0 m. D9 [+ H* ?2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
" F* `% |* U7 N" W- W9 k2022-09-07 13:42:41.776 49 ERROR cinder.service     fn(*args, **kw)
' o, [6 x0 J2 I- X8 m9 \% c- ~2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx. Z6 i% E# Y4 e) V9 p8 Y1 X- D
2022-09-07 13:42:41.776 49 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)+ L/ Q# E( o2 V) `( e1 [1 D3 t
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
0 H2 [) v5 r$ X2 r2022-09-07 13:42:41.776 49 ERROR cinder.service     return self.connection.info* _, y8 o5 M, d. a  J6 J. j
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection) s; v1 F2 {: Z- ]6 H
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)! O6 R2 j5 o5 N% g- K. a+ R
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception% g, x5 S, }% J7 l, G
2022-09-07 13:42:41.776 49 ERROR cinder.service     exc_info
/ W+ {! i; T4 n* j# \2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
/ ]6 |6 r8 B. H0 U* B8 B$ Z0 Y2022-09-07 13:42:41.776 49 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
, m. w" k* g0 B2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection( Q/ K: h& n0 B* H  j
2022-09-07 13:42:41.776 49 ERROR cinder.service     return self._revalidate_connection()
/ ~% ]% v# T  B2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
$ b7 h/ P  |. K7 h. @/ L% Q- V9 O6 t2022-09-07 13:42:41.776 49 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
: M# U" R6 P0 N0 R& K2022-09-07 13:42:41.776 49 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)  M) ^+ e5 e+ m/ j6 Q/ m
2022-09-07 13:42:41.776 49 ERROR cinder.service
5 L( {- y$ U' Q0 C8 Y2022-09-07 13:42:51.713 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Recovered model server connection!
. Y. u+ J+ h  |5 d) U2 s$ ^
6 g: U5 d- w7 }( B7 L) n5 i
回复

举报

admin

0

主题

0

回帖

9

积分

管理员

积分
9
QQ
 楼主| 发表于 2022-9-7 14:09:45 | 显示全部楼层
Things i changed:
5 p5 d: E3 c7 P1 L1 g3 p
5 c7 y/ E8 m% f+ S6 yMariaDB [(none)]> show variables like '%timeout%';
: X  V- t/ _5 B+ e0 L: V5 q+---------------------------------------+----------+
; [$ C9 T* ?3 O) B; ?7 W8 Z| Variable_name                         | Value    |& z: ~; D& j+ v! O: {8 e# q
+---------------------------------------+----------+
* s; G+ J+ g9 S0 l6 T# W0 ~$ a| connect_timeout                       | 120      | <<==== This one, Initially we raised to 30s which has improvement but didn't help and then 60s which had lot of improvement but still saw connect errors., N2 a- |4 G6 S7 P7 T! v
| deadlock_timeout_long                 | 50000000 |
* ?) n' D6 |* J) u7 D; V# W| deadlock_timeout_short                | 10000    |. G* i! n  D/ j& H" ~: h
| delayed_insert_timeout                | 300      |, V( Y2 G  @4 C( M
| idle_readonly_transaction_timeout     | 0        |
2 W8 F0 c3 h& ^, t; b| idle_transaction_timeout              | 0        |
3 j" H, n: X/ Y: || idle_write_transaction_timeout        | 0        |
5 H* p0 M( R7 T+ @5 h7 A! U6 j| innodb_flush_log_at_timeout           | 1        |, e) S4 J" Y9 }3 m. p) Y) w
| innodb_lock_wait_timeout              | 120      |<< ==== This one for lock wait timeout.
9 S) u7 A  h8 h; f$ w+ @. [| innodb_rollback_on_timeout            | OFF      |
: @' B, [3 J# x0 Z0 H, w* T6 b  J- O4 ?| interactive_timeout                   | 28800    |% p% |; J/ @( \
| lock_wait_timeout                     | 86400    |
4 K6 m+ D3 R/ Z2 [! P8 Q& {| net_read_timeout                      | 30       |
& c' L6 W' J  c" z  P+ W| net_write_timeout                     | 60       |
. \& D( }, D& T. r8 Y| rpl_semi_sync_master_timeout          | 10000    |6 r9 `$ ~! ?$ Z& o# o2 S6 W; Y5 |
| rpl_semi_sync_slave_kill_conn_timeout | 5        |% z9 B% {8 q; y' h
| slave_net_timeout                     | 60       |' B; [  g/ O6 f0 b0 m
| thread_pool_idle_timeout              | 60       |+ p9 ^4 P7 D8 r- Y
| wait_timeout                          | 28800    |7 h& ^: x+ h- O9 _* `" n
+---------------------------------------+----------+
  E: `6 j5 H. w- H' s+ b3 [! T4 ~! ]9 D2 R) _' ^. M! d0 U: j
: L4 q: w" z- o
In Cinder.conf,
6 f% n" h: T+ J% Y' ]3 ^- \
! f5 H/ p% v" i! I: A/ y3 hservice_down_time = 300, k# x  G4 y: f7 E
report_interval = 30. d' z% Y9 F  \+ o  y' h
rpc_response_timeout = 600
3 U- k- C; y. F. A( juse_db_reconnect = True9 l6 v: }0 P" `3 R$ h

/ P, I0 x. F( Q" Z5 g  {In nova-compute:. C9 T( M% Y3 H! @* {, i: `

3 W) a2 g' V0 O( [( A+ N( s' Zblock_device_allocate_retries=2007 k9 _" ?+ [7 E% A8 k5 Q  v

6 p4 v0 m" h3 MThe above seem to help but there are still occasional mysql timeouts.
0 V" I: X' s8 y7 m  K" Y
回复

举报

返回列表 发新帖
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

本版积分规则

返回首页|Archiver|手机版|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )

GMT+8, 2026-6-11 22:57 , Processed in 0.028395 second(s), 23 queries .

Powered by Discuz! X5.0

© 2001-2026 Discuz! Team.

快速回复 返回顶部 返回列表