浏览此站
联系我们相册切换到窄版 Language

 找回密码
 注册
易陆发现论坛»论坛 › 云计算开源区 › ceph分布式存储 › ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a6 ...
返回列表 发新帖
查看: 576|回复: 1

ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Except

[复制链接]
admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
发表于 2022-9-7 14:02:45 | 显示全部楼层 |阅读模式
[root@controller1 ~]# tail -f /var/lib/docker/volumes/kolla_logs/_data/cinder/cinder-volume.log
& \; F$ c! A8 z2022-09-07 11:36:22.698 245 INFO cinder.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Initiating service 32 cleanup( H5 i$ v* `6 S4 `8 I. X
2022-09-07 11:36:22.706 245 INFO cinder.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Service 32 cleanup completed.
( v8 }7 g3 R5 y0 F2022-09-07 11:36:22.834 245 INFO cinder.volume.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)) I- n; v. S& g" Y2 {9 N
2022-09-07 11:36:23.670 34 INFO cinder.volume.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Driver initialization completed successfully.
1 w- `9 Z* M: ^8 R2022-09-07 11:36:23.683 34 INFO cinder.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Initiating service 12 cleanup# G0 E" W* H# M3 q
2022-09-07 11:36:23.691 34 INFO cinder.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Service 12 cleanup completed.. N* }) o+ R0 \& n6 ?
2022-09-07 11:36:23.812 34 INFO cinder.volume.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
& r6 p9 J7 p) v5 `2022-09-07 11:36:26.016 245 INFO cinder.volume.manager [req-54522f62-9207-4ca1-9b97-03953311947c - - - - -] Driver post RPC initialization completed successfully.% w2 G" |& j5 f6 e6 m/ O
2022-09-07 11:36:27.696 49 INFO cinder.volume.manager [req-3e8b1d22-3d32-4d94-93a8-5d1ad0375ae1 - - - - -] Driver post RPC initialization completed successfully.
( s+ W/ z7 J, g& s2022-09-07 11:36:27.937 34 INFO cinder.volume.manager [req-60011ea1-50bd-4314-9935-5b85e10ff8ad - - - - -] Driver post RPC initialization completed successfully.* `/ H& L5 E3 n  S% b

6 e$ M# m5 W/ k1 q) A
3 r# K5 K) I8 Z+ v& b( D& u
" [) p( v, p2 j; q- d  f* h
8 }$ W9 |' a1 [7 |- Y  d# v4 G0 z4 B: ]+ e, _6 ^  T1 e5 _
2022-09-07 11:46:35.171 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 8.71 sec
3 m8 |" t8 u: Y- R, D- K2022-09-07 11:46:36.142 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 0.22 sec$ [" o# q5 X  f' y$ H/ ?
2022-09-07 11:46:36.142 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 0.07 sec7 Q; _, L; V1 T# W4 ~
2022-09-07 11:46:37.424 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 10.17 sec/ D- O& g) g) r( P& A, R
2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
- p/ h9 N) ~9 E2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):5 [+ g/ k6 r) C6 X
2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
: q( r7 F) y% q2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
$ d5 D# H" E/ S1 e- {  S- }2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
% J2 [+ ?. f' O( e' h2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
1 f4 p1 Z5 K! X: W/ d2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
( e' H' f  ^  Y6 W: |2022-09-07 11:46:42.162 330 ERROR oslo_db.sqlalchemy.exc_filters $ k- \1 T7 f8 g8 j
2022-09-07 11:46:42.166 330 WARNING py.warnings [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:: f' y; H  {; W9 Q
<class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed
" X6 c4 U8 m7 W: p+ f" G/ c! I8 k2 m2 Q
" s8 _) R( r/ o  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1]))
2 ~! G$ S  H4 k# O, w. C' s% B: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
+ W- W) m7 A- O, v2022-09-07 11:46:42.167 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
1 ~7 {7 E- R# H1 [2 K# `: `2022-09-07 11:46:42.167 330 ERROR cinder.service Traceback (most recent call last):  e8 J# c1 T$ z, v
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
: q# v4 j4 }! U0 N( d! k2022-09-07 11:46:42.167 330 ERROR cinder.service     service_ref.save()
- Y$ }# W4 j1 b3 O3 B, ~# C* W2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save- r/ K9 }9 @7 N  t& K
2022-09-07 11:46:42.167 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)
* s4 ]& Q' x+ n% z4 ?4 `; \2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update, c) r& p! w. Y9 A  W
2022-09-07 11:46:42.167 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
6 ~! r) N0 j8 ]0 c- @9 P+ s" U2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
+ |5 R5 d: m. i7 k( _8 _* L2022-09-07 11:46:42.167 330 ERROR cinder.service     return f(*args, **kwargs)/ G/ F& _* C. z% p% P( R
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper3 P) C7 y7 |2 c+ M
2022-09-07 11:46:42.167 330 ERROR cinder.service     ectxt.value = e.inner_exc
/ l2 v; U2 |: [& n) b' Z7 v# [( u5 Q2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__, @; |6 j, |$ S% s7 S3 b
2022-09-07 11:46:42.167 330 ERROR cinder.service     self.force_reraise()
/ ^( I' Y" g4 k# M7 `, B+ M3 b2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise) v' V5 `/ ^! ?5 }+ c
2022-09-07 11:46:42.167 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
0 G" q- S* c" e0 L# R$ N5 D2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
6 d) l$ a2 _2 C* b' }2022-09-07 11:46:42.167 330 ERROR cinder.service     return f(*args, **kwargs)
5 l; X: T- T9 K# S( h+ l) O, E1 H2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update2 z) [" N5 [+ E1 _/ J  e5 [
2022-09-07 11:46:42.167 330 ERROR cinder.service     result = query.update(values)* V1 }2 X9 {4 v! K
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
  c; ]3 }# c- v& \2022-09-07 11:46:42.167 330 ERROR cinder.service     update_op.exec_()% g+ Y  g4 D) o9 n
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
$ ?& a* Q( W5 r2022-09-07 11:46:42.167 330 ERROR cinder.service     self._do_exec()
$ T/ W6 v' k# R, o6 l2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
4 v4 c/ U# b: A& l2022-09-07 11:46:42.167 330 ERROR cinder.service     self._execute_stmt(update_stmt)6 Q4 `( v1 b6 w, |8 c- n! v/ N, f
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt* ?9 A3 [9 V; R6 {/ r2 K7 Q
2022-09-07 11:46:42.167 330 ERROR cinder.service     mapper=self.mapper)
( T5 _% C6 U( x, {$ e3 z+ ~2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute; A8 P- Y/ k' |7 o+ }
2022-09-07 11:46:42.167 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {}): ~, D. X1 X% I# s9 S1 l
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
2 r2 ?0 w( }4 {. }; Z& H$ \2022-09-07 11:46:42.167 330 ERROR cinder.service     return meth(self, multiparams, params)
, B2 g" [7 o8 r5 R5 ]( [/ B2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
+ g$ H) Q  ?8 Q& O3 x2022-09-07 11:46:42.167 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
% ^5 L9 D- s" F& N5 f2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
/ H$ |2 s; U# q: z" R6 K$ Y2022-09-07 11:46:42.167 330 ERROR cinder.service     compiled_sql, distilled_params
+ A3 z5 {& m: R2 R- [$ J2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context
7 `' }8 E9 {, k; c4 s3 g2022-09-07 11:46:42.167 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)
, g7 D( q: w6 I% H2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl# @) d$ c3 E8 `3 K' i- V
2022-09-07 11:46:42.167 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:$ Z% E7 Y+ \. C
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection% H2 R5 d2 _( l/ h# G" q" U
2022-09-07 11:46:42.167 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
6 Y+ Y1 _2 K, W9 S2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
& g; R* L) c8 N7 L+ v1 Z0 X2022-09-07 11:46:42.167 330 ERROR cinder.service     self._autorollback()
) f# O1 ?' {% d7 l+ o2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
8 P. u( ?/ h5 }3 z7 ?2022-09-07 11:46:42.167 330 ERROR cinder.service     compat.reraise(type_, value, traceback)( |2 m/ {4 j( R  \! }0 o5 a: |
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
& E; F1 Y, k$ o0 C! \! q* g2022-09-07 11:46:42.167 330 ERROR cinder.service     self._autorollback()& N: W- s1 D, l3 a1 o
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
8 w. i6 f( J. V6 ]$ {6 \0 @; ~/ H2022-09-07 11:46:42.167 330 ERROR cinder.service     self._root._rollback_impl()7 Q9 [7 x, c& o# O+ O; I
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
9 Z* n; v- s$ c, _" p2022-09-07 11:46:42.167 330 ERROR cinder.service     self.dispatch.rollback(self)
6 m; c8 \9 ^$ y! P/ _2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
! m% j( F5 q0 u; z3 b! y2022-09-07 11:46:42.167 330 ERROR cinder.service     fn(*args, **kw)1 ^3 h; D9 E7 h: M& ^6 J% c/ ]
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
* d% S' g5 K7 Z  y; s2022-09-07 11:46:42.167 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
" d3 C9 ?( e8 c2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info! s8 `' J5 F) h+ N6 \
2022-09-07 11:46:42.167 330 ERROR cinder.service     return self.connection.info
  j7 ^8 p2 j5 _) y; P5 q2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
- u1 l1 N4 Z2 f/ i2022-09-07 11:46:42.167 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
7 ^/ ?# E7 w4 H( T2 H$ g; ~. ]0 z8 d2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception/ |/ g$ X( C4 l* \$ m$ b* L1 p# }
2022-09-07 11:46:42.167 330 ERROR cinder.service     exc_info
5 Y3 @' ]' L, X% V7 r( _2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
2 y% a4 S5 }- W. F2022-09-07 11:46:42.167 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)( J2 F1 H9 C: d) s
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
! ^  |) P- G& x+ p- k/ o2022-09-07 11:46:42.167 330 ERROR cinder.service     return self._revalidate_connection()! L  q  C) W/ \: M+ n
2022-09-07 11:46:42.167 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
( ^- b" Q9 D. u' H1 F2022-09-07 11:46:42.167 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")6 p8 I, a6 F4 c6 n9 l& N
2022-09-07 11:46:42.167 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
+ V; e- t( L! A) Z! Q" J' {+ r2022-09-07 11:46:42.167 330 ERROR cinder.service
" z2 u- ~7 f3 t( ?0 b2022-09-07 11:46:57.813 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 18.91 sec
9 E+ u% ~1 m3 r1 S! d/ q7 ^1 }2022-09-07 11:46:57.817 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 11.67 sec
5 E6 K  \* S7 W. G2022-09-07 11:47:05.300 34 WARNING oslo.service.loopingcall [req-8fa905ab-6b12-4005-9ef8-bc279b74b2da - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 36.06 sec
, j* ^" S& r, _2 }6 ]2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
+ f3 A2 S3 b# O; _1 H2 z5 a! |2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):. |5 [: M# b( n& u5 u
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection4 B$ m* R2 _+ i) W
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
% L  y% W0 A5 s$ ]4 J2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection+ |. j; ~7 w& B3 M% @. K5 M+ F
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed"); q8 y- o4 H% p9 M) J2 e
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed; s( b  j; j2 S  [2 m& G
2022-09-07 11:47:05.319 330 ERROR oslo_db.sqlalchemy.exc_filters - |6 h0 a' B! f3 C
2022-09-07 11:47:05.320 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 10.14 sec
5 x4 G- ?* Q# r) v. a4 [! f7 H2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
; T2 V. f- c; r+ x/ z5 }2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):$ C$ Q2 X/ j/ H+ P' V
2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection) A2 n; S2 c+ Q9 n: G
2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
# O& E- C. a# J1 r2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection' e' m+ @" T7 t0 i4 y
2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
. e: P9 e: f. q; x2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed: A6 w* B5 y) w5 ?2 {! f
2022-09-07 11:47:05.363 168 ERROR oslo_db.sqlalchemy.exc_filters 5 z. u$ [" x1 v4 I6 |$ p
2022-09-07 11:47:05.366 168 WARNING py.warnings [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:( x& o& L1 I7 Q# Y* C; i
<class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed: E7 f) F+ U2 a! u, g0 G

5 U+ o, b6 p" n( G  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1]))
. Q, }) a- x# j4 e  o0 e: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)# P6 H* y. [& }3 C" D/ q9 b, i3 q2 N
2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
' P3 i8 H) O) H' b2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
5 H8 u/ M7 \3 C1 f2 M2 O: @, K+ Y2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
- B' E& ]( f; C; _6 _2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()5 c; c- m& `- j2 q4 p$ @  L) I
2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection3 ^; A) B0 }+ `$ V; x9 M
2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
9 q7 N. B2 ?  G, |: R2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
  d9 n; p, C- n9 f& a3 J2022-09-07 11:47:05.366 330 ERROR oslo_db.sqlalchemy.exc_filters
9 f! P  Z) i( R7 Y/ o$ p( T3 n2022-09-07 11:47:05.367 168 ERROR cinder.service [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi): X: E5 x, ]' ?0 J8 {
2022-09-07 11:47:05.367 168 ERROR cinder.service Traceback (most recent call last):" ^  I7 v  ~; @5 Y
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state* h8 f- j+ E+ q+ p
2022-09-07 11:47:05.367 168 ERROR cinder.service     service_ref.save()
; X: C& f% I% ~8 _7 }9 {2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
0 d" U. Y, ?' ~$ }9 _( I# d6 M2022-09-07 11:47:05.367 168 ERROR cinder.service     db.service_update(self._context, self.id, updates)
% B* ]8 {5 b2 x5 L2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update8 q1 R3 H' ~  m4 A
2022-09-07 11:47:05.367 168 ERROR cinder.service     return IMPL.service_update(context, service_id, values)7 c; s2 ^0 K& b* Y; C" p* i7 H
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper0 ?- [- Y! o# n, |7 T
2022-09-07 11:47:05.367 168 ERROR cinder.service     return f(*args, **kwargs)) G. l0 m- R1 C+ W
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper4 Q4 [* g' m  G8 L8 d* n
2022-09-07 11:47:05.367 168 ERROR cinder.service     ectxt.value = e.inner_exc) j1 N& p. [4 {* a9 N
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__' `& @1 M. N$ ?& c, Z7 D* u
2022-09-07 11:47:05.367 168 ERROR cinder.service     self.force_reraise()8 B# l4 S9 m8 {! h( E1 U
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
) ]2 j2 ]% x- \2 }! {# n2022-09-07 11:47:05.367 168 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)4 Z- {+ R- J% v  y& g
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
% w; X/ A2 O) x2022-09-07 11:47:05.367 168 ERROR cinder.service     return f(*args, **kwargs)4 n( U0 Z% M. V, O$ j+ a; {
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update. @. ]9 [$ U( {' _3 e
2022-09-07 11:47:05.367 168 ERROR cinder.service     result = query.update(values)% K" ]: d9 s( R" C( F1 M6 I
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
0 ?: T, c9 e4 ^, Q$ |$ [2 }2022-09-07 11:47:05.367 168 ERROR cinder.service     update_op.exec_()! w: \" B- f: w# G
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_4 l1 c+ k6 a& S/ B' s4 S
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._do_exec()
2 |/ H( l) o  v8 T, b2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec. @. x7 u2 o/ B! n$ s8 i& I
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._execute_stmt(update_stmt)
: Z2 t8 _& q: W) K2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
! i" x' o7 e( D2 M' y2022-09-07 11:47:05.367 168 ERROR cinder.service     mapper=self.mapper)
( s* Z$ _* Y! R& \  J) }) H2 K2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute; H) T4 @2 [5 ^4 G
2022-09-07 11:47:05.367 168 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
9 x* _0 N; D- D' r# r# h6 U* K  q2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute) \4 J- G- N5 v. q0 L
2022-09-07 11:47:05.367 168 ERROR cinder.service     return meth(self, multiparams, params)5 }/ |2 d6 g1 N* i
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
# x7 O7 X# |% t, g; m* l: F: {5 @2022-09-07 11:47:05.367 168 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
/ }; ]8 b1 @2 F, s2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement$ c* b& n9 {- ]0 [% K4 S2 z
2022-09-07 11:47:05.367 168 ERROR cinder.service     compiled_sql, distilled_params
' Z5 g2 c, X: t# ]. V; s2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context+ ~, @# I* _& \3 G
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._root._commit_impl(autocommit=True)
& i, Q" E  v; z  c* |% h1 D9 |5 G$ B: o2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl* ^8 B# x- F8 [9 x) v! P4 x
2022-09-07 11:47:05.367 168 ERROR cinder.service     self.connection._reset_agent is self.__transaction:& k& P; K& L, [
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
' Q6 k" c9 w4 o- |3 S9 n8 |2022-09-07 11:47:05.367 168 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
% M! i% N7 P! V: j# ]2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
4 Q2 T, G9 o/ {( f. r# d) N2022-09-07 11:47:05.367 168 ERROR cinder.service     self._autorollback()2 ^: F; O& L' p9 I9 t7 \& E
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
7 R! \( U7 h0 D& K8 @% x7 E2022-09-07 11:47:05.367 168 ERROR cinder.service     compat.reraise(type_, value, traceback)3 x& [$ ]# ^$ }' I( a0 \
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception) v6 K; F& }/ C# i9 G
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._autorollback()
3 {" X$ T' M0 F& f. ~2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback" i+ @* P! M8 H+ E
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._root._rollback_impl()1 T' R' u9 F* Q4 l- y4 D: R
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl+ Z8 ^5 s, q' T; V, n& Z+ P+ P8 s
2022-09-07 11:47:05.367 168 ERROR cinder.service     self.dispatch.rollback(self), ?) q. m& P. W8 L7 W# t
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__5 N0 h8 c+ k/ G
2022-09-07 11:47:05.367 168 ERROR cinder.service     fn(*args, **kw)
0 W4 Y9 l* L( V$ ^1 S2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx+ d, X3 L+ a1 f3 v7 v
2022-09-07 11:47:05.367 168 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
6 }7 k# {+ E$ Y  @* r  [% D! C2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info# s1 G! @5 {5 F9 K8 g( e7 q
2022-09-07 11:47:05.367 168 ERROR cinder.service     return self.connection.info" u% U8 a( S; F* S! D# E
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection1 u1 a2 f5 B2 D' |) @
2022-09-07 11:47:05.367 168 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
5 l8 I) l5 j' J2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception, N. Q9 H% J8 G1 E3 P
2022-09-07 11:47:05.367 168 ERROR cinder.service     exc_info: ^* }7 @) p$ s* \
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause6 S$ q( k+ R8 `: ]3 R" [/ ?# C
2022-09-07 11:47:05.367 168 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)$ ^9 _! i- u- m
2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
5 _/ o7 L) g7 I% D& B' J2022-09-07 11:47:05.367 168 ERROR cinder.service     return self._revalidate_connection()
7 j+ P& @' ~" o* j5 \. @2022-09-07 11:47:05.367 168 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection5 |3 Z7 k/ p3 C6 J
2022-09-07 11:47:05.367 168 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed"): ^' T/ }0 v1 t, N: D
2022-09-07 11:47:05.367 168 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)4 u- f8 }9 |/ Z& S# y
2022-09-07 11:47:05.367 168 ERROR cinder.service " [# F" r, Y: ~7 ]4 R' a
2022-09-07 11:47:05.375 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 17.95 sec- l* b) g# B# G% L+ k  F3 \
2022-09-07 11:47:05.428 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 19.28 sec
& y* u9 X, e6 I2 O, g* n& w2022-09-07 11:47:05.561 168 ERROR cinder.service [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Recovered model server connection!; L( F. e, R9 s3 P/ h* W+ R
2022-09-07 11:47:15.330 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!
6 p0 P" {8 [, B+ v& o+ G- i3 [) j) Z$ ~2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed1 H6 d" M6 g# i) P
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):8 {& L& \6 @2 L5 \, B
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
' D5 E' c' e9 p+ N) U2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
4 f8 I: l8 t; E* C2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection# ]. @, o+ J; C7 ]
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")" o& `; F8 l3 p/ e2 N1 L7 B
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed6 Q3 i) U3 V: Z0 @8 R  u
2022-09-07 11:53:39.861 49 ERROR oslo_db.sqlalchemy.exc_filters % f4 z7 L: H7 Q' w
2022-09-07 11:53:39.864 49 WARNING py.warnings [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:
$ O& D: U* r$ q: w <class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed
' {: ^* O( z2 ?( A$ k9 x7 |- _0 E$ c( P- o4 {
  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1]))
# J% z5 w/ Q( Q5 q4 y: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)! Y2 `  u" ]9 s0 w9 I6 e
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
- Z( P$ J2 y* a% V9 _2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):' `6 }' V+ d- \& ]7 J, U) ~5 c3 T
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection3 t; V' g1 b9 s
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
) L* _' a- z. M2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection! [8 I, A  G3 m+ e1 G
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")  e- a% U# I+ ~5 P/ k
2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
" h" y  ?/ k) ], o0 w2022-09-07 11:53:39.864 125 ERROR oslo_db.sqlalchemy.exc_filters
# q; T7 z9 Y9 M2022-09-07 11:53:39.867 125 WARNING py.warnings [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] /usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py:74: SAWarning: An exception has occurred during handling of a previous exception.  The previous exception is:0 ]6 b* g0 e) A& g
<class 'sqlalchemy.exc.ResourceClosedError'> This Connection is closed
# C* v1 W. ?5 @+ k$ }  @
7 d! ]9 I/ B6 H2 @" e, E2 W  "is:\n %s %s\n" % (self._exc_info[0], self._exc_info[1]))
" q$ U, x3 V' g; h: DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
- x% D0 Z. Z! u; a1 a7 d  r4 |/ ~& B2022-09-07 11:53:39.865 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
# h4 l; T: H; z1 ~2022-09-07 11:53:39.865 49 ERROR cinder.service Traceback (most recent call last):9 H4 Q3 g6 N  {: A
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
9 I3 J* {' D+ |2022-09-07 11:53:39.865 49 ERROR cinder.service     service_ref.save()
3 ~+ x* C* I: G1 v& N8 f+ ^4 k7 u4 @2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
5 w6 f* Z% x1 {# K- L1 V( T2022-09-07 11:53:39.865 49 ERROR cinder.service     db.service_update(self._context, self.id, updates)
( g$ E0 \( u$ Y- }2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update! N" `/ K8 a$ J
2022-09-07 11:53:39.865 49 ERROR cinder.service     return IMPL.service_update(context, service_id, values)# Q% ]1 K: K& B4 B# k
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper9 @7 j0 J. ?- a7 ^. e# E8 O3 E
2022-09-07 11:53:39.865 49 ERROR cinder.service     return f(*args, **kwargs)* w8 ~5 w% C$ @: H6 B- a% P9 ^4 @
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper+ {9 _; \' n- x8 {2 @- ]) |
2022-09-07 11:53:39.865 49 ERROR cinder.service     ectxt.value = e.inner_exc
3 K# s# j4 @9 u, e2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
5 D; T0 ?5 q( ^8 G- a( G* k4 `2022-09-07 11:53:39.865 49 ERROR cinder.service     self.force_reraise()
3 X- _3 W5 r/ R5 x4 E2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
: r# w+ T/ v0 ~3 b& i2022-09-07 11:53:39.865 49 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)) J# y# O6 T# X- G0 Q- s
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper7 I7 u+ I5 L& L3 W- P  E) R
2022-09-07 11:53:39.865 49 ERROR cinder.service     return f(*args, **kwargs)
0 J, w( k% n' F$ g) M+ I8 X2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update8 W" \+ s* U: J  N' r
2022-09-07 11:53:39.865 49 ERROR cinder.service     result = query.update(values)1 L9 h. B2 G+ L3 Y3 I; i3 G
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
& Z9 ^. B) d$ M# Z/ t- ]: W) ?2022-09-07 11:53:39.865 49 ERROR cinder.service     update_op.exec_()
5 n. Z5 W% G1 {7 g! D8 N1 {2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
0 Z0 h3 K" q- V) ]/ ^2022-09-07 11:53:39.865 49 ERROR cinder.service     self._do_exec()
, }; `4 w% ]8 B* w: G' h3 E7 w2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec9 T1 S& P5 u; d1 E( l. j
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._execute_stmt(update_stmt)
+ i4 {, c3 k: E2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt2 O, B+ H# l, N, {0 K4 `* w8 h$ v
2022-09-07 11:53:39.865 49 ERROR cinder.service     mapper=self.mapper)  p- r, e  C5 W/ s
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute3 c) w0 H- ~: O4 b/ k
2022-09-07 11:53:39.865 49 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
  k' R3 |' ^. m2 `, J2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute& J! k4 l8 A# s4 K4 d- `, b  t
2022-09-07 11:53:39.865 49 ERROR cinder.service     return meth(self, multiparams, params)
9 O* t0 z; j& c! u2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection! B  B2 C3 d5 k6 m) `: I- }: E
2022-09-07 11:53:39.865 49 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)2 ~- _0 H8 W0 o0 Q8 Q9 C
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
( Z8 \$ D& h& G2022-09-07 11:53:39.865 49 ERROR cinder.service     compiled_sql, distilled_params
- I9 n; y& n  [3 R. j# @2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context) @- X1 p7 F, J4 y& Z1 K% p8 L* m; j
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._root._commit_impl(autocommit=True)6 ~4 U6 v" ?7 g% W$ N& @
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl4 t, _5 t3 y5 @! U7 D/ |
2022-09-07 11:53:39.865 49 ERROR cinder.service     self.connection._reset_agent is self.__transaction:' U3 u9 K' W, L
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection# n" j  P5 q4 ?7 h6 o  X( Q# P% C
2022-09-07 11:53:39.865 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
) G( b, o' ]+ `8 d* z+ C" u2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
& T3 P% Z2 j. i6 T2022-09-07 11:53:39.865 49 ERROR cinder.service     self._autorollback()
, g; i. u, b6 e9 L/ R2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__9 ~- ~8 X& t$ ?+ u- y# f
2022-09-07 11:53:39.865 49 ERROR cinder.service     compat.reraise(type_, value, traceback)
4 d+ Y' o+ `2 C/ V4 @, J2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
- v2 s" @' M: o5 _2022-09-07 11:53:39.865 49 ERROR cinder.service     self._autorollback()+ ^+ R5 w3 n% s
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
2 @0 Z5 ~0 _0 p9 u" Q# r2 |2022-09-07 11:53:39.865 49 ERROR cinder.service     self._root._rollback_impl()
: Q. @3 y& p  I  M2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl7 K$ p/ D" s8 k( J1 O4 b6 r
2022-09-07 11:53:39.865 49 ERROR cinder.service     self.dispatch.rollback(self)
4 R4 q' @6 @/ B0 j5 q; O2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
, O& D1 P" a6 u2022-09-07 11:53:39.865 49 ERROR cinder.service     fn(*args, **kw)
7 p0 k4 b& ]$ q/ R% P( p5 B) M+ s2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
$ X  V0 S+ s# m% z& o# y& T2022-09-07 11:53:39.865 49 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)' p% C/ }/ \: ^& X0 v
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
0 Z6 f- `, ]+ Z. x2 L2022-09-07 11:53:39.865 49 ERROR cinder.service     return self.connection.info* c: J3 x  P/ f8 R; V
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
: w- A# J" D: w0 O" w# ?2022-09-07 11:53:39.865 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
4 }1 a7 {& n6 I* i4 ]' L2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception5 R: O/ e* `, x: i. ~6 `* e
2022-09-07 11:53:39.865 49 ERROR cinder.service     exc_info& \$ t/ J" T9 J
2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
( f( L$ [7 i* U6 _$ x) \2022-09-07 11:53:39.865 49 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
$ ~% y$ A1 K7 D3 q, o. ~! a2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
+ {( @' c% W' M2 i2022-09-07 11:53:39.865 49 ERROR cinder.service     return self._revalidate_connection()
; a; M% E. s( G0 [& O) ]1 Y4 B1 r2022-09-07 11:53:39.865 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
$ D& z, ~+ h5 B& u2022-09-07 11:53:39.865 49 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
( J8 ~8 G9 I1 Q" V5 E9 C6 }2022-09-07 11:53:39.865 49 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)' V: e2 S9 d- R4 i2 j5 C
2022-09-07 11:53:39.865 49 ERROR cinder.service
9 l# K$ X( \7 B/ d3 S2022-09-07 11:53:39.868 125 ERROR cinder.service [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)( a2 J( H1 U% j  s
2022-09-07 11:53:39.868 125 ERROR cinder.service Traceback (most recent call last):% u7 e- W# W4 R1 D0 }) U: Q
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
  P! v+ R% r9 @& M2022-09-07 11:53:39.868 125 ERROR cinder.service     service_ref.save()' J- e% B+ i  Z$ K# ^
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
. ~( U- M, A  b9 \1 f2022-09-07 11:53:39.868 125 ERROR cinder.service     db.service_update(self._context, self.id, updates)
3 r2 }( F3 h+ W; H2 M2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
; ?2 G$ d( G: R) r) u) j9 T0 A2022-09-07 11:53:39.868 125 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
9 ^. |8 U9 j. F: h2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
6 t# M, c, A4 g! D2022-09-07 11:53:39.868 125 ERROR cinder.service     return f(*args, **kwargs)) m, n; G9 P1 B/ ~" I; H3 w0 |
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper* O  k& m4 Z4 A7 }) m! ?4 y- g
2022-09-07 11:53:39.868 125 ERROR cinder.service     ectxt.value = e.inner_exc
: x. j6 Y6 u% m7 R5 Y2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__+ P' K# Z! t+ w7 H/ z. f2 n
2022-09-07 11:53:39.868 125 ERROR cinder.service     self.force_reraise()
" g( @! a& q+ V& @* X. v, d4 t2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise% V4 ?7 h2 o1 W( c9 H  q. E
2022-09-07 11:53:39.868 125 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
$ W  b' e/ V  Q" r2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper# [' k& d2 c6 y# I
2022-09-07 11:53:39.868 125 ERROR cinder.service     return f(*args, **kwargs)0 X+ R8 {) K$ f& z
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
% C/ {0 w! H2 q6 E: W" K2022-09-07 11:53:39.868 125 ERROR cinder.service     result = query.update(values)/ P% x, W* X+ x+ x3 |* z
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
3 D2 K9 S8 H. u( d( |2022-09-07 11:53:39.868 125 ERROR cinder.service     update_op.exec_()
+ A! S0 {. Q1 p& S8 l+ M2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_! k2 N# A4 i4 A
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._do_exec()
/ V* r  ?' Q; E  M5 r3 }2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
- _, }+ x" }" B( L: p! f2022-09-07 11:53:39.868 125 ERROR cinder.service     self._execute_stmt(update_stmt)/ T0 T+ A3 m/ g8 |7 p2 G) @
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt7 n2 @! R$ l- s  K
2022-09-07 11:53:39.868 125 ERROR cinder.service     mapper=self.mapper)9 P; g; J" B% d( r* g% v) `
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute" _6 w5 |# t; U, I2 Q
2022-09-07 11:53:39.868 125 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
4 e  O. S  ~6 y# a- \7 t2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute- x3 _6 K7 f) E- u; X( e  r6 r0 D
2022-09-07 11:53:39.868 125 ERROR cinder.service     return meth(self, multiparams, params)5 i9 W9 w( X* w" L0 s6 n
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
4 D" M' J0 C: ?1 ^% S2022-09-07 11:53:39.868 125 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
; o% U* e% }* T2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
7 [# m' l% x! j1 C$ J$ g2022-09-07 11:53:39.868 125 ERROR cinder.service     compiled_sql, distilled_params, H9 I( C! @: }7 H+ ?) X* P
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context  P; k/ U2 U5 O/ c
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._root._commit_impl(autocommit=True)
- }( f+ N/ e  G' U8 C: H# s2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
9 k6 m+ }% ?0 u' r6 m3 V- R2022-09-07 11:53:39.868 125 ERROR cinder.service     self.connection._reset_agent is self.__transaction:
$ l' g" M  f5 d3 y: O1 I$ G2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection7 t+ f8 p$ _' Y
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
$ b2 c0 u- r2 j* I. Y  S2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception/ r  O/ Q  P+ F0 P! i. K
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._autorollback()9 |4 _2 T. |5 a, S( e1 a( z
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
7 u3 J3 G  Z% K  J2022-09-07 11:53:39.868 125 ERROR cinder.service     compat.reraise(type_, value, traceback)
" O( D" w) b/ `' P) J6 C. O2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
3 O' ]0 N  Z& |$ ]! m8 @) J2022-09-07 11:53:39.868 125 ERROR cinder.service     self._autorollback()$ |! |6 V* r4 k+ j
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback( ^) c5 Y9 N$ @# W( U
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._root._rollback_impl()
% V% @5 n: O  C# U2 F2 `2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
! b5 U' ?/ T* F; A9 Z; q2022-09-07 11:53:39.868 125 ERROR cinder.service     self.dispatch.rollback(self)( G9 ]% ?# i: u3 L4 Z* O
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
. P- S- W! }  g8 f0 n2022-09-07 11:53:39.868 125 ERROR cinder.service     fn(*args, **kw)2 m; A8 F! Y. k  E
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx4 T) z1 c2 \3 t' g# s6 s+ n  i1 C( ^" j5 Q
2022-09-07 11:53:39.868 125 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)6 y3 X( a+ o  Z9 X& T" J; p# g
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
- `  ~! t% a8 O2 @& t" B2022-09-07 11:53:39.868 125 ERROR cinder.service     return self.connection.info, H( J6 K/ ~! ^8 l" P0 n: p4 n
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection2 w+ Y5 P# D4 n6 d1 w, N% J
2022-09-07 11:53:39.868 125 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)- }. a8 }$ d+ i: c% H. i7 l
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
& W8 h  ?+ V8 e$ H! G2022-09-07 11:53:39.868 125 ERROR cinder.service     exc_info% t! T& q! q% a
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
+ Q4 l/ a7 I% H2022-09-07 11:53:39.868 125 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)$ a4 m" h0 g- W: m" d* k5 J
2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
5 n! o1 o/ W+ C- Q, v! J  ^2022-09-07 11:53:39.868 125 ERROR cinder.service     return self._revalidate_connection()
6 P, ^$ x0 y/ X+ D2022-09-07 11:53:39.868 125 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
; |  t# e- {0 m; \2022-09-07 11:53:39.868 125 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
7 v4 y8 p, Q; b% U' m% d6 _2022-09-07 11:53:39.868 125 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
, S) H) ^2 P% d/ o/ j8 Y2022-09-07 11:53:39.868 125 ERROR cinder.service
2 c: ~2 W) [0 N. H2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
: z; Y0 I" d0 X$ {2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
" I  t- K, C8 t' N2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection; N1 z, ?+ A) D* [( h3 O! X& F
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()) Q2 z# u& |& L
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection6 m% R$ f2 }/ D9 ~. u$ S+ g, P
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")0 R2 U" ^; p% J: V* a
2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
% c) _! u# G" t7 h; k4 v( p: m2022-09-07 11:53:49.428 125 ERROR oslo_db.sqlalchemy.exc_filters
) X5 q9 I) K. ^1 q) z! r) c1 T3 {1 R2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed2 [, m. }; {# m
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):" z3 M- x$ z9 E0 v) C
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection/ v9 @: E/ w/ ]+ N8 Z; i
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
" h8 }' b' ~$ m; i* R2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
7 H+ c* C% a5 @! M0 m2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")' i2 n5 K6 [9 q4 v3 ^) i) m( \
2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
4 n. G" @: V& k/ A! t* d2022-09-07 11:54:06.357 49 ERROR oslo_db.sqlalchemy.exc_filters " Q" b: g' F. f7 J& v! ?
2022-09-07 11:54:06.359 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 7.79 sec
' i" l: x* ]8 f  r$ T% Q! k2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
( P4 j9 L8 B5 r& u& _2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
5 W: E3 J0 R' i2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection1 A, K; |6 G( }) V* f- ]* u; [
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()- |: B3 _7 s8 ]7 u3 s6 u
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection! z* |: t0 G  i) _/ R# s
2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
/ E0 B, k( Y! X; G' ]1 h9 s2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
" D/ @1 T6 z. i; p4 c2022-09-07 11:54:16.889 49 ERROR oslo_db.sqlalchemy.exc_filters
+ [& @* R1 F* x& Q8 X* E1 ]7 X2022-09-07 11:54:16.891 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 0.53 sec
8 e( O# f/ a9 N2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed/ Q9 U3 t9 i# q. M6 ^0 Z* X# O
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):) d4 {* ~  q7 \, ~4 Y
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection" B7 N2 _# f& z0 r) l7 ^
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
5 u6 u, I& {( \4 k" ?; J: _2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection  y3 R' s! |4 ^; n; n7 X) m/ _
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")! K7 h) E6 I6 W. I) l- H
2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
, j% Z1 W2 s, b0 W: v2022-09-07 11:54:16.893 125 ERROR oslo_db.sqlalchemy.exc_filters ) }" s2 n# N( b" y1 c
2022-09-07 11:54:16.895 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 9.08 sec. X* D. p4 H: k; E& X1 R
2022-09-07 11:54:16.902 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.48 sec1 P, K0 \8 g* Q* ~% R
2022-09-07 11:54:16.902 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.44 sec
# {9 d9 n5 B  }* b2022-09-07 11:54:16.909 34 WARNING oslo.service.loopingcall [req-8fa905ab-6b12-4005-9ef8-bc279b74b2da - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.17 sec& K" l" a9 p% u' B# o; L, H& N7 [; ^! t5 W
2022-09-07 11:54:16.945 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.53 sec
( B! |) O5 C9 g/ p8 Y- q2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed6 a) r/ `  h( H: p$ [
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
4 t& [, s& r3 k' o+ J4 ?2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
# {: C' l* X* G2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
# w9 f, v& u5 V9 v2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection0 y8 N' X( B/ a, |' G! s% q( g* H2 Y
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed"), N0 g# E4 J& F$ D" O4 T( R
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed9 v3 {3 o; U/ ]" r
2022-09-07 11:54:17.894 49 ERROR oslo_db.sqlalchemy.exc_filters
+ R3 Y: x  J' ?. M8 H8 C2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed# M! L: l& R1 Z, Q5 N  R7 V# e0 v; Y
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
: w* m* @, {2 r5 ^  T0 ^- Z# ?0 V2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection) x6 e1 {; V7 Z; D1 ^
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()% V  e9 [! C! T. \, ^
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection1 Z$ C. s5 f) E2 @% [  _6 R
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
' {$ f6 {: t+ Z# F# S6 D6 F2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed7 P* j* B: v7 c2 E$ A/ X
2022-09-07 11:54:29.672 125 ERROR oslo_db.sqlalchemy.exc_filters 5 R5 i6 v0 T) f, n6 |, J
2022-09-07 11:54:29.674 125 WARNING oslo.service.loopingcall [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 2.78 sec( M3 N% Y( z$ F& J- ?$ t$ @0 z, Y
2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed1 c! z, l, Q) `! v
2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):( ~5 Q- q& V( l0 ]$ \
2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
+ Z1 z4 p* \. N( f* J! K2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
/ l2 l. }  R$ v/ o/ I3 \8 S2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection2 N1 T% j: m8 R) r6 H
2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
/ i) U9 [: q6 @( Z2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
8 G8 D7 c* [+ ?& c5 R9 }# |, I9 [2022-09-07 11:54:38.349 330 ERROR oslo_db.sqlalchemy.exc_filters
$ s! \# H2 K4 a1 f2022-09-07 11:54:38.350 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
; Z9 \8 g9 G3 p* R2 v3 y2022-09-07 11:54:38.350 330 ERROR cinder.service Traceback (most recent call last):
& Y2 _$ L: |  \  v% J4 w5 h" }) d2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state
3 M3 o: ^% q8 \% W( t1 I: V2022-09-07 11:54:38.350 330 ERROR cinder.service     service_ref.save()
# r& ?! d7 }  ~4 G0 o, {) e& e2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save$ ^( j( O4 C4 p- x( {* N' x$ O! e
2022-09-07 11:54:38.350 330 ERROR cinder.service     db.service_update(self._context, self.id, updates); n8 R* W& A; Y. E  `3 U2 ~
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update4 J! K  S4 E/ `6 Y" l% }$ c7 I- P
2022-09-07 11:54:38.350 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)" u, o; p" [# {
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
. K, a, P7 F3 j" q2022-09-07 11:54:38.350 330 ERROR cinder.service     return f(*args, **kwargs)
+ n: M5 w7 M& I! @0 n( C9 C: F2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper
' a7 O* N* w7 P3 ^2022-09-07 11:54:38.350 330 ERROR cinder.service     ectxt.value = e.inner_exc
) Y% ]4 C7 s1 D+ c* T2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
0 f6 A1 X6 X) `2022-09-07 11:54:38.350 330 ERROR cinder.service     self.force_reraise()  J9 e7 U3 b: |3 A( g' K1 b
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
% S1 S% y6 Z. ^2022-09-07 11:54:38.350 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
! l9 R5 @- Z0 G8 }2 a6 b2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
9 s$ x5 I7 C& M1 ~2022-09-07 11:54:38.350 330 ERROR cinder.service     return f(*args, **kwargs)1 x# ]4 Q: O% U3 U8 ~
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
! T: F  H, E8 T! w- z! K# a2022-09-07 11:54:38.350 330 ERROR cinder.service     result = query.update(values)
' d5 C9 l. X- R2 b0 X4 D2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update, N% a( S, C1 l% E4 S9 g
2022-09-07 11:54:38.350 330 ERROR cinder.service     update_op.exec_(): b9 y3 R6 ?. y6 @7 U
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
/ }$ [- m6 D% m2022-09-07 11:54:38.350 330 ERROR cinder.service     self._do_exec()
* m' {3 f# t' n2 I2 A2 P0 |2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec. k9 q' Y! P# D0 J5 J
2022-09-07 11:54:38.350 330 ERROR cinder.service     self._execute_stmt(update_stmt)$ C2 U( W" J$ A  X$ a- s
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
8 e: b5 r  d& T- d- e6 f- R( Q% F2022-09-07 11:54:38.350 330 ERROR cinder.service     mapper=self.mapper)
9 l6 t; {2 s# ~# u! D8 P) a2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
$ D+ g! y4 W$ `# v- |0 h+ |, E" B4 d2022-09-07 11:54:38.350 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
  r  Q) y* w& S$ _8 q6 k2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute" D# L' C5 g) J& U1 k& }1 l
2022-09-07 11:54:38.350 330 ERROR cinder.service     return meth(self, multiparams, params)3 u) g% y2 X: y9 M. [8 ~# L" _
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection2 C& l" S6 A+ Q$ U/ V
2022-09-07 11:54:38.350 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)/ I% s$ `& |% Q6 \
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement' |- ^# a% r* j) G! E1 l$ ~
2022-09-07 11:54:38.350 330 ERROR cinder.service     compiled_sql, distilled_params6 d( O4 B' J7 p2 \# q: I
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context
& _( s! k' ]7 Y1 S: f- J2022-09-07 11:54:38.350 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)$ F2 a, o+ B9 X% T! z: U: F
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl, t0 F" X9 s" E( `% T' G
2022-09-07 11:54:38.350 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:- N! O2 n0 O8 R5 B& p
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection$ e& L! O5 t" H; m) x  |4 B
2022-09-07 11:54:38.350 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
. }+ E: q2 C+ @2 t$ c& s. T+ T$ W! k2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
+ J& S5 j: M- n% H2022-09-07 11:54:38.350 330 ERROR cinder.service     self._autorollback()! K% D( ^( Q) A0 F. l! R1 n7 W
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
- E5 F- _- N$ {+ q$ Q2022-09-07 11:54:38.350 330 ERROR cinder.service     compat.reraise(type_, value, traceback)
8 n$ Y- O; i7 A- R2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
/ K, r  `; A' l% Q7 _' q7 I2022-09-07 11:54:38.350 330 ERROR cinder.service     self._autorollback()
" k- j( k/ J! Y2 v0 Z- C  Q) {: L' f$ u2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
  ^  [" Q% Y& C1 m9 g2022-09-07 11:54:38.350 330 ERROR cinder.service     self._root._rollback_impl()
6 Q; }4 l2 ?2 x1 j( {1 f2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl! M( R5 o' _/ L7 T. U
2022-09-07 11:54:38.350 330 ERROR cinder.service     self.dispatch.rollback(self)0 m9 i3 e& {' ]/ A6 u: w
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
% f6 G% Q% i6 U. K- L- Y3 B, v2022-09-07 11:54:38.350 330 ERROR cinder.service     fn(*args, **kw)5 M2 K# R; |# v5 s, Y
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx! h# O7 b" M0 `6 d0 N
2022-09-07 11:54:38.350 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
" r" q$ M+ W3 i2 i( ~8 H3 C7 Y/ Z2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info* x( ?$ W! k% |+ ^: L/ g3 A
2022-09-07 11:54:38.350 330 ERROR cinder.service     return self.connection.info+ ?2 c# ?$ z4 g5 z! P
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
. F: o. d3 K, k- ?0 I2 @7 b2 d! h2022-09-07 11:54:38.350 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)7 \" e( v0 l" n9 U0 H) l/ A
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
7 [& \  X3 n/ N4 O2022-09-07 11:54:38.350 330 ERROR cinder.service     exc_info- z# T( `  P5 a6 \
2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
( f7 {! e* x4 N& U5 J& d2022-09-07 11:54:38.350 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
) [; E! l( ^; l: Q5 P* h9 j2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
6 \+ ?( h5 ^/ x: G; E$ T2022-09-07 11:54:38.350 330 ERROR cinder.service     return self._revalidate_connection()
( j: _- X; E0 l% z! D. j! H* Y2022-09-07 11:54:38.350 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection* G7 i, l6 m! b$ H% [3 G9 B) x
2022-09-07 11:54:38.350 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
- X5 w* T; V$ O* _$ [2022-09-07 11:54:38.350 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)  t: t/ B/ R3 `: f1 s4 u
2022-09-07 11:54:38.350 330 ERROR cinder.service
1 w- W1 Q, p! u2022-09-07 11:54:38.354 330 WARNING oslo.service.loopingcall [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.45 sec
* N, L5 U4 W! `8 w9 [2022-09-07 11:54:38.361 168 WARNING oslo.service.loopingcall [req-a83a2b2a-d4ab-41bc-ab79-7398a124f27f - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.45 sec! N1 Y6 Q! L- V, J7 t
2022-09-07 11:54:38.361 245 WARNING oslo.service.loopingcall [req-bbfcba31-efb7-4199-8a6b-6b1383f0de67 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 11.41 sec
+ a, X- A0 S* J+ L2 l: M5 A1 C. ^2022-09-07 11:54:38.362 34 WARNING oslo.service.loopingcall [req-8fa905ab-6b12-4005-9ef8-bc279b74b2da - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.45 sec" Y" l4 n9 K& V3 C
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
. o  }( @. a+ [) A& d% n1 N1 E1 l2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):7 A3 n2 f8 {) E$ B
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection) m+ _  L& f  r
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()6 u) K7 H5 Q" S" n+ r
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection. K! u' V3 g; c/ O" Y
2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
6 U' r2 `! x; E2 O6 s( R5 y) j2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed
' M* e' r/ b) J4 s' s2 ]2022-09-07 11:54:38.401 49 ERROR oslo_db.sqlalchemy.exc_filters
+ D1 O* E  V! P! F2022-09-07 11:54:38.403 49 WARNING oslo.service.loopingcall [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 1.51 sec% h4 g$ i6 Z$ y( |3 P
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
: B5 j0 _# K2 A5 f: I6 \3 `2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):( [% H) L0 S5 B( e4 L. |
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
- J) Q& N& M+ B  ]2 a2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
: R1 u  U% M6 ]2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection9 u& V2 A$ X; w. o5 a
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
6 @  C% [; c1 U; f5 r2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed2 a* r5 p5 _- A* I5 f+ j
2022-09-07 11:54:38.405 125 ERROR oslo_db.sqlalchemy.exc_filters
" q) \5 S% q; S( C1 ]2 i- D2022-09-07 11:54:38.498 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!
. p" `' ?: V  K' B2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
: R/ v; \' v/ L( H2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
3 z6 N$ L( L* D. z2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection4 r+ R+ n0 \6 n* B- z
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
6 E4 @6 [: \( B+ {) ^2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
5 \) ]( f+ L3 \$ ?1 O8 i( G1 s2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed"): u0 j+ c+ l& c! |5 j) V
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed% M: m4 s5 a* i2 B" I0 [, K& d8 S( O
2022-09-07 11:54:38.954 49 ERROR oslo_db.sqlalchemy.exc_filters 2 P) S9 K! O! _8 I9 w3 y1 A
2022-09-07 11:54:39.691 125 ERROR cinder.service [req-f0687257-7ade-4121-bab2-6fb72f80424a - - - - -] Recovered model server connection!! h+ X6 p% o! W+ w0 R! q, q/ @8 o
2022-09-07 11:54:48.421 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Recovered model server connection!/ c, o) Q) p) @. y% O' w5 M! g
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed9 Y9 y- f1 F' ?7 x
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
  E/ [+ ]8 B& W5 v: A: L; I2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection1 k' B: a3 y. ~! [+ s9 N
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection(); K8 W, A7 N4 }/ n
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
1 ]1 Q/ P. K+ j# w6 V7 d! T* a" `) h: {( f2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")) \0 Q, N) E/ `
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed1 u8 I2 \! j/ z
2022-09-07 11:55:08.373 330 ERROR oslo_db.sqlalchemy.exc_filters " m3 Y' w1 }2 R
2022-09-07 11:55:08.375 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
' W9 u/ b1 Z. b2022-09-07 11:55:08.375 330 ERROR cinder.service Traceback (most recent call last):
- b4 _  e2 ~- z3 Q8 q) J1 G2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state( |" O; @4 P9 W; \7 O
2022-09-07 11:55:08.375 330 ERROR cinder.service     service_ref.save()
) _$ O" ^7 N+ E% S: M2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save4 F% b8 a$ m2 ]% F: A4 R
2022-09-07 11:55:08.375 330 ERROR cinder.service     db.service_update(self._context, self.id, updates); j% D9 D) a% k5 R! k4 ]
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update
& h# ~2 V8 l- }! A& W2022-09-07 11:55:08.375 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
8 s( C( r* h1 f. U' y5 N; r2 ^+ H) y2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper$ L* V9 R& H$ O  Z1 r. J: v; R
2022-09-07 11:55:08.375 330 ERROR cinder.service     return f(*args, **kwargs)
0 j; ~; z1 G4 B1 y: n2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper, n$ n( \  {2 X& L- c  ?$ E* J
2022-09-07 11:55:08.375 330 ERROR cinder.service     ectxt.value = e.inner_exc9 g% R5 @2 F3 a9 W
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2 s- s! J! [; i; Q+ ]: w) j6 W2022-09-07 11:55:08.375 330 ERROR cinder.service     self.force_reraise()
  X$ N( |/ Q2 _- d2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
; h' d. p, {6 z2022-09-07 11:55:08.375 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)5 _/ q6 D' N( p1 S7 {: P0 {' c
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper+ u6 |* C& p- R* W; ]3 f! F
2022-09-07 11:55:08.375 330 ERROR cinder.service     return f(*args, **kwargs)' v- a; i- ^% ^2 ]+ Z$ b3 ]
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update) L5 {: f9 g2 @
2022-09-07 11:55:08.375 330 ERROR cinder.service     result = query.update(values)/ P7 K/ Z; d3 m$ X( L
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update# L% ]- b3 H/ s) m6 Y4 f: U' X* X/ q
2022-09-07 11:55:08.375 330 ERROR cinder.service     update_op.exec_()( H& {9 w  \. `( N- D' g
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
! @* R2 m) ?% B2022-09-07 11:55:08.375 330 ERROR cinder.service     self._do_exec()) m6 X$ o- ?5 u* z5 y6 W
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec, V" o  K9 S" ]( O0 h; H; ^- `
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._execute_stmt(update_stmt)
/ m" V' z+ V$ F1 A6 H2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
7 E0 V, F) h, I' p9 Y2022-09-07 11:55:08.375 330 ERROR cinder.service     mapper=self.mapper)+ V3 P: x+ n3 Y! [+ t4 \; b8 ?
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
# r  Q' n3 N/ b% V. t" n* `7 q2022-09-07 11:55:08.375 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})8 Q2 S/ E- G6 f, ?' M+ F5 {9 L3 }
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute5 F1 s# D. Q. S9 c8 I" H
2022-09-07 11:55:08.375 330 ERROR cinder.service     return meth(self, multiparams, params)$ ~9 L0 ~! ]2 `# f( m
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection! d. v/ u. Y) d# H+ X% D* [/ D
2022-09-07 11:55:08.375 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params); _( @' K$ f6 D, x6 p) Q$ o
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement, h9 K' w- P6 y9 M: R! @. e
2022-09-07 11:55:08.375 330 ERROR cinder.service     compiled_sql, distilled_params4 x' d# v" J' X* U
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context! g" V6 k4 \- e* B' w5 g3 f4 R
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)# n4 n. D8 b7 D1 Z
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl
& |3 v1 e6 x1 D2022-09-07 11:55:08.375 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:( Y& o1 J7 |; `, u5 M
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
. i/ ]0 z8 t- u: B* o; @, I+ X. B/ N) V2022-09-07 11:55:08.375 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
% f! l+ h% m: `: L! L5 e! z2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception9 H* T0 ^3 B2 Q  W( C8 R  ~
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._autorollback()
0 ~, h$ e" v/ r& X" h2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
# y" h) f5 h+ W5 ^6 a7 [" a2022-09-07 11:55:08.375 330 ERROR cinder.service     compat.reraise(type_, value, traceback)" ^! A! |1 Y+ J; Y
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception, m3 F! Q# z, W; Z  T: u) a3 r4 ?
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._autorollback()& U* e) `" _. h( o9 C
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
" V& K4 G$ K; D- m# |6 F2022-09-07 11:55:08.375 330 ERROR cinder.service     self._root._rollback_impl()$ c  |7 q2 u; L) m7 N5 F; G+ i4 l
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
7 x( Y2 W% Z* X8 S% y9 M2022-09-07 11:55:08.375 330 ERROR cinder.service     self.dispatch.rollback(self)
* E7 \  g& f- v( }% d2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
3 U& i- @4 U: G) W' H1 x2022-09-07 11:55:08.375 330 ERROR cinder.service     fn(*args, **kw)" \8 U. Z- l* x6 L  b$ o( L5 _
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx# o( F- H% Z$ a1 M2 H5 u8 a# J
2022-09-07 11:55:08.375 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)% `5 s2 R8 w+ g* r
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
2 K7 L6 ]6 T% Z: n- r! |2022-09-07 11:55:08.375 330 ERROR cinder.service     return self.connection.info5 F! C2 I: p# [: X4 I( p4 V; R
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection6 m5 Q, d9 x& s& F$ S9 K' t6 `4 {
2022-09-07 11:55:08.375 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)4 ?$ f' c: J3 ]. |6 `# T
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
$ E4 T" ?1 g" }9 B0 h8 |2022-09-07 11:55:08.375 330 ERROR cinder.service     exc_info9 e6 v* S! n  M( F: I
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause2 f! l. M8 X: k1 c# |- j$ o9 u- b
2022-09-07 11:55:08.375 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
1 o3 A5 d" U/ v. V6 P2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
, Q2 O+ j- B0 r  P+ h" g, |2022-09-07 11:55:08.375 330 ERROR cinder.service     return self._revalidate_connection(), s  L' t" P  i3 K/ Z* j
2022-09-07 11:55:08.375 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
1 J0 M# U5 Z) W; ~/ [2022-09-07 11:55:08.375 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")8 d( f5 I$ {" r, I1 z
2022-09-07 11:55:08.375 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)& O! G" l# n2 H
2022-09-07 11:55:08.375 330 ERROR cinder.service 0 ]1 C8 P6 f5 `- c* o5 U$ W
2022-09-07 11:55:18.372 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!; L. Z& L2 U# J5 Q( w# b
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed
/ r9 z2 f  l' w( q5 r2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
) f2 |3 i: [7 ?& G2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection. l# p( p+ `  e5 H7 `& }+ _
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()6 @6 V4 `( n4 G" i; F+ v
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
  k, T3 U: c! q: k$ a2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")
% u0 C) q* @8 `. A" }2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed+ |9 U/ Y* ^4 A
2022-09-07 11:55:28.373 330 ERROR oslo_db.sqlalchemy.exc_filters 2 k5 p( X  f6 s2 R9 ]9 f9 C, N- `9 G
2022-09-07 11:55:28.374 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
6 H, o/ [& q( m8 t  T2022-09-07 11:55:28.374 330 ERROR cinder.service Traceback (most recent call last):
1 W( f* ~' A5 j# b- {6 E4 Q7 w4 |2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state% a  _+ g) t. B% y0 D
2022-09-07 11:55:28.374 330 ERROR cinder.service     service_ref.save()
  k: r1 O: I: Z5 a9 W' M3 ?2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save  f& V  @( C; g% B* `. |+ y4 R8 O
2022-09-07 11:55:28.374 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)/ }% r8 w$ `* |  M: f, A
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update+ K' C# w& r8 T2 K
2022-09-07 11:55:28.374 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
* I! F) Z5 g+ V# z, a* `3 ]* H# g2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
+ `0 v$ D2 m& v- O: E2022-09-07 11:55:28.374 330 ERROR cinder.service     return f(*args, **kwargs)
# v' T  `$ {8 k5 e( w2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper* X* U, Y! j3 n% |% m) R' P" l
2022-09-07 11:55:28.374 330 ERROR cinder.service     ectxt.value = e.inner_exc% `! D0 Y' N1 }- O) \0 ]
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
! Z5 K. h6 O" L6 ^$ b( A2022-09-07 11:55:28.374 330 ERROR cinder.service     self.force_reraise()  k. q  C6 M# v& k
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise! |7 Z0 `! d1 x+ M4 Y+ b& ]$ Q
2022-09-07 11:55:28.374 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)' r1 I! K1 s9 D1 r
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
' g% i4 K. ]$ }, h* ~2022-09-07 11:55:28.374 330 ERROR cinder.service     return f(*args, **kwargs)
" L3 S* L! U/ s/ L! X2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update; X: r1 r6 F7 W3 `9 j
2022-09-07 11:55:28.374 330 ERROR cinder.service     result = query.update(values)
' R* x5 N& C* |" `. O; v4 r0 |/ t2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update; T% m- l/ N! {! f! `2 ~- Y- D
2022-09-07 11:55:28.374 330 ERROR cinder.service     update_op.exec_()# t9 F. `- {0 \' @. Q! U7 X
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_+ j1 ~  P% |$ C6 [! Y8 C8 l4 C
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._do_exec()* c' l, M1 J7 I) }6 s: G  }. A
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec0 v) p8 [1 v0 t: T. M
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._execute_stmt(update_stmt)' \. w  n" Z! V$ c+ c2 R* p
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
/ ~4 c& W" }! o5 g) z% V/ Q2022-09-07 11:55:28.374 330 ERROR cinder.service     mapper=self.mapper); I! K7 ]" }9 n2 L3 U- O3 G" Q5 I
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute
, J, t' a9 c6 {& E2022-09-07 11:55:28.374 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})! T" p  j2 E9 h) ?  ^  A
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
" ]. d) r0 F' G; R$ H, M5 U2022-09-07 11:55:28.374 330 ERROR cinder.service     return meth(self, multiparams, params): S: ]) C5 K- v5 {; {& A$ \% X1 Q
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
2 {# w* C' X. P" ?1 L5 P2022-09-07 11:55:28.374 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
" C! M9 w7 F: n4 B$ Z# r! U5 U2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
/ F) A1 ?2 |( F* t2022-09-07 11:55:28.374 330 ERROR cinder.service     compiled_sql, distilled_params$ V! l9 h6 u( x3 U' M4 Q
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context0 _5 G" Q. z6 s5 n
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)( Q  A# B3 W& ?  z* x
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl8 C% e, \0 k4 M
2022-09-07 11:55:28.374 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:% J9 H* L" J8 e3 x8 A
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
5 @# ~: u$ f- c6 U* x2022-09-07 11:55:28.374 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)6 R3 v; o5 z& E9 V# H; S
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
4 ]% p; x1 i  [8 I5 ?- @2022-09-07 11:55:28.374 330 ERROR cinder.service     self._autorollback()9 o! T' j. F# g# _( Q6 H0 N" w7 Y
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
# m6 x. \+ M" D: \$ ^2022-09-07 11:55:28.374 330 ERROR cinder.service     compat.reraise(type_, value, traceback)
1 r: L& d$ I( g0 o2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
: i! w( g$ Y0 ^1 ]* {3 V+ k2022-09-07 11:55:28.374 330 ERROR cinder.service     self._autorollback()
. R; G" E8 ]$ u# y% P; J2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback; E( J8 L  S$ p; \% c2 h
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._root._rollback_impl()
& b$ z4 k( ~: }2 w2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
0 d* g* b% j4 W4 P! A* f2022-09-07 11:55:28.374 330 ERROR cinder.service     self.dispatch.rollback(self)$ ]( d6 ^) Y+ p8 o% P
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
, {: S- V1 d8 F2022-09-07 11:55:28.374 330 ERROR cinder.service     fn(*args, **kw)
+ z9 \6 e/ ~0 P+ E& h8 k2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx; b3 S/ u7 I, D6 n! [$ a, r* q
2022-09-07 11:55:28.374 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)7 {4 `9 r- D3 K8 s' k3 ]1 B
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
% T# E2 Q3 }  v. T, e' S# p2022-09-07 11:55:28.374 330 ERROR cinder.service     return self.connection.info: d( V) @# x( j* S
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection. g6 v) A! u3 O2 e3 A
2022-09-07 11:55:28.374 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)' i3 f0 M. u/ F4 ^- B
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
8 n0 l4 ^( w: `. f& t( ~' w" H/ r2022-09-07 11:55:28.374 330 ERROR cinder.service     exc_info! D; D* b4 D& z# \. O
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
9 ^; C6 M4 P& N  g' e# J, o+ J1 \2022-09-07 11:55:28.374 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)3 Y2 y/ ]+ @, p* {/ p" L
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
& l  k. K! f2 F7 q+ A+ n2022-09-07 11:55:28.374 330 ERROR cinder.service     return self._revalidate_connection()5 ~: t* e& l' s
2022-09-07 11:55:28.374 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
5 c: ~1 J5 n3 B+ R4 s0 `4 z2022-09-07 11:55:28.374 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")% ^/ R- {5 o& Y( k6 o; }) f
2022-09-07 11:55:28.374 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
% U1 c: ^. o5 g% c2022-09-07 11:55:28.374 330 ERROR cinder.service 1 f3 @3 i/ C9 j- G" ]
2022-09-07 11:55:38.373 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!/ g1 s; h* d) P$ J
2022-09-07 13:31:20.753 49 INFO cinder.volume.manager [req-808e7d95-8769-4222-9160-49d2a558ad7b 2d3de65e3f1f46df86c7789341ba4523 5ec1142884724554b1a1257489e624e8 - default default] attachment_update completed successfully.
4 H% N0 T5 ?5 i/ r# ]2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed3 q- Y% m: B' v: G1 K
2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
4 U/ e: x; l# Y1 K2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
! ?4 i2 k4 u4 H2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
1 U4 N* }) I6 m  k, O2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
0 w/ N# I/ K3 e6 N7 q2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")) S3 ~( W* o  k! O6 U) a3 W
2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed- F& l# S1 r. r4 _
2022-09-07 13:33:18.824 330 ERROR oslo_db.sqlalchemy.exc_filters
. Z/ o* \, U# S2022-09-07 13:33:18.826 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)7 k  M; D7 a- f0 h! u
2022-09-07 13:33:18.826 330 ERROR cinder.service Traceback (most recent call last):9 J6 Y+ I& O  K
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state2 j& b% O! S5 K' i+ [, r) z4 F
2022-09-07 13:33:18.826 330 ERROR cinder.service     service_ref.save()" z" z5 m4 L8 p1 k* c. q/ n* q
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save
8 R, C! {& B1 Z1 \8 f2022-09-07 13:33:18.826 330 ERROR cinder.service     db.service_update(self._context, self.id, updates)0 X! }3 Q3 G' }; I
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update3 i; ^/ v; ^6 T6 H
2022-09-07 13:33:18.826 330 ERROR cinder.service     return IMPL.service_update(context, service_id, values)
) z6 L/ M+ E1 b( I/ U2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper3 P. z* r! |$ P# q, t; g+ H/ K
2022-09-07 13:33:18.826 330 ERROR cinder.service     return f(*args, **kwargs); c5 x1 R4 \5 [  D' q) a
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper4 _- _  v; K' Y* V
2022-09-07 13:33:18.826 330 ERROR cinder.service     ectxt.value = e.inner_exc
0 Y; W$ I  q& R$ i- w- g, ]" G2 i2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
3 Z* ~5 q2 b% f0 a8 m2022-09-07 13:33:18.826 330 ERROR cinder.service     self.force_reraise()5 `9 W1 i+ B; e( u
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise. l* d! a* F+ z7 o' \
2022-09-07 13:33:18.826 330 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
/ s1 d0 i+ g: _2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper1 u& c+ q# E3 j3 R
2022-09-07 13:33:18.826 330 ERROR cinder.service     return f(*args, **kwargs)4 d! |! |/ D, e: l
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update; W1 D( `# \1 a& i7 G2 ^
2022-09-07 13:33:18.826 330 ERROR cinder.service     result = query.update(values)" O: U% T0 Y& B, o6 r5 B, f2 Z
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update
# a9 U$ U$ B& G4 ?* m2022-09-07 13:33:18.826 330 ERROR cinder.service     update_op.exec_()
5 W6 V3 R0 Z. R/ @+ [9 e0 A, M4 ~2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_' W4 N0 s* f1 {5 c! {
2022-09-07 13:33:18.826 330 ERROR cinder.service     self._do_exec()1 n# S! l7 D1 |
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
+ G; i6 j- }! H2 |# q+ V! l7 y4 K1 J( D2022-09-07 13:33:18.826 330 ERROR cinder.service     self._execute_stmt(update_stmt)
. [7 T* M% c8 f/ ~2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt5 \6 L$ ]6 b( I  l6 ~, U; D: l6 B! B1 i/ c
2022-09-07 13:33:18.826 330 ERROR cinder.service     mapper=self.mapper)
! w% g- r7 N/ Y2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute7 U9 F) \2 k5 ]" j. z$ _+ R
2022-09-07 13:33:18.826 330 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})
: V+ w! x) y; e6 e  J& E8 r2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
7 E5 A  W# d1 w9 O2022-09-07 13:33:18.826 330 ERROR cinder.service     return meth(self, multiparams, params)
& i5 X) v3 r$ d  @2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
: D8 ]( y7 C  j2022-09-07 13:33:18.826 330 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
2 n) u$ d& O% {+ R8 ^+ N4 d& @2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
: A1 f. z2 R! Q& w: u. v* ^  R2022-09-07 13:33:18.826 330 ERROR cinder.service     compiled_sql, distilled_params
; @' m) S. `; c3 e8 C2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context
( k7 Y1 r7 M# j5 y2022-09-07 13:33:18.826 330 ERROR cinder.service     self._root._commit_impl(autocommit=True)( ^! A- x! u5 P7 b0 S; P
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl$ r4 h$ Q$ m& O# ?
2022-09-07 13:33:18.826 330 ERROR cinder.service     self.connection._reset_agent is self.__transaction:8 [2 N6 n3 m2 M! y. O
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
; T. J, K! }& [2 T1 Z2 [" L  @2022-09-07 13:33:18.826 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None), O: m. V* t. ?& T, w$ o/ U
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception: \* u3 z' u. Z0 _
2022-09-07 13:33:18.826 330 ERROR cinder.service     self._autorollback()! i) J" T& I4 ]  k8 D! ]
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__
  H* L. A6 \% ^3 p& ^: g* I2022-09-07 13:33:18.826 330 ERROR cinder.service     compat.reraise(type_, value, traceback)
1 r. A  a  I) [$ y8 N2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception0 M5 o2 K# j& q6 I2 e0 m
2022-09-07 13:33:18.826 330 ERROR cinder.service     self._autorollback()
* U! Y( D" s) G7 S- F9 f2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
- y0 t5 _) A* |2022-09-07 13:33:18.826 330 ERROR cinder.service     self._root._rollback_impl()) V$ O- n: |% o6 o3 i. O$ Q
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl
6 Z) ~5 `$ C& [1 D4 q1 k. n% q2022-09-07 13:33:18.826 330 ERROR cinder.service     self.dispatch.rollback(self)
: b) E6 \4 N( H/ e3 ^, ?2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__+ q5 K  s3 u8 ?( ]: N9 k- g) h
2022-09-07 13:33:18.826 330 ERROR cinder.service     fn(*args, **kw)9 [4 y9 k/ O+ ~
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
* ^; y) k1 V3 d$ u$ x; j2022-09-07 13:33:18.826 330 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)
" i1 ~& w2 }; F+ p1 }2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
2 u  Z, b" j1 L0 o' \* T( p6 T3 v2022-09-07 13:33:18.826 330 ERROR cinder.service     return self.connection.info
% d5 I. P; r% E5 j. o2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
  O6 c* Q; K6 q+ B2022-09-07 13:33:18.826 330 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None), W& W9 @2 h- O2 m  E
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
- \1 Q2 s" J7 ?2022-09-07 13:33:18.826 330 ERROR cinder.service     exc_info* b/ |' N- |* Q6 d
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause+ F; `6 m% M1 `
2022-09-07 13:33:18.826 330 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)" d- d) U$ K% b" L0 v% a
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection3 ?% w" |" C8 V4 [% B2 _# `8 A, ~' a
2022-09-07 13:33:18.826 330 ERROR cinder.service     return self._revalidate_connection()* D* _; y# C- S0 l3 v' Q
2022-09-07 13:33:18.826 330 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection' E! n  |4 r( E
2022-09-07 13:33:18.826 330 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")$ t1 ~  E0 @. v8 u/ d
2022-09-07 13:33:18.826 330 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
6 u. ^: t9 L6 G: S/ L* F+ ^/ l2022-09-07 13:33:18.826 330 ERROR cinder.service ' r# E3 x4 Z8 u6 P- B' s3 o( K
2022-09-07 13:33:28.822 330 ERROR cinder.service [req-5a2a750d-da1e-49f2-9067-a67db8a9d953 - - - - -] Recovered model server connection!9 y8 R2 H/ m; J0 W/ {
2022-09-07 13:35:05.363 49 INFO cinder.volume.manager [req-c7ac38c5-b0a2-48e5-9bc1-1a6abac4f14f 2d3de65e3f1f46df86c7789341ba4523 5ec1142884724554b1a1257489e624e8 - default default] attachment_update completed successfully.
0 o. m) S) a+ ~. M8 O3 L- k2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] DB exception wrapped.: ResourceClosedError: This Connection is closed7 i/ o' e1 K. X7 \' z; O
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):- \  ?9 {  c* x" ?& |
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
* [; Z' K4 @' `2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters     return self._revalidate_connection()
5 f  L, t( N! \) O8 p7 I9 X2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection
! I% ~) C$ X& J) t  X$ I4 G" I2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters     raise exc.ResourceClosedError("This Connection is closed")$ P5 c5 r* U3 j' Z; A: b5 l& R6 r
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters ResourceClosedError: This Connection is closed0 J! F* N" j. L4 ?
2022-09-07 13:42:41.774 49 ERROR oslo_db.sqlalchemy.exc_filters
5 A1 O. l  {/ }# z2022-09-07 13:42:41.776 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Exception encountered: : DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
- r/ x4 z& W4 r# S4 O/ W6 a2022-09-07 13:42:41.776 49 ERROR cinder.service Traceback (most recent call last):
! j" V# Q4 G# K2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 482, in report_state- V* r' J+ b; B) l0 ^
2022-09-07 13:42:41.776 49 ERROR cinder.service     service_ref.save()
+ B1 Q9 K  w; O/ N: K$ \' C2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 181, in save# n1 R  Q$ M$ W% `* }
2022-09-07 13:42:41.776 49 ERROR cinder.service     db.service_update(self._context, self.id, updates)
. U) ~5 f2 H' o" G, C5 M7 x2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 154, in service_update/ I4 O0 J. |/ T. }3 R+ l) _$ Q) N% I
2022-09-07 13:42:41.776 49 ERROR cinder.service     return IMPL.service_update(context, service_id, values)$ G" X/ D& C! j5 h# Z$ k
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper+ o# Q+ a6 \* `: V
2022-09-07 13:42:41.776 49 ERROR cinder.service     return f(*args, **kwargs)0 V' V! }: m! d
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper; v2 e% u7 S  F% |6 j' J6 e# w
2022-09-07 13:42:41.776 49 ERROR cinder.service     ectxt.value = e.inner_exc$ I$ u' Z- k# J7 c
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__% F6 O. |8 V) W. j$ ~
2022-09-07 13:42:41.776 49 ERROR cinder.service     self.force_reraise()
/ p8 k& P/ f( X' Q. z4 ?* Q2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
' i: z6 q. G3 m- N( @2022-09-07 13:42:41.776 49 ERROR cinder.service     six.reraise(self.type_, self.value, self.tb)
- C: X4 M# f! O! B& ?$ K' n- ^' d, j1 W2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper9 {, z+ n* _0 }- [0 s4 `
2022-09-07 13:42:41.776 49 ERROR cinder.service     return f(*args, **kwargs). v( N$ I9 c! ^) J1 b  q
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 560, in service_update
: [, P; R: T4 V: i2 Q! e9 e2022-09-07 13:42:41.776 49 ERROR cinder.service     result = query.update(values)9 |, ^% H/ X) n0 ~
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3369, in update9 F, P# R6 @# q
2022-09-07 13:42:41.776 49 ERROR cinder.service     update_op.exec_()$ X$ r' r# @- I9 s! r
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1325, in exec_
4 B9 ?8 }  o. J: ^7 r. _; p2022-09-07 13:42:41.776 49 ERROR cinder.service     self._do_exec()4 H( Y0 `8 b; a8 f$ G8 t
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1492, in _do_exec
$ \1 T; x# v. m6 H5 X1 y2022-09-07 13:42:41.776 49 ERROR cinder.service     self._execute_stmt(update_stmt)) o" o, z& R+ m9 Z
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 1332, in _execute_stmt
0 L6 F- a, n, B, o2022-09-07 13:42:41.776 49 ERROR cinder.service     mapper=self.mapper)# R- D- b& |( {$ B0 B
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1176, in execute$ ]& q0 F( G' d$ R7 t
2022-09-07 13:42:41.776 49 ERROR cinder.service     bind, close_with_result=True).execute(clause, params or {})& z$ K, n8 N4 F9 j" D
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute0 v+ J0 k. S0 w" x6 s# m
2022-09-07 13:42:41.776 49 ERROR cinder.service     return meth(self, multiparams, params)
3 v8 X1 q' I2 [9 b7 v7 i1 [- F4 N3 K8 b2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection! T4 [! @' {" a, r+ L
2022-09-07 13:42:41.776 49 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
* s# P" K" s$ G( d0 E2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement% n  B- h" r9 y" A4 i& g( d
2022-09-07 13:42:41.776 49 ERROR cinder.service     compiled_sql, distilled_params
3 }% [% u0 _# _+ C, T2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1220, in _execute_context
. x8 Y7 ?# p, t9 U0 J8 N2022-09-07 13:42:41.776 49 ERROR cinder.service     self._root._commit_impl(autocommit=True)
8 {4 w. D3 a$ j! v" C/ ^2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in _commit_impl; \1 N* x) X" J( L
2022-09-07 13:42:41.776 49 ERROR cinder.service     self.connection._reset_agent is self.__transaction:
# q7 m6 ~" k  \4 e5 q2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection7 A' W& H* D0 _9 W' T
2022-09-07 13:42:41.776 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
% ]/ [2 d) M& G# Q  |2 v2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
# \0 Z- `8 s% u# m! S2022-09-07 13:42:41.776 49 ERROR cinder.service     self._autorollback()) h& m) h0 n8 [3 S9 J- f
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 76, in __exit__) V4 K/ n3 l% h& N* [$ i
2022-09-07 13:42:41.776 49 ERROR cinder.service     compat.reraise(type_, value, traceback)5 [% ]2 z5 S- ^% C8 ~% i
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1406, in _handle_dbapi_exception
8 b& J; I7 v5 Z# Q& p1 j2022-09-07 13:42:41.776 49 ERROR cinder.service     self._autorollback()* C' r$ r2 v9 M# E
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 827, in _autorollback
9 n% e  M8 z* e  A! n1 y2022-09-07 13:42:41.776 49 ERROR cinder.service     self._root._rollback_impl()' K! P# U4 k) x5 ^5 D6 b% D
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 698, in _rollback_impl  m2 ^* ]6 w& T$ ]/ C: u6 H
2022-09-07 13:42:41.776 49 ERROR cinder.service     self.dispatch.rollback(self)5 I5 c- Y) @0 s/ O2 M; m0 i  [
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
# h( N& s, ]! I# I! m& V0 l* Y2022-09-07 13:42:41.776 49 ERROR cinder.service     fn(*args, **kw)+ o+ g0 x, z; j, s7 Q- `2 z
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/exc_filters.py", line 510, in pop_exc_tx
+ E! \, Q4 }* J. g* B& @5 p2022-09-07 13:42:41.776 49 ERROR cinder.service     conn.info.pop(ROLLBACK_CAUSE_KEY, None)) n0 g! A8 F. q4 X
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 461, in info
9 n0 H- ]+ D' h3 i# d! ?2022-09-07 13:42:41.776 49 ERROR cinder.service     return self.connection.info
. E# V9 x8 x* x4 i$ a, S2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 354, in connection
  \3 a  ~/ Z9 i$ m3 m* h! d2022-09-07 13:42:41.776 49 ERROR cinder.service     self._handle_dbapi_exception(e, None, None, None, None)
/ U$ I( L$ F9 c0 a6 A, `2 H4 t: L0 Q2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1334, in _handle_dbapi_exception
5 S. J: ~8 J5 ^/ S  e2022-09-07 13:42:41.776 49 ERROR cinder.service     exc_info1 \$ y7 s3 ~' |% O
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
3 O8 }- I. z" O' s4 h2022-09-07 13:42:41.776 49 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)' P3 p2 s3 X) v) k: D
2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 352, in connection
" u+ A* q+ P  \8 ], W4 W2022-09-07 13:42:41.776 49 ERROR cinder.service     return self._revalidate_connection()
+ B; b# \' P" y- Z! i6 e* z! Q( H2022-09-07 13:42:41.776 49 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 432, in _revalidate_connection# V" m, r9 S* S) a/ U! Y
2022-09-07 13:42:41.776 49 ERROR cinder.service     raise exc.ResourceClosedError("This Connection is closed")
* {8 j! D" n8 h2022-09-07 13:42:41.776 49 ERROR cinder.service DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed (Background on this error at: http://sqlalche.me/e/dbapi)
" ]( V& B, c  H: F  p: P2022-09-07 13:42:41.776 49 ERROR cinder.service
: p0 _1 G- m8 X* w, W2022-09-07 13:42:51.713 49 ERROR cinder.service [req-6d1e20e3-4ff9-4b18-9421-26fb66fd6270 - - - - -] Recovered model server connection!. [& f& j# A8 S# n% Y2 M" J" e
4 t+ e6 X  r) M  o) @6 D6 V' d/ Z
回复

举报

admin

1

主题

0

回帖

12

积分

管理员

积分
12
QQ
 楼主| 发表于 2022-9-7 14:09:45 | 显示全部楼层
Things i changed:
9 U' P! f  l- d3 H* @8 }
" `. m# n9 i8 Q: z% C, i; qMariaDB [(none)]> show variables like '%timeout%';
) r' x/ A, p- R+---------------------------------------+----------+7 }2 p5 U( c9 C! _
| Variable_name                         | Value    |% q7 v0 `- Q$ ?  d- b* R
+---------------------------------------+----------+0 s$ X% C# ~! c
| connect_timeout                       | 120      | <<==== This one, Initially we raised to 30s which has improvement but didn't help and then 60s which had lot of improvement but still saw connect errors.5 X" R, |( v: a' z  G% v2 {/ P; `
| deadlock_timeout_long                 | 50000000 |
4 l, U* X: }( U9 u) t% U| deadlock_timeout_short                | 10000    |
$ b3 U7 J2 c7 P- m! @| delayed_insert_timeout                | 300      |& M* b8 g+ g5 a# l6 w) Z- g( O
| idle_readonly_transaction_timeout     | 0        |  T4 M' i* O. x$ G3 g; ?* b5 ^! E
| idle_transaction_timeout              | 0        |
5 V$ |& h- D5 D  k- M- b" p9 V. Y| idle_write_transaction_timeout        | 0        |
- e' y8 ?9 S5 Z2 m. K| innodb_flush_log_at_timeout           | 1        |: _6 _- p# ~+ l2 ]8 |
| innodb_lock_wait_timeout              | 120      |<< ==== This one for lock wait timeout.  g2 J$ k8 C2 Z4 r2 E3 v
| innodb_rollback_on_timeout            | OFF      |+ `" F/ R% l1 w' |4 k, b/ P
| interactive_timeout                   | 28800    |. g) ^1 d6 p3 f8 L& o8 R+ ~
| lock_wait_timeout                     | 86400    |' R) t) M4 m0 c5 x' i
| net_read_timeout                      | 30       |+ Q: O/ j' a0 j4 [
| net_write_timeout                     | 60       |
" e/ f! u9 k$ n| rpl_semi_sync_master_timeout          | 10000    |- H/ c$ L; t" E2 m* \& U
| rpl_semi_sync_slave_kill_conn_timeout | 5        |% E  [' ]) S& m5 f) z, ^/ k! X
| slave_net_timeout                     | 60       |
: x$ h8 z: w, E" P! `| thread_pool_idle_timeout              | 60       |  [8 ]3 ]) A1 u  Z, F$ N# @+ E
| wait_timeout                          | 28800    |
4 F, |; n) u% X2 q% b' P+---------------------------------------+----------+5 f) A' G' I# f+ v/ y# d/ B. \/ c
# p! @$ z, l& A6 \

* N4 d0 _' B$ ^In Cinder.conf,6 k' _, L/ [+ ~% i* R" f. H

5 h4 ?. @7 o' L  s# e& \3 Oservice_down_time = 300
" H, l: q+ Z; |6 Q( Yreport_interval = 30# j* {/ t1 F3 _0 N3 |
rpc_response_timeout = 600
3 R" V% y& E, x0 Quse_db_reconnect = True
/ f# Q; T$ ]9 r& X  B2 S  r0 X  j! }
In nova-compute:
1 \6 {8 C3 Q! p4 j# [
" G5 F3 F" r5 i- Iblock_device_allocate_retries=200
$ v# D; j4 n$ Q$ h
: D! T9 Y1 a$ ]$ BThe above seem to help but there are still occasional mysql timeouts.. P) Q. H" p5 ]% w
回复

举报

返回列表 发新帖
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

本版积分规则

返回首页|Archiver|手机版|小黑屋|易陆发现技术论坛 ( 蜀ICP备2026014127号-1 )

GMT+8, 2026-6-11 23:59 , Processed in 0.023276 second(s), 23 queries .

Powered by Discuz! X5.0

© 2001-2026 Discuz! Team.

快速回复 返回顶部 返回列表