|
|
楼主 |
发表于 2021-10-18 11:12:53
|
显示全部楼层
[root@controller1 _data]# kolla-ansible -i multinode mariadb_recovery, j$ O5 U M5 o
Attempting to restart mariadb cluster : ansible-playbook -i multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=deploy -e common_run=true /usr/share/kolla-ansible/ansible/mariadb_recovery.yml
6 G6 P) f+ J$ N y4 j; M/usr/lib/python2.7/site-packages/ansible/parsing/vault/__init__.py:44: CryptographyDeprecationWarning: Python 2 is no longer supported by the Python core team. Support for it is now deprecated in cryptography, and will be removed in the next release.9 X5 {" c2 Z$ A$ r
from cryptography.exceptions import InvalidSignature
$ i) N7 w9 T5 c7 y8 O[WARNING]: Unable to parse /var/lib/docker/volumes/mariadb/_data/multinode as an inventory source% D# D3 }: |, G; X t
[WARNING]: No inventory was parsed, only implicit localhost is available
/ Y+ N8 d. {5 b0 F2 B/ K, I3 j[WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all'
5 ^+ O; |5 ]9 i! J, A[WARNING]: Could not match supplied host pattern, ignoring: mariadb
! x/ [$ u2 q8 @
. Q2 U3 g/ A" c/ Y8 ^PLAY [Detect openstack_release variable] **************************************************************************************************************************0 u, F" x; r, ^. V' P
skipping: no hosts matched
( E7 H1 j6 ~" B* c2 ] nPLAY [Recover mariadb] ********************************************************************************************************************************************
+ H- d/ _- B6 ^. ~skipping: no hosts matched1 o. e4 S- I7 K4 C
PLAY RECAP ********************************************************************************************************************************************************
/ R$ o6 T8 N! E& r- a. G' b[root@controller1 _data]# cd
4 Y3 I; k/ s& c[root@controller1 ~]# kolla-ansible -i multinode mariadb_recovery
; ?# k- h! w; z' Z- P" U G6 y% d9 D: GAttempting to restart mariadb cluster : ansible-playbook -i multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=deploy -e common_run=true /usr/share/kolla-ansible/ansible/mariadb_recovery.yml % q3 I# O. ~) R& N. H4 P) } }6 n
/usr/lib/python2.7/site-packages/ansible/parsing/vault/__init__.py:44: CryptographyDeprecationWarning: Python 2 is no longer supported by the Python core team. Support for it is now deprecated in cryptography, and will be removed in the next release.
p8 J- i9 _, d from cryptography.exceptions import InvalidSignature
" y* I9 L- [' {; P- `. q Y# C[WARNING]: Invalid characters were found in group names but not replaced, use -vvvv to see details3 E/ H- [7 S( c3 ]
[WARNING]: Found variable using reserved name: action
' k- f& z) c9 A- m; J: X; T/ U
PLAY [Detect openstack_release variable] **************************************************************************************************************************2 v9 ]1 x7 D% Y+ [2 V6 l9 `% @2 N
TASK [Get current kolla-ansible version number] *******************************************************************************************************************( n4 R( Q" e; e0 H- f
skipping: [controller1]
" ^; D( Y/ c2 D& L# E1 _skipping: [controller2]) \+ D T- Y0 O6 a
skipping: [controller3]
" U( J9 K! U, e- m9 V9 H1 ITASK [Set openstack_release variable] *****************************************************************************************************************************
5 O, A( K1 }7 {; x( Y6 pskipping: [controller1]& P9 x# J! a+ ~( g7 a% T! a) E7 Z
skipping: [controller2]
# i3 I F2 E( q8 w) eskipping: [controller3]) Z; ?6 B* a/ P9 k2 d2 F& W
PLAY [Recover mariadb] ********************************************************************************************************************************************4 m, p! u d/ b) d$ K
TASK [Gathering Facts] ********************************************************************************************************************************************7 b7 b1 S x& `* g. F
ok: [controller1]
/ O' [! S4 s4 Y: c& @9 V7 sok: [controller3]- O, a) [' q2 ?/ A# l; ~- z
ok: [controller2]
3 K! c3 ^+ n2 T* qTASK [common : include] *******************************************************************************************************************************************0 a3 J- l0 r8 D! N& ]
skipping: [controller1]) n) W( K& s5 K" F3 y
skipping: [controller2]
- p- b( T2 f0 q, I$ r9 O$ e/ Kskipping: [controller3]& S, b$ y k* |- z' I4 t- H7 a
TASK [common : Registering common role has run] *******************************************************************************************************************
+ q. d" y: @4 G+ q6 l$ v: U8 Vskipping: [controller1]
2 K" m; M% L9 i" x, Tskipping: [controller2]
, m2 ~, J2 `. S9 X( B4 _. P" |/ ]( }& `skipping: [controller3]
) d7 j! M1 I9 g0 v' O% XTASK [mariadb : include] ******************************************************************************************************************************************
- ]8 \5 Y, _8 [. ^2 i8 v4 B5 Jincluded: /usr/share/kolla-ansible/ansible/roles/mariadb/tasks/deploy.yml for controller1, controller2, controller3
5 I6 Z8 ?9 ]/ H8 MTASK [mariadb : include] ******************************************************************************************************************************************
! ]+ e( V5 a& g6 Y8 Mincluded: /usr/share/kolla-ansible/ansible/roles/mariadb/tasks/config.yml for controller1, controller2, controller3
. [' L' s0 n* m( `$ ?TASK [mariadb : Ensuring config directories exist] ****************************************************************************************************************
# K7 h& t7 y! A( _; ^) ^6 Sok: [controller2] => (item={'value': {u'enabled': True, u'image': u'kolla/centos-binary-mariadb:queens', u'group': u'mariadb', u'volumes': [u'/etc/kolla//mariadb/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'mariadb:/var/lib/mysql', u'kolla_logs:/var/log/kolla/'], u'container_name': u'mariadb'}, 'key': u'mariadb'})! T9 d' }) I/ q6 ]2 {/ J5 u* x
ok: [controller3] => (item={'value': {u'enabled': True, u'image': u'kolla/centos-binary-mariadb:queens', u'group': u'mariadb', u'volumes': [u'/etc/kolla//mariadb/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'mariadb:/var/lib/mysql', u'kolla_logs:/var/log/kolla/'], u'container_name': u'mariadb'}, 'key': u'mariadb'})
. c* U1 ?- z7 i3 C& l) M+ r2 o+ \3 gok: [controller1] => (item={'value': {u'enabled': True, u'image': u'kolla/centos-binary-mariadb:queens', u'group': u'mariadb', u'volumes': [u'/etc/kolla//mariadb/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'mariadb:/var/lib/mysql', u'kolla_logs:/var/log/kolla/'], u'container_name': u'mariadb'}, 'key': u'mariadb'})5 W, R1 O+ a H- J
TASK [mariadb : Copying over config.json files for services] ******************************************************************************************************! A* d2 b& i0 t0 t+ ?% g
ok: [controller2] Z% d8 C0 J+ [9 N$ x+ `
ok: [controller3]
' q( d$ ~3 g0 ?1 u5 Zok: [controller1]# Y# h& q6 J$ G; f& r9 i* v2 {7 p
TASK [mariadb : Copying over galera.cnf] **************************************************************************************************************************
6 @7 [% f. v4 @; B+ t8 s[WARNING]: _execute_module no longer honors the tmp parameter. Action plugins should set self._connection._shell.tmpdir to share the tmpdir
; v7 O8 p9 [4 b1 x' D[WARNING]: _execute_module no longer honors the tmp parameter. Action plugins should set self._connection._shell.tmpdir to share the tmpdir! a9 b1 R$ J9 V1 w) U: c
[WARNING]: _execute_module no longer honors the tmp parameter. Action plugins should set self._connection._shell.tmpdir to share the tmpdir
# P- `5 t5 H- _; Yok: [controller3], B( H+ f6 V! }6 \/ E
ok: [controller2]( m$ P9 X" f3 }# J: \' y% k
ok: [controller1]8 \: B2 z R1 Y' Y7 x
TASK [mariadb : Copying over wsrep-notify.sh] *********************************************************************************************************************
3 s: B/ ~! l6 d7 d g) p* Kok: [controller2] => (item={'value': {u'enabled': True, u'image': u'kolla/centos-binary-mariadb:queens', u'group': u'mariadb', u'volumes': [u'/etc/kolla//mariadb/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'mariadb:/var/lib/mysql', u'kolla_logs:/var/log/kolla/'], u'container_name': u'mariadb'}, 'key': u'mariadb'})
$ Y# a4 _% C8 E7 m! ^( Iok: [controller1] => (item={'value': {u'enabled': True, u'image': u'kolla/centos-binary-mariadb:queens', u'group': u'mariadb', u'volumes': [u'/etc/kolla//mariadb/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'mariadb:/var/lib/mysql', u'kolla_logs:/var/log/kolla/'], u'container_name': u'mariadb'}, 'key': u'mariadb'})
4 [' k4 Z9 L6 u6 [ok: [controller3] => (item={'value': {u'enabled': True, u'image': u'kolla/centos-binary-mariadb:queens', u'group': u'mariadb', u'volumes': [u'/etc/kolla//mariadb/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'mariadb:/var/lib/mysql', u'kolla_logs:/var/log/kolla/'], u'container_name': u'mariadb'}, 'key': u'mariadb'})
# b" ~2 k) ], G0 x. E! \, OTASK [mariadb : Check mariadb containers] *************************************************************************************************************************6 {1 x, C/ \3 A8 X4 o8 Q
changed: [controller3] => (item={'value': {u'enabled': True, u'image': u'kolla/centos-binary-mariadb:queens', u'group': u'mariadb', u'volumes': [u'/etc/kolla//mariadb/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'mariadb:/var/lib/mysql', u'kolla_logs:/var/log/kolla/'], u'container_name': u'mariadb'}, 'key': u'mariadb'})
5 G( Z' c0 y1 [! X4 [2 }9 H7 zchanged: [controller1] => (item={'value': {u'enabled': True, u'image': u'kolla/centos-binary-mariadb:queens', u'group': u'mariadb', u'volumes': [u'/etc/kolla//mariadb/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'mariadb:/var/lib/mysql', u'kolla_logs:/var/log/kolla/'], u'container_name': u'mariadb'}, 'key': u'mariadb'})
# D6 b$ U$ @- C% t9 N" bchanged: [controller2] => (item={'value': {u'enabled': True, u'image': u'kolla/centos-binary-mariadb:queens', u'group': u'mariadb', u'volumes': [u'/etc/kolla//mariadb/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'mariadb:/var/lib/mysql', u'kolla_logs:/var/log/kolla/'], u'container_name': u'mariadb'}, 'key': u'mariadb'})
" M a" u" h5 C9 B/ |: m4 S1 }TASK [mariadb : include] ******************************************************************************************************************************************% K2 a( N1 f2 K8 W( F, g' k
included: /usr/share/kolla-ansible/ansible/roles/mariadb/tasks/bootstrap.yml for controller1, controller2, controller3
9 K3 P0 i3 `. E& |6 }; U8 O( dTASK [mariadb : set_fact] *****************************************************************************************************************************************
. B! c$ i+ K8 ?$ V, Lok: [controller1]
! t3 H8 K- l! ^7 |6 C" Nok: [controller2]
6 ^ d* N; \6 w. rok: [controller3]
: u6 X4 ?' H$ NTASK [mariadb : include] ******************************************************************************************************************************************0 V) V7 O. i' p4 p* G
included: /usr/share/kolla-ansible/ansible/roles/mariadb/tasks/lookup_cluster.yml for controller1, controller2, controller3
6 e' Q3 z1 d9 Y; yTASK [mariadb : Cleaning up temp file on localhost] ***************************************************************************************************************" Y( n8 t8 d3 ], G) `! Z! W& o& @
ok: [controller1 -> localhost]! a2 a) n' r5 x
TASK [mariadb : Creating temp file on localhost] ******************************************************************************************************************3 d; o% s2 W( F$ L; w: q" e
ok: [controller1 -> localhost]- w. X! | x5 d9 n; t5 U0 L) L3 O& O3 z
TASK [mariadb : Creating mariadb volume] **************************************************************************************************************************
/ t A1 j6 R! X+ vok: [controller1]; n3 J6 J8 K. L$ o+ Z& s- ~
ok: [controller2]: D- g5 l: x# s/ N+ x9 l
ok: [controller3]
5 ^$ g2 O8 p6 g4 {' XTASK [mariadb : Writing hostname of host with existing cluster files to temp file] ********************************************************************************
' ?/ K; s+ m$ \2 v[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 9 R4 r X# q$ s+ C
2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.
* T1 C% `7 b% v; O0 {) q0 ^[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 5 m& S1 k: h2 P( Z
2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.6 a: G* \6 N$ m" h. l
[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version ' I, j* H4 M7 h2 x3 ] W# [
2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg./ z7 t" m% B3 E. M+ s! K
ok: [controller1 -> localhost]
5 p) \, Y( n" d+ k1 |ok: [controller2 -> localhost]
# f" M" Q9 d& C7 b: ?ok: [controller3 -> localhost]
5 m, G) ]" ~) V+ r! Z; G6 CTASK [mariadb : Registering host from temp file] ******************************************************************************************************************/ L+ E' p& l* H) u# G5 ~& w- H
ok: [controller1]
7 V& E" k( T& o3 i/ D: z# Wok: [controller2]% A' P- D: m9 a2 q1 I% t
ok: [controller3]
4 d- f6 m' r2 L0 l$ x1 HTASK [mariadb : Cleaning up temp file on localhost] ***************************************************************************************************************
6 ~; o1 g2 H H' c7 Z1 v) g* @ok: [controller1 -> localhost]' S) K# O4 G) }
TASK [mariadb : include] ******************************************************************************************************************************************
' C+ [+ A3 Z8 Uskipping: [controller1]
1 c3 v4 W. I5 ^0 k1 O+ ?" O F/ y5 kskipping: [controller2]
! W6 ?0 ^& x% T. |! v# Jskipping: [controller3]4 ~7 w* a* A9 p$ E6 e$ e
TASK [mariadb : include] ******************************************************************************************************************************************: t N @ m. c7 ~) O
included: /usr/share/kolla-ansible/ansible/roles/mariadb/tasks/recover_cluster.yml for controller1, controller2, controller3- X ~' {8 s1 R" e6 p5 p
TASK [mariadb : fail] *********************************************************************************************************************************************" }! S, ~0 F# q! _3 A5 Z3 | S9 J4 y
skipping: [controller1]: y; P9 ~& V' ^1 h
skipping: [controller2]7 @; k; y8 b+ k8 K' X
skipping: [controller3]
+ y6 K: |4 R! `5 V- yTASK [mariadb : Cleaning up temp file on mariadb hosts] ***********************************************************************************************************1 P; |+ I7 T& i, J4 J5 b4 ? b
ok: [controller2]
7 u+ D+ s! r' c' k( Q+ rok: [controller1]
' d" [6 n D* n5 a2 p! \ok: [controller3]% m8 `5 A: g3 Y6 b# s7 N s
TASK [mariadb : Cleaning up temp file on localhost] ***************************************************************************************************************
1 E1 {6 B. Y. ~" Bok: [controller1 -> localhost]
$ q1 K7 c8 i% cTASK [mariadb : Stop MariaDB containers] **************************************************************************************************************************! X; P- Y1 ~/ Y; b3 ~
ok: [controller2]' M+ b5 p( ^; `( e
ok: [controller1]
( }4 R2 N# b. T C. cok: [controller3]8 }' t' B) U" I
TASK [mariadb : Run MariaDB wsrep recovery] ***********************************************************************************************************************
1 z2 c4 I* @, G* |changed: [controller1]! V/ l8 h, O( k) q
changed: [controller2]
* W% P( F# ? i2 xchanged: [controller3]3 z9 \2 A0 t0 Y i4 n9 N6 W
TASK [mariadb : Copying MariaDB log file to /tmp] *****************************************************************************************************************
& |% S4 i! [! r+ H* H- Schanged: [controller3]1 V% g' \; }8 {# l
changed: [controller2]
4 G- `0 S; h% H9 Z6 d1 ychanged: [controller1]
5 B) h8 Z& I, ATASK [mariadb : Get MariaDB wsrep recovery seqno] *****************************************************************************************************************. [3 L( y( D/ D
changed: [controller2]4 g( I1 Q. t& R! ]8 ~9 V: _' {8 h
changed: [controller1]5 q% M* e6 ` K9 M
changed: [controller3]
9 Y# e8 B) Q1 {6 dTASK [mariadb : Removing MariaDB log file from /tmp] **************************************************************************************************************
4 u( ] K& G" y$ P* i0 rok: [controller2]6 E6 |: V6 T2 L7 c6 w: E/ |( ^
ok: [controller1]9 Z p/ C: [. s* Y
ok: [controller3]) F! R$ t6 o9 Q( Z, |" }* q
TASK [mariadb : Registering MariaDB seqno variable] ***************************************************************************************************************
, @2 D- S, S/ k; H! f, qok: [controller1]' `* `8 ]. `/ p" N x6 n9 x3 W
ok: [controller2]
5 ?7 f p2 V) J) m, K7 _5 nok: [controller3]
& i) b+ ^8 A4 w) z$ lTASK [mariadb : Comparing seqno value on all mariadb hosts] *******************************************************************************************************
% P. G: h6 X$ x$ uok: [controller2] => (item=controller1)9 W( N7 S: s) z- \# Z" h8 f$ V
ok: [controller1] => (item=controller1)
. R* ]& ?* a* s& U. b$ Y6 Cok: [controller3] => (item=controller1)' j& m2 }* ?8 K8 O$ p
ok: [controller2] => (item=controller2)
. R0 f) M- N$ e# pok: [controller3] => (item=controller2)4 T" Y9 {8 `7 y% H7 M2 o5 b, x7 o
ok: [controller1] => (item=controller2)
4 c8 _8 F8 l- C) G6 vok: [controller2] => (item=controller3)" ^, K3 K: h2 I# u
ok: [controller3] => (item=controller3)
. r4 x% c* E* X+ m6 |" Yok: [controller1] => (item=controller3)
2 P6 C8 s* b5 B' {, Q/ ^TASK [mariadb : Writing hostname of host with the largest seqno to temp file] *************************************************************************************& U1 n y5 A& s8 L/ Z
skipping: [controller3]$ w4 b* a: c# S/ k) m" [1 t
ok: [controller1 -> localhost]5 w4 ~6 O, V4 X* ?, s
ok: [controller2 -> localhost]
3 r N, g. U4 w) f+ hTASK [mariadb : Registering mariadb_recover_inventory_name from temp file] ****************************************************************************************
- e" i% \1 J K, m! N3 Mok: [controller1]
5 l) [( W; L% }& H+ d2 W+ Sok: [controller2]
3 \# q# u" q$ d( M2 {ok: [controller3]
; P% }2 S/ x) n: pTASK [mariadb : set_fact] *****************************************************************************************************************************************
- |( m/ ^- i1 T' i2 Wchanged: [controller1]
. H6 d1 h9 K0 {changed: [controller2]) t% v# A* x) Y Q+ r
changed: [controller3], X5 _' X: g1 t8 {* ?# F3 c
TASK [mariadb : Copying grastate.dat file from MariaDB container in bootstrap host] *******************************************************************************
: f4 x/ T( Y- dskipping: [controller1]% p0 w7 `$ i* y7 V1 u# |: f: P/ Y
skipping: [controller3]( X K; ^+ C+ Z3 Z3 H
ok: [controller2]
" E! V! W% }: h( W' T2 H' PTASK [mariadb : Set grastate.dat file from MariaDB container in bootstrap host] ***********************************************************************************& V$ w- j/ v/ }% F- F# t" N
skipping: [controller1]1 F7 X4 K0 T2 _$ q
skipping: [controller3]
) ~% U7 v- V0 S9 M8 P8 u: D% {changed: [controller2]0 l, c( b/ W; T$ g% f% N- [
TASK [mariadb : Copying grastate.dat file to mariadb container] ***************************************************************************************************! o" m+ e. Q. y I& Q
skipping: [controller1]: P( N8 z, E5 j* h
skipping: [controller3]
7 q u1 Z9 v/ s0 x9 h' \ok: [controller2]
0 U3 u' Z' o' k% ^/ qTASK [mariadb : Starting first MariaDB container] *****************************************************************************************************************9 K' d6 I+ |6 W& S$ W
skipping: [controller1]
6 d j7 c* L7 W" Qskipping: [controller3]' u7 \8 a9 Z3 T! C( p6 W' J9 P
changed: [controller2]; k5 K( t+ p2 V$ F2 l. ~
TASK [mariadb : Wait for first MariaDB container] *****************************************************************************************************************
1 ~6 i) b# ?' d7 g6 c0 f0 R Eskipping: [controller1]& y+ C* B2 _6 @" o9 @' l! E
skipping: [controller3]# o7 `1 E9 j7 X/ I& n+ ?
[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|success` use `result is success`. This feature will be removed in version
- V! V- b: L( N2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.5 ]0 I5 q2 D( Y2 V& e
FAILED - RETRYING: Wait for first MariaDB container (10 retries left).
2 i" \3 ^: R+ m# M4 @1 j2 @ok: [controller2]
9 C1 c% B: N. \" yTASK [mariadb : Set first MariaDB container as primary] ***********************************************************************************************************
7 D1 s' f. I! K [" v- J: m& Zskipping: [controller1]
: Z+ [7 q; ?% x" g1 Fskipping: [controller3]
. u) @" d" P* r9 n' ]changed: [controller2]
\2 ?- y' Z* b) ITASK [mariadb : Wait for MariaDB to become operational] ***********************************************************************************************************( b) W& O+ g( I: k. }4 x6 O/ v! y* t
skipping: [controller1]
1 ]9 Y$ u3 f n) ^+ eskipping: [controller3]
2 y3 \8 ?* w/ bok: [controller2]
' S6 J$ l7 ?' kTASK [mariadb : Restart slave MariaDB container] ******************************************************************************************************************1 T% Q0 m/ n# {/ w9 y1 s
skipping: [controller2]; h [, d; {2 H
changed: [controller3]
& a1 E! p# h7 E+ C; Y2 Gchanged: [controller1]' |" v+ ^% g' F0 D1 S' Y
TASK [mariadb : Wait for slave MariaDB] ***************************************************************************************************************************
- |( e$ K+ v- \skipping: [controller2]
8 c# Z( k' q% p5 n- W+ w[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|success` use `result is success`. This feature will be removed in version
8 a& L+ z( S: a7 C* D2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.) q7 ]4 U1 m. ?) j
FAILED - RETRYING: Wait for slave MariaDB (10 retries left).$ f0 {# i: Y) I% l" I7 `3 w* o
[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|success` use `result is success`. This feature will be removed in version 8 R6 S+ }; K$ v6 S
2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.
# e! k0 V# h( v) R+ f2 N0 gFAILED - RETRYING: Wait for slave MariaDB (10 retries left).. x% [( [( v% A
ok: [controller3]1 a: E y! `2 g
ok: [controller1]
# v( a6 W% M- `[WARNING]: flush_handlers task does not support when conditional
9 Z+ C" v2 ^$ F; J6 z5 [5 H% k# G* I
RUNNING HANDLER [mariadb : restart slave mariadb] *****************************************************************************************************************
4 W/ j6 n$ g/ `+ r0 _, B; S( dskipping: [controller3]0 v& `3 w" p/ D% @" n& G
skipping: [controller1]) w4 [0 ?+ n4 N1 m% |
skipping: [controller2]2 _7 \6 i0 V) J7 j6 R, U
RUNNING HANDLER [mariadb : restart master mariadb] ****************************************************************************************************************' F& h3 N$ h! l) @4 ?
skipping: [controller3]
" A, v! D5 a0 ^. j' Y4 ]1 ^$ _skipping: [controller1]
9 z( j$ G" T& A% P0 C9 Mskipping: [controller2]
8 {1 o/ j( A$ s/ H% hTASK [mariadb : include] ******************************************************************************************************************************************: `6 }; B# X! v$ T( e3 @
included: /usr/share/kolla-ansible/ansible/roles/mariadb/tasks/register.yml for controller1, controller2, controller3" K% s) c6 P2 b i/ }
TASK [mariadb : Creating haproxy mysql user] **********************************************************************************************************************
$ c/ j7 x$ G. E$ n/ zok: [controller1]
) Z5 O( s# W. T* J ^" oTASK [mariadb : Cleaning up facts] ********************************************************************************************************************************
; N3 z2 b( B8 C! _4 k/ T" X! H! Tok: [controller1]
# p* O! {- a# ~' c7 r, {- n* Uok: [controller2]' n0 B3 ?8 ^* d8 v# v0 o( P
ok: [controller3]
' t6 h, a: A8 i- F: y# Q$ l8 cTASK [mariadb : include] ******************************************************************************************************************************************
2 \% o# A6 m1 Gincluded: /usr/share/kolla-ansible/ansible/roles/mariadb/tasks/check.yml for controller1, controller2, controller38 F( k4 B& \. x
TASK [mariadb : Waiting for MariaDB service to be ready through VIP] **********************************************************************************************
+ L" E- Y R: L[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|success` use `result is success`. This feature will be removed in version
6 K) `! T/ _* x* `0 e& O& n2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.
% I0 l5 g; @4 l0 _8 `- u3 [5 }ok: [controller1]
3 [7 Q9 p2 M( X# g[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|success` use `result is success`. This feature will be removed in version W& ~* x5 G! ]6 B
2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.0 c, ?( i. _6 F/ k; ^3 ]
[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|success` use `result is success`. This feature will be removed in version
% I/ H1 q5 K2 O2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.
' n4 H5 L1 n. xok: [controller2]( Q. w) g; U9 G
ok: [controller3]
1 I) s: n5 r# J! l% APLAY RECAP ******************************************************************************************************************************************************** Y% a& }( v6 u. |
controller1 : ok=37 changed=6 unreachable=0 failed=0 skipped=15 rescued=0 ignored=0 ' P2 o5 }2 g& J, ^
controller2 : ok=37 changed=8 unreachable=0 failed=0 skipped=10 rescued=0 ignored=0 ' c7 l4 L- c2 }
controller3 : ok=31 changed=6 unreachable=0 failed=0 skipped=16 rescued=0 ignored=0
$ a+ x4 U2 w: d4 j3 R
9 K% b1 D% R" b5 w' N- ` |恢复正常。# Y/ F H( C) M8 Y- M6 A
9 i& x; T. D, M- I- `7 T
# ~3 v; C0 T5 B: Q
有时候通过一些特殊手段可以帮助我们解决一些特别的问题，与其长时间尝试老方法，不如来点新的方式试试或许不一样的效果。* }) L$ Q* I$ a' B7 X
& e; q s- b7 D5 @1 a M- S B4 S
( n% w; k* J, x% G" c
我们首先是因为数据库恢复出问题，无法恢复数据，， 检查数据的库的值，8 [+ q! H' M# L' B6 R
cat /var/lib/docker/volumes/mariadb/_data/grastate.dat 中seqno值，若该值在所有节点中存在唯一得最大值7 q: N7 Q$ I g5 u2 n( B% k
然后我们保留这个节点上数据，$ s4 K( q: g. D
删除其他节点上的数据文件/ Z* a3 _- H5 ^- x, @
然后通过scp或者rsync同步保留节点的数据文件 （根据个人喜好同步文件，本人建议使用rsync）3 V' W; s* H( m9 h$ R# | Y
然后再执行kolla-ansible数据库mariadb_recovery恢复命令：
) l1 ?6 t7 E) }* O+ x
& o' g# ]/ f) I+ w( }3 ^ x5 l7 |2 D( ] H' ]& R/ a! V, D: Q0 m2 J
, S& I* O, P* d
) N1 h* j) c; r5 ^
差不多就可以完成数据库集群恢复了。
2 i- O" e/ k/ E# b |
|
发表于 2021-10-18 11:03:46