|
|
Jun 7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log" `, q& @( l% `! N4 {
Jun 7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
; b- ^, ^1 z! p! @Jun 7 14:35:18 controller2 systemd: Started RabbitMQ broker.' j& n" C7 r5 j9 u
Jun 7 14:35:18 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548943, rc=0, cib-update=594832, confirmed=true)
( Q7 S) I- Y$ ]' J9 ?3 yJun 7 14:35:18 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}- n% B( }0 f$ G6 F5 x# C0 C. X% B
Jun 7 14:35:18 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548944, rc=0, cib-update=594833, confirmed=false): ~6 y5 m4 R" \2 r1 [& K, v
Jun 7 14:35:19 controller2 filebeat: 2024-06-07T14:35:19.300+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890090,"time":{"ms":4}},"total":{"ticks":2986430,"time":{"ms":11},"value":2986430},"user":{"ticks":2096340,"time":{"ms":7}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384740183}},"memstats":{"gc_next":33883984,"memory_alloc":18558592,"memory_total":69310713440},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.47,"15":2.54,"5":2.58,"norm":{"1":0.0618,"15":0.0635,"5":0.0645}}}}}}
/ x$ l) \, l! W- ZJun 7 14:35:19 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump
) j6 \& m6 N6 {" P/ L5 W% ~; ]5 ?Jun 7 14:35:19 controller2 rabbitmq-server: init terminating in do_boot ()
/ U7 j9 l& G7 Z- ~7 RJun 7 14:35:19 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE" b! q& l: m" Q6 E! {
Jun 7 14:35:20 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ..., c! @# {3 a' q- P/ [4 e+ V
Jun 7 14:35:20 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown& [6 T# }# Z" b9 m
Jun 7 14:35:20 controller2 rabbitmqctl: DIAGNOSTICS4 Q+ R( A @3 m! d2 ?/ ~ V/ @
Jun 7 14:35:20 controller2 rabbitmqctl: ===========
2 i0 n. H$ \5 m$ h7 S( D3 _5 v6 L% |Jun 7 14:35:20 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']9 Z$ M& F# L$ z' U) L2 F
Jun 7 14:35:20 controller2 rabbitmqctl: rabbit@controller2:* V5 J1 [# s" d D; ~! x9 _
Jun 7 14:35:20 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2
3 C& \+ ~9 ^% p# K4 _; gJun 7 14:35:20 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all! [( L7 Q* B- }
Jun 7 14:35:20 controller2 rabbitmqctl: no other nodes on controller2
* o( i+ N, c& a7 n- {Jun 7 14:35:20 controller2 rabbitmqctl: * suggestion: start the node
1 ^2 [8 D- _9 z4 C7 O7 {Jun 7 14:35:20 controller2 rabbitmqctl: current node details:
8 w! h1 @! E3 R: QJun 7 14:35:20 controller2 rabbitmqctl: - node name: 'rabbitmqctl-19643@controller2'- o* u& @. G, ^0 X* [
Jun 7 14:35:20 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq- g3 X9 @7 ?. M6 }& U/ X1 H1 c e
Jun 7 14:35:20 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==
( V2 W6 N, `8 t+ _3 I: t X1 sJun 7 14:35:20 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=26 M) a+ V \9 z9 j" n
Jun 7 14:35:20 controller2 systemd: Unit rabbitmq-server.service entered failed state.
2 C q" ~8 B+ x8 B, `5 t- S* GJun 7 14:35:20 controller2 systemd: rabbitmq-server.service failed.' \" B* I( w9 I
: A+ V, ]4 `: @; f$ c
F: t5 R' J* e+ }( I7 _1 }# R& Y7 a( S0 w5 q: z" v3 Z- J
Jun 7 14:35:23 controller2 dhcpd: isc-dhcpd-4.2.5
+ e. p/ c5 q' g% B9 y2 JJun 7 14:35:25 controller2 systemd: Starting RabbitMQ broker...0 b8 W3 W$ S J% Q9 T! w3 o; }
Jun 7 14:35:25 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984
- o* @ D) g9 h8 l8 d# i2 UJun 7 14:35:25 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984
1 P0 ^/ [4 K) r! |0 t9 JJun 7 14:35:26 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...4 V2 k2 z1 H: M
Jun 7 14:35:26 controller2 rabbitmqctl: pid is 20016 ...
# I% L p! e2 W& [3 q3 QJun 7 14:35:27 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.
# \0 c6 ~ D- T- LJun 7 14:35:27 controller2 rabbitmq-server: ## ## Licensed under the MPL. See http://www.rabbitmq.com/' c- P: }4 `3 n& ~) {3 z* ^
Jun 7 14:35:27 controller2 rabbitmq-server: ## ##, A0 `8 X+ [* t, F7 X$ `1 z* b+ [; V
Jun 7 14:35:27 controller2 rabbitmq-server: ########## Logs: /var/log/rabbitmq/rabbit@controller2.log' W; n7 g3 W5 m3 U( Q6 n5 n
Jun 7 14:35:27 controller2 rabbitmq-server: ###### ## /var/log/rabbitmq/rabbit@controller2-sasl.log
. `1 D$ w! r NJun 7 14:35:27 controller2 rabbitmq-server: ##########
8 c" X( p6 w5 t v; w: pJun 7 14:35:27 controller2 rabbitmq-server: Starting broker...
1 l5 l$ H2 A2 J. ]$ j% K0 bJun 7 14:35:27 controller2 rabbitmq-server: BOOT FAILED
8 s* u; I; D. k3 Q8 } PJun 7 14:35:27 controller2 rabbitmq-server: ===========6 C8 [ s3 Q( e- k- ?
Jun 7 14:35:27 controller2 rabbitmq-server: Error description:
# H T( }! ^$ Q' ?5 O) q. a; N: |; mJun 7 14:35:27 controller2 rabbitmq-server: {boot_step,recovery,
( A, E/ D% ?* a2 Q% Y' c7 }Jun 7 14:35:27 controller2 rabbitmq-server: {badmatch,
* {# q/ `. O! u1 k5 Q2 yJun 7 14:35:27 controller2 rabbitmq-server: {error,
7 g* J S. D5 Y! A) KJun 7 14:35:27 controller2 rabbitmq-server: {{{badmatch,
5 g/ ?4 O, K5 iJun 7 14:35:27 controller2 rabbitmq-server: {error,, m" j$ [3 ]9 B0 S# ]7 N
Jun 7 14:35:27 controller2 rabbitmq-server: {not_a_dets_file,
1 {+ E2 T T7 U# c( T. T/ C' ]+ oJun 7 14:35:27 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
7 Y$ B$ u2 H. V K( l$ `) S; g. RJun 7 14:35:27 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
; R4 g, g7 U/ @, A) t T6 tJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
2 S: p. L4 k: s" | c5 GJun 7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,1 e9 ?3 E+ F3 I! n% i
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},* `/ g% d# t1 F, ]. f( V
Jun 7 14:35:27 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},! P8 s q% w) m8 B* J
Jun 7 14:35:27 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,- f& c, o2 a% f$ S# A7 J
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},# c2 C+ u/ \. t6 y4 P9 T9 O& K3 c
Jun 7 14:35:27 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,; l( b9 g: ], l) V) v6 w% u
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},5 W4 x+ _, s8 J3 q, H% I
Jun 7 14:35:27 controller2 rabbitmq-server: transient,4294967295,worker,' T8 i1 L, o4 m: v
Jun 7 14:35:27 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}
4 @% F. F* D4 g! R) TJun 7 14:35:27 controller2 rabbitmq-server: Log files (may contain more information):1 n+ p x' c% b0 V, n
Jun 7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
3 r% r- S/ S8 JJun 7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
: r# c2 a' e# EJun 7 14:35:27 controller2 rabbitmq-server: Stack trace:
( ^, C3 }) p" W, i% CJun 7 14:35:27 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,
) `, p" v) ~2 D! |& j4 f8 @Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},/ T& c8 ~4 x9 V! m
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_variable_queue,start,1,. V+ v( n. h4 J
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},
A+ ]% u G4 M6 }$ E5 zJun 7 14:35:27 controller2 rabbitmq-server: {line,402}]},5 |6 Z4 ]; e) X2 \
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]},% H3 z$ a& `" C
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},* F8 @0 _9 B6 U. O# v4 p Z( W
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},1 p8 h& U: y% @" A
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},0 V$ T5 {. }* F& `
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,
) f+ f; @' x* B) EJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},
8 [& _ B# ~2 `Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]; m9 ~+ j) ^" c# @* \. b
2 z* U( Q t0 Q5 H8 s9 ~% q$ f# V1 @. Q
0 L7 X/ R, i& vJun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20504]: ERROR: RabbitMQ server is failed.* c7 f5 `1 L4 D6 a; Z+ t6 b
Jun 7 14:35:28 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548944, rc=1, cib-update=594834, confirmed=false)# \5 t i) ?0 r- U
Jun 7 14:35:28 controller2 rabbitmq-server: BOOT FAILED+ O% o& t* X. \( b* ?
Jun 7 14:35:28 controller2 rabbitmq-server: ===========) L; P# Y9 y/ Y% V6 o
Jun 7 14:35:28 controller2 rabbitmq-server: Error description:) T$ J6 R/ U# @( H: ?
Jun 7 14:35:28 controller2 rabbitmq-server: {could_not_start,rabbit,4 {( z# C/ t0 z0 m1 T! d% k; p" g' u7 ]
Jun 7 14:35:28 controller2 rabbitmq-server: {bad_return,8 g* x2 K: |* Y2 e/ W( i: `
Jun 7 14:35:28 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},% x2 q+ m' G/ @2 _9 t2 I
Jun 7 14:35:28 controller2 rabbitmq-server: {'EXIT',
# j" h8 o5 v6 U" }% UJun 7 14:35:28 controller2 rabbitmq-server: {rabbit,failure_during_boot,2 }( _0 ?0 X3 ?4 l9 X
Jun 7 14:35:28 controller2 rabbitmq-server: {boot_step,recovery,5 F5 p/ `: U; J- }" \( _4 e8 h& l
Jun 7 14:35:28 controller2 rabbitmq-server: {badmatch,
) F0 u9 _* q/ p, [# o. @1 v' Y3 \ jJun 7 14:35:28 controller2 rabbitmq-server: {error,
1 q: A7 b. L. bJun 7 14:35:28 controller2 rabbitmq-server: {{{badmatch,
8 O" @+ C$ _/ H% }" Z T8 A! T, o& LJun 7 14:35:28 controller2 rabbitmq-server: {error,; S( m; _: J' c, A! [* n8 t
Jun 7 14:35:28 controller2 rabbitmq-server: {not_a_dets_file,, J5 l6 j ]; q) p, G% {; @4 |: H
Jun 7 14:35:28 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
/ [0 Q5 q" x+ i: A6 ?Jun 7 14:35:28 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
0 O" u0 J. j! a% jJun 7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
5 v, C1 U& D3 Z- JJun 7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,
7 N# C( @ [8 Y7 z* {5 P3 t& B; A- ~6 ~( b M
Jun 7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
9 E2 M4 Y2 q6 V! OJun 7 14:35:28 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
4 s6 v$ X6 P5 _) [1 n3 R7 g$ }Jun 7 14:35:28 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
! |: ]5 U* U" y6 |/ ]! HJun 7 14:35:28 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
& q$ w! }# _& P% FJun 7 14:35:28 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,0 V" T& w2 d0 U+ ~
Jun 7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},$ K0 ?* }$ l2 Y3 A6 R8 \' R/ g1 \
Jun 7 14:35:28 controller2 rabbitmq-server: transient,4294967295,worker,
6 D. \& P4 |; w- x q5 `Jun 7 14:35:28 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}
. R [* P& J4 A) R6 m: L) u7 H5 R, h8 TJun 7 14:35:28 controller2 rabbitmq-server: Log files (may contain more information):1 y( ?) r" l. p
Jun 7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
$ C% \7 w6 r! V/ d6 [Jun 7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log. [2 U7 A* J! _3 Q
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: ERROR: RabbitMQ server is failed., p# _% `% d! ~, C
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: INFO: Resource not running./ ?1 S5 s7 E( x3 z0 g
Jun 7 14:35:28 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548946, rc=0, cib-update=594835, confirmed=true)
; G8 W6 I1 c J4 j* |0 `Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20544]: ERROR: RabbitMQ server is failed.( [/ k/ i* N( f k: k/ |% @! q
' C8 x6 J4 q2 t* U* K1 ~Jun 7 14:35:29 controller2 systemd: Started RabbitMQ broker.
' y$ C/ V, Q* B( p: YJun 7 14:35:29 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
2 s1 b. w3 `3 B2 @Jun 7 14:35:29 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548947, rc=0, cib-update=594836, confirmed=true)* l4 f/ F4 D$ G% v: W& |; r
Jun 7 14:35:29 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548948, rc=0, cib-update=594837, confirmed=false)
4 Q4 ~) B C, B* T; l8 B% oJun 7 14:35:31 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump
5 n% F( s6 D8 k' P$ F; lJun 7 14:35:31 controller2 rabbitmq-server: init terminating in do_boot ()
3 B( m* S3 O+ M) z9 m4 ]Jun 7 14:35:31 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE, a& y2 l; o! W' m" o V" C
Jun 7 14:35:31 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...
! I2 s: ?4 }1 d! S8 \% OJun 7 14:35:31 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown
% W; h, C2 X1 J" C4 g/ mJun 7 14:35:31 controller2 rabbitmqctl: DIAGNOSTICS& ^' H, I$ {9 ]6 `
Jun 7 14:35:31 controller2 rabbitmqctl: ===========
5 W: K9 S6 \9 {3 h- k; ]. rJun 7 14:35:31 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']7 s! X2 s/ q9 I9 E- {& Y( P
Jun 7 14:35:31 controller2 rabbitmqctl: rabbit@controller2:: K+ b' B: J8 L6 ~+ s! D* k
Jun 7 14:35:31 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2, u) o- G8 N. K
Jun 7 14:35:31 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all0 t4 T' d1 [% j! g: n
Jun 7 14:35:31 controller2 rabbitmqctl: no other nodes on controller2; H" l; n8 O4 h' l4 R; Z; W5 r
Jun 7 14:35:31 controller2 rabbitmqctl: * suggestion: start the node
3 u. F* W# h4 m+ O; D HJun 7 14:35:31 controller2 rabbitmqctl: current node details:2 j3 z6 L6 u- V- ^) e7 K5 [
Jun 7 14:35:31 controller2 rabbitmqctl: - node name: 'rabbitmqctl-20636@controller2'
2 M; A# i. \9 g# M) V; kJun 7 14:35:31 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq( A. A$ @- W0 n6 f! j$ x3 [# | U; d
Jun 7 14:35:31 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==* A2 W4 c8 a$ x% _' F( T. Q/ M0 h
Jun 7 14:35:31 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=21 \4 N+ S2 U4 J2 d+ I- d a
Jun 7 14:35:31 controller2 systemd: Unit rabbitmq-server.service entered failed state.
: v! g" x' y6 \1 {% OJun 7 14:35:31 controller2 systemd: rabbitmq-server.service failed.0 Z* N8 x) K: o- N: I
Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.127:9200)): Get "http://172.24.110.127:9200": dial tcp 172.24.110.127:9200: connect: connection timed out, C7 z% ?/ x7 ?' j8 d& K
Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.127:9200)) with 84247 reconnect attempt(s)
8 p7 L r' M2 u$ x: l( X7 fJun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer( h3 g$ k% k& i: F4 x
Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher] pipeline/retry.go:217 done
$ r+ j: n8 a/ hJun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.125:9200)): Get "http://172.24.110.125:9200": dial tcp 172.24.110.125:9200: connect: connection timed out
; m! Q3 _5 Q \7 A* d1 qJun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.125:9200)) with 84378 reconnect attempt(s)
* x; ` j w0 SJun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer. b8 P U) }' e7 S5 ^5 f
Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher] pipeline/retry.go:217 done
8 z0 a( Q* d! I! s" V0 wJun 7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.186 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] Start to report status of agent
/ ]% f4 ?' U- A) s# K* BJun 7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.211 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] report agent status with {u'binary': u'startKingCloudOSAgent', u'host': u'controller2.ksc', u'uuid': u'9f541bc8-e6db-4816-ae39-0eb60cc58166', u'report_count': 3145039, u'state': u'up'}+ J& g) q( h7 D/ v" |7 N
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22417]: ERROR: RabbitMQ server is failed.
" E, d1 M7 N. S4 J, QJun 7 14:35:39 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548948, rc=1, cib-update=594838, confirmed=false)
( q2 a! g3 |: R# M8 QJun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: ERROR: RabbitMQ server is failed.3 t, r. X4 O0 g, j k$ y& l" Y
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: INFO: Resource not running.2 W3 [- o* U6 z; D# r; q# w
Jun 7 14:35:39 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548950, rc=0, cib-update=594839, confirmed=true)- F3 i& R. |8 `" ]; Y0 N1 n- s
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22448]: ERROR: RabbitMQ server is failed.
5 I9 @# W) j4 i, RJun 7 14:35:39 controller2 systemd: Starting RabbitMQ broker...2 g" T) N9 W/ P
Jun 7 14:35:40 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ..." ?- Y. P( [3 g* _; v/ p
Jun 7 14:35:40 controller2 rabbitmqctl: pid is 22597 ...
; L8 {$ A: C: j8 PJun 7 14:35:41 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.
: M1 b/ i- w. I# CJun 7 14:35:41 controller2 rabbitmq-server: ## ## Licensed under the MPL. See http://www.rabbitmq.com/& w- {; W" o7 M& C0 @1 @/ j
Jun 7 14:35:41 controller2 rabbitmq-server: ## ##
' E+ B$ F6 S% j2 r: b* [Jun 7 14:35:41 controller2 rabbitmq-server: ########## Logs: /var/log/rabbitmq/rabbit@controller2.log5 g" o% t; b1 @* J
Jun 7 14:35:41 controller2 rabbitmq-server: ###### ## /var/log/rabbitmq/rabbit@controller2-sasl.log
1 \5 m. h& l! {. E5 g7 i7 OJun 7 14:35:41 controller2 rabbitmq-server: ##########
0 m. K h* j- j; T) ?6 mJun 7 14:35:41 controller2 rabbitmq-server: Starting broker.... @/ I, P, `6 D- j1 v- b
Jun 7 14:35:41 controller2 rabbitmq-server: BOOT FAILED- y* E2 Z7 {( ^; Z
Jun 7 14:35:41 controller2 rabbitmq-server: ===========
- h1 C/ F( ~. S& X- n. BJun 7 14:35:41 controller2 rabbitmq-server: Error description:: L8 S( o% W5 w3 C$ O) t
Jun 7 14:35:41 controller2 rabbitmq-server: {boot_step,recovery,, y2 n' K7 V3 Y& W" S. ?
Jun 7 14:35:41 controller2 rabbitmq-server: {badmatch,
) e' C x0 ?: ]* i, h; Y1 GJun 7 14:35:41 controller2 rabbitmq-server: {error,+ r( V5 E" d/ q
Jun 7 14:35:41 controller2 rabbitmq-server: {{{badmatch,5 z' e0 L6 i$ S$ F' U
Jun 7 14:35:41 controller2 rabbitmq-server: {error,+ k' z- D4 b" {7 C& }0 {
Jun 7 14:35:41 controller2 rabbitmq-server: {not_a_dets_file,
% r/ } |, N* s3 dJun 7 14:35:41 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},3 x( q' |/ O, r4 t, Q% `6 \8 q* G
Jun 7 14:35:41 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
3 W2 h' |. n" H- T$ X0 SJun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
' j- _* y$ t% WJun 7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,$ s+ M" A/ _2 E# T+ M& c
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},& ^7 {$ X4 P9 C% N
Jun 7 14:35:41 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
) h. f" n( \$ A2 pJun 7 14:35:41 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
* P2 }) {4 y+ |' J3 h' G v. ~Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
8 n# T& D& J9 ~+ [Jun 7 14:35:41 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,9 r4 U+ D! ?) F$ ^# d6 G1 c
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
. M* [5 R- X5 Y! o7 sJun 7 14:35:41 controller2 rabbitmq-server: transient,4294967295,worker,7 l8 y3 j" r/ i& d
Jun 7 14:35:41 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}. h. i# `8 w T6 _- u4 j
Jun 7 14:35:41 controller2 rabbitmq-server: Log files (may contain more information):1 D) x; l) K3 a% @
Jun 7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
M0 H1 ~: k6 d/ I& zJun 7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log5 I4 j$ f9 d5 q4 H8 i: E
Jun 7 14:35:41 controller2 rabbitmq-server: Stack trace:5 r2 d+ T* W! r3 G' E! T. q
Jun 7 14:35:41 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,
- [6 `9 }; ~* ~% NJun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},
2 `( K6 V4 i! o3 E& `Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_variable_queue,start,1,
0 _' w: z1 w9 Q* S, NJun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},
4 D" z/ r6 S; S$ XJun 7 14:35:41 controller2 rabbitmq-server: {line,402}]},$ S, J9 T$ H$ m% i7 |! m
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]},, A; ~: J+ k, u3 D3 [. k
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},; x" |3 i- |( s
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},
M4 ?4 T0 p' B% cJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
# Y3 V7 H9 O& F4 a6 S! uJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,$ y7 C. {: w9 E4 f' U/ M) b, q
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},9 q0 t& a' C) b3 }" t, f* i. X
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]
3 Y7 d5 c9 x3 ? uJun 7 14:35:42 controller2 rabbitmq-server: BOOT FAILED
+ E$ e [! O( M4 I0 X' H4 H9 NJun 7 14:35:42 controller2 rabbitmq-server: ===========7 q7 n* ~1 q* r. A9 y2 Q; d
Jun 7 14:35:42 controller2 rabbitmq-server: Error description:
9 @9 y8 n; y+ D: O) d( ^2 \Jun 7 14:35:42 controller2 rabbitmq-server: {could_not_start,rabbit,0 O! Z( {8 N$ ?( l
Jun 7 14:35:42 controller2 rabbitmq-server: {bad_return,
6 f5 n; b' l, x- W5 O, `- ?/ i; cJun 7 14:35:42 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},* u, G# @0 ]0 _! Q5 W
Jun 7 14:35:42 controller2 rabbitmq-server: {'EXIT',3 l4 H* O' C( x2 |
Jun 7 14:35:42 controller2 rabbitmq-server: {rabbit,failure_during_boot,3 Q# m1 L1 L/ w+ S' o5 `) G' s
Jun 7 14:35:42 controller2 rabbitmq-server: {boot_step,recovery,
! C0 Q" Y( y ?8 v( \+ D6 O' ZJun 7 14:35:42 controller2 rabbitmq-server: {badmatch,, p; U" t' q, {
Jun 7 14:35:42 controller2 rabbitmq-server: {error,' r3 Z& @7 L0 ~; k
Jun 7 14:35:42 controller2 rabbitmq-server: {{{badmatch,0 _! I! p2 d F1 Q% _
Jun 7 14:35:42 controller2 rabbitmq-server: {error,
; \4 s8 h; D) {5 t/ `5 lJun 7 14:35:42 controller2 rabbitmq-server: {not_a_dets_file,5 N; R8 e4 K& `
Jun 7 14:35:42 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}}," O x" F- h" ^5 J
Jun 7 14:35:42 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
% k8 C, F5 F. [) M: |# q, J' q2 x kJun 7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},+ W2 k' g7 T, R. l
Jun 7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,! N- N" B3 ^: o* ]! }4 F# Q6 t
Jun 7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
, [8 c6 w D' g+ K+ @+ A- G9 `Jun 7 14:35:42 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},0 a4 ?. D# c& V3 X0 x; t Z
Jun 7 14:35:42 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,/ E2 D; e) ]/ F+ ~ m
Jun 7 14:35:42 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},) s) m$ B* z L+ E5 f
Jun 7 14:35:42 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
6 N# e/ Y( `1 C% L4 OJun 7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},0 a& I" G) L. o/ u+ [9 C/ ?' A
Jun 7 14:35:42 controller2 rabbitmq-server: transient,4294967295,worker," ?' F: p1 Z' @! q4 P; _; W# H
Jun 7 14:35:42 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}4 w) M# B$ s& e1 u1 \( Q
Jun 7 14:35:42 controller2 rabbitmq-server: Log files (may contain more information):
9 L3 k, z" I4 ^ C0 N9 h2 ? EJun 7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log& Z% a% F( B5 e- Q; n8 W
Jun 7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log. ~5 ]6 g: V3 H; m
Jun 7 14:35:43 controller2 systemd: Started RabbitMQ broker.: ^7 ?+ _0 A4 ?( n
Jun 7 14:35:43 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548951, rc=0, cib-update=594840, confirmed=true)
3 d; h" J; w' R! I- cJun 7 14:35:43 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}# G, U' z1 s" x2 L( z
Jun 7 14:35:43 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548952, rc=0, cib-update=594841, confirmed=false)
. V* R4 _4 S7 kJun 7 14:35:45 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump2 o* `4 D' M/ _
Jun 7 14:35:45 controller2 rabbitmq-server: init terminating in do_boot ()
$ o( L- i, A$ R3 Q2 l1 IJun 7 14:35:45 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE/ |1 X1 ?, m. ~4 c2 v: {
Jun 7 14:35:45 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...
, n; ?+ E1 x! w- X; KJun 7 14:35:45 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown
P! {# g& }% j7 U% ~8 e( O6 g6 XJun 7 14:35:45 controller2 rabbitmqctl: DIAGNOSTICS) I( }( J* K$ l3 R$ _" o
Jun 7 14:35:45 controller2 rabbitmqctl: ===========
5 j* U' @' E7 |1 a+ L8 lJun 7 14:35:45 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']" G0 A6 o$ ~! q
Jun 7 14:35:45 controller2 rabbitmqctl: rabbit@controller2:
5 k0 h- i6 L. wJun 7 14:35:45 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2
" e3 ?0 [) O: vJun 7 14:35:45 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all
' h1 J5 p; j" C' D2 h7 FJun 7 14:35:45 controller2 rabbitmqctl: no other nodes on controller2* m& P" s2 R w5 ]
Jun 7 14:35:45 controller2 rabbitmqctl: * suggestion: start the node0 L/ ?6 i, @7 f. z6 G2 v- {0 O2 X
Jun 7 14:35:45 controller2 rabbitmqctl: current node details:
) d# s" \1 _6 R5 @+ jJun 7 14:35:45 controller2 rabbitmqctl: - node name: 'rabbitmqctl-22956@controller2'
% \3 N% E4 V8 B( E s. wJun 7 14:35:45 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq. n& v) h4 w1 b: v1 v' J$ Z1 M
Jun 7 14:35:45 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==
' G; Q/ }: u' [: e g+ o6 q9 L" XJun 7 14:35:45 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=2
. f& p1 P+ K% m# K$ OJun 7 14:35:45 controller2 systemd: Unit rabbitmq-server.service entered failed state.
! ~6 [6 M E6 C" }3 L7 u7 bJun 7 14:35:45 controller2 systemd: rabbitmq-server.service failed.
4 |9 D2 O4 F8 z c" F- q4 RJun 7 14:35:45 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185
* r$ a! \+ b8 F' {% eJun 7 14:35:45 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185
: Z2 w4 O8 R$ {+ ?Jun 7 14:35:49 controller2 filebeat: 2024-06-07T14:35:49.300+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890100,"time":{"ms":6}},"total":{"ticks":2986480,"time":{"ms":48},"value":2986480},"user":{"ticks":2096380,"time":{"ms":42}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384770183}},"memstats":{"gc_next":33872784,"memory_alloc":17183880,"memory_total":69311206544},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.84,"15":2.57,"5":2.66,"norm":{"1":0.071,"15":0.0643,"5":0.0665}}}}}}
& d$ y3 R# T& y/ |# ?Jun 7 14:35:53 controller2 dhcpd: isc-dhcpd-4.2.5. k4 |: d. p8 |+ |2 U
Jun 7 14:35:53 controller2 rabbitmq-server(ksc-os-rabbitmq)[23948]: ERROR: RabbitMQ server is failed.) ^2 \, Q8 G) E/ b
Jun 7 14:35:53 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548952, rc=1, cib-update=594842, confirmed=false)
6 I; L2 J+ ~% _- t: RJun 7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: ERROR: RabbitMQ server is failed.
E+ G) c3 D; G; c( {1 I' FJun 7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: INFO: Resource not running.
" i) Q5 m l6 j6 Y7 s w. _2 PJun 7 14:35:54 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548954, rc=0, cib-update=594843, confirmed=true)
. h8 ~& e- F5 J& R8 K) d4 oJun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.029+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.126:9200)): Get "http://172.24.110.126:9200": dial tcp 172.24.110.126:9200: connect: connection timed out1 K, k" w4 G; l7 G( L/ v8 V7 \/ B4 [
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.126:9200)) with 84327 reconnect attempt(s)
- c0 W& D6 d$ W4 O$ x& B/ |Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer2 h9 O$ g5 Z* C( x* k1 `
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher] pipeline/retry.go:217 done" Y" C0 b' ]3 N- R( @
7 I% s2 O: U6 M; T9 E6 ]. ~
' M r4 d! P$ D |! _Jun 7 14:36:06 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452424
1 |2 q. C7 T5 t$ l6 S9 p, a5 XJun 7 14:36:06 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:20444524245 n, N+ i; t# w2 Q3 G4 ^0 M, c
- B% W4 b, J, L3 X! J( e2 k' P4 f/ ?9 B& W
|
|
发表于 2024-6-7 15:00:19