|
|
Jun 7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
# P" @6 |! p8 G! y! _6 Q1 b: C+ M4 {Jun 7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
( R& b, P, t! d& _Jun 7 14:35:18 controller2 systemd: Started RabbitMQ broker.
! Z9 \: ~4 V, P6 n6 x WJun 7 14:35:18 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548943, rc=0, cib-update=594832, confirmed=true)8 [) w3 t1 G& [, V0 t4 W; N
Jun 7 14:35:18 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}4 j% G1 u! ~+ j2 t4 T
Jun 7 14:35:18 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548944, rc=0, cib-update=594833, confirmed=false)
: e8 @$ w( c" O) _6 Z$ m/ h3 KJun 7 14:35:19 controller2 filebeat: 2024-06-07T14:35:19.300+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890090,"time":{"ms":4}},"total":{"ticks":2986430,"time":{"ms":11},"value":2986430},"user":{"ticks":2096340,"time":{"ms":7}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384740183}},"memstats":{"gc_next":33883984,"memory_alloc":18558592,"memory_total":69310713440},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.47,"15":2.54,"5":2.58,"norm":{"1":0.0618,"15":0.0635,"5":0.0645}}}}}}0 w, b& t$ i) c+ O1 g
Jun 7 14:35:19 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump
& f$ K. R8 e5 b2 R* X/ eJun 7 14:35:19 controller2 rabbitmq-server: init terminating in do_boot ()3 X O, Z1 q5 ~# B* i/ I
Jun 7 14:35:19 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE+ L! j4 Q) |. J( @: p" W
Jun 7 14:35:20 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...' H, R F/ y: G3 x# E6 V! g
Jun 7 14:35:20 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown
/ X8 D' K& I2 J$ W1 yJun 7 14:35:20 controller2 rabbitmqctl: DIAGNOSTICS. C9 {# o+ |+ W* w/ L( X* z: |& A4 |1 j" _
Jun 7 14:35:20 controller2 rabbitmqctl: ===========* S- [* a1 j+ X* I
Jun 7 14:35:20 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']* D4 @- i! ^: y" c0 C/ S
Jun 7 14:35:20 controller2 rabbitmqctl: rabbit@controller2:5 j# n4 r+ x8 T2 i& ]/ s ?" [
Jun 7 14:35:20 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller21 ?, U4 b0 N6 t, z5 ^& f1 C% S
Jun 7 14:35:20 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all
2 @8 q2 d. T) Q$ T. i4 C( uJun 7 14:35:20 controller2 rabbitmqctl: no other nodes on controller2
* y1 \" c+ U1 a, sJun 7 14:35:20 controller2 rabbitmqctl: * suggestion: start the node: a) b4 F( `4 i7 a, n& \( v
Jun 7 14:35:20 controller2 rabbitmqctl: current node details:9 }. u% s! w" |- d1 d
Jun 7 14:35:20 controller2 rabbitmqctl: - node name: 'rabbitmqctl-19643@controller2' D8 _" Q9 v. @2 `& Z% `# r
Jun 7 14:35:20 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq, z6 u; ^" H( I" [, [: y: k) D
Jun 7 14:35:20 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==
! i; }* T6 A6 ^) N4 t9 `Jun 7 14:35:20 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=21 y) Y2 E! u: r+ n8 a& I/ V
Jun 7 14:35:20 controller2 systemd: Unit rabbitmq-server.service entered failed state.
! ^; Z+ O! _. O" s5 W7 F- EJun 7 14:35:20 controller2 systemd: rabbitmq-server.service failed.( Q1 \" m6 s" V. {- w+ O
' r! u7 D: j2 W: }: q% Z9 x
# W! [8 k* f4 x& l4 U& O$ f# W: W$ q" H8 ? g! i3 u
Jun 7 14:35:23 controller2 dhcpd: isc-dhcpd-4.2.5( G3 q' \% {& z- x* k6 f" H
Jun 7 14:35:25 controller2 systemd: Starting RabbitMQ broker...( Z# {2 a _" C( h
Jun 7 14:35:25 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:20444519841 k8 t0 e2 @# X! r9 n
Jun 7 14:35:25 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984' f$ g2 Z# |6 P* L8 C
Jun 7 14:35:26 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...
2 S& v/ N% B4 x5 Q: _4 vJun 7 14:35:26 controller2 rabbitmqctl: pid is 20016 ...
9 e" X: i2 D0 B0 H* B3 I: lJun 7 14:35:27 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.
. p3 R6 b: A) W) c3 uJun 7 14:35:27 controller2 rabbitmq-server: ## ## Licensed under the MPL. See http://www.rabbitmq.com/+ A; D( n& G9 k
Jun 7 14:35:27 controller2 rabbitmq-server: ## ##( s* x# N* w# g5 d7 V1 Q
Jun 7 14:35:27 controller2 rabbitmq-server: ########## Logs: /var/log/rabbitmq/rabbit@controller2.log
: U4 R4 A; Y* X* NJun 7 14:35:27 controller2 rabbitmq-server: ###### ## /var/log/rabbitmq/rabbit@controller2-sasl.log8 ]* ?1 ~1 g3 s
Jun 7 14:35:27 controller2 rabbitmq-server: ##########
/ J! M3 e' P O) _$ rJun 7 14:35:27 controller2 rabbitmq-server: Starting broker...% d+ U* X- Q0 c: ^
Jun 7 14:35:27 controller2 rabbitmq-server: BOOT FAILED, o1 J) \; d8 h N: G: O/ L
Jun 7 14:35:27 controller2 rabbitmq-server: ===========
% H" w& i5 `! ?3 O. z2 M. JJun 7 14:35:27 controller2 rabbitmq-server: Error description:, P* }( ^$ m0 j4 G- p
Jun 7 14:35:27 controller2 rabbitmq-server: {boot_step,recovery,# d9 A/ Z' e% b5 }8 G1 `
Jun 7 14:35:27 controller2 rabbitmq-server: {badmatch,
% o3 c$ s% R+ v4 KJun 7 14:35:27 controller2 rabbitmq-server: {error,5 B" x8 F( ]7 F) {9 Y
Jun 7 14:35:27 controller2 rabbitmq-server: {{{badmatch,
! I& Z0 E. ~1 @4 s P+ D; R( b8 GJun 7 14:35:27 controller2 rabbitmq-server: {error,2 g" f: i7 x. t
Jun 7 14:35:27 controller2 rabbitmq-server: {not_a_dets_file,2 b3 l+ o+ @6 u+ g2 U
Jun 7 14:35:27 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
4 _* z+ v5 v M4 @: ]Jun 7 14:35:27 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
7 Y+ q6 f5 u6 e# tJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
2 g6 Q/ Q( s4 }Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,
, ?) u# Q% v5 \# _; uJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
0 B S2 U+ G4 Q7 R4 I: n, V% H3 W( jJun 7 14:35:27 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},7 r9 X l2 i' E0 J
Jun 7 14:35:27 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
6 h, j2 _5 X7 {8 H8 \Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},! _# J1 O5 r; i3 @( E- k9 S4 p4 @ P
Jun 7 14:35:27 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
' z; s: b% A: Q o( h OJun 7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},8 h# d9 g: x( L% c: [1 ]) b" Y/ W# Q
Jun 7 14:35:27 controller2 rabbitmq-server: transient,4294967295,worker,& I! q' Z# k: }$ p ]; N) o
Jun 7 14:35:27 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}
) O4 l U" A! J, L" XJun 7 14:35:27 controller2 rabbitmq-server: Log files (may contain more information):
- D5 L: p" y3 fJun 7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log p; j9 w9 o3 i1 |
Jun 7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log+ @8 G) ?) s) l0 l# ^1 a+ g6 `& K+ D* c
Jun 7 14:35:27 controller2 rabbitmq-server: Stack trace:
% a* g7 G1 Z( A- g3 `+ Z0 Y2 oJun 7 14:35:27 controller2 rabbitmq-server: [{rabbit_queue_index,start,1," S/ ~7 b# x! e9 d
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},
, X# \* i' g$ n) [$ sJun 7 14:35:27 controller2 rabbitmq-server: {rabbit_variable_queue,start,1,
: s" R0 {8 {0 nJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},8 F a" n" t" F- R) i
Jun 7 14:35:27 controller2 rabbitmq-server: {line,402}]},9 [+ J" Q% ?$ T! `7 b
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]},- b( w# }/ l1 v$ j
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},
' w% j! o6 J' |) cJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},0 h4 x+ ~3 T9 ]( r
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
9 j' w& n1 U3 }# h1 ?) JJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,
7 y* H1 O/ o5 `Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},
# C# v0 w0 G, E3 {- I2 }Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]7 E6 F6 {2 I1 ]" O, q, X9 p- {
* f9 h8 |6 r1 ]9 s- m5 [, W
3 Y8 q- Q( k7 a. h. R, T& N5 v! W5 |/ d: w6 X. ]
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20504]: ERROR: RabbitMQ server is failed.( P9 @& ~' m E6 M5 B8 c
Jun 7 14:35:28 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548944, rc=1, cib-update=594834, confirmed=false)
# S0 ]1 E X0 l! KJun 7 14:35:28 controller2 rabbitmq-server: BOOT FAILED
3 H& o+ x ], v8 `6 A MJun 7 14:35:28 controller2 rabbitmq-server: ===========
% u" l1 H+ q8 g" |" N& _Jun 7 14:35:28 controller2 rabbitmq-server: Error description:% |2 ?: e, |0 \' ]3 C& [
Jun 7 14:35:28 controller2 rabbitmq-server: {could_not_start,rabbit,
$ A* K/ i2 O1 y9 F1 F( x7 H2 L3 RJun 7 14:35:28 controller2 rabbitmq-server: {bad_return,
0 D+ P! s _. s, }( b9 v4 K, cJun 7 14:35:28 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},& C6 }) h. N8 \7 E$ S+ s W
Jun 7 14:35:28 controller2 rabbitmq-server: {'EXIT',5 W# V! E5 X% |: D9 Q4 j3 r
Jun 7 14:35:28 controller2 rabbitmq-server: {rabbit,failure_during_boot,0 r/ M4 S2 \# o1 }, q \2 l
Jun 7 14:35:28 controller2 rabbitmq-server: {boot_step,recovery,
+ D/ a9 Q4 |+ v6 UJun 7 14:35:28 controller2 rabbitmq-server: {badmatch,+ T: D4 [/ W# a0 R
Jun 7 14:35:28 controller2 rabbitmq-server: {error,
$ ^& o0 C& x% ~Jun 7 14:35:28 controller2 rabbitmq-server: {{{badmatch,
0 z! @$ b3 u( K- I1 M0 Y% eJun 7 14:35:28 controller2 rabbitmq-server: {error,
8 g5 w/ m7 i0 J, K- e: D5 vJun 7 14:35:28 controller2 rabbitmq-server: {not_a_dets_file,
1 p6 E$ [( E+ x, g- P+ c# hJun 7 14:35:28 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
1 G/ h7 `) ~) X5 \; s* QJun 7 14:35:28 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,. j$ W' i3 ?. o6 e! x! u
Jun 7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
- e# Z2 T1 Q* {6 Y/ qJun 7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,7 S/ ^0 n! a2 p) }
5 `: }" M3 e8 |Jun 7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
' U* j: ^9 q# S, cJun 7 14:35:28 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},/ }; p: S' V7 H- d4 `# d c# R
Jun 7 14:35:28 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,1 s2 R7 L8 d8 ]' N& [
Jun 7 14:35:28 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
' f- t: h( e* L0 mJun 7 14:35:28 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
: c* g9 p5 c9 ~Jun 7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},- W, n' q# p( e/ R8 z8 O4 t& X
Jun 7 14:35:28 controller2 rabbitmq-server: transient,4294967295,worker,
8 [7 o! O% M) T) K' mJun 7 14:35:28 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}
' ]7 Z& a7 }% Q, CJun 7 14:35:28 controller2 rabbitmq-server: Log files (may contain more information):
/ n' Z/ R% H: A9 Z+ @+ |# HJun 7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
1 I5 D( K+ ]1 A4 |0 Z. }Jun 7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log& Z, D) S- g2 ^* H, f# P2 Y, c
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: ERROR: RabbitMQ server is failed. [' w. U) p! @+ C* s) d
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: INFO: Resource not running.
2 h9 ]) y: H8 F: h/ {Jun 7 14:35:28 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548946, rc=0, cib-update=594835, confirmed=true)* h; c; _8 t! b& L% I# o& ]$ r
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20544]: ERROR: RabbitMQ server is failed.& f6 D1 K- O; h. a3 m5 E
* Y1 i D: W* `# t& U: A, IJun 7 14:35:29 controller2 systemd: Started RabbitMQ broker.
8 v# a' H) {' G1 e$ J8 CJun 7 14:35:29 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
! T6 O$ [% j% x( `' _4 d jJun 7 14:35:29 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548947, rc=0, cib-update=594836, confirmed=true)
8 ]4 y$ E2 p/ B6 T0 hJun 7 14:35:29 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548948, rc=0, cib-update=594837, confirmed=false). F9 W5 {2 f( I" ^& F8 C/ f
Jun 7 14:35:31 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump/ k5 K3 t' \. ]5 E( V7 W) y& c
Jun 7 14:35:31 controller2 rabbitmq-server: init terminating in do_boot ()
1 A6 B0 g1 g; V. K" v( q7 D- |6 _Jun 7 14:35:31 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE
3 m6 E' d# g# q# u2 _% lJun 7 14:35:31 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...
) O& Y- F U$ h/ d+ b# B6 k; m) z# QJun 7 14:35:31 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown
. j$ G4 B; C& ?Jun 7 14:35:31 controller2 rabbitmqctl: DIAGNOSTICS
- D3 [; N7 L* Z4 A/ p. WJun 7 14:35:31 controller2 rabbitmqctl: =========== }" k! D/ Y2 f. g
Jun 7 14:35:31 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']2 P9 q6 q8 _7 n2 Q a
Jun 7 14:35:31 controller2 rabbitmqctl: rabbit@controller2:, h8 Z3 }2 T. h
Jun 7 14:35:31 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller25 T% X1 B/ r$ R! }
Jun 7 14:35:31 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all: C- M s& B6 ]" d2 o# J+ E
Jun 7 14:35:31 controller2 rabbitmqctl: no other nodes on controller2
; W* b0 a& f) y( C1 sJun 7 14:35:31 controller2 rabbitmqctl: * suggestion: start the node
/ W0 ~# w& e/ b4 R% z: D7 BJun 7 14:35:31 controller2 rabbitmqctl: current node details:- h1 m: x# t0 j
Jun 7 14:35:31 controller2 rabbitmqctl: - node name: 'rabbitmqctl-20636@controller2'
& N* k3 l# Y6 t) l/ jJun 7 14:35:31 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq8 V X* o# ?" q
Jun 7 14:35:31 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==2 h8 S$ E( P' o: e1 f
Jun 7 14:35:31 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=2
0 `, c0 i6 e5 C" N1 m/ i0 OJun 7 14:35:31 controller2 systemd: Unit rabbitmq-server.service entered failed state.# P' O9 r1 N4 B6 T
Jun 7 14:35:31 controller2 systemd: rabbitmq-server.service failed.
" c3 @9 h) q* F6 GJun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.127:9200)): Get "http://172.24.110.127:9200": dial tcp 172.24.110.127:9200: connect: connection timed out
1 G2 X. ]; `) @# W, QJun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.127:9200)) with 84247 reconnect attempt(s)3 m) g6 |: L$ _ j7 w
Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer6 e- c9 n/ U- O d; a' J2 b ^, U3 O
Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher] pipeline/retry.go:217 done, P, [1 R7 Y9 f7 ?
Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.125:9200)): Get "http://172.24.110.125:9200": dial tcp 172.24.110.125:9200: connect: connection timed out
- D& g& u/ `$ e( }Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.125:9200)) with 84378 reconnect attempt(s)" q1 B( T5 D2 N3 H j3 V
Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer
. L0 \" A5 e; G0 E4 U" \Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher] pipeline/retry.go:217 done! G8 l0 O9 g: V7 K6 y) y% r
Jun 7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.186 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] Start to report status of agent
1 B- b5 e ]# I4 r. q) Y3 a. rJun 7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.211 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] report agent status with {u'binary': u'startKingCloudOSAgent', u'host': u'controller2.ksc', u'uuid': u'9f541bc8-e6db-4816-ae39-0eb60cc58166', u'report_count': 3145039, u'state': u'up'}
9 a* i9 N/ c$ Y0 y$ k rJun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22417]: ERROR: RabbitMQ server is failed.; o+ `# Y; [0 z' s
Jun 7 14:35:39 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548948, rc=1, cib-update=594838, confirmed=false)* q6 S5 N( v- E9 A: f
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: ERROR: RabbitMQ server is failed.
& G9 Z7 A) y5 Z; Y5 X. WJun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: INFO: Resource not running.
8 F- K2 q: N3 r6 g9 H- t! DJun 7 14:35:39 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548950, rc=0, cib-update=594839, confirmed=true)& J% `2 P% P" {7 _4 j9 s+ J
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22448]: ERROR: RabbitMQ server is failed.1 M* `$ q& ^* {4 I* V
Jun 7 14:35:39 controller2 systemd: Starting RabbitMQ broker...
1 {+ R1 [/ `' `7 cJun 7 14:35:40 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...
, Y# r) G4 T1 ?# }2 h* `" _Jun 7 14:35:40 controller2 rabbitmqctl: pid is 22597 ...0 c, Q, y8 \# c
Jun 7 14:35:41 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.
8 V9 x7 g! f: |( B( j: e: ZJun 7 14:35:41 controller2 rabbitmq-server: ## ## Licensed under the MPL. See http://www.rabbitmq.com/$ \* u2 {1 ]9 J+ E. D$ T
Jun 7 14:35:41 controller2 rabbitmq-server: ## ##
3 `" w( h# A3 f' A# w2 D# qJun 7 14:35:41 controller2 rabbitmq-server: ########## Logs: /var/log/rabbitmq/rabbit@controller2.log
6 a: S4 `. k6 ~ A. Y) ZJun 7 14:35:41 controller2 rabbitmq-server: ###### ## /var/log/rabbitmq/rabbit@controller2-sasl.log+ O; p0 @1 r- n* G( D/ B
Jun 7 14:35:41 controller2 rabbitmq-server: ##########
: H* Y8 \/ \" Y! JJun 7 14:35:41 controller2 rabbitmq-server: Starting broker..., y+ N6 G. F8 p6 U) `6 \ {% i l
Jun 7 14:35:41 controller2 rabbitmq-server: BOOT FAILED1 C7 \1 ?8 Y b7 ]7 F
Jun 7 14:35:41 controller2 rabbitmq-server: ===========( U2 g" G$ e9 M4 [" d
Jun 7 14:35:41 controller2 rabbitmq-server: Error description:
( d+ q) F1 f+ @1 K' h/ C& m* F2 K, }Jun 7 14:35:41 controller2 rabbitmq-server: {boot_step,recovery,; ?+ v6 i% [% w9 {
Jun 7 14:35:41 controller2 rabbitmq-server: {badmatch,* O$ \: x; `1 f8 x" T
Jun 7 14:35:41 controller2 rabbitmq-server: {error,
' m$ a/ T" E6 h' m$ R% i- B7 n: D7 }Jun 7 14:35:41 controller2 rabbitmq-server: {{{badmatch,
. [, @! p. l: H2 ]& LJun 7 14:35:41 controller2 rabbitmq-server: {error,' E3 o7 P6 u6 }! ]* O7 y
Jun 7 14:35:41 controller2 rabbitmq-server: {not_a_dets_file,* T' O0 f- H6 E+ d/ M8 ^4 J% a7 u
Jun 7 14:35:41 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
* Y1 M `) [8 m! i# vJun 7 14:35:41 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,5 }* b% L; Z9 \& {9 D O* M& R
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
& |% M8 C1 q' eJun 7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,5 q! X, Q3 i! z* Q
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
6 Z" A; B( ?7 [ M% X, q# GJun 7 14:35:41 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
, G- m/ `4 f5 k2 p. a }7 {6 HJun 7 14:35:41 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,/ E' y/ W; R2 C) Q( w- L1 X
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},6 I" \8 Q1 F, I9 Q s
Jun 7 14:35:41 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,; @ n& t2 p4 _* M; V
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},) K c4 S7 N/ o M
Jun 7 14:35:41 controller2 rabbitmq-server: transient,4294967295,worker,
3 P$ S% _8 P2 |3 ]2 yJun 7 14:35:41 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}# d* L1 U' D! x" B/ L7 e$ l
Jun 7 14:35:41 controller2 rabbitmq-server: Log files (may contain more information):
1 |0 H8 f& F7 u! p# l6 uJun 7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log( [8 [4 p, v7 ?. m/ {/ l T
Jun 7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
: X4 q1 p0 C6 [7 k$ _6 OJun 7 14:35:41 controller2 rabbitmq-server: Stack trace:
# y( H; D: z9 c2 @Jun 7 14:35:41 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,
" g5 Q' p1 m( V3 r2 Y' c/ k$ J. YJun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},
n' b7 E! E1 {. DJun 7 14:35:41 controller2 rabbitmq-server: {rabbit_variable_queue,start,1,6 d5 \' y7 ]' ^7 z# o3 z% p
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},
. P1 j4 h9 K5 w4 A" ]0 O0 S1 K( gJun 7 14:35:41 controller2 rabbitmq-server: {line,402}]},* Q- R# H8 b% c) S/ |8 J
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]},& k" q* j( ~# n, h& ?
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},4 p" `/ {% A/ A7 s8 y; H" v
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},
) y6 ?' D. O* u; e9 ~; K) ^: nJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
% R+ ?* T/ t& ^: N6 d) z, H8 s$ mJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,1 N* I& G: \7 V+ T6 h
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]}, |/ q: k" H, l* {8 L* _) a0 s; T% k7 ^
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]' x' @1 \4 t- f' T6 S
Jun 7 14:35:42 controller2 rabbitmq-server: BOOT FAILED8 n: K2 Q8 \5 b' T9 I) Y
Jun 7 14:35:42 controller2 rabbitmq-server: ===========
- e: m+ W- |! G3 d- a5 {* lJun 7 14:35:42 controller2 rabbitmq-server: Error description:9 u( \5 w4 z6 f0 E! h( i
Jun 7 14:35:42 controller2 rabbitmq-server: {could_not_start,rabbit,8 L. e" \6 P( y5 |
Jun 7 14:35:42 controller2 rabbitmq-server: {bad_return,
9 C* b" V* X) ?) f$ p _- `Jun 7 14:35:42 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},
0 e: x8 x/ ?! }2 B9 w0 }7 B7 [Jun 7 14:35:42 controller2 rabbitmq-server: {'EXIT',3 ^+ i5 z- e# q: c \
Jun 7 14:35:42 controller2 rabbitmq-server: {rabbit,failure_during_boot,
/ b( V$ z: ]' G' G8 k' SJun 7 14:35:42 controller2 rabbitmq-server: {boot_step,recovery,
$ q% E( P' ]$ a$ F- OJun 7 14:35:42 controller2 rabbitmq-server: {badmatch,
# g# G& u- H& }Jun 7 14:35:42 controller2 rabbitmq-server: {error,5 p7 U. `8 x! x a( L
Jun 7 14:35:42 controller2 rabbitmq-server: {{{badmatch,3 L6 h! v) {( c- }, ^& e, }7 S
Jun 7 14:35:42 controller2 rabbitmq-server: {error,% H# d& P8 A& W+ E- J4 |6 [
Jun 7 14:35:42 controller2 rabbitmq-server: {not_a_dets_file,* R; d/ z- N. G
Jun 7 14:35:42 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
+ B' T- h& i/ g) {( [, [( [Jun 7 14:35:42 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,# f# N5 n8 E$ Q8 j ?) `
Jun 7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
0 j/ ?$ u$ v) {% }+ Y% _% KJun 7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,- A U) E+ `% q* X
Jun 7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
1 _' R' j' l/ S6 {Jun 7 14:35:42 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
" J: H! h" k* [5 E& gJun 7 14:35:42 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
# d. [* d! i9 E3 ~0 q" ~Jun 7 14:35:42 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},1 r$ o0 l6 x5 r3 m7 ]3 _
Jun 7 14:35:42 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
8 r. K* c8 V2 B- [Jun 7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
0 f( ~: Z! k, @- r- @5 w3 `. D6 jJun 7 14:35:42 controller2 rabbitmq-server: transient,4294967295,worker,' T9 w5 g1 M! }( ] A/ x
Jun 7 14:35:42 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}( a, o# q$ a, c: u
Jun 7 14:35:42 controller2 rabbitmq-server: Log files (may contain more information):0 _" x3 N# k& H- o! Y [! q1 A9 O
Jun 7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
* g- Q2 f2 j9 C: i9 E- HJun 7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log6 K, r3 f6 E! t2 Y, w% s" T$ ]: |5 q
Jun 7 14:35:43 controller2 systemd: Started RabbitMQ broker.: z; X. G3 O3 y7 a
Jun 7 14:35:43 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548951, rc=0, cib-update=594840, confirmed=true)9 j# H$ `% [" I5 L# H
Jun 7 14:35:43 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
1 l7 K$ I0 S. r* bJun 7 14:35:43 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548952, rc=0, cib-update=594841, confirmed=false)' d+ D, B/ F; G% _* o2 `
Jun 7 14:35:45 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump
# d: d$ M2 Q0 L0 ]5 XJun 7 14:35:45 controller2 rabbitmq-server: init terminating in do_boot ()
" r# i3 V/ Z( l) q _3 L3 WJun 7 14:35:45 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE* J7 m. H0 W7 U' l1 O' H1 z
Jun 7 14:35:45 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...4 B7 t2 f( w4 { ?+ K# n0 T E
Jun 7 14:35:45 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown! w. `7 ? u7 E5 K; g2 f$ q
Jun 7 14:35:45 controller2 rabbitmqctl: DIAGNOSTICS. _1 t: y3 ], D# \
Jun 7 14:35:45 controller2 rabbitmqctl: ===========
) [) Y0 M0 ^4 S8 rJun 7 14:35:45 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']
+ W1 x& a2 z5 @0 j; `" R) IJun 7 14:35:45 controller2 rabbitmqctl: rabbit@controller2:% T- m% d3 l% n
Jun 7 14:35:45 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2& P7 R) Y% X, l3 i' _
Jun 7 14:35:45 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all
2 z+ y* S/ ] bJun 7 14:35:45 controller2 rabbitmqctl: no other nodes on controller2
; C Z9 Q. I5 |' U8 Q$ f% o5 a8 c7 ]Jun 7 14:35:45 controller2 rabbitmqctl: * suggestion: start the node6 j$ u, J* G1 v6 w
Jun 7 14:35:45 controller2 rabbitmqctl: current node details:& b' E/ y, A% s/ [, h) L$ D- u% W8 O
Jun 7 14:35:45 controller2 rabbitmqctl: - node name: 'rabbitmqctl-22956@controller2'
. x0 i/ T+ G3 u/ ?Jun 7 14:35:45 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq& q R! G1 [$ c' o+ `8 F# W1 u1 \' z
Jun 7 14:35:45 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==9 K. j( O' [' u7 ^( R
Jun 7 14:35:45 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=2
& n' n) C# R. T, O O9 xJun 7 14:35:45 controller2 systemd: Unit rabbitmq-server.service entered failed state.
- q x5 S, B# l: o- k5 \) f- Z; HJun 7 14:35:45 controller2 systemd: rabbitmq-server.service failed.0 O8 Q8 o; Y4 Y2 c( J) _
Jun 7 14:35:45 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185! t# m! |5 o$ a
Jun 7 14:35:45 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185
% g6 k C2 v8 @# d7 }" sJun 7 14:35:49 controller2 filebeat: 2024-06-07T14:35:49.300+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890100,"time":{"ms":6}},"total":{"ticks":2986480,"time":{"ms":48},"value":2986480},"user":{"ticks":2096380,"time":{"ms":42}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384770183}},"memstats":{"gc_next":33872784,"memory_alloc":17183880,"memory_total":69311206544},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.84,"15":2.57,"5":2.66,"norm":{"1":0.071,"15":0.0643,"5":0.0665}}}}}}
. |9 [% i: R6 |4 Z# W2 RJun 7 14:35:53 controller2 dhcpd: isc-dhcpd-4.2.5
8 g; o& @; u$ q& b. ^; ~' wJun 7 14:35:53 controller2 rabbitmq-server(ksc-os-rabbitmq)[23948]: ERROR: RabbitMQ server is failed.
# j2 E4 @2 W% G7 \* I8 u0 YJun 7 14:35:53 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548952, rc=1, cib-update=594842, confirmed=false)
) J9 F6 b/ y8 g, g$ NJun 7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: ERROR: RabbitMQ server is failed.: F9 G t/ M$ d5 ~9 A+ d
Jun 7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: INFO: Resource not running.0 C& S7 V4 F Z0 X4 E. }; Z
Jun 7 14:35:54 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548954, rc=0, cib-update=594843, confirmed=true) i. R! p# N l$ ~6 m8 z6 k
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.029+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.126:9200)): Get "http://172.24.110.126:9200": dial tcp 172.24.110.126:9200: connect: connection timed out
m: v% n2 k0 l* p; G+ F( VJun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.126:9200)) with 84327 reconnect attempt(s)! o& ~* d+ O" l- y) f$ F4 T
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer0 f. c7 Y- \0 d2 g$ S0 B$ t
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher] pipeline/retry.go:217 done6 E0 B# a$ m/ s, L2 d' B
* A* Z+ u# e2 g
4 [: f* t; l' T. k& Z/ J
Jun 7 14:36:06 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:20444524244 U; W0 k0 P b2 n b+ L
Jun 7 14:36:06 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452424
7 W1 [& [# X" o+ r% Y; S
) \2 ]1 s7 [0 z0 N% A9 o8 B, h" b
* e' Z9 G- N6 p n9 l" h, T2 [ |
|
发表于 2024-6-7 15:00:19