|
|
Jun 7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
( a% w3 |# N ` H N& oJun 7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log" `& `1 H7 i% ]' Z
Jun 7 14:35:18 controller2 systemd: Started RabbitMQ broker., \- A9 O; _* Z& r, |; c
Jun 7 14:35:18 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548943, rc=0, cib-update=594832, confirmed=true)( w& @* o. [( C9 N' v- h
Jun 7 14:35:18 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}( M- W4 l: ]& c- l% f+ P
Jun 7 14:35:18 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548944, rc=0, cib-update=594833, confirmed=false)
* H2 G! Z' N' @' }9 Y K7 BJun 7 14:35:19 controller2 filebeat: 2024-06-07T14:35:19.300+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890090,"time":{"ms":4}},"total":{"ticks":2986430,"time":{"ms":11},"value":2986430},"user":{"ticks":2096340,"time":{"ms":7}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384740183}},"memstats":{"gc_next":33883984,"memory_alloc":18558592,"memory_total":69310713440},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.47,"15":2.54,"5":2.58,"norm":{"1":0.0618,"15":0.0635,"5":0.0645}}}}}}
; o& ~) n* Q1 X' _+ ]$ Z6 B; fJun 7 14:35:19 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump- t5 Y9 u1 w1 k/ [1 F- A
Jun 7 14:35:19 controller2 rabbitmq-server: init terminating in do_boot ()
' M# I& x" f2 V# W& ZJun 7 14:35:19 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE
+ X' \1 h, N, q' V1 ]/ zJun 7 14:35:20 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...9 U' M$ c1 o! k$ ?+ m& ]
Jun 7 14:35:20 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown+ g0 |# \4 Y' \# C ?; J6 w, |$ C
Jun 7 14:35:20 controller2 rabbitmqctl: DIAGNOSTICS6 a- G+ V2 w! y9 H$ C4 l# k
Jun 7 14:35:20 controller2 rabbitmqctl: ===========' y A y& g8 Y% @7 T5 p
Jun 7 14:35:20 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']
B' D* P0 Y3 o9 ~- L& q: D1 YJun 7 14:35:20 controller2 rabbitmqctl: rabbit@controller2:
7 p3 r3 t# Y/ P. Z2 Q+ ZJun 7 14:35:20 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller28 _0 F2 |! @0 A9 U0 b& E
Jun 7 14:35:20 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all; s7 X: L& ^/ i0 a/ {
Jun 7 14:35:20 controller2 rabbitmqctl: no other nodes on controller2
/ g+ S+ f. l* |, {3 O$ hJun 7 14:35:20 controller2 rabbitmqctl: * suggestion: start the node
+ L3 m# d$ K* m3 C, F0 \Jun 7 14:35:20 controller2 rabbitmqctl: current node details:
4 A- N$ J5 N2 e2 _4 `Jun 7 14:35:20 controller2 rabbitmqctl: - node name: 'rabbitmqctl-19643@controller2'
; k$ B2 P+ K( Z1 g7 @6 v" mJun 7 14:35:20 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq a4 |% O: @+ n2 V4 d% W1 g1 X
Jun 7 14:35:20 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==; _# f U7 \7 M* ~7 Q
Jun 7 14:35:20 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=2+ w) ?2 ?$ d& K5 n! R3 D0 [2 h
Jun 7 14:35:20 controller2 systemd: Unit rabbitmq-server.service entered failed state.3 `0 e8 Q# I+ ?+ D% N9 ]
Jun 7 14:35:20 controller2 systemd: rabbitmq-server.service failed." i$ \5 Y2 M% {. m$ Z+ V; y
; U# U: j" K" u- w
* u) c3 p/ M/ L/ M- i5 T7 b3 F& {. J& ?% B
Jun 7 14:35:23 controller2 dhcpd: isc-dhcpd-4.2.5
' Q# ?+ X4 b% n& h) t( [ `( N2 M% FJun 7 14:35:25 controller2 systemd: Starting RabbitMQ broker...
7 \: X/ l4 D EJun 7 14:35:25 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984& o) t! b$ y# w& [' e- L
Jun 7 14:35:25 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984
$ D3 l0 n4 q; K" w' L& dJun 7 14:35:26 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...0 M; V9 G2 `, O% W; [
Jun 7 14:35:26 controller2 rabbitmqctl: pid is 20016 ...% n; y w- s% p3 L/ p* h- y
Jun 7 14:35:27 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.1 \ ~( Z1 q9 u$ S
Jun 7 14:35:27 controller2 rabbitmq-server: ## ## Licensed under the MPL. See http://www.rabbitmq.com/+ J# T; v/ h4 V2 F; `# c6 z* p/ Z
Jun 7 14:35:27 controller2 rabbitmq-server: ## ##
9 M x6 m U6 \: Y2 dJun 7 14:35:27 controller2 rabbitmq-server: ########## Logs: /var/log/rabbitmq/rabbit@controller2.log$ m) R9 r* z2 v1 s, v
Jun 7 14:35:27 controller2 rabbitmq-server: ###### ## /var/log/rabbitmq/rabbit@controller2-sasl.log
' _. h4 h; I. @; O+ [- Q tJun 7 14:35:27 controller2 rabbitmq-server: ##########' k1 q, D7 L( Q. N8 T
Jun 7 14:35:27 controller2 rabbitmq-server: Starting broker...2 c, X: ~% |, k- c$ [5 B
Jun 7 14:35:27 controller2 rabbitmq-server: BOOT FAILED
6 {! Z/ H `( E" D/ g7 }0 |Jun 7 14:35:27 controller2 rabbitmq-server: ===========
3 A: V/ p, U. h$ }Jun 7 14:35:27 controller2 rabbitmq-server: Error description:0 z1 h- w z1 H" ?
Jun 7 14:35:27 controller2 rabbitmq-server: {boot_step,recovery,
" h$ |/ x: ]; P% LJun 7 14:35:27 controller2 rabbitmq-server: {badmatch,
4 R) D8 ^/ ~7 }4 s& m6 }Jun 7 14:35:27 controller2 rabbitmq-server: {error,
! k: C, E( {& j3 m8 n$ ~# {. Y9 TJun 7 14:35:27 controller2 rabbitmq-server: {{{badmatch,
) ]* X ?5 c1 D; X5 F7 fJun 7 14:35:27 controller2 rabbitmq-server: {error,% ?8 L$ r8 t# |6 j" ]
Jun 7 14:35:27 controller2 rabbitmq-server: {not_a_dets_file,
' `$ s% U% y, @8 H& N8 XJun 7 14:35:27 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},) W; P7 M, l9 c9 V$ `" e ^
Jun 7 14:35:27 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
2 ~& B) c- W: ]7 M4 ^Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]}," [0 r( g# G8 y2 \: ?
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,
! Y) m+ l3 H5 ]9 B0 ]9 xJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},0 A: f \3 [0 _2 S& s
Jun 7 14:35:27 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
/ A. c8 H# v9 eJun 7 14:35:27 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,: o" P* S" W9 b( U M
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},6 \8 P a% J l4 C; A9 ]
Jun 7 14:35:27 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,9 L+ Z* g+ \# M$ O* N0 O9 T- w. b
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
4 ?) @4 t5 d3 O# mJun 7 14:35:27 controller2 rabbitmq-server: transient,4294967295,worker,/ }/ f' {; }" y8 A/ }# k* ^2 U
Jun 7 14:35:27 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}
) y& o" B. ]# v) d/ o, ^$ ?Jun 7 14:35:27 controller2 rabbitmq-server: Log files (may contain more information):0 I9 f e' d3 G: Z+ b
Jun 7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
( P6 X0 b$ f9 g! Y5 u% T9 sJun 7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log# D& Z( C0 t- y& x4 G u2 z0 Z1 g, y( a
Jun 7 14:35:27 controller2 rabbitmq-server: Stack trace:0 M/ C+ F) J' M0 a3 L4 b8 h
Jun 7 14:35:27 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,8 ?, p/ A9 P" G7 I
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},6 C, U4 l' B9 k1 a3 R, H- ?
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_variable_queue,start,1,
7 v" h% y+ y3 _4 g( O" U0 z, \! sJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},% Y0 F5 n2 v0 b! @- G2 a/ I
Jun 7 14:35:27 controller2 rabbitmq-server: {line,402}]},
+ u" N. Y4 z' d7 C ]5 UJun 7 14:35:27 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]},
3 ]; T2 o( k! S5 B2 g+ J- T' r! PJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},+ X, k; r5 m! r# i7 L2 a
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},6 V6 f& t5 f6 F% q0 I% `
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
& L- p, _' M, h; mJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,
& y* [+ S% }8 l' y7 O- {Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},
; h7 r! D, u ]) n3 b& UJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]
0 g* w i0 g% J. ^: \3 P5 W- U: K' J: i( Y
8 o: c; [" a; D& o m! C0 H* H. e; V) O$ A: u. v
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20504]: ERROR: RabbitMQ server is failed.
4 ]% t M. p O( w& m7 NJun 7 14:35:28 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548944, rc=1, cib-update=594834, confirmed=false)5 s* F# ^) B. S/ x" i% @+ i
Jun 7 14:35:28 controller2 rabbitmq-server: BOOT FAILED# Z* B1 ^, V' o
Jun 7 14:35:28 controller2 rabbitmq-server: ===========) u- Y, r) ^: F/ c
Jun 7 14:35:28 controller2 rabbitmq-server: Error description:+ I8 J: H. e, b: e z& H
Jun 7 14:35:28 controller2 rabbitmq-server: {could_not_start,rabbit,
- X" V, q2 a* U, l gJun 7 14:35:28 controller2 rabbitmq-server: {bad_return,& @7 K# m- z( t% B7 b% f
Jun 7 14:35:28 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},
; ^3 X% Z8 }$ M- N" T% ^) f& X. MJun 7 14:35:28 controller2 rabbitmq-server: {'EXIT',
/ B% [5 f" d1 M5 QJun 7 14:35:28 controller2 rabbitmq-server: {rabbit,failure_during_boot,& r7 k& o8 s' t* }0 l( H' X+ Y
Jun 7 14:35:28 controller2 rabbitmq-server: {boot_step,recovery, U0 D- A1 L* }3 `% P8 v- H) M
Jun 7 14:35:28 controller2 rabbitmq-server: {badmatch,
/ B( p+ I, f6 m) @Jun 7 14:35:28 controller2 rabbitmq-server: {error,
- W- _1 g5 \( L: y2 g+ FJun 7 14:35:28 controller2 rabbitmq-server: {{{badmatch,& s9 T: k% N. P, ?1 g2 }9 o
Jun 7 14:35:28 controller2 rabbitmq-server: {error,' ]- u8 ~: k) H9 m8 M
Jun 7 14:35:28 controller2 rabbitmq-server: {not_a_dets_file,2 U/ M$ y0 n4 V# C n
Jun 7 14:35:28 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},+ M$ X9 l2 I2 o1 s: S* u3 P
Jun 7 14:35:28 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,2 U2 q8 T% t7 m# G" r# j3 x+ x* I
Jun 7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
- p. i- O* P# i" Y- J1 ~# aJun 7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,8 M$ ]( P; k; Q* ~2 I2 T5 C s' a
, X5 m" L% m* u' y3 t
Jun 7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},* X: Z- E% L* X' `- e
Jun 7 14:35:28 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
5 y! Z' N8 Z" [2 pJun 7 14:35:28 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
- [4 {9 P1 s1 s+ |8 CJun 7 14:35:28 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]}, D! Q1 s# R% v# _0 X3 M+ S
Jun 7 14:35:28 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,: b6 }& J+ A) Z& f$ [# Y
Jun 7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
- m+ E$ F5 M0 Y5 WJun 7 14:35:28 controller2 rabbitmq-server: transient,4294967295,worker,. n8 u6 P) J* U' U" i' u
Jun 7 14:35:28 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}} S3 f6 p" H5 c- u
Jun 7 14:35:28 controller2 rabbitmq-server: Log files (may contain more information):: N, `$ Q+ p& b& }/ Z
Jun 7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log0 M1 C. L5 X$ S s/ B& C# n
Jun 7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
- |1 \; U9 \: U6 Z( \Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: ERROR: RabbitMQ server is failed.
h/ c4 F! _; Y8 o0 oJun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: INFO: Resource not running.3 }: U2 Z/ S" [0 R+ J
Jun 7 14:35:28 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548946, rc=0, cib-update=594835, confirmed=true)
5 ]' Q$ d" b% E2 [. O7 H5 y( qJun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20544]: ERROR: RabbitMQ server is failed., a8 b9 F" P; z. h) r
2 k2 N m, L& g- YJun 7 14:35:29 controller2 systemd: Started RabbitMQ broker.
7 E8 j% }% b5 O ]. K. u% V0 `2 J; C+ oJun 7 14:35:29 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
" G9 L5 e9 e9 u+ Y0 _. yJun 7 14:35:29 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548947, rc=0, cib-update=594836, confirmed=true)
+ D7 u( b0 V& J f- s+ MJun 7 14:35:29 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548948, rc=0, cib-update=594837, confirmed=false)) d4 n( P6 Y9 q
Jun 7 14:35:31 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump
, J, r, D+ b- U- x, R0 {Jun 7 14:35:31 controller2 rabbitmq-server: init terminating in do_boot ()) `, _; s7 n' Z/ g z; h% K
Jun 7 14:35:31 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE, x; j5 a/ k; J8 N: u& A3 ]3 F4 R
Jun 7 14:35:31 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...1 p" v3 m5 x$ Z) @! R- n
Jun 7 14:35:31 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown
3 \# u3 ]# o- eJun 7 14:35:31 controller2 rabbitmqctl: DIAGNOSTICS8 Z" R" r+ ]" ?/ e9 r' z. X
Jun 7 14:35:31 controller2 rabbitmqctl: ===========" L' _9 N3 e0 ?- t: T
Jun 7 14:35:31 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2'], W' v: L# Z1 p s: z# @. Z, W
Jun 7 14:35:31 controller2 rabbitmqctl: rabbit@controller2:
+ j/ Y5 x& g' c. m% `* u5 i% sJun 7 14:35:31 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2
2 E, S1 m3 A' M' t2 \Jun 7 14:35:31 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all* g1 q" W! t- m" Q7 R1 @/ h
Jun 7 14:35:31 controller2 rabbitmqctl: no other nodes on controller2( m& r: G. d) z6 `
Jun 7 14:35:31 controller2 rabbitmqctl: * suggestion: start the node; _' z) R8 b: M* `" @5 y5 `
Jun 7 14:35:31 controller2 rabbitmqctl: current node details:; P% F- ] q) j+ c5 J% u. x
Jun 7 14:35:31 controller2 rabbitmqctl: - node name: 'rabbitmqctl-20636@controller2'. Y: i7 p" `+ e/ _) V K K
Jun 7 14:35:31 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq, D S% o: o! i! L
Jun 7 14:35:31 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==" E. R4 q) t' h0 e7 v
Jun 7 14:35:31 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=2
+ g& S# S3 B( r5 E. ~. jJun 7 14:35:31 controller2 systemd: Unit rabbitmq-server.service entered failed state.
5 d) B7 G# v+ l! P1 V$ h( e# iJun 7 14:35:31 controller2 systemd: rabbitmq-server.service failed.
( d7 w3 O- q, z" c. O0 D, f4 I. mJun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.127:9200)): Get "http://172.24.110.127:9200": dial tcp 172.24.110.127:9200: connect: connection timed out* I: e5 u/ R& i* U
Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.127:9200)) with 84247 reconnect attempt(s)# n- q. `* \$ t7 L3 h, U, ^
Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer
' r9 [1 W2 X# @# H5 U2 c b& tJun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher] pipeline/retry.go:217 done9 G# w1 \# G, \: D( K
Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.125:9200)): Get "http://172.24.110.125:9200": dial tcp 172.24.110.125:9200: connect: connection timed out
$ t" m/ i. K8 u+ n/ IJun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.125:9200)) with 84378 reconnect attempt(s)
% z' E2 F0 h( t' B5 u2 `# jJun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer
7 A6 {! F5 M9 } V" d9 k8 ^$ AJun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher] pipeline/retry.go:217 done
7 i* a0 K% ]7 p! h5 S7 u5 Q" C0 }4 A) EJun 7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.186 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] Start to report status of agent
% `3 c: O5 X8 H% _9 {1 W: T5 u; X. y0 dJun 7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.211 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] report agent status with {u'binary': u'startKingCloudOSAgent', u'host': u'controller2.ksc', u'uuid': u'9f541bc8-e6db-4816-ae39-0eb60cc58166', u'report_count': 3145039, u'state': u'up'}# s% _( V' j3 x$ d
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22417]: ERROR: RabbitMQ server is failed.
: T3 e) i; a- l( d6 d Z) D2 `% OJun 7 14:35:39 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548948, rc=1, cib-update=594838, confirmed=false)
3 ]5 v$ v j7 b1 {Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: ERROR: RabbitMQ server is failed., H* ]" `, C8 u4 |
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: INFO: Resource not running.% Y$ L( l: i- Y1 n
Jun 7 14:35:39 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548950, rc=0, cib-update=594839, confirmed=true)
( n0 V3 N$ U UJun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22448]: ERROR: RabbitMQ server is failed.
: n" s7 {1 \* Q4 K, cJun 7 14:35:39 controller2 systemd: Starting RabbitMQ broker.../ c) S1 I1 c' m4 O
Jun 7 14:35:40 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...
4 i2 D/ I! m" q* K* ^8 _Jun 7 14:35:40 controller2 rabbitmqctl: pid is 22597 ...
- \* B ?4 O+ Q- W4 k7 RJun 7 14:35:41 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.
- p' N; X' o" D. TJun 7 14:35:41 controller2 rabbitmq-server: ## ## Licensed under the MPL. See http://www.rabbitmq.com/
( L1 Q$ A5 S! A7 ]# rJun 7 14:35:41 controller2 rabbitmq-server: ## ##
) L8 ~9 y9 l# C# n1 dJun 7 14:35:41 controller2 rabbitmq-server: ########## Logs: /var/log/rabbitmq/rabbit@controller2.log. N1 A4 E9 q* T O
Jun 7 14:35:41 controller2 rabbitmq-server: ###### ## /var/log/rabbitmq/rabbit@controller2-sasl.log
6 i) L7 i: C( a' ?- {$ MJun 7 14:35:41 controller2 rabbitmq-server: ##########- _4 h( t, F7 V( n4 N! D* Z" ?
Jun 7 14:35:41 controller2 rabbitmq-server: Starting broker...
5 S3 @- H3 c- ~' c W) ZJun 7 14:35:41 controller2 rabbitmq-server: BOOT FAILED
/ ?3 B1 L6 ^6 T5 _Jun 7 14:35:41 controller2 rabbitmq-server: ===========
& H& L- V, W9 a- N5 A, M4 PJun 7 14:35:41 controller2 rabbitmq-server: Error description:; q% j2 v2 z1 f. M7 O2 A
Jun 7 14:35:41 controller2 rabbitmq-server: {boot_step,recovery,
5 D- S7 ?! y! U3 |Jun 7 14:35:41 controller2 rabbitmq-server: {badmatch,
) I+ _- F6 f) C$ ?' [( ~Jun 7 14:35:41 controller2 rabbitmq-server: {error,: z( e" Y, ]% k8 y& O6 _4 V
Jun 7 14:35:41 controller2 rabbitmq-server: {{{badmatch,/ _, a7 K* }% V. x @* y$ j5 I
Jun 7 14:35:41 controller2 rabbitmq-server: {error,6 [3 W; W3 k2 j$ c, c
Jun 7 14:35:41 controller2 rabbitmq-server: {not_a_dets_file," d: `$ t+ `* ^# S) ?
Jun 7 14:35:41 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},' ^! v5 Q0 h' m1 g4 c
Jun 7 14:35:41 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
# C0 d. @& j3 X) A3 ~7 _" J% B( TJun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
8 r. {- {2 ]3 @2 J: b. |9 DJun 7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,& h$ |, v* }/ F' M! l% N8 |( b
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
. [6 M; K) p! l* V$ d/ D/ OJun 7 14:35:41 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
1 r: @4 B$ Y/ c0 g4 JJun 7 14:35:41 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,( o1 e' O; A. x0 M: X H
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
2 e4 `% M6 ~$ K0 ~Jun 7 14:35:41 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
, J% i: h1 e4 M* nJun 7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
* |2 o( u% Y6 Y! z6 n( ]Jun 7 14:35:41 controller2 rabbitmq-server: transient,4294967295,worker,0 c+ n8 n1 T5 k' l
Jun 7 14:35:41 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}: W( p' g; E3 W6 T& |
Jun 7 14:35:41 controller2 rabbitmq-server: Log files (may contain more information):+ J$ A3 C) `. P3 i! K) Z* n
Jun 7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
6 L! ^5 l# |0 E" F. E$ OJun 7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log2 W4 G, d# x4 G! C. H" C
Jun 7 14:35:41 controller2 rabbitmq-server: Stack trace:
) l' `6 D4 ?# H1 b% l4 eJun 7 14:35:41 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,
# ~* r: a* [: l4 W/ a: Q8 lJun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},3 u1 G4 m( L3 @' d* w
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_variable_queue,start,1,% k$ I' y4 j- c$ I$ Q1 R `1 h
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},
. i% f/ T' K8 q7 G7 Q. mJun 7 14:35:41 controller2 rabbitmq-server: {line,402}]},
4 Q) z0 q& l6 r8 o( Y5 dJun 7 14:35:41 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]},' u7 d# N8 P' e8 b: {+ r% W) [( F
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},( D+ L- F \* t7 p
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},1 f) u) j) t2 k2 R5 B; U* z
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
6 q* b) _. Q' F4 g: ZJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,& C% o- j' \) B: n/ u/ j
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},
$ Q1 }3 T+ n5 N/ u; JJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]
- s( I5 |, C$ B9 LJun 7 14:35:42 controller2 rabbitmq-server: BOOT FAILED
) U% [/ U8 O s5 KJun 7 14:35:42 controller2 rabbitmq-server: ===========
4 P, n) ?8 B) c" E$ mJun 7 14:35:42 controller2 rabbitmq-server: Error description:
! z1 J' w7 N0 e( }' N: o' z4 \Jun 7 14:35:42 controller2 rabbitmq-server: {could_not_start,rabbit,
, q" c& H' V, g6 _* [( gJun 7 14:35:42 controller2 rabbitmq-server: {bad_return,
; V. Q7 V; a1 k2 ~1 n& U- pJun 7 14:35:42 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},! H% M: r% T y4 g; u% ^
Jun 7 14:35:42 controller2 rabbitmq-server: {'EXIT',
8 A2 Q0 D9 H, i4 v% nJun 7 14:35:42 controller2 rabbitmq-server: {rabbit,failure_during_boot,0 Q3 L4 ]8 |* g
Jun 7 14:35:42 controller2 rabbitmq-server: {boot_step,recovery,* n$ o2 h1 k: D
Jun 7 14:35:42 controller2 rabbitmq-server: {badmatch,2 x7 i% f5 m7 z" U( k7 e9 l
Jun 7 14:35:42 controller2 rabbitmq-server: {error,
( c1 b* J4 t# ^5 t. Y2 p5 |6 x4 e4 DJun 7 14:35:42 controller2 rabbitmq-server: {{{badmatch,
' Q' l9 b5 E0 A, i, jJun 7 14:35:42 controller2 rabbitmq-server: {error,
; x1 h8 c) q% z; h# {% @Jun 7 14:35:42 controller2 rabbitmq-server: {not_a_dets_file,
z1 R) S/ E5 o/ w9 B+ L& BJun 7 14:35:42 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
2 h {( v" _1 s& o) ?Jun 7 14:35:42 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
$ [4 I$ j$ r% D& M) Q9 Y; WJun 7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},; A! C8 d( N( }6 H
Jun 7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,, K' V( n+ W* `5 l: P" K
Jun 7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
4 r% ]8 x- a! Y% i, FJun 7 14:35:42 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},- k: K0 r5 Z" w5 ~0 Q
Jun 7 14:35:42 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
+ S3 G0 r0 ~- I( k3 S$ z+ {7 sJun 7 14:35:42 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
9 D* u3 Z$ i- o- Q$ FJun 7 14:35:42 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
2 G2 g7 E L+ C4 K/ UJun 7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
- O1 f# W, t' i1 B, mJun 7 14:35:42 controller2 rabbitmq-server: transient,4294967295,worker,% @2 |/ c1 v4 Q* @& H: O
Jun 7 14:35:42 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}' s* L: s; z7 g6 ^
Jun 7 14:35:42 controller2 rabbitmq-server: Log files (may contain more information):; w1 v; e9 x g. U
Jun 7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log. {* m; N3 R, F: h% t5 u, e3 U% ~
Jun 7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
3 ^$ Y4 f9 N/ |; v% A, P2 |; JJun 7 14:35:43 controller2 systemd: Started RabbitMQ broker.
0 Y K) K$ K4 W# `1 h) qJun 7 14:35:43 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548951, rc=0, cib-update=594840, confirmed=true)0 Q5 A. K* ?7 F, {( z
Jun 7 14:35:43 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}) S. Q5 h) f: E: n
Jun 7 14:35:43 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548952, rc=0, cib-update=594841, confirmed=false)
3 n* V2 B6 L6 Y0 t* R7 C. mJun 7 14:35:45 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump
, ?$ y2 {& v4 @8 ^9 }2 @5 u& eJun 7 14:35:45 controller2 rabbitmq-server: init terminating in do_boot ()1 R1 v7 o2 Y7 [% _. q& @ Y
Jun 7 14:35:45 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE. G" D9 G8 [& [. ^+ t9 w( _, y
Jun 7 14:35:45 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...
* F9 ?# l) x% s' ^/ E4 |Jun 7 14:35:45 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown
E$ N3 z X9 aJun 7 14:35:45 controller2 rabbitmqctl: DIAGNOSTICS" r m( D) m0 Z4 S# D' C9 x- [
Jun 7 14:35:45 controller2 rabbitmqctl: ===========
7 t+ ?, s% _. U. Y" O2 SJun 7 14:35:45 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']
# A* E0 S$ n6 H* g3 v! CJun 7 14:35:45 controller2 rabbitmqctl: rabbit@controller2:1 e2 Y) a, e% P! K' O! F' C
Jun 7 14:35:45 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2
0 S% l' ]$ h- V# l# i* t; vJun 7 14:35:45 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all
6 p+ V0 z' _( W; v& IJun 7 14:35:45 controller2 rabbitmqctl: no other nodes on controller2- S+ l2 P; @9 y* \
Jun 7 14:35:45 controller2 rabbitmqctl: * suggestion: start the node
9 S, T( n5 ^+ tJun 7 14:35:45 controller2 rabbitmqctl: current node details:
: n: v+ |, N, D% A0 ]/ b) u: i: TJun 7 14:35:45 controller2 rabbitmqctl: - node name: 'rabbitmqctl-22956@controller2'
8 }" R# e" e" N/ H7 XJun 7 14:35:45 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq
, R- P" p$ L) ?2 f7 uJun 7 14:35:45 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==
0 B! O0 i1 E9 `Jun 7 14:35:45 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=24 ?1 F% i( ^9 f: u" c# x' v# ?
Jun 7 14:35:45 controller2 systemd: Unit rabbitmq-server.service entered failed state.
+ J- i* e3 `; C$ h$ _. mJun 7 14:35:45 controller2 systemd: rabbitmq-server.service failed.! D/ O! Y0 K6 }" t5 j
Jun 7 14:35:45 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185
5 n' Z# D+ o$ y$ w, H9 q' `Jun 7 14:35:45 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185. |0 {( S$ B( D. k5 d6 P9 d
Jun 7 14:35:49 controller2 filebeat: 2024-06-07T14:35:49.300+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890100,"time":{"ms":6}},"total":{"ticks":2986480,"time":{"ms":48},"value":2986480},"user":{"ticks":2096380,"time":{"ms":42}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384770183}},"memstats":{"gc_next":33872784,"memory_alloc":17183880,"memory_total":69311206544},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.84,"15":2.57,"5":2.66,"norm":{"1":0.071,"15":0.0643,"5":0.0665}}}}}}) T) a! C1 J8 f/ {
Jun 7 14:35:53 controller2 dhcpd: isc-dhcpd-4.2.5% `: U4 C/ s7 ^% W" n
Jun 7 14:35:53 controller2 rabbitmq-server(ksc-os-rabbitmq)[23948]: ERROR: RabbitMQ server is failed.6 L, z& H& z3 |, ~4 Z5 K. d
Jun 7 14:35:53 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548952, rc=1, cib-update=594842, confirmed=false)
/ C. b$ O( I# @( ?: b8 KJun 7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: ERROR: RabbitMQ server is failed.. x0 ]* h0 i1 P% J2 \4 x. Z( T
Jun 7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: INFO: Resource not running.- f" n, I8 \" [/ s9 `" C! i, r! H
Jun 7 14:35:54 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548954, rc=0, cib-update=594843, confirmed=true) }6 k% {& J2 U h8 V6 H
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.029+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.126:9200)): Get "http://172.24.110.126:9200": dial tcp 172.24.110.126:9200: connect: connection timed out7 y5 H0 Q, ^: j# `! ?; H: p
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.126:9200)) with 84327 reconnect attempt(s)
7 `; J7 p5 \/ y: G A( c+ bJun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer) k6 V" l% G1 Q3 u! E
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher] pipeline/retry.go:217 done
' Y4 p) E0 F8 y* }
; K# d4 g- _1 F0 P) g
* c X/ S2 A' |1 g8 e6 WJun 7 14:36:06 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452424
# x* W N8 q1 V4 r& T$ [Jun 7 14:36:06 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452424
+ n) k; w1 p3 ], m* c1 r, \) a; V6 _9 y' J5 L7 A: N/ ]
+ |3 A* @. ~( i* ^
|
|
发表于 2024-6-7 15:00:19