|
|
=ERROR REPORT==== 30-Nov-2021::13:49:27 ===/ q/ W3 }8 o7 |2 z5 l9 b% {
Discarding message {'$gen_cast',{deliver,{delivery,false,true,<0.9387.4>,{basic_message,{resource,<<"/">>,exchange,<<"cinder-scheduler_fanout">>},[<<>>],{content,60,{'P_basic',<<"application/json">>,<<"utf-8">>,[],2,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<248,0,16,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110,5,117,116,102,45,56,0,0,0,0,2,0>>,rabbit_framing_amqp_0_9_1,[<<"{\"oslo.message\": \"{\\"_context_domain\\": null, \\"_context_request_id\\": \\"req-b000eeab-2474-45d3-8866-e47cb5272f33\\", \\"_context_global_request_id\\": null, \\"_context_quota_class\\": null, \\"_context_service_catalog\\": [], \\"_context_auth_token\\": null, \\"_context_resource_uuid\\": null, \\"_context_user\\": null, \\"_context_user_id\\": null, \\"_context_show_deleted\\": false, \\"_context_is_admin\\": true, \\"version\\": \\"3.3\\", \\"_context_project_domain\\": null, \\"_context_timestamp\\": \\"2021-11-28T04:30:25.732563\\", \\"method\\": \\"update_service_capabilities\\", \\"_context_project\\": null, \\"_context_remote_address\\": null, \\"_context_roles\\": [\\"admin\\"], \\"args\\": {\\"cluster_name\\": null, \\"service_name\\": \\"volume\\", \\"host\\": \\"rbd:pool-hdd-1@pool-hdd-1\\", \\"capabilities\\": {\\"filter_function\\": null, \\"location_info\\": \\"ceph:/etc/ceph/ceph.conf:29046cc0-0682-496b-98b1-912e59964282:cinder:pool-hdd-1\\", \\"goodness_function\\": null, \\"multiattach\\": false, \\"provisioned_capacity_gb\\": 0.0, \\"allocated_capacity_gb\\": 0, \\"volume_backend_name\\": \\"pool-hdd-1\\", \\"thin_provisioning_support\\": true, \\"free_capacity_gb\\": 57622.53, \\"driver_version\\": \\"1.2.0\\", \\"total_capacity_gb\\": 57622.53, \\"vendor_name\\": \\"Open Source\\", \\"reserved_percentage\\": 0, \\"max_over_subscription_ratio\\": \\"20.0\\", \\"replication_enabled\\": false, \\"storage_protocol\\": \\"ceph\\"}, \\"timestamp\\": \\"2021-11-28T04:30:25.921858\\"}, \\"_context_domain_id\\": null, \\"_unique_id\\": \\"82121467fe0143a180cc5d1ccbae1722\\", \\"_context_is_admin_project\\": true, \\"_context_project_name\\": null, \\"_context_read_deleted\\": \\"no\\", \\"_context_user_identity\\": \\"- - - - -\\", \\"_context_tenant\\": null, \\"_context_project_id\\": null, \\"_context_read_only\\": false, \\"_context_user_domain\\": null}\", \"oslo.version\": \"2.0\"}">>]},<<240,161,163,119,204,133,9,43,72,178,44,117,76,120,13,130>>,true},1,flow},false}} from <0.9387.4> to <0.449.0> in an old incarnation (1) of this node (3)9 v# s! d" R2 E# Y
6 `* `, a6 w9 B. b0 \; p) g; z1 I7 _
" c/ @; ]& L+ w; y7 n5 c=ERROR REPORT==== 30-Nov-2021::13:53:29 ===
$ g; Z7 W, M$ k+ h( zDiscarding message {'$gen_cast',{deliver,{delivery,false,true,<0.9568.4>,{basic_message,{resource,<<"/">>,exchange,<<"cinder-scheduler_fanout">>},[<<>>],{content,60,{'P_basic',<<"application/json">>,<<"utf-8">>,[],2,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<248,0,16,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110,5,117,116,102,45,56,0,0,0,0,2,0>>,rabbit_framing_amqp_0_9_1,[<<"{\"oslo.message\": \"{\\"_context_domain\\": null, \\"_context_request_id\\": \\"req-b000eeab-2474-45d3-8866-e47cb5272f33\\", \\"_context_global_request_id\\": null, \\"_context_quota_class\\": null, \\"_context_service_catalog\\": [], \\"_context_auth_token\\": null, \\"_context_resource_uuid\\": null, \\"_context_user\\": null, \\"_context_user_id\\": null, \\"_context_show_deleted\\": false, \\"_context_is_admin\\": true, \\"version\\": \\"3.3\\", \\"_context_project_domain\\": null, \\"_context_timestamp\\": \\"2021-11-28T04:30:25.732563\\", \\"method\\": \\"update_service_capabilities\\", \\"_context_project\\": null, \\"_context_remote_address\\": null, \\"_context_roles\\": [\\"admin\\"], \\"args\\": {\\"cluster_name\\": null, \\"service_name\\": \\"volume\\", \\"host\\": \\"rbd:pool-hdd-1@pool-hdd-1\\", \\"capabilities\\": {\\"filter_function\\": null, \\"location_info\\": \\"ceph:/etc/ceph/ceph.conf:29046cc0-0682-496b-98b1-912e59964282:cinder:pool-hdd-1\\", \\"goodness_function\\": null, \\"multiattach\\": false, \\"provisioned_capacity_gb\\": 0.0, \\"allocated_capacity_gb\\": 0, \\"volume_backend_name\\": \\"pool-hdd-1\\", \\"thin_provisioning_support\\": true, \\"free_capacity_gb\\": 57622.53, \\"driver_version\\": \\"1.2.0\\", \\"total_capacity_gb\\": 57622.53, \\"vendor_name\\": \\"Open Source\\", \\"reserved_percentage\\": 0, \\"max_over_subscription_ratio\\": \\"20.0\\", \\"replication_enabled\\": false, \\"storage_protocol\\": \\"ceph\\"}, \\"timestamp\\": \\"2021-11-28T04:30:25.921858\\"}, \\"_context_domain_id\\": null, \\"_unique_id\\": \\"82121467fe0143a180cc5d1ccbae1722\\", \\"_context_is_admin_project\\": true, \\"_context_project_name\\": null, \\"_context_read_deleted\\": \\"no\\", \\"_context_user_identity\\": \\"- - - - -\\", \\"_context_tenant\\": null, \\"_context_project_id\\": null, \\"_context_read_only\\": false, \\"_context_user_domain\\": null}\", \"oslo.version\": \"2.0\"}">>]},<<180,82,23,235,148,42,41,16,127,128,215,30,83,214,215,78>>,true},1,flow},false}} from <0.9568.4> to <0.449.0> in an old incarnation (1) of this node (3)
1 j( m. G: @4 U3 e
' X. ^: P' i, _, @$ c3 n% e=ERROR REPORT==== 30-Nov-2021::13:54:15 ===
1 z, L. ]# s' P$ v' Sclosing AMQP connection <0.9421.4> (10.160.77.3:40944 -> 10.160.77.1:5672 - neutron-server:26:8d7352b7-cf2b-448f-9c84-dd55a5736035):
+ |0 c* m% f& A4 [missed heartbeats from client, timeout: 60s
1 ?) Z& V ~* B% F- O3 `' a=INFO REPORT==== 30-Nov-2021::13:54:16 ===
: r) L6 V( P8 N- t( j2 v) jaccepting AMQP connection <0.9573.4> (10.160.77.3:49134 -> 10.160.77.1:5672)
4 C& i9 ^9 D0 v2 W0 h0 v2 V* Z=INFO REPORT==== 30-Nov-2021::13:54:16 ===
8 K/ Z2 V+ C9 R& r- h+ a6 ^Connection <0.9573.4> (10.160.77.3:49134 -> 10.160.77.1:5672) has a client-provided name: neutron-server:26:8d7352b7-cf2b-448f-9c84-dd55a57360357 [8 F: r. _) F& g* l. w
=INFO REPORT==== 30-Nov-2021::13:54:16 ===+ i. t& H; Y. q, L5 {
connection <0.9573.4> (10.160.77.3:49134 -> 10.160.77.1:5672 - neutron-server:26:8d7352b7-cf2b-448f-9c84-dd55a5736035): user 'openstack' authenticated and granted access to vhost '/'. C! |7 ~7 h5 K# q3 U" X' a
=ERROR REPORT==== 30-Nov-2021::13:54:16 ===
/ i9 U0 ?8 m& J. m+ Q- F, aDiscarding message {'$gen_cast',{deliver,{delivery,false,true,<0.9581.4>,{basic_message,{resource.... W) T% L& r4 k, U; r
=WARNING REPORT==== 30-Nov-2021::13:54:29 ===( p6 Y& X# q( M6 @: B
closing AMQP connection <0.9491.4> (10.160.77.3:44302 -> 10.160.77.1:5672 - cinder-volume:132:a4c453d2-4d58-4d65-a459-aaac01601687, vhost: '/', user: 'openstack'):0 L, a( l$ [9 \% \1 ?; D/ [: x4 A3 [
client unexpectedly closed TCP connection8 _3 @2 t+ U& _- W/ O
=INFO REPORT==== 30-Nov-2021::13:54:30 ===5 M0 f3 C! m; Y5 y. p9 ]
accepting AMQP connection <0.9588.4> (10.160.77.3:49768 -> 10.160.77.1:5672)
- [/ O3 T8 ^0 f( q2 I2 z=INFO REPORT==== 30-Nov-2021::13:54:30 ===
9 B' x6 A- [. M% Q5 x7 fConnection <0.9588.4> (10.160.77.3:49768 -> 10.160.77.1:5672) has a client-provided name: cinder-volume:132:a4c453d2-4d58-4d65-a459-aaac01601687- m# }$ H1 L4 j6 t
=INFO REPORT==== 30-Nov-2021::13:54:30 ===6 K4 [, f3 ]# j9 B( X: f; v- a
connection <0.9588.4> (10.160.77.3:49768 -> 10.160.77.1:5672 - cinder-volume:132:a4c453d2-4d58-4d65-a459-aaac01601687): user 'openstack' authenticated and granted access to vhost '/'& S3 k2 n/ E- ]3 d# k+ Z
=ERROR REPORT==== 30-Nov-2021::13:54:30 ===" y% M B/ D& L+ @
Discarding message {'$gen_cast',{deliver,{delivery,false,true,<0.9596.4>,{basic_message,{resource,<<"/">>,exchange,<<"cinder-scheduler_fanout">>},[<<>>],{content,60,{'P_basic',<<"application/json">>,<<"utf-8">>,[],2,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<248,0,16,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110,5,117,116,102,45,56,0,0,0,0,2,0>>,rabbit_framing_amqp_0_9_1,[<<"{\"oslo.message\": \"{\\"_context_domain\\": null, \\"_context_request_id\\": \\"req-e9711de3-e1e8-4012-a28d-3554c0374a8d\\", \\"_context_global_request_id\\": null, \\"_context_quota_class\\": null, \\"_context_service_catalog\\": [], \\"_context_auth_token\\": null, \\"_context_resource_uuid\\": null, \\"_context_user\\": null, \\"_context_user_id\\": null, \\"_context_show_deleted\\": false, \\"_context_is_admin\\": true, \\"version\\": \\"3.3\\", \\"_context_project_domain\\": null, \\"_context_timestamp\\": \\"2021-11-28T04:30:25.722800\\", \\"method\\": \\"update_service_capabilities\\", \\"_context_project\\": null, \\"_context_remote_address\\": null, \\"_context_roles\\": [\\"admin\\"], \\"args\\": {\\"cluster_name\\": null, \\"service_name\\": \\"volume\\", \\"host\\": \\"rbd:pool-ssd-2@pool-ssd-2\\", \\"capabilities\\": {\\"filter_function\\": null, \\"location_info\\": \\"ceph:/etc/ceph/ceph.conf:29046cc0-0682-496b-98b1-912e59964282:cinder:pool-ssd-2\\", \\"goodness_function\\": null, \\"multiattach\\": false, \\"provisioned_capacity_gb\\": 8800.0, \\"allocated_capacity_gb\\": 0, \\"volume_backend_name\\": \\"pool-ssd-2\\", \\"thin_provisioning_support\\": true, \\"free_capacity_gb\\": 17843.5, \\"driver_version\\": \\"1.2.0\\", \\"total_capacity_gb\\": 18295.89, \\"vendor_name\\": \\"Open Source\\", \\"reserved_percentage\\": 0, \\"max_over_subscription_ratio\\": \\"20.0\\", \\"replication_enabled\\": false, \\"storage_protocol\\": \\"ceph\\"}, \\"timestamp\\": \\"2021-11-28T04:30:26.163230\\"}, \\"_context_domain_id\\": null, \\"_unique_id\\": \\"1ac2dd9d9083443183d01d576ac844c3\\", \\"_context_is_admin_project\\": true, \\"_context_project_name\\": null, \\"_context_read_deleted\\": \\"no\\", \\"_context_user_identity\\": \\"- - - - -\\", \\"_context_tenant\\": null, \\"_context_project_id\\": null, \\"_context_read_only\\": false, \\"_context_user_domain\\": null}\", \"oslo.version\": \"2.0\"}">>]},<<107,53,236,113,26,133,171,127,148,8,15,143,148,87,11,11>>,true},1,flow},false}} from <0.9596.4> to <0.449.0> in an old incarnation (1) of this node (3) X( o6 X; v, ~, C
5 y8 G' U/ A, U7 |6 ~/ a=WARNING REPORT==== 30-Nov-2021::13:55:25 ===4 r6 ~4 u W9 k0 i0 H
closing AMQP connection <0.9519.4> (10.160.77.1:56460 -> 10.160.77.1:5672 - cinder-volume:49:cec311b7-f3bf-4b62-9397-7722d3b140db, vhost: '/', user: 'openstack'):
- _, z: X4 V0 {& I/ P8 lclient unexpectedly closed TCP connection; F: j7 C" P2 {+ ~8 I
=INFO REPORT==== 30-Nov-2021::13:55:26 ===0 v9 R4 f6 l C# j( G3 Y8 d
accepting AMQP connection <0.9604.4> (10.160.77.1:33776 -> 10.160.77.1:5672)
* \3 K" U4 h. P. }9 W4 N=INFO REPORT==== 30-Nov-2021::13:55:26 ===
# S. p* N% R& X, j+ m; B/ B3 f7 F% lConnection <0.9604.4> (10.160.77.1:33776 -> 10.160.77.1:5672) has a client-provided name: cinder-volume:49:cec311b7-f3bf-4b62-9397-7722d3b140db5 J2 T& s3 N$ n( C4 {9 W* _; }
=INFO REPORT==== 30-Nov-2021::13:55:26 ===
2 f. N0 b7 L1 l- t3 nconnection <0.9604.4> (10.160.77.1:33776 -> 10.160.77.1:5672 - cinder-volume:49:cec311b7-f3bf-4b62-9397-7722d3b140db): user 'openstack' authenticated and granted access to vhost '/'
' v; j7 ^! E# z+ L4 Q N$ Z=ERROR REPORT==== 30-Nov-2021::13:55:26 ===
& k; h& T4 T5 [9 HDiscarding message {'$gen_cast',{deliver,{delivery,false,true,<0.9612.4>,{basic_message,{resource,<<"/">>,exchange,<<"cinder-scheduler_fanout">>},[<<>>],{content,60,{'P_basic',<<"application/json">>,<<"utf-8">>,[],2,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<248,0,16,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110,5,117,116,102,45,56,0,0,0,0,2,0>>,rabbit_framing_amqp_0_9_1,[<<"{\"oslo.message\": \"{\\"_context_domain\\": null, \\"_context_request_id\\": \\"req-5a8df086-f7f3-4eee-94b6-0a676f734bb5\\", \\"_context_global_request_id\\": null, \\"_context_quota_class\\": null, \\"_context_service_catalog\\": [], \\"_context_auth_token\\": null, \\"_context_resource_uuid\\": null, \\"_context_user\\": null, \\"_context_user_id\\": null, \\"_context_show_deleted\\": false, \\"_context_is_admin\\": true, \\"version\\": \\"3.3\\", \\"_context_project_domain\\": null, \\"_context_timestamp\\": \\"2021-11-28T04:30:25.748442\\", \\"method\\": \\"update_service_capabilities\\", \\"_context_project\\": null, \\"_context_remote_address\\": null, \\"_context_roles\\": [\\"admin\\"], \\"args\\": {\\"cluster_name\\": null, \\"service_name\\": \\"volume\\", \\"host\\": \\"rbd:pool-hdd-2@pool-hdd-2\\", \\"capabilities\\": {\\"filter_function\\": null, \\"location_info\\": \\"ceph:/etc/ceph/ceph.conf:29046cc0-0682-496b-98b1-912e59964282:cinder:pool-hdd-2\\", \\"goodness_function\\": null, \\"multiattach\\": false, \\"provisioned_capacity_gb\\": 28250.0, \\"allocated_capacity_gb\\": 28250, \\"volume_backend_name\\": \\"pool-hdd-2\\", \\"thin_provisioning_support\\": true, \\"free_capacity_gb\\": 28811.26, \\"driver_version\\": \\"1.2.0\\", \\"total_capacity_gb\\": 31254.06, \\"vendor_name\\": \\"Open Source\\", \\"reserved_percentage\\": 0, \\"max_over_subscription_ratio\\": \\"20.0\\", \\"replication_enabled\\": false, \\"storage_protocol\\": \\"ceph\\"}, \\"timestamp\\": \\"2021-11-28T04:30:26.485450\\"}, \\"_context_domain_id\\": null, \\"_unique_id\\": \\"5ff5729da25540deb217c7a7a97abb68\\", \\"_context_is_admin_project\\": true, \\"_context_project_name\\": null, \\"_context_read_deleted\\": \\"no\\", \\"_context_user_identity\\": \\"- - - - -\\", \\"_context_tenant\\": null, \\"_context_project_id\\": null, \\"_context_read_only\\": false, \\"_context_user_domain\\": null}\", \"oslo.version\": \"2.0\"}">>]},<<165,168,206,246,154,211,38,29,9,142,127,114,251,233,147,123>>,true},1,flow},false}} from <0.9612.4> to <0.449.0> in an old incarnation (1) of this node (3)
M( y9 t- M0 c c; n
% y2 k- o! m4 a! t% t=WARNING REPORT==== 30-Nov-2021::13:55:27 ===0 w' ` D- \5 k7 e& H
closing AMQP connection <0.9536.4> (10.160.77.2:40538 -> 10.160.77.1:5672 - cinder-volume:48:62c1d852-1b2c-4ba4-a106-72943a12c8ed, vhost: '/', user: 'openstack'):
7 z. ] ~9 b1 bclient unexpectedly closed TCP connection
* d: w' d+ } @+ C5 K% X1 j. n2 ]=WARNING REPORT==== 30-Nov-2021::13:55:28 ===6 u2 `# s$ y9 w) F9 \; ?
closing AMQP connection <0.9549.4> (10.160.77.3:46964 -> 10.160.77.1:5672 - cinder-volume:35:3d494828-2f23-43bb-a63a-5ae6f6b7b168, vhost: '/', user: 'openstack'):
. \' s" [) z# |/ k8 w* L/ `" Kclient unexpectedly closed TCP connection& [! L* X( X4 Y# F3 M8 B& A
=INFO REPORT==== 30-Nov-2021::13:55:28 ===
5 U' E$ z) u, \' raccepting AMQP connection <0.9619.4> (10.160.77.2:46004 -> 10.160.77.1:5672)
, _: @; D) V4 [8 P# X2 r=INFO REPORT==== 30-Nov-2021::13:55:28 ===: i- S4 G7 ?' `6 {
Connection <0.9619.4> (10.160.77.2:46004 -> 10.160.77.1:5672) has a client-provided name: cinder-volume:48:62c1d852-1b2c-4ba4-a106-72943a12c8ed
) w) W% d/ F d: u' t3 P! b' R=INFO REPORT==== 30-Nov-2021::13:55:28 ===2 a' v Z+ H, G, w! E& f
connection <0.9619.4> (10.160.77.2:46004 -> 10.160.77.1:5672 - cinder-volume:48:62c1d852-1b2c-4ba4-a106-72943a12c8ed): user 'openstack' authenticated and granted access to vhost '/'
# x/ l3 f' F, q- O6 | @% ^, k; v=ERROR REPORT==== 30-Nov-2021::13:55:28 ===* D: L' u& H; J4 s4 h5 e
Discarding message {'$gen_cast',{deliver,{delivery,false,true,<0.9627.4>,{basic_message,{resource,<<"/">>,exchange,<<"cinder-scheduler_fanout">>},[<<>>],{content,60,{'P_basic',<<"application/json">>,<<"utf-8">>,[],2,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<248,0,16,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110,5,117,116,102,45,56,0,0,0,0,2,0>>,rabbit_framing_amqp_0_9_1,[<<"{\"oslo.message\": \"{\\"_context_domain\\": null, \\"_context_request_id\\": \\"req-4f98ba2b-ea1b-4627-a481-93755e3f7738\\", \\"_context_global_request_id\\": null, \\"_context_quota_class\\": null, \\"_context_service_catalog\\": [], \\"_context_auth_token\\": null, \\"_context_resource_uuid\\": null, \\"_context_user\\": null, \\"_context_user_id\\": null, \\"_context_show_deleted\\": false, \\"_context_is_admin\\": true, \\"version\\": \\"3.3\\", \\"_context_project_domain\\": null, \\"_context_timestamp\\": \\"2021-11-28T04:30:25.760304\\", \\"method\\": \\"update_service_capabilities\\", \\"_context_project\\": null, \\"_context_remote_address\\": null, \\"_context_roles\\": [\\"admin\\"], \\"args\\": {\\"cluster_name\\": null, \\"service_name\\": \\"volume\\", \\"host\\": \\"rbd:pool-hdd-1@pool-hdd-1\\", \\"capabilities\\": {\\"filter_function\\": null, \\"location_info\\": \\"ceph:/etc/ceph/ceph.conf:29046cc0-0682-496b-98b1-912e59964282:cinder:pool-hdd-1\\", \\"goodness_function\\": null, \\"multiattach\\": false, \\"provisioned_capacity_gb\\": 0.0, \\"allocated_capacity_gb\\": 0, \\"volume_backend_name\\": \\"pool-hdd-1\\", \\"thin_provisioning_support\\": true, \\"free_capacity_gb\\": 57622.53, \\"driver_version\\": \\"1.2.0\\", \\"total_capacity_gb\\": 57622.53, \\"vendor_name\\": \\"Open Source\\", \\"reserved_percentage\\": 0, \\"max_over_subscription_ratio\\": \\"20.0\\", \\"replication_enabled\\": false, \\"storage_protocol\\": \\"ceph\\"}, \\"timestamp\\": \\"2021-11-28T04:30:25.921913\\"}, \\"_context_domain_id\\": null, \\"_unique_id\\": \\"a1d65331713d4d2cb29103909aebf1ba\\", \\"_context_is_admin_project\\": true, \\"_context_project_name\\": null, \\"_context_read_deleted\\": \\"no\\", \\"_context_user_identity\\": \\"- - - - -\\", \\"_context_tenant\\": null, \\"_context_project_id\\": null, \\"_context_read_only\\": false, \\"_context_user_domain\\": null}\", \"oslo.version\": \"2.0\"}">>]},<<70,51,6,232,233,225,143,184,196,130,15,44,32,27,206,118>>,true},1,flow},false}} from <0.9627.4> to <0.449.0> in an old incarnation (1) of this node (3)
- A- n& A5 P3 |7 v: {; n! N3 c5 C; B3 \! l; N
=WARNING REPORT==== 30-Nov-2021::13:55:29 ===
, n$ X1 V! \. g3 Eclosing AMQP connection <0.9560.4> (10.160.77.3:47024 -> 10.160.77.1:5672 - cinder-volume:38:28fbb28c-6b04-4d9a-bd41-e7b7c954374d, vhost: '/', user: 'openstack'): z+ D% [) w4 @; K8 t& K5 Z1 n7 Z
client unexpectedly closed TCP connection
9 K+ i2 F/ z" R3 j& ~4 f, o=INFO REPORT==== 30-Nov-2021::13:55:29 ===( r( k6 ^) q n+ T) d3 ^ D8 t, M
accepting AMQP connection <0.9632.4> (10.160.77.3:52452 -> 10.160.77.1:5672)) m5 I9 w& a X( x7 Y( W
=INFO REPORT==== 30-Nov-2021::13:55:29 ===
* d$ p0 V2 X0 ZConnection <0.9632.4> (10.160.77.3:52452 -> 10.160.77.1:5672) has a client-provided name: cinder-volume:35:3d494828-2f23-43bb-a63a-5ae6f6b7b168! J) q4 y8 v+ r9 N# ^( C# ^. H9 b
=INFO REPORT==== 30-Nov-2021::13:55:29 ===
7 T7 f8 `2 u; T, e4 a [connection <0.9632.4> (10.160.77.3:52452 -> 10.160.77.1:5672 - cinder-volume:35:3d494828-2f23-43bb-a63a-5ae6f6b7b168): user 'openstack' authenticated and granted access to vhost '/'1 F$ N) P" o# ~
=ERROR REPORT==== 30-Nov-2021::13:55:29 ===6 a1 K' V4 L" M1 h
Discarding message {'$gen_cast',{deliver,{delivery,false,true,<0.9640.4>,{basic_message,{resource,<<"/">>,exchange,<<"cinder-scheduler_fanout">>},[<<>>],{content,60,{'P_basic',<<"application/json">>,<<"utf-8">>,[],2,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<248,0,16,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110,5,117,116,102,45,56,0,0,0,0,2,0>>,rabbit_framing_amqp_0_9_1,[<<"{\"oslo.message\": \"{\\"_context_domain\\": null, \\"_context_request_id\\": \\"req-a21b6b10-490d-46a5-a23f-7caf5cf576eb\\", \\"_context_global_request_id\\": null, \\"_context_quota_class\\": null, \\"_context_service_catalog\\": [], \\"_context_auth_token\\": null, \\"_context_resource_uuid\\": null, \\"_context_user\\": null, \\"_context_user_id\\": null, \\"_context_show_deleted\\": false, \\"_context_is_admin\\": true, \\"version\\": \\"3.3\\", \\"_context_project_domain\\": null, \\"_context_timestamp\\": \\"2021-11-28T04:30:25.743952\\", \\"method\\": \\"update_service_capabilities\\", \\"_context_project\\": null, \\"_context_remote_address\\": null, \\"_context_roles\\": [\\"admin\\"], \\"args\\": {\\"cluster_name\\": null, \\"service_name\\": \\"volume\\", \\"host\\": \\"rbd:pool-hdd-2@pool-hdd-2\\", \\"capabilities\\": {\\"filter_function\\": null, \\"location_info\\": \\"ceph:/etc/ceph/ceph.conf:29046cc0-0682-496b-98b1-912e59964282:cinder:pool-hdd-2\\", \\"goodness_function\\": null, \\"multiattach\\": false, \\"provisioned_capacity_gb\\": 28250.0, \\"allocated_capacity_gb\\": 28250, \\"volume_backend_name\\": \\"pool-hdd-2\\", \\"thin_provisioning_support\\": true, \\"free_capacity_gb\\": 28811.26, \\"driver_version\\": \\"1.2.0\\", \\"total_capacity_gb\\": 31254.06, \\"vendor_name\\": \\"Open Source\\", \\"reserved_percentage\\": 0, \\"max_over_subscription_ratio\\": \\"20.0\\", \\"replication_enabled\\": false, \\"storage_protocol\\": \\"ceph\\"}, \\"timestamp\\": \\"2021-11-28T04:30:26.483769\\"}, \\"_context_domain_id\\": null, \\"_unique_id\\": \\"d4ce84c74c99440392d5264f0fa3ff90\\", \\"_context_is_admin_project\\": true, \\"_context_project_name\\": null, \\"_context_read_deleted\\": \\"no\\", \\"_context_user_identity\\": \\"- - - - -\\", \\"_context_tenant\\": null, \\"_context_project_id\\": null, \\"_context_read_only\\": false, \\"_context_user_domain\\": null}\", \"oslo.version\": \"2.0\"}">>]},<<72,231,171,116,139,232,213,203,215,174,98,158,232,230,145,118>>,true},1,flow},false}} from <0.9640.4> to <0.449.0> in an old incarnation (1) of this node (3)" N: S4 ~) i) N5 c
/ O2 e' Q, `+ v9 V/ F! E N6 V
=INFO REPORT==== 30-Nov-2021::13:55:30 ===/ v* C# V% Q9 a5 G" b0 Y
accepting AMQP connection <0.9643.4> (10.160.77.3:52486 -> 10.160.77.1:5672)
$ R6 n# F/ y+ J/ R) p* R=INFO REPORT==== 30-Nov-2021::13:55:30 ===
% C3 L& l% q" Z5 d6 D/ q, xConnection <0.9643.4> (10.160.77.3:52486 -> 10.160.77.1:5672) has a client-provided name: cinder-volume:38:28fbb28c-6b04-4d9a-bd41-e7b7c954374d) C+ a0 \- K: g$ D) T, P+ p1 y
=INFO REPORT==== 30-Nov-2021::13:55:30 ===
, x8 y$ i3 x4 Q/ j. O( H4 ^connection <0.9643.4> (10.160.77.3:52486 -> 10.160.77.1:5672 - cinder-volume:38:28fbb28c-6b04-4d9a-bd41-e7b7c954374d): user 'openstack' authenticated and granted access to vhost '/'
5 O8 K8 s7 }" l8 _=ERROR REPORT==== 30-Nov-2021::13:55:30 ===
/ s6 v4 L: B" ~+ q4 N" r( wDiscarding message {'$gen_cast',{deliver,{delivery,false,true,<0.9651.4>,{basic_message,{resource,<<"/">>,exchange,<<"cinder-scheduler_fanout">>},[<<>>],{content,60,{'P_basic',<<"application/json">>,<<"utf-8">>,[],2,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<248,0,16,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110,5,117,116,102,45,56,0,0,0,0,2,0>>,rabbit_framing_amqp_0_9_1,[<<"{\"oslo.message\": \"{\\"_context_domain\\": null, \\"_context_request_id\\": \\"req-b000eeab-2474-45d3-8866-e47cb5272f33\\", \\"_context_global_request_id\\": null, \\"_context_quota_class\\": null, \\"_context_service_catalog\\": [], \\"_context_auth_token\\": null, \\"_context_resource_uuid\\": null, \\"_context_user\\": null, \\"_context_user_id\\": null, \\"_context_show_deleted\\": false, \\"_context_is_admin\\": true, \\"version\\": \\"3.3\\", \\"_context_project_domain\\": null, \\"_context_timestamp\\": \\"2021-11-28T04:30:25.732563\\", \\"method\\": \\"update_service_capabilities\\", \\"_context_project\\": null, \\"_context_remote_address\\": null, \\"_context_roles\\": [\\"admin\\"], \\"args\\": {\\"cluster_name\\": null, \\"service_name\\": \\"volume\\", \\"host\\": \\"rbd:pool-hdd-1@pool-hdd-1\\", \\"capabilities\\": {\\"filter_function\\": null, \\"location_info\\": \\"ceph:/etc/ceph/ceph.conf:29046cc0-0682-496b-98b1-912e59964282:cinder:pool-hdd-1\\", \\"goodness_function\\": null, \\"multiattach\\": false, \\"provisioned_capacity_gb\\": 0.0, \\"allocated_capacity_gb\\": 0, \\"volume_backend_name\\": \\"pool-hdd-1\\", \\"thin_provisioning_support\\": true, \\"free_capacity_gb\\": 57622.53, \\"driver_version\\": \\"1.2.0\\", \\"total_capacity_gb\\": 57622.53, \\"vendor_name\\": \\"Open Source\\", \\"reserved_percentage\\": 0, \\"max_over_subscription_ratio\\": \\"20.0\\", \\"replication_enabled\\": false, \\"storage_protocol\\": \\"ceph\\"}, \\"timestamp\\": \\"2021-11-28T04:30:25.921858\\"}, \\"_context_domain_id\\": null, \\"_unique_id\\": \\"82121467fe0143a180cc5d1ccbae1722\\", \\"_context_is_admin_project\\": true, \\"_context_project_name\\": null, \\"_context_read_deleted\\": \\"no\\", \\"_context_user_identity\\": \\"- - - - -\\", \\"_context_tenant\\": null, \\"_context_project_id\\": null, \\"_context_read_only\\": false, \\"_context_user_domain\\": null}\", \"oslo.version\": \"2.0\"}">>]},<<16,41,146,38,121,104,209,85,161,90,4,177,187,14,25,196>>,true},1,flow},false}} from <0.9651.4> to <0.449.0> in an old incarnation (1) of this node (3)( H: o/ s; ^. D+ ~& {7 Y. q
4 h. h" p" h2 S=ERROR REPORT==== 30-Nov-2021::13:55:33 ===$ t( G4 W: \0 ]
closing AMQP connection <0.9504.4> (10.160.77.2:38086 -> 10.160.77.1:5672 - neutron-server:31:f79d6a3f-6719-4703-b53f-90c24e454a57):& f1 @& j2 h) A5 {* }1 {2 R" M# k
missed heartbeats from client, timeout: 60s
: a4 C1 u8 w7 @3 I) q=INFO REPORT==== 30-Nov-2021::13:55:34 ===, i' u0 y3 o# I/ J: {
accepting AMQP connection <0.9656.4> (10.160.77.2:46280 -> 10.160.77.1:5672)1 W7 f% s# Z+ D( x- i
=INFO REPORT==== 30-Nov-2021::13:55:34 ===0 ? H/ w) ?3 ?5 L N K& I
Connection <0.9656.4> (10.160.77.2:46280 -> 10.160.77.1:5672) has a client-provided name: neutron-server:31:f79d6a3f-6719-4703-b53f-90c24e454a57
$ }' j5 J) _2 F=INFO REPORT==== 30-Nov-2021::13:55:34 ===
4 {* ?9 W, d# s) y- d: uconnection <0.9656.4> (10.160.77.2:46280 -> 10.160.77.1:5672 - neutron-server:31:f79d6a3f-6719-4703-b53f-90c24e454a57): user 'openstack' authenticated and granted access to vhost '/'
9 Q* D: O- h$ ]8 z4 i) |! U0 i=ERROR REPORT==== 30-Nov-2021::13:55:35 ===4 K1 b' H" j# ^9 z k+ [7 X
Discarding message {'$gen_cast',{deliver,{delivery,false,true,<0.9664.4>,{basic_message,{resource...
3 Z7 C1 V8 L/ V6 S m/ h1 O8 o P+ v2 {$ U; @) t2 v
|
|