openstack平台dashboard出现闪退

admin

dashboard的闪退问题
4 p8 t6 X& h/ Z: b; h6 i) c- P[Sun Sep 02 13:31:09.172447 2018] [:error] [pid 28024] INFO openstack_auth.plugin.base Attempted scope to domain default failed, will attemptto scope to another domain.
; {, n$ ~, }0 g7 Y[Sun Sep 02 13:31:09.346659 2018] [:error] [pid 28024] INFO openstack_auth.forms Login successful for user "admin" using domain "default", remote address 192.168.90.1.

9 @- z5 D( d4 L3 L  ~! Y1 K* l[Sun Sep 02 13:34:25.577781 2018] [authz_core:error] [pid 28419] [client 192.168.90.1:57704] AH01630: client denied by server configuration: /usr/bin/keystone-wsgi-public, referer: http://192.168.90.65/dashboard/auth/login/

8 P4 N. c) j! qopenstack-status
9 m2 U' e" {: n' t+ S/ T+ y' s! O== Nova services ==
$ K4 A: _' M7 C1 h6 gopenstack-nova-api:                     active
openstack-nova-compute:                 inactive  (disabled on boot)
openstack-nova-network:                 inactive  (disabled on boot)
openstack-nova-scheduler:               active
openstack-nova-conductor:               active
openstack-nova-console:                 inactive  (disabled on boot)
9 r$ l$ w' g4 z* Zopenstack-nova-consoleauth:             active
openstack-nova-xvpvncproxy:             inactive  (disabled on boot)
== Glance services ==
openstack-glance-api:                   active
openstack-glance-registry:              active
== Keystone service ==
openstack-keystone:                     inactive  (disabled on boot)
== Horizon service ==
  G# s' X2 [7 }! v4 w# G+ Z9 Y5 ropenstack-dashboard:                    uncontactable
* R& Q6 m( E1 ~1 q2 n9 {$ a6 \! _: f: k+ G== neutron services ==
" p$ E7 d8 [3 M8 o+ y! Q; Aneutron-server:                         active
neutron-dhcp-agent:                     active
neutron-l3-agent:                       active
6 D. D+ Y) z+ c+ nneutron-metadata-agent:                 active
neutron-linuxbridge-agent:              active
== Support services ==
5 v5 l7 H* X/ }mariadb:                                active
dbus:                                   active
rabbitmq-server:                        active
. ^5 l4 B, ^3 \: b% {memcached:                              active
== Keystone users ==
+----------------------------------+-----------+
, w' R+ C' }6 G3 L9 ^" y; f8 E| ID                               | Name      |
3 ^; |  F$ B0 C" z1 `* V+----------------------------------+-----------+
2 B0 j+ q# x  ~5 V| 35cba790e2b44595a9219e6c18176065 | nova      |
| 72177ec2346542518bb5e5a14f2745d4 | glance    |
% \) Q7 L2 B; t# I: p| 893fd35e580c4d54a8c775d84207b191 | admin     |
5 I# l1 M8 y% m| 91506d00e6e14cec99bf448cbb189a9a | neutron   |
2 s# o1 a- |$ d+ }3 j+ W+ {! A| a47170e629444ae59e655f11f92022d9 | placement |
  l8 {2 h8 W7 D3 f$ G" \! m& l+ s| af71b1d71cc54262aee370e9b6d5c622 | demo      |
; M5 \: N/ u3 g+----------------------------------+-----------+
== Glance images ==
+--------------------------------------+---------------------+
| ID                                   | Name                |
+--------------------------------------+---------------------+
| 047884ba-6a47-45c0-8ace-d72c5d566367 | cirros              |
| 2c685860-4fa2-43dd-abad-1cae69e59861 | cirros-0.3.4-x86_64 |
/ A/ e# e" t; d0 q+--------------------------------------+---------------------+
== Nova managed services ==
/ f# U* {1 ^3 J. K: a  f+--------------------------------------+------------------+------------+----------+---------+-------+----------------------------+-----------------+-------------+
( B, N" {) O+ |  N. \| Id                                   | Binary           | Host       | Zone     | Status  | State | Updated_at                 | Disabled Reason | Forced down |
+--------------------------------------+------------------+------------+----------+---------+-------+----------------------------+-----------------+-------------+
| 11290f6e-283f-4309-884e-7a171ab0a53e | nova-consoleauth | controller | internal | enabled | up    | 2018-09-02T05:35:44.000000 | -               | False       |
% d8 Q0 ?- w- M% y| 1c161768-160b-4829-9245-1ba3598ab5a4 | nova-scheduler   | controller | internal | enabled | up    | 2018-09-02T05:35:41.000000 | -               | False       |
6 d+ |$ ~2 t- O# y| 6d66755b-76bf-481d-a4ec-1ccddd8641c5 | nova-conductor   | controller | internal | enabled | up    | 2018-09-02T05:35:47.000000 | -               | False       |
5 Y. i1 Q; [  T3 M; D9 g| 8d12536b-22d2-44e7-a1d5-656d20ff0393 | nova-compute     | compute    | nova     | enabled | up    | 2018-09-02T05:35:49.000000 | -               | False       |
3 W8 U" p$ e: _9 Q6 B. [+--------------------------------------+------------------+------------+----------+---------+-------+----------------------------+-----------------+-------------+
) q/ h* J: V1 q* g/ f7 z- Q* k6 t== Nova networks ==
/ E$ a* }7 T$ @8 Z! b5 e: fusage: nova [--version] [--debug] [--os-cache] [--timings]
            [--os-region-name <region-name>] [--service-type <service-type>]
5 z" s" ^; ?: {  |# n$ j. Y            [--service-name <service-name>]
            [--os-endpoint-type <endpoint-type>]
            [--os-compute-api-version <compute-api-ver>]
            [--endpoint-override <bypass-url>] [--profile HMAC_KEY]
            [--insecure] [--os-cacert <ca-certificate>]
            [--os-cert <certificate>] [--os-key <key>] [--timeout <seconds>]
            [--os-auth-type <name>] [--os-auth-url OS_AUTH_URL]
            [--os-system-scope OS_SYSTEM_SCOPE] [--os-domain-id OS_DOMAIN_ID]
            [--os-domain-name OS_DOMAIN_NAME] [--os-project-id OS_PROJECT_ID]
; A2 S. d) e- I" N2 ~/ M4 ~) P            [--os-project-name OS_PROJECT_NAME]
8 k1 u4 w2 h" a2 \            [--os-project-domain-id OS_PROJECT_DOMAIN_ID]
            [--os-project-domain-name OS_PROJECT_DOMAIN_NAME]
            [--os-trust-id OS_TRUST_ID]
" _' i, X7 k! Z. K8 F1 C, Z; p            [--os-default-domain-id OS_DEFAULT_DOMAIN_ID]
            [--os-default-domain-name OS_DEFAULT_DOMAIN_NAME]
0 C1 f+ O7 z1 Q* @/ m0 R            [--os-user-id OS_USER_ID] [--os-username OS_USERNAME]
            [--os-user-domain-id OS_USER_DOMAIN_ID]
            [--os-user-domain-name OS_USER_DOMAIN_NAME]
            [--os-password OS_PASSWORD]
, |  Q1 q4 g; J: G+ e! U            <subcommand> ...
error: argument <subcommand>: invalid choice: u'network-list'
Try 'nova help ' for more information.
( g1 ]7 Q% p1 ]2 V== Nova instance flavors ==
+----+------+-----------+------+-----------+------+-------+-------------+-----------+-------------+
| ID | Name | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public | Description |
+----+------+-----------+------+-----------+------+-------+-------------+-----------+-------------+
* b! h+ }7 w& a# J4 M8 l+----+------+-----------+------+-----------+------+-------+-------------+-----------+-------------+
== Nova instances ==
+----+------+-----------+--------+------------+-------------+----------+
| ID | Name | Tenant ID | Status | Task State | Power State | Networks |
8 \8 Z3 }9 }! [2 l/ i2 Y6 l+----+------+-----------+--------+------------+-------------+----------+
+----+------+-----------+--------+------------+-------------+----------+

admin

### 重启httpd memcached rabbitmq-server 和neutron服务，还是 无法修复
7 i9 ]6 q) \1 y% O: R2 O
查看keystone
# M% k# }# X" |8 X- O" [

openstack service list
+----------------------------------+-----------+-----------+
9 S- \" h9 V, @& F| ID                               | Name      | Type      |
, H5 N5 f6 S% N+ }) j+----------------------------------+-----------+-----------+
  {8 w: `; U; B2 q4 p| 02929a487f484e9fbb2221d11212b11f | neutron   | network   |
! B( D$ Y9 P- ^| 1b0061ff680042ea8bd764de0cefc25a | placement | placement |
| 48cc7da12bb84f118ed528c57ba1cb3c | nova      | compute   |
2 U2 e( D/ l) v' U* ^| 75581fbfdf244aa78b5aba2a656a53e5 | keystone  | identity  |
7 _  J9 ]1 e* n( Y| ae94823f314c46098f1ff04dba0427db | glance    | image     |
+----------------------------------+-----------+-----------+

没有发现重复的demain

5 N1 w8 f* E8 S( K% u$ K############重启控制节点，   节点无法修复

• systemctl restart rabbitmq-server.service
  # ]7 s3 O- Q: p$ `5 m
  , l! f7 H; @% H
• 
  ' N' m8 ~9 V2 a* ]- O  K
  systemctl restart neutron-server.service                 
  
  # s+ j4 R4 c6 S
• 
  & @9 N0 L" R3 B4 S: R
  9 Z" ?0 ~/ s  U2 l: Hsystemctl daemon-reload
  6 F: j7 Y4 z: @
  
• 
  
  " h+ ]8 q% u2 u0 g. p1 nsystemctl stop httpd.service memcached
  
  2 K5 w" O! q- H+ @  I% w5 v
• 
  
  最后搞定
  
  
• 
  * t+ Q4 L) s! n+ m) i' B8 F7 A
  5 {: E' m  }  \5 k

0 }+ C- A% }( T& A7 ~, j, L

心得：由于本环境是多控节点，rabbitmq-server 集群 没有优化，出现故障较多，建议如果发现有amqp 相关报错，先检查 rabbitmq 服务，有问题就重启一下

, U6 `) e5 ^. s" D7 o

admin

=ERROR REPORT==== 2-Sep-2018::13:43:24 ===
closing AMQP connection <0.1199.0> (192.168.90.65:48940 -> 192.168.90.65:5672):
8 |1 P  Y( B- S/ r/ v* N{handshake_error,starting,1,
. F0 K" p2 ^+ ^9 i6 b                 {amqp_error,unexpected_frame,
1 D1 N' W$ t9 H& k6 {                             "type 1, first 16 octets = <<0,60,0,40,0,0,38,114,101,112,108,121,95,57,48,50>>",
3 F8 j- v  i) `4 C& W) ?                             none}}

admin

keystone  access信息：
' S  O# z% ]- N! T$ P7 C192.168.90.65 - - [02/Sep/2018:13:47:26 +0800] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.6 (CentOS) mod_wsgi/3.4 Python/2.7.5 (internal dummy connection)"
192.168.90.65 - - [02/Sep/2018:13:47:34 +0800] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.6 (CentOS) mod_wsgi/3.4 Python/2.7.5 (internal dummy connection)"
& w3 R5 P) O0 z* _" T
6 N' ]9 }5 t0 _( ?% Z* S+ y( c也没有发现问题，尴尬

admin

后来测试发现，使用Firefox浏览器好像可以减少dashboard页面闪退现象。这是浏览器的问题么？