openstack平台dashboard出现闪退

admin

dashboard的闪退问题
[Sun Sep 02 13:31:09.172447 2018] [:error] [pid 28024] INFO openstack_auth.plugin.base Attempted scope to domain default failed, will attemptto scope to another domain.
& g8 U1 u, F8 P8 \, z. |[Sun Sep 02 13:31:09.346659 2018] [:error] [pid 28024] INFO openstack_auth.forms Login successful for user "admin" using domain "default", remote address 192.168.90.1.

[Sun Sep 02 13:34:25.577781 2018] [authz_core:error] [pid 28419] [client 192.168.90.1:57704] AH01630: client denied by server configuration: /usr/bin/keystone-wsgi-public, referer: http://192.168.90.65/dashboard/auth/login/

openstack-status
/ E9 |1 V* |0 w7 O' k! R/ F" U== Nova services ==
openstack-nova-api:                     active
openstack-nova-compute:                 inactive  (disabled on boot)
: ]' \7 j, ?/ X, R) _7 ]6 n+ topenstack-nova-network:                 inactive  (disabled on boot)
openstack-nova-scheduler:               active
openstack-nova-conductor:               active
openstack-nova-console:                 inactive  (disabled on boot)
openstack-nova-consoleauth:             active
openstack-nova-xvpvncproxy:             inactive  (disabled on boot)
== Glance services ==
; C4 }# ~5 C3 J. z& Q: O9 n6 nopenstack-glance-api:                   active
openstack-glance-registry:              active
7 {0 W, u. M4 i$ I; S( G== Keystone service ==
4 U1 B* }0 J& p. Xopenstack-keystone:                     inactive  (disabled on boot)
. I, `4 @# ?# j== Horizon service ==
& V' g2 t. D$ J! w8 ~6 iopenstack-dashboard:                    uncontactable
8 w' T) [5 i" m6 h$ p1 `1 d' r== neutron services ==
" ?- N4 n7 S. X6 `$ o5 ^$ Oneutron-server:                         active
6 \6 o) {+ b/ M- Q! p3 o7 h# Aneutron-dhcp-agent:                     active
neutron-l3-agent:                       active
neutron-metadata-agent:                 active
neutron-linuxbridge-agent:              active
== Support services ==
mariadb:                                active
4 h0 k3 i7 p. h, [+ Rdbus:                                   active
rabbitmq-server:                        active
8 ]- m! e( u+ O  S8 N$ Cmemcached:                              active
== Keystone users ==
( d4 D7 `* m7 h3 \+----------------------------------+-----------+
| ID                               | Name      |
+----------------------------------+-----------+
| 35cba790e2b44595a9219e6c18176065 | nova      |
+ J6 H0 n2 x' D| 72177ec2346542518bb5e5a14f2745d4 | glance    |
| 893fd35e580c4d54a8c775d84207b191 | admin     |
| 91506d00e6e14cec99bf448cbb189a9a | neutron   |
| a47170e629444ae59e655f11f92022d9 | placement |
# l/ z, b" M  H- f/ h| af71b1d71cc54262aee370e9b6d5c622 | demo      |
8 }# H( Q0 y  z  J& v1 y! f+----------------------------------+-----------+
$ m4 t- l4 U& C) g( g== Glance images ==
+--------------------------------------+---------------------+
! Z( n, X4 J( w. o* D  H8 l( w| ID                                   | Name                |
2 g* h. X" b3 c1 K( {2 g! w+--------------------------------------+---------------------+
0 w/ H5 P5 p" Z) m| 047884ba-6a47-45c0-8ace-d72c5d566367 | cirros              |
| 2c685860-4fa2-43dd-abad-1cae69e59861 | cirros-0.3.4-x86_64 |
+--------------------------------------+---------------------+
== Nova managed services ==
* B$ \+ q9 G- S) h+--------------------------------------+------------------+------------+----------+---------+-------+----------------------------+-----------------+-------------+
| Id                                   | Binary           | Host       | Zone     | Status  | State | Updated_at                 | Disabled Reason | Forced down |
, Y. Q" ^+ S  v4 m+--------------------------------------+------------------+------------+----------+---------+-------+----------------------------+-----------------+-------------+
| 11290f6e-283f-4309-884e-7a171ab0a53e | nova-consoleauth | controller | internal | enabled | up    | 2018-09-02T05:35:44.000000 | -               | False       |
| 1c161768-160b-4829-9245-1ba3598ab5a4 | nova-scheduler   | controller | internal | enabled | up    | 2018-09-02T05:35:41.000000 | -               | False       |
) x& k" S, W' i& |7 o( h| 6d66755b-76bf-481d-a4ec-1ccddd8641c5 | nova-conductor   | controller | internal | enabled | up    | 2018-09-02T05:35:47.000000 | -               | False       |
: Y7 P) F# S# H, d7 Q7 Y| 8d12536b-22d2-44e7-a1d5-656d20ff0393 | nova-compute     | compute    | nova     | enabled | up    | 2018-09-02T05:35:49.000000 | -               | False       |
+--------------------------------------+------------------+------------+----------+---------+-------+----------------------------+-----------------+-------------+
' ]6 R% C) O+ [== Nova networks ==
! @, Z& o: m: F3 g7 yusage: nova [--version] [--debug] [--os-cache] [--timings]
            [--os-region-name <region-name>] [--service-type <service-type>]
0 l* l$ z% D& F# O, j            [--service-name <service-name>]
& `% {& r( H2 U1 o) K            [--os-endpoint-type <endpoint-type>]
8 e1 K, W2 U7 Z: p2 v) A            [--os-compute-api-version <compute-api-ver>]
            [--endpoint-override <bypass-url>] [--profile HMAC_KEY]
. V, ?! w- t; Y3 [: M' m            [--insecure] [--os-cacert <ca-certificate>]
            [--os-cert <certificate>] [--os-key <key>] [--timeout <seconds>]
& g3 e* \# Q" t  J0 ~) R, q            [--os-auth-type <name>] [--os-auth-url OS_AUTH_URL]
            [--os-system-scope OS_SYSTEM_SCOPE] [--os-domain-id OS_DOMAIN_ID]
- s2 E9 g0 T3 P, ]7 b' i            [--os-domain-name OS_DOMAIN_NAME] [--os-project-id OS_PROJECT_ID]
1 y+ o' B( X5 _6 ~/ [$ G            [--os-project-name OS_PROJECT_NAME]
            [--os-project-domain-id OS_PROJECT_DOMAIN_ID]
7 K+ n, T$ d! `% ^, B& ?/ w            [--os-project-domain-name OS_PROJECT_DOMAIN_NAME]
            [--os-trust-id OS_TRUST_ID]
            [--os-default-domain-id OS_DEFAULT_DOMAIN_ID]
0 b* {- i5 d: M6 ]6 S            [--os-default-domain-name OS_DEFAULT_DOMAIN_NAME]
1 g) z# S* O$ p2 V5 w( B  o            [--os-user-id OS_USER_ID] [--os-username OS_USERNAME]
            [--os-user-domain-id OS_USER_DOMAIN_ID]
5 r0 W( k6 m. {5 l2 z            [--os-user-domain-name OS_USER_DOMAIN_NAME]
            [--os-password OS_PASSWORD]
2 P; h0 L7 P- G4 b/ f            <subcommand> ...
+ z, b& A% e5 {; V7 K3 D. f) g; ierror: argument <subcommand>: invalid choice: u'network-list'
Try 'nova help ' for more information.
== Nova instance flavors ==
+----+------+-----------+------+-----------+------+-------+-------------+-----------+-------------+
4 r. g( V2 L/ s' r+ U0 O4 y: x3 N| ID | Name | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public | Description |
+----+------+-----------+------+-----------+------+-------+-------------+-----------+-------------+
+----+------+-----------+------+-----------+------+-------+-------------+-----------+-------------+
* v' v0 S3 J2 O2 C. i== Nova instances ==
+----+------+-----------+--------+------------+-------------+----------+
| ID | Name | Tenant ID | Status | Task State | Power State | Networks |
+----+------+-----------+--------+------------+-------------+----------+
! `# \. O* U- E0 B* B% W+----+------+-----------+--------+------------+-------------+----------+
$ t; V6 H+ {& U) k

admin

### 重启httpd memcached rabbitmq-server 和neutron服务，还是 无法修复
# d9 {) ]* |7 k* h. f
; m1 }& b5 T. j9 W! g" Z查看keystone
- `) {! c' ^; B1 E  c8 E

openstack service list
+----------------------------------+-----------+-----------+
3 E4 q; B. D) n| ID                               | Name      | Type      |
+----------------------------------+-----------+-----------+
5 J# I) h9 f5 Y, l6 S| 02929a487f484e9fbb2221d11212b11f | neutron   | network   |
1 Z8 _2 j$ z' ~* A# x| 1b0061ff680042ea8bd764de0cefc25a | placement | placement |
| 48cc7da12bb84f118ed528c57ba1cb3c | nova      | compute   |
( d, a% v, x9 \& g+ F| 75581fbfdf244aa78b5aba2a656a53e5 | keystone  | identity  |
. T; `/ s0 N* X/ i| ae94823f314c46098f1ff04dba0427db | glance    | image     |
+----------------------------------+-----------+-----------+

7 a- y+ ]! ], [/ I没有发现重复的demain
4 k1 k0 `- S8 @5 }
* M6 W6 G$ v& ~1 ~3 U! t2 r############重启控制节点，   节点无法修复

• systemctl restart rabbitmq-server.service
    x) C% w# i5 C2 R1 }
  6 h8 i; k$ H2 b, }  @: @' M
• 
  
  + r, J2 F( k: _/ ~8 o9 Csystemctl restart neutron-server.service                 
  
  
• 
  3 |* V8 f+ d8 W/ v; V$ N
  systemctl daemon-reload
  
  
• 
  $ X7 b3 U; I# r; k+ z- V
  systemctl stop httpd.service memcached
  6 ^+ @+ p) K" I& E8 e
  ( P" Z; C# f" X; F/ W- L
• 
  : H/ I  l2 J4 }' D6 ^
  . D1 m* h# D: I最后搞定
  
  
• 
  6 |, l/ y# X0 z" k
  

; r- ?' m/ I, {4 d. W5 p

心得：由于本环境是多控节点，rabbitmq-server 集群 没有优化，出现故障较多，建议如果发现有amqp 相关报错，先检查 rabbitmq 服务，有问题就重启一下

# K/ C  ?4 q+ V2 N2 H

admin

=ERROR REPORT==== 2-Sep-2018::13:43:24 ===
closing AMQP connection <0.1199.0> (192.168.90.65:48940 -> 192.168.90.65:5672):
( X' d- e7 C* S7 T6 o! ]{handshake_error,starting,1,
                 {amqp_error,unexpected_frame,
! S5 b9 ?6 I* W  a+ k' p                             "type 1, first 16 octets = <<0,60,0,40,0,0,38,114,101,112,108,121,95,57,48,50>>",
                             none}}

admin

keystone  access信息：
192.168.90.65 - - [02/Sep/2018:13:47:26 +0800] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.6 (CentOS) mod_wsgi/3.4 Python/2.7.5 (internal dummy connection)"
192.168.90.65 - - [02/Sep/2018:13:47:34 +0800] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.6 (CentOS) mod_wsgi/3.4 Python/2.7.5 (internal dummy connection)"

也没有发现问题，尴尬

admin

后来测试发现，使用Firefox浏览器好像可以减少dashboard页面闪退现象。这是浏览器的问题么？