failed to probe daemons or devices 问题ceph -s出现的错误

admin

[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices
+ g4 s0 N- u  H: \/ N; hhost private-registry.example.com `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr:Non-zero exit code 125 from /bin/podman run --rm --ipc=host --net=host --entrypoint stat --init -e CONTAINER_IMAGE=ceph5-2-1-registry.example.com:5000/rhceph/rhceph-5-rhel8@sha256:d42c0d99ddeaa001570dce4eb90b71699e0401fe449966b935f669ffad22bd01 -e NODE_NAME=private-registry.example.com -e CEPH_USE_RANDOM_NONCE=1 ceph5-2-1-registry.example.com:5000/rhceph/rhceph-5-rhel8@sha256:d42c0d99ddeaa001570dce4eb90b71699e0401fe449966b935f669ffad22bd01 -c %u %g /var/lib/ceph
8 a/ @3 ?% l# t1 S1 o: rstat: stderr Trying to pull ceph5-2-1-registry.example.com:5000/rhceph/rhceph-5-rhel8@sha256:d42c0d99ddeaa001570dce4eb90b71699e0401fe449966b935f669ffad22bd01...
stat: stderr Error: initializing source docker://ceph5-2-1-registry.example.com:5000/rhceph/rhceph-5-rhel8@sha256:d42c0d99ddeaa001570dce4eb90b71699e0401fe449966b935f669ffad22bd01: reading manifest sha256:d42c0d99ddeaa001570dce4eb90b71699e0401fe449966b935f669ffad22bd01 in ceph5-2-1-registry.example.com:5000/rhceph/rhceph-5-rhel8: unauthorized: authentication required
How to eliminate this warning?
) T/ `* w% N, A4 GResolution
Login to the cephadm shell on the lead monitor node.
: |* [$ M9 w2 \. z
8 M8 l( o; s+ N, j/ ^* p6 bRaw
# cephadm shell
! @7 @: j9 s& O! m0 a  y5 WLog in manually to the custom registry on all the new hosts simultaneously:

Raw
+ z) K: j2 b. j; W4 U3 R2 ^8 R# ceph cephadm registry-login --registry-url <CUSTOM_REGISTRY_NAME>  --registry_username <REGISTRY_USERNAME> --registry_password <PASSWORD>
Executing the aforementioned command will produce a podman-auth.json file in the /etc/ceph directory that contains the custom registry's authentication details.
, |) T% j% |# R
" L' h* }/ _, u! m6 q1 d' ~2 y2 ]& bWait 3-5 minutes to see if the daemon starts up.
/ z# E" p* O1 @, i# x( H! {
Raw
# watch ceph orch ls
OPTIONAL: Restart the daemon if it is still not in running state.

Raw
0 g2 c+ f5 o' d, }$ a# ceph orch restart <DAEMON_NAME>
; i8 f- h5 W. x) m1 J# z) wSPECIAL CASE:
For daemons like node-exporter, prometheus, alertmanager, grafana:

1 W/ C/ c( D/ f7 b& A" N! |5 L! QAfter logging into the custom registry, use the ceph config command to configure the custom container images:
* j6 o3 |4 N9 g, R* A; o
Raw
# ceph config set mgr mgr/cephadm/OPTION_NAME CUSTOM_REGISTRY_NAME/CONTAINER_NAME
Use the following options for OPTION_NAME:
$ h5 L# p, b$ {* F
Raw
container_image_prometheus
( n9 g  A8 E; c& f: s# U! h( rcontainer_image_grafana
container_image_alertmanager
' y( v7 |+ C# m! T, h! n8 c9 [container_image_node_exporter
  b/ n+ _: N7 K3 i( kRedeploy each daemon:

) S* _% }5 |6 E7 e( {Raw
# ceph orch redeploy DAEMON_NAME
4 }  U0 d& i# H/ v+ X( TRoot Cause
3 z% i; L& |5 cWhile adding ceph daemons on newly added hosts, cephadm is not able to determine the custom registry credentials under podman-auth.json file under the /etc/ceph directory or the file itself is missing.
0 ^4 R2 L: i  m+ p8 f: M! Z! s" ]
. {5 P1 U! U& }; v# QBehind the scene, when we run this command it actually only logs in the host where the command is run. As a result, when cephadm attempts to pull the image on other hosts it still fails due to not logged in on the other hosts.
  t' Q) _7 f$ K7 M  Q7 {0 x0 p
# K4 Q/ j# R! v. w; V. YFor this, instead of running the command on the host itself, use the ceph cephadm registry-login command from inside the cephadm shell and it should log in all the hosts in the cluster.

, b% U( F& r* |  g6 S6 EDiagnostic Steps
% c4 W, V/ m+ Z8 v0 I" X2 vCheck if the podman-auth.json file is present under /etc/ceph/ on each node.
5 y. `2 f1 G0 @2 r
Raw
+ Y5 C& Q  r/ m- ^# ls -l /etc/ceph/
Verify the daemon status:

Raw
# ceph orch ls
0 L; F5 n; `4 I0 i. F0 \# ceph orch ps
( w6 g( a& q/ a" S8 ~  J6 K
! d, f2 Z8 u% c& ~- [1 g2 i