drbdadm 执行connect 报错信息terminated with exit code 10

admin

drbdadm connect all
& o9 y: i1 E9 K7 s: q0 bimage: Failure: (102) Local address(port) already in use.
Command 'drbdsetup-84 connect image ipv4:10.29.114.236:7799 ipv4:10.29.114.235:7799 --protocol=C --cram-hmac-alg=sha1 --shared-secret=q123' terminated with exit code 10
mysql: Failure: (102) Local address(port) already in use.
' j! z  b. F; T  M0 m* W* y$ q: `Command 'drbdsetup-84 connect mysql ipv4:10.29.114.236:7789 ipv4:10.29.114.235:7789 --protocol=C --cram-hmac-alg=sha1 --shared-secret=q123' terminated with exit code 10
; r4 I" D  u  u7 }, l
+ H4 y, j9 t7 k2 O9 |- _* i0 x drbdadm -- --discard-my-data connect all
image: Failure: (102) Local address(port) already in use.
Command 'drbdsetup-84 connect image ipv4:10.29.114.236:7799 ipv4:10.29.114.235:7799 --protocol=C --cram-hmac-alg=sha1 --shared-secret=q123 --discard-my-data' terminated with exit code 10
mysql: Failure: (102) Local address(port) already in use.
/ ~! B" R6 \/ R) fCommand 'drbdsetup-84 connect mysql ipv4:10.29.114.236:7789 ipv4:10.29.114.235:7789 --protocol=C --cram-hmac-alg=sha1 --shared-secret=q123 --discard-my-data' terminated with exit code 10
# V6 Q8 N- Y% w

" q4 m4 U3 Z* Y

admin

Added new hard disk and do partition on both nodes:

fdisk /dev/sdb

Then format partition:

mkfs.ext4 /dev/sdb

(Failed on node2, so removed it and added a new disk become /dev/sdc. Formated it.)

Follow official guide to config the basic resource on both nodes:

[color=var(--theme-link-color, var(--theme-secondary-400))]http://docs.linbit.com/docs/users-guide-8.4/p-build-install-configure/#ch-configure

Created /etc/drbd.d/r0.res on both nodes:

resource r0 {    protocol C;    on node1 {            device /dev/drbd0;            disk /dev/sdb;            address 192.168.0.1:7789;            meta-disk internal;    }    on node2 {            device /dev/drbd0;            disk /dev/sdc;            address 192.168.0.2:7789;            meta-disk internal;    }}

Edit iptables on both nodes:

iptables -I INPUT -p tcp -m state --state NEW -m tcp --dport 7788 -j ACCEPTiptables -I INPUT -p tcp -m state --state NEW -m tcp --dport 7799 -j ACCEPTservice iptables save

Initialize data on both nodes:

drbdadm create-md r0

All OK.

Put the resource up on both nodes: drbdadm up r0

node1:

Device '0' is configured!Command 'drbdmeta 0 v08 /dev/sdb internal apply-al' terminated with exit code 20

node2:

??: Failure: (162) Invalid configuration requestadditional info from kernel:minor exists in different resourceCommand 'drbdsetup-84 new-minor r0 0 0' terminated with exit code 10

Both of them happened issues.

Run cat /proc/drbd on both nodes:

node1:

version: 8.4.9-1 (api:1/proto:86-101)GIT-hash: 9976da086367a2476503ef7f6b13d4567327a280 build by akemi@Build64R7, 2016-12-04 01:08:48 0: cs:WFConnection ro:Primary/Unknown ds:UpToDate/DUnknown C r----s    ns:0 nr:0 dw:0 dr:912 al:8 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:2097052

node2:

version: 8.4.9-1 (api:1/proto:86-101)GIT-hash: 9976da086367a2476503ef7f6b13d4567327a280 build by akemi@Build64R7, 2016-12-04 01:08:48 0: cs:WFConnection ro:Secondary/Unknown ds:Diskless/DUnknown C r----s    ns:0 nr:0 dw:0 dr:0 al:8 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0

Primary and Secondary unknown.

Run drbdadm connect all on node1:

r0: Failure: (125) Device has a net-config (use disconnect first)Command 'drbdsetup-84 connect r0 ipv4:192.168.0.1:7789 ipv4:192.168.0.2:7789 --protocol=C' terminated with exit code 10

Run drbdadm -- --discard-my-data connect all on node2:

r0: Failure: (102) Local address(port) already in use.Command 'drbdsetup-84 connect r0 ipv4:192.168.0.1:7789 ipv4:192.168.0.2:7789 --protocol=C --discard-my-data' terminated with exit code 10

What's wrong of using it?

---

Edit 1

After ran dd if=/dev/zero of=/dev/sdb(sdc) bs=1M oflag=direct status=progress on both nodes, they also can't ran drbdadm up r0 successfully:

node1No valid meta data foundCommand 'drbdmeta 0 v08 /dev/sdb internal apply-al' terminated with exit code 255node2??: Failure: (162) Invalid configuration requestadditional info from kernel:minor exists in different resourceCommand 'drbdsetup-84 new-minor r0 0 0' terminated with exit code 10

---

Edit 2

At this time, ran systemctl start brdb on both nodes, all of them got pending. Wait for a long time returned no result.

And ran lsblk -a now:

NAME        MAJ:MIN RM  SIZE RO TYPE MOUNTPOINTsda           8:0    0   10G  0 disk├─sda1        8:1    0    1G  0 part /boot└─sda2        8:2    0    9G  0 part  ├─cl-root 253:0    0    8G  0 lvm  /  └─cl-swap 253:1    0    1G  0 lvm  [SWAP]sdb           8:32   0   16G  0 disksr0          11:0    1 1024M  0 romdrbd0       147:0    0    2G  0 disk

admin

You don't want to create the filesystem on your backing disks for DRBD (sdb and sdc); you want to create the DRBD first, and then format the resulting DRBD device with your filesystem. It can be done the other way, but then you'd need to grow the backing partition, or reduce the size of the filesystem to make room for DRBD's metadata (which lives at the end of the block device when using internal metadata).
% C8 ^5 Q, y& y, U  ]0 |
The process should be something like this:

) D3 B# Y/ J/ I- D/ d% E-Install all your software like you have done above.
! Y& |( O# O# m/ P5 X$ A! ~' P2 D
-Zero out your partition on both nodes (optional, but do it):

# dd if=/dev/zero of=/dev/sdb bs=1M oflag=direct status=progress
: c) m7 E9 d1 o' u. i# dd if=/dev/zero of=/dev/sdc bs=1M oflag=direct status=progress
-Create the configuration file for your DRBD resources like you have done above.
) n  h/ |- n* Q
: y# V' z3 Y" U  _8 F( m-Add the firewall rules like you've done above (except you don't really need the port 7799, as that's not used in your configuration).
9 ]2 v' V( g6 {6 j9 s
-Create DRBD's metadata on the backing block devices, and bring up r0 on both nodes:
5 I+ k1 |# ~( [' @* v
# drbdadm create-md r0
# drbdadm up r0
# cat /proc/drbd
+ A" r' K: l: ]-Check the output of cat /proc/drbd, you should see your device is Connected, Secondary/Secondary, and Inconsistent/Inconsistent. If any of those things are NOT true, STOP, something isn't right.

, b: n4 P3 e6 E) g; c( [% g-Then, pick either node (NOT BOTH), force it to be primary (DRBD will not let you go primary on a node with Inconsistent data) and create the FS:
* G# X2 R' G5 C$ b5 K' z
! @5 S! J& f1 I% x# drbdadm primary r0 --force
# mkfs.ext4 /dev/drbd0
3 m* J9 F* O  Q2 g8 ~" VThen you'd use /dev/drbd0 just like you would have used /dev/sda or /dev/sdc; don't touch /dev/sdb or /dev/sdc ever again unless you're confident in what you're doing. Touching DRBD's backing disks can introduce inconsistencies that DRBD will be unaware of (until you run a verify or otherwise overwrite the block).
$ S. h8 d; s  K/ }
7 _& y9 ^) O8 f5 e' t( Z) V0 yKeep reading LINBIT's documentation. DRBD is obviously a great tool, and is easy to use once you understand the basics, but you're dealing with storage so there is a lot of room to mess things up in a permanent way.