Setup Docker Host as a Worker Node
TLDR: WORKER_TYPE=docker MASTER_NODE=x.x.x.x make setup-worker
For the Worker Node with meeting the system requirements, three steps are required:
System Requirements
- Hardware: 4c8g50g
- Docker engine:
- 1.10.0~1.18.6
Docker Daemon Setup
Let Docker daemon listen on port 2375, and make sure Master can reach Worker Node through this port.
Ubuntu 18.04
Edit systemd service config file /lib/systemd/system/docker.service
, update the ExecStart
line under section [Service]
, as the following:
[Service]
ExecStart=/usr/bin/dockerd -H fd:// -H unix:///var/run/docker.sock -H tcp://0.0.0.0:2375 --default-ulimit=nofile=8192:16384 --default-ulimit=nproc=8192:16384
Ubuntu 16.04
Edit systemd service config file usr/lib/systemd/system/docker.service
, update the ExecStart
line under section [Service]
, as the following:
[Service]
ExecStart=/usr/bin/dockerd -H fd:// -H unix:///var/run/docker.sock -H tcp://0.0.0.0:2375 --default-ulimit=nofile=8192:16384 --default-ulimit=nproc=8192:16384
Regenerate the docker service script and restart the docker engine:
$ sudo systemctl daemon-reload; sudo systemctl restart docker.service
Alternatively (for all Linux distro):
This will run the docker-daemon on port 2375 as long as the system is restarted or docker-daemon is killed.
$ sudo systemctl stop docker.service
$ sudo dockerd -H fd:// -H unix:///var/run/docker.sock -H tcp://0.0.0.0:2375 --default-ulimit=nofile=8192:16384 --default-ulimit=nproc=8192:16384 -D &
At last, run the follow test at Master node and get OK response, to make sure it can access the Worker node successfully.
[Master] $ docker -H Worker_Node_IP:2375 info
Setup
Run the following cmd to pull the necessary images and copy required artifacts.
$ MASTER_NODE=xx.xx.xx.xx make setup-worker
Firewall Setup
Make sure ip forward is enabled, you can simply run the follow command.
$ sysctl -w net.ipv4.ip_forward=1
And check the os iptables config, to make sure host ports are open (e.g., 2375, 7050~10000)
Work with MacOS
In MacOS, Docker currently provides no support to config the daemon to listen from network.
Users need to use some tools to config Docker daemon to listen at network manually, e.g., to config Docker daemon to listen on 127.0.0.1:2375
,
$ docker run -d -v /var/run/docker.sock:/var/run/docker.sock -p 127.0.0.1:2375:2375 bobrik/socat TCP-LISTEN:2375,fork UNIX-CONNECT:/var/run/docker.sock
$ docker -H 127.0.0.1:2375 info
And users can use 0.0.0.0
to replace 127.0.0.1
to make sure Master can reach Worker Node through this port, as Ubuntu.
$ docker run -d -v /var/run/docker.sock:/var/run/docker.sock -p 0.0.0.0:2375:2375 bobrik/socat TCP-LISTEN:2375,fork UNIX-CONNECT:/var/run/docker.sock
This work is licensed under a Creative Commons Attribution 4.0 International License.