CentOS7.0上部署kubernetes集群 + 简单应用示例
前端之家收集整理的这篇文章主要介绍了
CentOS7.0上部署kubernetes集群 + 简单应用示例,
前端之家小编觉得挺不错的,现在分享给大家,也给大家做个参考。
http://www.centoscn.com/CentosServer/cluster/2016/0515/7239.html
http://www.open-open.com/lib/view/open1451484695073.html
一.部署环境及架构
-
OpenStack:恒天云3.4
-
操作系统:centos 7.0
-
flannel: 0.5.5
-
Kubernetes: 1.2.0
-
Etcd版本: 2.2.2
-
Docker版本: 1.18.0
-
集群信息:
Role |
Hostname |
IP Address |
Master |
master |
10.0.222.2 |
Node |
node1 |
10.0.222.3 |
Node |
node2 |
10.0.222.4 |
Node |
node3 |
10.0.222.5 |
Node |
node4 |
10.0.222.6 |
master包含kube-apiserver kube-scheduler kube-controller-manager etcd四个组件
node包含kube-proxy和kubelet两个组件
@H_
502_248@
1. kube-apiserver:位于master节点,接受
用户请求。
2. kube-scheduler:位于master节点,负责资源调度,即pod建在哪个node节点。
3. kube-controller-manager:位于master节点,包含ReplicationManager,Endpointscontroller,Namespacecontroller,and Nodecontroller等。
4. etcd:分布式键值存储系统,共享整个集群的资源对象信息。
5. kubelet:位于node节点,负责维护在特定主机上运行的pod。
6. kube-proxy:位于node节点,它起的作用是一个服务代理的角色。
@H_
502_248@
二 、安装步骤
准备工作
为了避免和Docker的iptables产生冲突,我们需要关闭node上的防火墙:
1
2
|
$ systemctl stop firewalld
$ systemctl disable firewalld
|
安装NTP
为了让各个服务器的时间保持一致,还需要为所有的服务器安装NTP:
1
2
3
$ yum -y install ntp
$ systemctl start ntpd
$ systemctl enable ntpd
|
@H_338_
301@ 部署Master
安装etcd和kubernetes
@H_403_309@1
|
$ yum -y install etcd kubernetes
|
配置etcd
修改etcd的配置文件/etc/etcd/etcd.conf
:
ETCD_NAME=default
ETCD_DATA_DIR="/var/lib/etcd/default.etcd"
ETCD_LISTEN_CLIENT_URLS="http://0.0.0.0:2379"
配置etcd中的网络
定义etcd中的网络配置,nodeN中的flannel service会拉取此配置
1
$ etcdctl mk /coreos.com/network/config '{"Network":"172.17.0.0/16"}'
|
配置Kubernetes API server
1
2
3
4
5
6
7
API_ADDRESS="--address=0.0.0.0"
KUBE_API_PORT="--port=8080"
KUBELET_PORT="--kubelet_port=10250"
KUBE_ETCD_SERVERS="--etcd_servers=http://10.0.222.2:2379"
KUBE_SERVICE_ADDRESSES="--portal_net=10.254.0.0/16"
KUBE_ADMISSION_CONTROL="--admission_control=NamespaceLifecycle,NamespaceExists,LimitRanger,SecurityContextDeny,ResourceQuota"
KUBE_API_ARGS=""
|
这里需要注意原来KUBE_ADMISSION_CONTROL
默认包含的ServiceAccount
要删掉,不然启动API server的时候会报错。
启动服务
接下来,在Master上启动下面的服务:
1
2
3
4
5
$for SERVICES in etcd kube-apiserver kube-controller-manager kube-scheduler; do
systemctl restart $SERVICES
systemctl enable $SERVICES
systemctl status $SERVICES
done
|
部署Node
安装Kubernetes和Flannel
$ yum -y install flannel kubernetes
配置Flannel
修改Flannel的配置文件/etc/sysconfig/flanneld
:
1
2
3
|
@H_171_403@FLANNEL_ETCD="http://10.0.222.2:2379"
FLANNEL_ETCD_KEY="/coreos.com/network"
FLANNEL_OPTIONS="--iface=ens3"
|
这里需要注意FLANNEL_OPTIONS
中的iface的值是你自己服务器的网卡,不同的服务器以及配置下和我的是不一样的。
启动Flannel
$systemctl restart flanneld
$systemctl enable flanneld
$systemctl status flanneld
在当前目录下创建一个config.json
,内容如下:
1
2
3
4
5
6
7
8
{
"Network": "172.17.0.0/16","SubnetLen": 24,"Backend": {
"Type": "vxlan","VNI": 7890
}
}
|
然后将配置上传到etcd服务器上:
1
|
$ curl -L http://10.0.222.2:2379/v2/keys/coreos.com/network/config -XPUT --data-urlencode value@config.json
|
修改Kubernetes配置
修改kubernetes默认的配置文件/etc/kubernetes/config
:
KUBE_MASTER="--master=http://10.0.222.2:8080"
修改kubelet配置
修改kubelet服务的配置文件/etc/kubernetes/kubelet
:
1
2
3
4
5
6
|
KUBELET_ADDRESS="--address=0.0.0.0"
KUBELET_PORT="--port=10250"
# change the hostname to minion IP address
KUBELET_HOSTNAME="--hostname_override=node1"
KUBELET_API_SERVER="--api_servers=http://10.0.222.2:8080"
KUBELET_ARGS=""
|
不同node节点只需要更改KUBELET_HOSTNAME 为node的hostname即可。
启动node服务
$ for SERVICES in kube-proxy kubelet docker; do
systemctl restart $SERVICES
systemctl enable $SERVICES
systemctl status $SERVICES
done
创建快照,其他节点用快照安装(修改相应的hostname以及KUBELET_HOSTNAME即可)
查看集群nodes
部署完成之后,可以kubectl命令来查看整个集群的状态:
@H_
502_248@
1 kubectl -s "http://10.0.222.2:8080" get nodes
以下面的图来安装一个简单的静态内容的Nginx应用:
首先,我们用复制器启动一个2个备份的Nginx Pod。然后在前面挂Service,一个service只能被集群内部访问,一个能被集群外的节点访问。
1. 部署Nginx pod 和复制器
#cat Nginx-rc.yaml
apiVersion: v1
kind: ReplicationController
Metadata:
name: Nginx-controller
spec:
replicas: 2
selector:
name: Nginx
template:
Metadata:
labels:
name: Nginx
spec:
containers:
- name: Nginx
image: Nginx
ports:
- containerPort: 80
我们定义了一个Nginx pod复制器,复制份数为2,我们使用Nginx docker镜像。
执行下面的操作创建Nginx pod复制器:
[root@master test]# kubectl create -f Nginx-rc.yaml
replicationcontrollers/Nginx-controller
记得先去下载gcr.io镜像,然后改名,否则会提示失败。由于还会下载Nginx镜像,所以所创建的Pod需要等待一些时间才能处于running状态。
[root@master test]# kubectl get pods
NAME READY STATUS RESTARTS AGE
Nginx 1/1 Running 0 1d
Nginx-controller-dkl3v 1/1 Running 0 14s
Nginx-controller-hxcq8 1/1 Running 0 14s
我们可以使用describe 命令查看pod的相关信息:
[root@master test]# kubectl describe pod Nginx-controller-dkl3v
Name: Nginx-controller-dkl3v
Namespace: default
Image(s): Nginx
Node: 192.168.32.17/192.168.32.17
Labels: name=Nginx
Status: Running
Reason:
Message:
IP: 172.17.67.2
Replication Controllers: Nginx-controller (2/2 replicas created)
Containers:
Nginx:
Image: Nginx
State: Running
Started: Wed,30 Dec 2015 02:03:19 -0500
Ready: True
Restart Count: 0
Conditions:
Type Status
Ready True
Events:
FirstSeen LastSeen Count From SubobjectPath Reason Message
Wed,30 Dec 2015 02:03:14 -0500 Wed,30 Dec 2015 02:03:14 -0500 1 {scheduler } scheduled Successfully assigned Nginx-controller-dkl3v to 192.168.32.17
Wed,30 Dec 2015 02:03:15 -0500 Wed,30 Dec 2015 02:03:15 -0500 1 {kubelet 192.168.32.17} implicitly required container POD pulled Pod container image "kubernetes/pause" already present on machine
Wed,30 Dec 2015 02:03:16 -0500 Wed,30 Dec 2015 02:03:16 -0500 1 {kubelet 192.168.32.17} implicitly required container POD created Created with docker id e88dffe46a28
Wed,30 Dec 2015 02:03:17 -0500 Wed,30 Dec 2015 02:03:17 -0500 1 {kubelet 192.168.32.17} implicitly required container POD started Started with docker id e88dffe46a28
Wed,30 Dec 2015 02:03:18 -0500 Wed,30 Dec 2015 02:03:18 -0500 1 {kubelet 192.168.32.17} spec.containers{Nginx} created Created with docker id 25fcb6b4ce09
Wed,30 Dec 2015 02:03:19 -0500 Wed,30 Dec 2015 02:03:19 -0500 1 {kubelet 192.168.32.17} spec.containers{Nginx} started Started with docker id 25fcb6b4ce09
2. 部署节点内部可访问的Nginx service
Service的type有ClusterIP和NodePort之分,缺省是ClusterIP,这种类型的Service只能在集群内部访问。配置文件如下:
#cat Nginx-service-clusterip.yaml
apiVersion: v1
kind: Service
Metadata:
name: Nginx-service-clusterip
spec:
ports:
- port: 8001
targetPort: 80
protocol: TCP
selector:
name: Nginx
执行下面的命令创建service:
[root@master test]# kubectl create -f ./Nginx-service-clusterip.yaml
services/Nginx-service-clusterip
查看所创建的service:
[root@master test]# kubectl get service
NAME LABELS SELECTOR IP(S) PORT(S)
kubernetes component=apiserver,provider=kubernetes <none> 10.254.0.1 443/TCP
Nginx-service-clusterip <none> name=Nginx 10.254.234.255 8001/TCP
上面的输出告诉我们这个
Service的Cluster IP是10.254.234.255,端口是8001。下面我们验证这个PortalNet IP的工作情况:
在192.168.32.16上执行以下命令:
[root@minion1 ~]# curl -s 10.254.234.255:8001
<!DOCTYPE html>
<html>
<head>
<title>Welcome to Nginx!</title>
<style>
body {
width: 35em;
margin: 0 auto;
font-family: Tahoma,Arial,sans-serif;
}
</style>
</head>
<body>
<h1>Welcome to Nginx!</h1>
<p>If you see this page,the Nginx web server is successfully installed and
working. Further configuration is required.</p>
<p>For online documentation and support please refer to
<a href="http://Nginx.org/">Nginx.org</a>.<br/>
Commercial support is available at
<a href="http://Nginx.com/">Nginx.com</a>.</p>
<p><em>Thank you for using Nginx.</em></p>
</body>
</html>
从前面部署复制器的部分我们知道Nginx Pod运行在17节点上。上面我们特意从16代理节点上访问我们的服务来体现Service Cluster IP在所有集群代理节点的可到达性。
3. 部署外部可访问的Nginx service
下面我们创建NodePort类型的Service,这种类型的Service在集群外部是可以访问。配置文件如下:
cat Nginx-service-nodeport.yaml
apiVersion: v1
kind: Service
Metadata:
name: Nginx-service-nodeport
spec:
ports:
- port: 8000
targetPort: 80
protocol: TCP
type: NodePort
selector:
name: Nginx
执行如下命令创建service并进行查看:
[root@master test]# kubectl create -f ./Nginx-service-nodeport.yaml
You have exposed your service on an external port on all nodes in your
cluster. If you want to expose this service to the external internet,you may
need to set up firewall rules for the service port(s) (tcp:31000) to serve traffic.
See http://releases.k8s.io/HEAD/docs/user-guide/services-firewalls.md for more details.
services/Nginx-service-nodeport
[root@master test]# kubectl get service
NAME LABELS SELECTOR IP(S) PORT(S)
kubernetes component=apiserver,provider=kubernetes <none> 10.254.0.1 443/TCP
Nginx-service-clusterip <none> name=Nginx 10.254.234.255 8001/TCP
Nginx-service-nodeport <none> name=Nginx 10.254.210.68 8000/TCP
创建service时提示需要设置firewall rules,不用去管,不影响后续操作。
查看创建的service:
[root@master test]# kubectl describe service Nginx-service-nodeport
Name: Nginx-service-nodeport
Namespace: default
Labels: <none>
Selector: name=Nginx
Type: NodePort
IP: 10.254.210.68
Port: <unnamed> 8000/TCP
NodePort: <unnamed> 31000/TCP
Endpoints: 172.17.67.2:80,172.17.67.3:80
Session Affinity: None
No events.
这个
Service的节点级别端口是31000
。下面我们验证这个
Service的工作情况:
[root@master test]# curl -s 192.168.32.16:31000
<!DOCTYPE html>
<html>
<head>
<title>Welcome to Nginx!</title>
<style>
body {
width: 35em;
margin: 0 auto;
font-family: Tahoma,the Nginx web server is successfully installed and
working. Further configuration is required.</p>
<p>For online documentation and support please refer to
<a href="http://Nginx.org/">Nginx.org</a>.<br/>
Commercial support is available at
<a href="http://Nginx.com/">Nginx.com</a>.</p>
<p><em>Thank you for using Nginx.</em></p>
</body>
</html>
[root@master test]# curl -s 192.168.32.17:31000
<!DOCTYPE html>
<html>
<head>
<title>Welcome to Nginx!</title>
<style>
body {
width: 35em;
margin: 0 auto;
font-family: Tahoma,the Nginx web server is successfully installed and
working. Further configuration is required.</p>
<p>For online documentation and support please refer to
<a href="http://Nginx.org/">Nginx.org</a>.<br/>
Commercial support is available at
<a href="http://Nginx.com/">Nginx.com</a>.</p>
<p><em>Thank you for using Nginx.</em></p>
</body>
</html>
不管是从16还是17,都能访问到我们的服务。