Kubernetes集群中多节点合作博弈负载均衡策略

doi:10.19665/j.issn1001-2400.2021.06.003

Abstract

Abstract:

Kubernetes has the potential to become a new generation of hyper-converged architecture,but there are still some problems in the research on cluster resource load balancing:on the one hand,most of the existing scheduling algorithms are static scheduling algorithms,and the dynamics of cluster resources in actual use are not considered; on the other hand,the existing research on solving cluster resource load balancing only optimizes the CPU and memory resources in the cluster,but cannot give a complete resource profile of the cluster,with the algorithm lacking comprehensiveness.In this paper,we introduce the MBCGT,a multi-resource load balancing algorithm based on the cooperative game theory for Kubernetes cluster scheduling,and proposes the index of cluster resource load balance to optimize scheduling and reduce the fragmentation of cluster resources.First,we use real-time monitoring to obtain the actual resource usage of service requests to achieve dynamic service scheduling.Second,we consider the load balance among the four resources of cluster CPU,memory,network bandwidth and disk IO,establish a cooperative game model between physical nodes to ensure the lower bound of the MBCGT algorithm when facing different resource requests of various applications,and solve the cluster Resource fragmentation phenomenon.Finally,the algorithm is tested in a real Kubernetes cluster.The results show that the MBCGT algorithm reduces the fragmentation of cluster resources,and that the average load balance of each node in the cluster can be increased by 8.40%.

Key words: cloud computing, Kubernetes cluster, cooperative game theory, multi-resource load balancing

CLC Number:

TP306

LI Huadong,ZHANG Xueliang,WANG Xiaolei,LIU Hui,WANG Pengcheng,DU Junzhao. Multi-node cooperative game load balancing strategy in the Kubernetes cluster[J].Journal of Xidian University, 2021, 48(6): 16-22.

Figures/Tables 4

References 22

[1]	FELTER W, FERREIRA A, RAJAMONY R, et al. An Updated Performance Comparison of Virtual Machines and Linux Containers[C]// 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS).Piscataway:IEEE, 2015:171-172.
[2]	KIM S, KIM C, KIM J. Reliable Smart Energy IoT-Cloud Service Operation with Container Orchestration[C]// 2017 19th Asia-Pacific Network Operations and Management Symposium (APNOMS).Piscataway:IEEE, 2017:378-381.
[3]	GONG Z. Kubernetes Definitive Guide:Full Contact from Docker to Kubernetes Practice[M]. Beijing:Publishing House of Electronics Industry, 2016:43-49.
[4]	MEDEL V, TOLOSANA-CALASANZ R, BAÑARES J Á, et al. Characterising Resource Management Performance in Kubernetes[J]. Computers & Electrical Engineering, 2018, 68:286-297.
[5]	CHANG C, YANG S, YEH E, et al. A Kubernetes-Based Monitoring Platform for Dynamic Cloud Resource Provisioning[C]// GLOBECOM 2017-2017 IEEE Global Communications Conference.Piscataway:IEEE, 2017:1-6.
[6]	MEDEL V, TOLON C, ARRONATEGUI U, et al. Client-Side Scheduling Based on Application Characterization on Kubernetes[C]// International Conference on the Economics of Grids,Clouds,Systems,and Services.Heidelberg:Springer, 2017:162-176.
[7]	CASQUERO O, ARMENTIA A, SARACHAGA I, et al. Distributed Scheduling in Kubernetes Based on MAS for Fog-in-the-Loop Applications[C]// 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA).Piscataway:IEEE, 2019:1213-1217.
[8]	AHMED G E H, GIL-CASTIÑEIRA F, COSTA-MONTENEGRO E. KubCG:A Dynamic Kubernetes Scheduler for Heterogeneous Clusters[J]. Software:Practice and Experience, 2021, 51(2):213-234. doi: 10.1002/spe.v51.2
[9]	ZHANG W, MA X, ZHANG J. Research on Kubernetes' Resource Scheduling Scheme[C]// Proceedings of the 8th International Conference on Communication and Network Security.New York:ACM, 2018:144-148.
[10]	ZHAI G, TIAN L, ZHOU Y, et al. Load Diversity Based Optimal Processing Resource Allocation for Super Base Stations in Centralized Radio Access Networks[J]. Science China Information Sciences, 2014, 57(4):1-12.
[11]	ZHAI G, TIAN L, ZHOU Y, et al. A Computing Resource Adjustment Mechanism for Communication Protocol Processing in Centralized Radio Access Networks[J]. China Communications, 2016, 13(12):79-89.
[12]	LIU Q, E H, SONG M. The Design of Multi-Metric Load Balancer for Kubernetes[C]// 2020 International Conference on Inventive Computation Technologies (ICICT).Piscataway:IEEE, 2020:1114-1117.
[13]	HUANG J, XIAO C, WU W. RLSK:A Job Scheduler for Federated Kubernetes Clusters Based on Reinforcement Learning[C]// 2020 IEEE International Conference on Cloud Engineering (IC2E).Piscataway:IEEE, 2020:116-123.
[14]	左灿, 刘晓洁. 一种改进的Kubernetes动态资源调度方法[J]. 数据通信, 2019, 189(2):50-54.
	ZUO Can, LIU Xiaojie. An Improved Kubernetes Dynamic Resource Scheduling Method[J]. Data Communication, 2019, 189(2):50-54.
[15]	平凡, 陈莉君. 基于Kubernetes的动态负载均衡机制研究与设计[J]. 计算机与数字工程, 2020, 48(1):141-146.
	PING Fan, CHEN Lijun. Research and Design of Dynamic Load Balancing Mechanism Based on Kubernetes[J]. Computer & Digital Engineering, 2020, 48(1):141-146.
[16]	NGUYEN N D, KIM T. Balanced Leader Distribution Algorithm in Kubernetes Clusters[J]. Sensors, 2021, 21(3):869. doi: 10.3390/s21030869
[17]	龚正, 吴治辉, 闫健勇. Kubernetes权威指南[M]. 北京: 电子工业出版社, 2021:346-349.
[18]	CAO K, LI L, CUI Y, et al. Exploring Placement of Heterogeneous Edge Servers for Response Time Minimization in Mobile Edge-Cloud Computing[J]. IEEE Transactions on Industrial Informatics, 2021, 17(1):494-503. doi: 10.1109/TII.9424
[19]	王汝言, 吴和, 崔亚平, 等. 超密集网络中多基站博弈边缘卸载策略[J]. 西安电子科技大学学报, 2021, 48(4):1-10.
	WANG Ruyan, WU He, CUI Yaping, et al. Edge Offloading Strategy for the Multi-Base Station Game in Ultra-Dense Networks[J]. Journal of Xidian University, 2021, 48(4):1-10.
[20]	LIU L, ZHOU Y, GARCIA V, et al. Load Aware Joint CoMP Clustering and Inter-Cell Resource Scheduling in Heterogeneous Ultra Dense Cellular Networks[J]. IEEE Transactions on Vehicular Technology, 2018, 67(3):2741-2755. doi: 10.1109/TVT.25
[21]	赖成喆, 陈瑶, 郭奇立, 等. 车联网中基于博弈论的合作下载激励方案[J]. 西安电子科技大学学报, 2021, 48(3):9-20.
	LAI Chengzhe, CHEN Yao, GUO Qili, et al. Game Theory Based Incentive Scheme for Cooperative Downloading in the Internet of Vehicles[J]. Journal of Xidian University, 2021, 48(3):9-20.
[22]	NASH J. The Bargaining Problem[J]. Econometrica, 1950, 18(2):155-162. doi: 10.2307/1907266

节点名称	操作系统	CPU/核	内存/GB	网络带宽/(MB·s^-1)	磁盘IO/(MB·s^-1)
master	CentOS7	Inter Xeon 2	4	100	100
node1	CentOS7	Inter Xeon 2	4	100	100
node2	CentOS7	Inter Xeon 2	4	100	100
node3	CentOS7	Inter Xeon 2	4	100	100
node4	CentOS7	Inter Xeon 2	4	100	100
grafana	CentOS7	Inter Xeon 2	4	100	100

调度器	第1组实验	第2组实验	第3组实验
Kubernetes默认调度器	0.401	0.351	0.296
动态资源调度器^[12]	0.384	0.347	0.289
MBCGT算法调度器	0.270	0.233	0.221

Multi-node cooperative game load balancing strategy in the Kubernetes cluster

RichHTML

PDF (PC)

Like

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 4

References 22

Related Articles 9

Metrics

Comments

Recommended 10

Pod	CPU/核	内存/MB	磁盘/MB	网络/MB
Pod 1	0.2	200	10	10
Pod 2	0.2	200	20	5
Pod 3	0.2	200	30	10
Pod 4	0.3	300	10	20
Pod 5	0.3	300	25	10
Pod 6	0.3	300	30	10
Pod 7	0.4	400	15	30
Pod 8	0.4	400	5	25
Pod 9	0.4	400	30	5
Pod 10	0.2	400	1	10
Pod 11	0.3	300	3	7
Pod 12	0.4	200	10	1

[1]	WANG Yan. Enhanced multi-objective evolutionary algorithm for workflow scheduling on the cloud platform [J]. Journal of Xidian University, 2019, 46(1): 130-136.
[2]	HAN Kun;ZHANG Hailin;XIN Dan;WU Bo;KANG Yuanji. Design method of an identity-based fully homomorphic encryption library [J]. Journal of Xidian University, 2017, 44(4): 56-61.
[3]	JING Weipeng;HUO Shuaiqi;CHEN Guangsheng;LIU Yaqiu. Novel mixed-criticality reliability scheduling strategy and schedulability test [J]. Journal of Xidian University, 2016, 43(6): 158-163.
[4]	HUANG Chunshui;REN Yanli;CAI Jianxing. Verifiable outsourcing scheme for batch modular exponentiations [J]. Journal of Xidian University, 2016, 43(4): 135-140.
[5]	JING Weipeng;WU Zhibo;LIU Hongwei;SHU Yanjun. Multiple DAGs dynamic workflow reliability scheduling algorithm in a cloud computing system [J]. Journal of Xidian University, 2016, 43(2): 83-88.
[6]	LIU Xing;YUAN Chaowei;YANG Zhen;LI Zhenjun. Services promote Lyapunov-based strategy in mobile cloud computing [J]. J4, 2015, 42(6): 138-144.
[7]	LU Di;MA Jianfeng;WANG Yichuan;XI Ning;ZHANG Liumei;MENG Xianjia. Enhanced fairness-based multi-resource allocation algorithm for cloud computing [J]. J4, 2014, 41(3): 162-168.
[8]	WANG Yichuan;MA Jianfeng;LU Di;ZHANG Liumei;MENG Xianjia. Cloud droplets freezing attack in cloud computing [J]. J4, 2014, 41(3): 116-122.
[9]	ZHU Xudong;LI Hui;GUO Zhen. Privacy-preserving query over the encrypted image in cloud computing [J]. J4, 2014, 41(2): 151-158.