文献类型：期刊文献

中文题名：强化学习下能耗优化的虚拟机放置策略

英文题名：Virtual Machine Placement Strategy with Energy Consumption Optimization under Reinforcement Learning

作者：卢海峰[1];顾春华[1];罗飞[1];丁炜超[1];袁野[1];任强[1]

机构：[1]华东理工大学信息科学与工程学院

年份：2019

卷号：46

期号：9

起止页码：291

中文期刊名：计算机科学

外文期刊名：Computer Science

收录：CSTPCD;;北大核心:【北大核心2017】；CSCD:【CSCD_E2019_2020】；

基金：国家自然科学基金面上项目(61472139);华东理工大学2017年教育教学规律与方法研究项目(ZH1726107)资助

语种：中文

中文关键词：云计算;虚拟机放置;强化学习;能耗优化;Q-Learning(λ)算法

外文关键词：Cloud computing;Virtual machine placement;Reinforcement learning;Energy consumption optimization;Q-Learning(λ) algorithm

摘要：云数据中心的高速发展带来了非常强大的计算能力,但是伴随产生的能耗问题也日益严重。为了降低云数据中心内物理服务器的能耗开销,首先利用强化学习对虚拟机放置问题进行建模,随后结合实际问题从状态聚合和时间信度两个方面对Q-Learning(λ)算法进行优化,最后通过云仿真平台CloudSim和实际数据集对虚拟机放置问题进行实验。实验结果表明,与Q-Learning算法、Greedy算法和PSO算法相比,优化后的Q-Learning(λ)算法更有效地降低了物理服务器的能耗开销,同时针对不同数量的虚拟机放置请求也能够保证更好的结果,具有较强的实用价值。
Although the rapid development of cloud data centers has brought very powerful computing power,the energy consumption problem has become increasingly serious.In order to reduce the energy consumption of physical servers in cloud data centers,firstly the virtual machine placement problem is modeled by reinforcement learning.Then,the Q-Learning(λ) algorithm is optimized from two aspects:state aggregation and time reliability.Finally,the virtual machine placement problem is simulated through cloud simulation platform CloudSim and actual data.The simulation results show that the optimized Q-Learning(λ) algorithm can effectively reduce the energy consumption of the cloud data center compared with the Greedy algorithm,PSO algorithm and Q-Learning algorithm,and can ensure better results for different numbers of virtual machine placement requests.The proposed algorithm has strong practical value.