周钰,,
谭颀,
魏延南,
陈前斌
1.重庆邮电大学通信与信息工程学院 重庆 400065
2.重庆邮电大学移动通信重点实验室 重庆 400065
基金项目:国家自然科学基金(61571073)，重庆市教委科学技术研究项目(KJZD-M201800601)
详细信息
作者简介:唐伦：男，1973年生，教授，博士生导师，研究方向为新一代无线通信网络、异构蜂窝网络、软件定义无线网络等
周钰：男，1993年生，硕士生，研究方向为5G网络切片资源分配和深度学习
谭颀：女，1995年生，硕士生，研究方向为5G网络切片、资源分配、随机优化理论
魏延南：男，1995年生，硕士生，研究方向为5G网络切片、虚拟资源分配，可靠性
陈前斌：男，1967年生，教授，博士生导师，研究方向为个人通信、多媒体信息处理与传输、下一代移动通信网络
通讯作者:周钰 137068966@qq.com
中图分类号:TN929.5计量
文章访问数:2716
HTML全文浏览量:1200
PDF下载量:187
被引次数:0
出版历程
收稿日期:2019-04-25
修回日期:2019-09-11
网络出版日期:2019-09-19
刊出日期:2020-03-19
Virtual Network Function Migration Algorithm Based on Reinforcement Learning for 5G Network Slicing
Lun TANG,Yu ZHOU,,
Qi TAN,
Yannan WEI,
Qianbin CHEN
1. School of Communication and Information Engineering, Chongqing University ofPost and Telecommunications, Chongqing 400065, China
2. Key Laboratory of Mobile Communication Technology, Chongqing University ofPost and Telecommunications, Chongqing 400065, China
Funds:The National Natural Science Foundation of China (61571073), The Science and Technology Research Program of Chongqing Municipal Education Commission (KJZD-M201800601)
摘要
摘要:针对5G网络切片架构下业务请求动态性引起的虚拟网络功能(VNF)迁移优化问题，该文首先建立基于受限马尔可夫决策过程(CMDP)的随机优化模型以实现多类型服务功能链(SFC)的动态部署，该模型以最小化通用服务器平均运行能耗为目标，同时受限于各切片平均时延约束以及平均缓存、带宽资源消耗约束。其次，为了克服优化模型中难以准确掌握系统状态转移概率及状态空间过大的问题，该文提出了一种基于强化学习框架的VNF智能迁移学习算法，该算法通过卷积神经网络(CNN)来近似行为值函数，从而在每个离散的时隙内根据当前系统状态为每个网络切片制定合适的VNF迁移策略及CPU资源分配方案。仿真结果表明，所提算法在有效地满足各切片QoS需求的同时，降低了基础设施的平均能耗。
关键词:5G网络切片/
虚拟网络功能迁移/
强化学习/
资源分配
Abstract:In order to solve the Virtual Network Function (VNF) migration optimization problem caused by the dynamicity of service requests on the 5G network slicing architecture, firstly, a stochastic optimization model based on Constrained Markov Decision Process (CMDP) is established to realize the dynamic deployment of multi-type Service Function Chaining (SFC). This model aims to minimize the average sum operating energy consumption of general servers, and is subject to the average delay constraint for each slicing as well as the average cache, bandwidth resource consumption constraints. Secondly, in order to overcome the issue of having difficulties in acquiring the accurate transition probabilities of the system states and the excessive state space in the optimization model, a VNF intelligent migration learning algorithm based on reinforcement learning framework is proposed. The algorithm approximates the behavior value function by Convolutional Neural Network (CNN), so as to formulate a suitable VNF migration strategy and CPU resource allocation scheme for each network slicing according to the current system state in each discrete time slot. The simulation results show that the proposed algorithm can effectively meet the QoS requirements of each slice while reducing the average energy consumption of the infrastructure.
Key words:5G network slicing/
Virtual Network Function (VNF) migration/
Reinforcement learning/
Resource allocation
PDF全文下载地址:
https://jeit.ac.cn/article/exportPdf?id=bea3d7bb-2d4f-406b-bc3b-43239c41b983
