华和安¹,
方勇纯^1,,,
钱辰¹,
张雪涛²
1.南开大学人工智能学院 天津 300350
2.大连理工大学智能机器人实验室 大连 116024
基金项目:国家自然科学基金(61873132, 61633012)

详细信息

作者简介:华和安：男，1995年生，博士生，研究方向为旋翼无人机的智能控制与规划
方勇纯：男，1973年生，教授，研究方向为非线性控制、机器人视觉伺服、无人机和桥式吊车等欠驱动系统控制
钱辰：男，1993年生，博士生，研究方向为扑翼飞行器和其他仿生机器人的设计和控制
张雪涛：男，1992年生，副教授，研究方向为自主旋翼无人机的运动计划，视觉伺服，状态和干扰估计

通讯作者:方勇纯　fangyc@nankai.edu.cn

中图分类号:V279; TP273

计量

文章访问数:143
HTML全文浏览量:67
PDF下载量:44
被引次数:0

出版历程

收稿日期:2021-03-26
修回日期:2021-10-20
网络出版日期:2021-10-27
刊出日期:2021-12-21

Reinforcement Learning Control Strategy of Quadrotor Unmanned Aerial Vehicles Based on Linear Filter

He’an HUA¹,
Yongchun FANG^1,,,
Chen QIAN¹,
Xuetao ZHANG²
1. College of Artificial Intelligence, Nankai University, Tianjin 300350, China
2. Intelligent Robotic Laboratory, Dalian University of Technology, Dalian 116024, China
Funds:The National Natural Science Foundation of China (61873132, 61633012)


摘要
摘要:针对四旋翼无人机(UAVs)系统，该文提出一种基于线性降阶滤波器的深度强化学习(RL)策略，进而设计了一种新型的智能控制方法，有效地提高了旋翼无人机对外界干扰和未建模动态的鲁棒性。首先，基于线性降阶滤波技术，设计了维数更少的滤波器变量作为深度网络的输入，减小了策略的探索空间，提高了策略的探索效率。在此基础上，为了增强策略对稳态误差的感知，该文结合滤波器变量和积分项，设计集总误差作为策略的新输入，提高了旋翼无人机的定位精度。该文的新颖之处在于，首次提出一种基于线性滤波器的深度强化学习策略，有效地消除了未知干扰和未建模动态对四旋翼无人机控制系统的影响，提高了系统的定位精度。对比实验结果表明，该方法能显著地提升旋翼无人机的定位精度和对干扰的鲁棒性。
关键词:四旋翼无人机/
智能控制/
强化学习/
未知干扰
Abstract:In this paper, based on linear filter, a deep Reinforcement Learning (RL) strategy is proposed, then a novel intelligent control method is put forward for quadrotor Unmanned Aerial Vehicles (UAVs), which improves effectively the robustness against disturbance and unmodeled dynamics. First of all, based on linear reduced-order filtering technology, filter variables with fewer dimensions are designed as the input of the deep network, which reduces the exploration space of the strategy and improves the exploration efficiency. On this basis, to enhance strategy perception of steady-state errors, the filter variables and integration terms are combined to design the lumped error as the new network input, which improves the positioning accuracy of quadrotor UAVs. The novelty of this paper lies in that it is the first intelligent approach based on linear filtering technology, to eliminate successfully the influence of unknown disturbance and unmodeled dynamics of quadrotor UAVs, which improves the positioning accuracy. The results of comparative experiments show the effectiveness of the proposed method in terms of improving positioning accuracy and enhancing robustness.
Key words:Quadrotor Unmanned Aerial Vehicles (UAVs)/
Intelligent control/
Reinforcement Learning(RL)/
Unknown disturbance



PDF全文下载地址:

https://jeit.ac.cn/article/exportPdf?id=e3c2b359-e980-4074-b056-aa52dddf4960