侯永宏¹, 叶秀峰¹, 张亮^2,3, 李照洋¹, 董嘉蓉¹
AuthorsHTML:侯永宏¹, 叶秀峰¹, 张亮^2,3, 李照洋¹, 董嘉蓉¹
AuthorsListE:Hou Yonghong¹, Ye Xiufeng¹, Zhang Liang^2,3, Li Zhaoyang¹, Dong Jiarong¹
AuthorsHTMLE:Hou Yonghong¹, Ye Xiufeng¹, Zhang Liang^2,3, Li Zhaoyang¹, Dong Jiarong¹
Unit:1. 天津大学电气自动化与信息工程学院，天津 300072；2. 天津市先进电气工程与能源技术重点实验室，天津 300387；3. 天津工业大学电气工程与自动化学院，天津 300387
Unit_EngLish:1. School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
2．Tianjin Key Laboratory of Advanced Electrical Engineering and Energy Technology, Tianjin 300387, China
3. School of Electrical Engineering and Automation, Tianjin Polytechnic University, Tianjin 300387, China
Abstract_Chinese:现行的无人机控制(UAV)主要依靠专业的设备, 由经过专业训练的人来完成．为了更方便的人机交互, 本文提出了一种基于双目视觉和深度学习的手势控制无人机(HRI)方法．用双目视觉提取深度图, 跟踪提取人物所在区域并且设置阈值将人物与背景分离开来, 从而得到只含有人物的深度图．其次, 通过对深度图序列的处理并叠加, 将视频转换为同时含有时间与空间信息的彩色纹理图．本文用深度学习工具Caffe对所得到的彩色纹理图进行了训练与识别, 根据识别结果生成无人机的控制指令．本文所述方法在室内和室外均可使用, 有效范围达到10 m, 可以简化无人机控制复杂度, 对促进无人机普及及拓展无人机应用范围都具有重要意义．
Abstract_English:Traditionally，interacting with unmanned aerial vehicle(UAV)required specialized instrument and well trained operators. In order to reduce the difficulty interacting with UAV，a gesture based human robot interface(HRI)method based on stereo vision and deep learning was proposed in this paper. Firstly，the depth map was extracted using stereo vision. By utilizing tracking algorithm and setting a threshold，the pilot was spilt from background and a depth image with only the pilot in it was obtained. Secondly，a series of depth images were overlaid to generate a colored texture image which includes time and space information at the same time. Then，colored texture images were well learned and classified by a deep convolution neural network with the implementation of Caffe. Finally，UAV controlling command was generated according to the classified results. The proposed method is robust for both indoor and outdoor situations and is effective in 10 m. The study simplifies the control of UAV，and makes significant sense to the popularization of UAV and the extention of its application field.
Keyword_Chinese:人机交互; 双目视觉; 深度学习
Keywords_English:human robot interaction; stereo vision; deep learning

PDF全文下载地址:http://xbzrb.tju.edu.cn/#/digest?ArticleID=5913