所属研究所、院系:
先进网络与计算系统研究所

职称:
副教授

E-mail:
yuchao3@mail.sysu.edu.cn

办公地点:
广州大学城中山大学管理学院楼D504




教师简介:
余超，中山大学“****”引进副教授，国家“香江****”。2007年本科毕业于华中科技大学电信系，获通信工程学士学位，2013年博士毕业于澳大利亚伍伦贡大学计算机系，获计算机博士学位。主要从事强化学习理论与应用（健康医疗、机器人与多机器人系统、智能集群）研究工作。先后在IEEE TNNLS（IF:11.683）, IEEE TCB（IF:10.387），IEEE ITS（IF:4.051）, IEEE TVT（IF:4.432），ACM T等国际期刊和IJCAI、AAMAS上发表学术论文70余篇。主持科研项目10余项。获最佳论文奖3次。
担任SCI期刊IEICE TIS和JSSE副主编；组织国际会议MATCSD2015，ACAN 2016，IEEE ICA2016，IEEE ICA2017，Special Track in PRICA20I8，DAI2019, DAI2020；担任国际会议IJCAI2020, AAAI2020, IJCAI2019，AAMAS2019，AAAI2019，AAMAS2018，PRICAI2018，AAMAS2017等国际会议PC。
强化学习是当前人工智能热潮的核心技术之一，在机器人与多机器人系统、健康医疗、广告推荐、对话系统、经济博弈等领域有着广泛的应用。目前，我们团队主要的科研项目有：（1）基于强化学习的机器人行为控制（深度强化学习、人机交互、数字孪生）；（2）基于分布式强化学习的智能集群协同（军事集群、多机器人系统、智能网联汽车）；（3）基于强化学习的慢性病和重症室（脓毒症等）最优治疗；（4）非完全信息博弈（德扑麻将棋牌类游戏、王者荣耀Dota等战略游戏。军事对抗和兵棋推演等）；（5）强化学习理论（模型学习、探索和信任分配、多智能体强化学习、离线学习、分层学习、贝叶斯学习等）。
本实验室目前承担多项国家级课题，并与腾讯、华为、中山大学附属医院等企业机构建立校企合作平台，表现优异的学生有机会派遣至优秀互联网企业进行实习工作，或推荐至香港、澳大利亚、美国、日本、新加坡等众多高校攻读博士，欢迎有志于从事人工智能前沿研究的优秀本科生和研究生加入实验室。
已毕业学生
研究生：王鑫（中国农行、国家奖学金）、王东旭（百度）、谭佳瑶（华为）、赵洪义（中国电子科技集团）
本科生：李阳宁（爱丁堡大学）、杨天培（纽约大学）、吕柏杨（香港大学）、吕洪涛（上海交大直博、CCF优秀大学生奖）、冯湛搏（上海交大直博）、李豫晨（上海交大直博）
在读学生
研究生：董银昭（2018级，国家奖学金、校优秀研究生标兵）、任国奇（2018级）、夏礼俊（2019级）、谭晋（2019级）、张乐（2019级）

研究领域:
（1）智能体与多智能体系统理论：强化学习、多智能体强化学习、博弈论、计算经济学、社会选择理论
（2）智能体与多智能体系统应用：自动驾驶与智能网联汽车、机器人与多机器人系统、智能电网、量化交易
（3）基于强化学习的机器人行为控制：深度强化学习、人机交互、迁移学习、虚实混合（数字孪生）、模型学习
（4）基于强化学习的博弈对抗技术：军事集群、非完全信息博弈（实时战略游戏、棋牌、兵棋推演）
（5）基于强化学习的智能医疗：慢性病治疗、重症室（脓毒症、呼吸机）决策、健康管理、运动康复

工作经历:
2014.3-2016.12， 大连理工大学/计算机学院，讲师
2016.12-2019.12，大连理工大学/计算机学院，副教授（破格）
2019.12-今，中山大学/数据科学与计算机学院，副教授

海外经历:
2018.1-2019.6， 香港浸会大学/计算机系，研究员
2010.9-2013.12，澳大利亚伍伦贡大学/计算机与软件工程系，博士

获奖及荣誉:
国家“香江****”
大连市高层次创新人才
大连理工“星海****”
辽宁省自然科学学术成果奖（论文类）三等奖, 2018
辽宁省自然科学学术成果奖（论文类）二等奖, 2016, 2017
大连市自然科学优秀学术论文奖二等奖, 2017
大连市自然科学优秀学术论文奖一等奖, 2016
大连理工大学教学质量优良奖, 2016
大连理工大学“优秀党员“, 2016
大连理工大学“优秀工会工作积极分子”, 2016，2017

科研项目:
主持项目：
“多智能体强化学习算法研究”，国防科技创新特区项目，2020.11.1-2022.6.30；
“XXX强化学习新方法研究”，国防科技创新特区项目, 2020.12.1-2021.12.31；
“群体XXX”，XX重大基础研究项目子课题，2021.1.1-2023.12.31；
“面向非完全信息的多智能博弈学习技术研究”，腾讯犀牛鸟基金, 2019.3.30-2020.3.30；
“基于多步规划的强化学习方法研究”，2020华为-中大合作项目（共同主持）,2020.11.1-2021.11.1；
?“面向XX研究”，XXX院合作项目, 2020.10.1-2021.4.30；
?“XXX优化模型”，XXX研究所合作项目, 2020.11.15-2022.12.30；
“面向多智能体系统的博弈学习技术研究”，国家军委装备发展部“十三五”装备预研领域基金, 2018.11.1-2019.12.30；
“基于强化学习的智能医疗”，国家“香江****”项目 ,2018.11.1-2019.6.30；
“基于虚实混合的机器人强化学习关键技术研究”,大连市科技创新基金应用基础研究项目, 2018.1.1-2020.12.30；
“机器人强化学习的关键技术研究”，大连市高层次人才创新支持计划项目, 2017.11.1-2019.12.30；
“基于多智能体学习的社会规范涌现机制研究”，国家自然科学青年基金, 2016.1.1-2018.12.31；
“基于复杂学习的一致性涌现机制研究”, 中国博士后基金特别资助, 2015.9.15-2016.12.31;
“大规模分布式系统社会规范涌现机制研究”, 中国博士后面上基金项目, 2014.9.15-2015.12.31;
“社会规范理论”, 中央高校基本科研业务经费;
“基于多智能体系统的社交物联网研究”，大连理工大学首届“星海骨干”人才培养项目；
核心参与项目：
“网联汽车群体智能决策理论与方法研究”,国家自然科学基金委员会-辽宁联合基金重点支持项目(U**)；
“车联网关键技术”,国家863项目；

主要学术兼职:
Editor
? ? ? ?? Special Section on Frontiers in Agent-based Technology, IEICE Trans. Information and Systems.
? ? ? ?? Special Issue on Agent-Based Modelling for Complex Systems, J. Systems Science and Engineering.
Organisers
? ? ? ?? Workshop on Reinforcement Learning at DAI'19
? ? ? ? Workshop on Methods and Applications of Reinforcement Learning @ PRICAI2018, Nanjing, China, August, 2018.
? ? ? ?? Special Track on Reinforcement Learning @ PRICAI2018, Nanjing, China, August, 2018.
? ? ? ? IEEE ICA2017, 2nd IEEE International Conference on Agents (2017 IEEE ICA), Beijing, China, July 6-9, 2017.
? ? ? ? IEEE ICA2016, IEEE International Conference on Agents (2016 IEEE ICA), Metsue, Japan, September 28-30, 2016.
? ? ? ? ACAN 2016, The 8th International Workshop on Agent-based Complex Automated Negotiations (ACAN2016@AAMAS2016), Singapore, May 4, 2016.
? ? ? ? MATCSD2015, Multi-Agent Technologies for Complex Systems Development: Challenges and Solutions, Dalian University of Technology, China, September 17-18, 2015.
PC
? ? ? ?IJCAI2019，AAMAS2019，AAAI2019，AAMAS2018，PRICAI2018，AAMAS2017

教授课程:
1. 《强化学习》
2. 《多智能体系统》
3. 《推理与学习》
4. 《汇编语言》
5. 《图论以及应用》

代表性论著:
期刊论文
Chao Yu, et al.?Supervised-actor-critic reinforcement learning for intelligent mechanical ventilation and sedative dosing in intensive care units.?BMC Medical Informatics and Decision Making, 2020?(IF:2.134)
Chao Yu, Yinzhao Dong, Yangning Li, Yatong Chen Distributed multi-agent deep reinforcement learning for cooperative multi-robot pursuit , The Journal of Engineering, 2020.
Chao Yu, JIming Liu and Shamim Nemati.?Reinforcement Learning in Healthcare: A Survey?arXiv preprint arXiv:1908.08796, 2019.
Chao Yu, Xin Wang, Xin Xu, et al. Distributed Multiagent Coordinated Learning for Autonomous Driving in Highways Based on Dynamic Coordination Graphs. IEEE Transactions Intelligent Transportation Systems, doi: 10.1109/TITS.2019.**, 2019. (IF:4.051)
?Chao Yu, Jiming Liu and Hongyi Zhao. Inverse Reinforcement Learning for Intelligent Mechanical Ventilation and Sedative Dosing in Intensive Care Units. BMC Medical Informatics and Decision Making, 2019. (IF:2.134)
Chao Yu, Yinzhao Dong and Jiming Liu, and Guoqi Ren. Incorporating Causal Factors into Reinforcement Learning for Dynamic Treatment Regimes in HIV. BMC Medical Informatics and Decision Making, 2019. (IF:2.134)
Bingcai Chen, Chao Yu, Qishaui Diao, Rui Liu and Yuliang Wang. Social or Individual Learning? An Aggregated Solution for Coordination in Multiagent Systems. Journal of Systems Science and Systems Engineering, 27 (2), 180-200 (IF:0.766)
Bingcai Chen, Xin Tao, Manrou Yang, Chao Yu, Weimin Pan, Victor C. M. Leung: A Saliency Map Fusion Method Based on Weighted DS Evidence Theory. IEEE Access 6: 27346-27355 (2018)
Bingcai Chen, Zhenguo Gao, Manrou Yang, Qian Ning, Chao Yu, Weimin Pan, Mei Nian, Dongmei Xie: Packet Multicast in Cognitive Radio Ad Hoc Networks: A Method Based on Random Network Coding. IEEE Access 6: 8768-8781 (2018)
?Fuxin Zhang, Guozhen Tan, Chao Yu. Fair Transmission Rate Adjustment in Cooperative Vehicle Safety Systems based on Multi-Agent Model Predictive Control. IEEE Transactions on Vehicular Technology. 66(7): 6115-6129, 2017. (IF:4.432)
J Hao, J Sun, G Chen, Z Wang, Chao Yu, Z Ming, Efficient and Robust Emergence of Norms through Heuristic Collective Learning. ACM Transactions on Autonomous and Adaptive Systems (TAAS) 12 (4), 23, 2017 (IF:1.216)
Chao Yu, Guozhen Tan, Hongtao Lv, Zhen Wang, Jun Meng, Jianye Hao and Fenghui Ren. Modelling adaptive learning behaviours for consensus formation in human societies. Scientific Reports, 6, 2016. (IF:4.122)
Chao Yu, Minjie Zhang, Fenghui Ren, and Guozhen Tan. Emotional Multiagent Reinforcement Learning in Spatial Social Dilemmas, IEEE Transactions on Neural Networks and Learning Systems. 26(12), 3083-3096, 2015. (4.051)
Chao Yu, Minjie Zhang, Fenghui Ren, and Guozhen Tan. Multiagent Learning of Coordination in Loosely Coupled Multiagent Systems, IEEE Transactions on Cybernetics. 45(12), 2853-2867, 2015. (IF:10.387）
Chao Yu, Minjie Zhang and Fenghui Ren and Guozhen Tan. Emergence of Social Norms through Collective Learning in Networked Multiagent Systems, IEEE Transactions on Cybernetics, 44(12): 2342-2355, 2014. (IF:10.387)
Chao Yu, Minjie Zhang and Fenghui Ren. Coordinated Learning by Exploiting Sparse Interaction in Multiagent Systems, Concurrency and Computation: Practice and Experience, 26(1): 51-70., 2014. (IF:1.114)
?Zhen Wang, Chao Yu, Guanghai Cui, Yapeng Li, Mingchu Li, Evolution of Cooperation in Spatial Iterated Prisoner’s Dilemma Games under Localized Extremal Dynamics. Physica A: Statistical Mechanics and its Applications, 444:566-575, 2016. (IF:2.132)
Jiankang Ren, Zichuan Xu, Chao Yu, Chi Lin, Guowei Wu, Guozhen Tan: Execution allowance based fixed priority scheduling for probabilistic real-time systems. Journal of Systems and Software 152: 120-133 (2019)
Bingcai Chen, Zhongru Ren, Chao Yu, Iftikhar Hussain, Jintao Liu: Adversarial Examples for CNN-Based Malware Detectors. IEEE Access 7: 54360-54371 (2019)
会议论文
Chao Yu, et al.?Decomposed Deep Reinforcement Learning for Robotic Control, AAMAS2020.
Chao Yu, et al.?Interactive RL via Online Human Demonstrations, AAMAS2020.
Chao Yu, Guozhen Tan,?The Price of Governance: A Middle Ground Solution to Coordination in Organizational Control, IJCAI2019.
Yaodong yang, Jianye Hao and Chao Yu,??Large-Scale Home Energy Management Using Entropy-Based Collective Multiagent Reinforcement Learning Framework. IJCAI2019
Chao Yu, Xin Wang, Zhanbo Feng: Coordinated Multiagent Reinforcement Learning for Teams of Mobile Sensing Robots. AAMAS 2019: 2297-2299
?Chao Yu, Guoqi Ren and Jiming Liu, Deep Inverse Reinforcement Learning for Sepsis Treatment, 2019 IEEE International Conference on Healthcare Informatics, 2019. (EI)
?Chao Yu, Yinzhao Dong and Xin Wang, Multiagent Reinforcement Learning on Coordination Graphs, 4th International Workshop on Smart Simulation and Modelling for Complex Systems (SSMCS@IJCAI 2019).?(Best Paper Award）
?Jiankang Ren, Xiaoyan Su, Guoqi Xie, Chao Yu, Guozhen Tan, Guowei Wu: Workload-Aware Harmonic Partitioned Scheduling of Periodic Real-Time Tasks with Constrained Deadlines. DAC 2019: 167:1-167:6
Chao Yu, Dongxu Wang, Jiankang Ren, Hongwei Ge and Liang Sun. Decentralized Multiagent Reinforcement Learning for Efficient Robotic Control by Coordination Graphs. 15th Pacific Rim International Conference on Artificial Intelligence, pp. 191-203, 2018.
Chao Yu, Dongxu Wang, Tianpei Yang, Wenxuan Zhu, Yuchen Li, Hongwei Ge and Jiankang Ren. Adaptively Shaping Reinforcement Learning Agents via Human Reward. 15th Pacific Rim International Conference on Artificial Intelligence, pp. 85-97, 2018. (Best Paper Nomination, 5 out of 441)
?Chao Yu, Yatong Chen, Hongtao Lv, Jiankang Ren, Hongwei Ge and Liang Sun. Neural learning for the emergence of social norms in multiagent systems. 2017 IEEE International Conference on Agents (ICA), pp. 40-45, 2017.
?Chao Yu, Hongtao Lv, Sandip Sen, Jianye hao, Fenghui Ren and Rui Liu. An Adaptive Learning Framework for Efficient Emergence of Social Norms. 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS2016), Singapore. pp. 1307-1308, 2016.
Chao Yu, Hongtao Lv, Sandip Sen, Fenghui Ren and Guozhen Tan. Adaptive Learning for Efficient Emergence of Social Norms in Networked Multiagent Systems. In The Proceedings of the 14th Pacific Rim International Conference on Artificial Intelligence (PRICAI 2016): Trends in Artificial Intelligence. LNAI 9810, pp. 805-818, 2016.
Chao Yu, Rui Liu and Yuliang Wang. Social Learning in Networked Multiagent Systems. IEEE International Conference on Agents (2016 IEEE ICA), pp. 57-62, 2016.
Chao Yu, Hongtao Lv, Honglin Bao, Jianye Hao and Zhen Wang. Hierarchical Learning for Emergence of Social Norms in Networked Multiagent Systems. In Proceedings of the 28th Australasian Joint Conference on Artificial Intelligence (AI2015).
?Chao Yu, Hongtao Lv. Norm Emergence through Collective Learning and Information Diffusion in Complex Relationship Networks. In Proceedings of International Joint Agents Workshop and Symposium (IJAWS2015).
Chao Yu, Minjie Zhang, Fenghui Ren and Jianye Hao. Individual and Social Learning for Norm Emergence in Networked Agent Societies. International Workshop on Multiagent Foundations of Social Computing co-located with the 12th International Conference on Autonomous Agents and Multiagent Systems (MFSC@AAMAS2014).
Chao Yu, Minjie Zhang, Fenghui Ren and Xudong Luo. Emergence of Social Norms Through Collective Learning in Networked Agent Societies. The Twelfth International Conference on Autonomous Agents and Multiagent Systems (AAMAS2013) , pp.475-482, May 6-10, 2013, Saint Paul, USA.
Chao Yu, Fenghui Ren and Minjie Zhang. An Adaptive Bilateral Negotiation Model Based on Bayesian Learning. The 4th AAMAS International Workshop on Agent-based Complex Automated Negotiations (ACAN@AAMAS2011), The Best Student Paper Award, Taipei, 2011