Chongjie Zhang
Assistant Professor
IIIS, Tsinghua University
MMW Building S-221
100084, Beijing, China
+8610-62773713 Ext. 6221
chongjie at tsinghua.edu.cn
About
I am an Assistant Professor in the Institute for Interdisciplinary Information Sciences at Tsinghua University. Before joining the faculty, I was a postdoctoral associate at MIT working with Julie Shah and the Interactive Robotics group in Computer Science and Artificial Intelligence Lab (CSAIL) on studying robotics with applications on manufacturing. I received my Ph.D. in Computer Science under the supervision of Victor Lesser from University of Massachusetts at Amherst in 2011.
Announcement
We have vacancies for research interns and post-docs in the areas related to Deep Reinforcement Learning, Multi-Agent Systems, and Robotics.
Research Interests
My research focuses on developing AI models and methods to endow agents with greater autonomy and intelligence, to enable them to efficiently collaborate with other agents or humans to solve complex problems, and to be effectively applied to physical robots. Specifically, my research interests spans: •Machine Learning: reinforcement learning, deep learning, statistical learning
•Multi-Agent Systems: multi-agent learning, coordination, decision making under uncertainty
•Robotics: human-robot collaboration, robot learning, task and motion planning
Publications:
•Learning Nearly Decomposable Value Functions via Communication Minimization
Tonghan Wang*, Jianhao Wang*, Chongyi Zheng, Chongjie Zhang
International Conference on Learning Representations (ICLR), 2020. To appear.
[Arxiv]
•Influence-Based Multi-Agent Exploration
Tonghan Wang*, Jianhao Wang*, Yi Wu, Chongjie Zhang
International Conference on Learning Representations (ICLR), 2020. To appear.
[Arxiv]
•Episodic Reinforcement Learning with Associated Memory
Guangxiang Zhu*, Zichuan Lin*, Guangwen Yang, Chongjie Zhang
International Conference on Learning Representations (ICLR), 2020. To appear.
•Object-Oriented Dynamics Learning through Multi-Level Abstraction
Guangxiang Zhu*, Jianhao Wang*, Zhizhou Ren*, Chongjie Zhang
AAAI Conference on Artificial Intelligence (AAAI), 2020. To appear.
[pdf] [Arxiv]
•Hierarchical Reinforcement Learning with Advantage-Based Auxiliary Rewards
Siyuan Li*, Rui Wang*, Minxue Tang, Chongjie Zhang
Advances in Neural Information Processing Systems (NeurIPS), 2019.
[pdf] [Arxiv]
•Efficiently Detecting and Optimally Responding Towards Sophisticated Opponents
Tianpei Yang, Jianye Hao, Zhaopeng Meng, Chongjie Zhang, Yan Zheng, Ze Zheng
Proc. of the 28th International Joint Conference on Artificial Intelligence (IJCAI) , 2019.
[pdf]
•Convergence of Multi-Agent Learning with a Finite Step Size in General-Sum Games
Xinliang Song, Tonghan Wang, Chongjie Zhang
Proc. of the 18th International Conference on Autonomous Agents and Multiagent Systems (AAMAS) , 2019.
[pdf]
•Context-Aware Policy Reuse
Siyuan Li, Fangda Gu, Guangxiang Zhu, Chongjie Zhang
Proc. of the 18th International Conference on Autonomous Agents and Multiagent Systems (AAMAS) , 2019.
[pdf]
•Bayes-ToMoP: A Fast Detection and Best Response Algorithm Towards Sophisticated Opponents
Tianpei Yang, Jianye Hao, Zhaopeng Meng, Chongjie Zhang, Yan Zheng, Ze Zheng
Proc. of the 18th International Conference on Autonomous Agents and Multiagent Systems (AAMAS) , 2019.
[pdf (Extended Abstract)] [ arXiv (Longer Version)]
•Object-Oriented Dynamics Learning through Multi-Level Abstraction
Guangxiang Zhu*, Jianhao Wang*, Zhizhou Ren*, Chongjie Zhang
Deep Reinforcement Learning Workshop, NeurIPS , 2018.
[pdf]
•Object-Oriented Dynamics Predictor
Guangxiang Zhu, Zhiao Huang, Chongjie Zhang
Advances in Neural Information Processing Systems (NeurIPS), 2018.
[pdf] [supplementary] [ arXiv ] [ Code ]
•Automation Reliability and Trust: A Bayesian Inference Approach
Chenlan Wang, Chongjie Zhang, X. Jessie Yang
Proceedings of the 62nd Human Factors and Ergonomics Society Annual Meeting (HFES) , 202-206, 2018. [Best Student Paper 3rd Prize, HFES CEDM-TG]
[pdf]
•Trust Dynamics in Sequential Decision Making
Changhoon Kim, Mengyuan Zhang, Chongjie Zhang, X. Jessie Yang
Proceedings of the 62nd Human Factors and Ergonomics Society Annual Meeting (HFES), 165-166, 2018.
[pdf]
•An Optimal Online Method of Selecting Source Policies for Reinforcement Learning
Siyuan Li, Chongjie Zhang
AAAI Conference on Artificial Intelligence (AAAI), 2018.
[pdf]
•Perturbation Training for Human-Robot Teams
Ramya Ramakrishnan, Chongjie Zhang, Julie A. Shah
Journal of Artificial Intelligence Research (JAIR), 2017.
[pdf]
•Context-Based Concurrent Experience Sharing in Multiagent Systems
Dan Garant, Bruno Da Silva, Victor Lesser, Chongjie Zhang
International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2017.
[pdf (Extended Abstract)][arXiv (longer version)]
•Co-Optimizing Task and Motion Planning
Chongjie Zhang, Julie A. Shah
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016.
[pdf]
•Co-Optimization Multi-Agent Placement with Task Assignment and Scheduling
Chongjie Zhang, Julie A. Shah
International Joint Conference on Artificial Intelligence (IJCAI), 2016.
[pdf]
•On Fairness in Decision-Making under Uncertainty: Definitions, Computation, and Comparison
Chongjie Zhang, Julie A. Shah
AAAI Conference on Artificial Intelligence (AAAI), 2015.
[pdf]
•Fairness in Multi-Agent Sequential Decision-Making
Chongjie Zhang, Julie A. Shah
Advances in Neural Information Processing Systems (NIPS), 2014.
[pdf]
•Decentralized Multi-Agent Reinforcement Learning in Average-Reward Dynamic DCOPs
Nguyen Duc Thien, William Yeoh, Hoong Chuin Lau, Shlomo Zilberstein, Chongjie Zhang
AAAI Conference on Artificial Intelligence (AAAI), 2014.
[pdf]
•Decentralized Multi-Agent Reinforcement Learning in Average-Reward Dynamic DCOPs (Extended Abstract)
Nguyen, Duc Thien, William Yeoh, Hoong Chuin Lau, Shlomo Zilberstein, Chongjie Zhang
International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2014.
[pdf]
•Coordinating Multi-Agent Reinforcement Learning with Limited Communication
Chongjie Zhang, Victor Lesser
International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2013.
[pdf]
•Combining Dynamic Reward Shaping and Action Shaping for Coordinating Multi-Agent Learning
Xiangbin Zhu, Chongjie Zhang, Victor Lesser
IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT), 2013.
[pdf]
•Biasing the Behavior of Organizationally Adept Agents (Extended Abstract)
Dan Corkill, Chongjie Zhang, Bruno da Silva, Yoonheui Kim, Xiaoqin (Shelley) Zhang, Victor Lesser
International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2013.
[pdf]
•Coordinating Multi-Agent Learning for Decentralized POMDPs
Chongjie Zhang, Victor Lesser
International Workshop on Multiagent Sequential Decision Making Under Uncertainty (MSDM), 2012.
[pdf]
•Using Annotated Guidelines to Influence the Behavior of Organizationally Adept Agents
Dan Corkill, Chongjie Zhang, Bruno da Silva, Yoonheui Kim, Xiaoqin (Shelley) Zhang, Victor Lesser
International Workshop on Coordination, Organization, Institutions, and Norms (COIN@AAMAS), 2012.
[pdf]
•An Ensemble Architecture for Learning Complex Problem-Solving Techniques from Demonstration
Xiaoqin Shelley Zhang, Sungwook Yoon, Phillip DiBona, Darren Scott Appling, Li Ding, Janardhan Rao Doppa, Derek Green, Jinhong K Guo, Ugur Kuter, Geoff Levine, Reid L MacTavish, Daniel McFarlane, James R Michaelis, Hala Mostafa, Bhavesh Shrestha, Zhexuan Song, Ethan B Trewhitt, Huzaifa Zafar, Chongjie Zhang, et al.
ACM Transactions on Intelligent Systems and Technology (TIST), 2012.
[pdf]
•Coordinated Multi-Agent Reinforcement Learning in Networked Distributed POMDPs
Chongjie Zhang, Victor Lesser
AAAI Conference on Artificial Intelligence (AAAI), 2011.
[pdf]
•Organizationally Adept Agents
Daniel Corkill, Edmund Durfee, Victor Lesser, Huzaifa Zafar, Chongjie Zhang
International Workshop on Coordination, Organization, Institutions and Norms in Agent Systems (COIN@AAMAS 2011), 2011.
[pdf]
•Scaling Multi-Agent Learning in Complex Environments
Chongjie Zhang
Ph.D. Dissertation, 2011.
[pdf]
• Multi-Agent Learning with Policy Prediction
Chongjie Zhang, Victor Lesser
AAAI Conference on Artificial Intelligence (AAAI), 2010.
[pdf]
•Self-Organization for Coordinating Decentralized Reinforcement Learning
Chongjie Zhang, Victor Lesser, Sherief Abdallah
International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2010.
[pdf]
•A Multi-Agent Learning Approach to Online Distributed Resource Allocation
Chongjie Zhang and Victor Lesser, Prashant Shenoy
International Joint Conference on Artificial Intelligence (IJCAI), 2009.
[pdf]
•Integrating Organizational Control into Multi-Agent Learning
Chongjie Zhang, Victor Lesser, Sherief Abdallah
International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2009.
[pdf]
•An Ensemble Learning and Problem-Solving Architecture for Airspace Management
Xiaoqin Shelley Zhang, Sungwook Yoon, Phillip DiBona, Darren Scott Appling, Li Ding, Janardhan Rao Doppa, Derek Green, Jinhong K Guo, Ugur Kuter, Geoff Levine, Reid L MacTavish, Daniel McFarlane, James R Michaelis, Hala Mostafa, Bhavesh Shrestha, Zhexuan Song, Ethan B Trewhitt, Huzaifa Zafar, Chongjie Zhang, et al.
Annual Conference on Innovative Applications of Artificial Intelligence (IAAI), 2009.
[pdf]
•Efficient Multi-Agent Reinforcement Learning through Automated Supervision (Short Paper)
Chongjie Zhang, Victor Lesser, Sherief Abdallah
International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2008.
[pdf]
•An Application Portal for Collaborative Coastal Modeling
Chongjie Zhang, Chirag Dekate, Gabrielle Allen, Ian Kelley, Jon MacLaren
Concurrency and Computation: Practice and Experience, 2007.
[pdf]
•Grid Portal Solutions: A Comparison of GridPortlets and OGCE
Chongjie Zhang, Ian Kelley, Gabrielle Allen
Concurrency and Computation: Practice and Experience, 2007.
[pdf]
•A Workflow Approach to Designed Reservoir Study
Gabrielle Allen, Promita Chakraborty, Dayong Huang, Zhou Lei, John Lewis, Christopher White, Xiaoxi Xu, Chongjie Zhang
Workshop on Workflows in Support of Large-Scale Science (WORKS), 2007.
[pdf]
•Shelter from the Storm: Building a Safe Archive in a Hostile World
Jon MacLaren, Gabrielle Allen, Chirag Dekate, Dayong Huang, Andrei Hutanu, Chongjie Zhang
Lecture Notes in Computer Science, 2005.
[pdf]
•An Application Portal for Collaborative Coastal Modeling
Chongjie Zhang, Chirag Dekate, Gabrielle Allen, Ian Kelley, Jon MacLaren
International Workshop on Grid Computing Environments (GCE), 2005. (Best Paper Award)
•Grid Portal Solutions: A Comparison of GridPortlets and OGCE
Chongjie Zhang, Ian Kelley, Gabrielle Allen
International Workshop on Grid Computing Environments (GCE), 2005.
