About Me

ZhiLei Liu (刘志磊) Ph.D, Assistant Professor

Tianjin Key Laboratory of Cognitive Computing and Application

School of Computer Science and Technology

TianJin University

92 Weijin Road, NanKai District, TianJin, P. R. China, 300072

Email: zhileiliu@tju.edu.cn leivo.ustc@gmail.com


I received my Ph.D. degree of Computer Science from University of Science and Technology of China (USTC) in Jun. 2014, advised by Prof. Shangfei Wangand Prof. Xiaoping Chen. I was a visiting student inIntelligent Systems Lab (ISL) of Rensselaer Polytechnic Institute (RPI) under the supervision of Prof. Qiang Ji, from Dec. 2012 to Jul. 2013. I worked as an engineer in China Academy of Electronics and Information Technology (CAEIT) from Jul. 2014 to Oct. 2014. After that, I moved to School of Computer Science and Technology in Tianjin University as an assistant professor.
Research Interests

Affective Computing Machine Learning Pattern Recognition Cognitive Computing Probabilistic Graphical ModelsBrain-Computer Interface

Research Projects
A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference In this work, we proposed and established a natural visible and infrared facial expression database, which contains both spontaneous and posed expressions of more than 100 subjects, recorded simultaneously by a visible and an infrared thermal camera, with illumination provided from three different directions. The posed database also includes expression image sequences with and without glasses. [USTC-NVIE Database]
Implicit Video Emotion Tagging from Audience's Facial ExpressionsIn this work, we proposed a novel multiple emotional tagging method based on multi-expressions, in which, multi-expressions are recognized by exploring dependencies among expressions. In addition, we model the relationships between outer expressions and inner emotions using a Bayesian Network.
Eye Localization from Thermal Infrared ImagesBy using the knowledge of facial structure and temperature distribution, in this work, we proposed an automatic eye localization method from long wave infrared thermal images both with eyeglasses and without eyeglasses.

Publications

Journal PapersShangfei Wang, Zhilei Liu, etc.: Exploiting Multi-expression Dependences for Implicit Multi-Emotion Video Tagging. Image and Vision Computing, Volume 32, Issue 10, October 2014, Pages 682-691, ISSN 0262-8856.NewShangfei Wang, Zhilei Liu, etc.: Implicit video emotion tagging from audiences' facial expression. Multimedia Tools and Applications, January 2014. [Published online]NewShangfei Wang, Zhilei Liu, etc.: Eye localization from thermal infrared images. Pattern Recognition, Elsevier, Volume 46, Issue 10, Pages 2613-2621, October 2013.Shangfei Wang, Zhilei Liu, etc.:Analysesof a Multi-modal Spontaneous Facial Expression Database. IEEE Transactions on Affective Computing, Vol.4, No.1, pp.34-46. Jan.-June 2013.Shangfei Wang, Zhilei Liu, etc.: A Natural Visible and Infrared Facial Expression Database for ExpressionRecognition and Emotion Inference. IEEE Transaction on Multimedia, Vol.12, No.7, pp.682-69. November 2010.

---

Conference PapersBaoyuan Wu, Zhilei Liu, Shangfei Wang, Baogang Hu, Qiang Ji: Multi-label Learning with Missing Labels. 2014 22nd International Conference on Pattern Recognition (ICPR), vol., no., pp.1964,1968, 24-28 Aug. 2014. [oral] NewMenghua He, Shangfei Wang,Zhilei Liu: Analyses of the Differences between Posed and Spontaneous Facial Expressions. 5th International Conference on Affective Computing and Intelligent Interaction, ACII 2013. September 2-5, 2013, Geneva, Switzerland.Zhilei Liu, Shangfei Wang, Zhaoyu Wang, and Qiang Ji: Implicit Video Multi-Emotion Tagging by Exploiting Multi-Expression Relations. 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013, April 22, 2013 - April 26, 2013, Shanghai, China. [oral]Zhaoyu Wang, Shangfei Wang, Menghua He, Zhilei Liu, Qiang Ji: Emotional tagging of videos by exploring multi-emotion coexistence. 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013, April 22, 2013 - April 26, 2013, Shanghai, China.Zhilei Liu, Shangfei Wang:Posed and Spontaneous Expression Distinguishment from InfraredThermal Images. The 21st International Conference on Pattern Recognition (ICPR 2012), Tsukuba, Japan. 2012. [oral]Shangfei Wang, Peijia Shen, Zhilei Liu:Eye Localization from Infrared Thermal Images. Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction (MPRSS 2012), LNCS, Vol 7742, 2013, pp. 35-42. Tsukuba, Japan. 2012. [oral]Shangfei Wang, Peijia Shen, Zhilei Liu:Facial Expression Recognition from Infrared Thermal Images using Temperature Difference by Voting. The 2nd IEEE International Conference on Cloud Computing and Intelligence Systems (IEEE CCIS2012), vol.01, no., pp.94,98, Oct. 30 2012-Nov. 1 2012, Hangzhou, China. 2012.Peijia Shen, Shangfei Wang, Zhilei Liu: Facial Expression Recognition from Infrared Thermal Videos. The 12th International Conference on Intelligent Autonomous Systems (IAS-12), Advances in Intelligent Systems and Computing, Volume 194, 2013, pp 323-333 Jeju Island, Korea, 2012.Zhilei Liu, Shangfei Wang: Emotion Recognition Using Hidden Markov Models from FacialTemperature Sequence. International Conference on Affective Computing and Intelligent Interaction, ACII 2011, Part II, LNCS 6975, pp.240-247, 2011 [oral]Shangfei Wang, Zhilei Liu: Infrared Face Recognition Based on Histogram and K-Nearest NeighborClassification. 7th International Symposium on Neural Networks, ISNN (2) 2010: 104-111, Shanghai, China [oral]

---

Technical ReportsShangfei Wang, Zhilei Liu, Xiaoping Chen, Xufa Wang: Affective Human-Robot Interaction Research in USTC (Extended Abstract), NSF/WTEC Workshop on Human-Robot Interaction, Oct. 2011, Beijing, China. [Presentation]

---

Dissertation[Ph. D, University of Science and Technology of China] The Applied Research of Probabilistic Graphic Model on Affective Computing (in Chinese)
Academic Service

Guest Reviewer, IEEE Transactions on Affective ComputingGuest Reviewer, IEEE Transactions on MultimediaGuest Reviewer, Image and Vision Computing JournalGuest Reviewer, ICCV 2013
Teaching

1.TBA
2.TBA

Resources

Code PackagesResearch Groups
Bayesian Network Toolbox (BNT toolbox)

MIT Media Lab (Prof. Rosalind W. Picard)

Intelligent Behaviour Understanding Group (iBUG) (Prof. Maja Pantic)
DatasetsOnline Courses
USTC-NVIE Database (USTC) Cohn-Kanade AU-Coded Expression DatabaseMMI Facial Expression Database (...to be continued) Probabilistic Graphical Models (Prof. Daphne Koller)

Neural Networks for Machine Learning (Prof. Geoffrey Hinton)

Machine Learning (Prof. Andrew Ng) [Notes]

Visual Perception and the Brain (Prof. Dale Purves)

The Brain and Space (Prof. Jennifer M. Groh)