相册


基本信息 The basic information
姓名: 蒋冬梅

学院: 计算机学院


学历: 博士研究生毕业

学位: 工学博士


职称: 教授

职务:


学科: 计算机科学与技术


邮箱: jiangdm@nwpu.edu.cn




工作经历 Work Experience
蒋冬梅，女，教授，博士生导师。2000.12毕业于西北工业大学，获计算机科学与技术工学博士学位，后留校任教。2000.12—2003.11 在西北工业大学控制科学与技术博士后流动站进行研究工作，2003.11-2010.4为西北工业大学计算机学院副教授，2010.5至今为计算机学院教授，曾分别于2001.11—2002.6和2006.6—2007.10期间在布鲁塞尔自由大学进行中国科技部与比利时政府间的国际合作项目研究。



科学研究 Scientific Research
主要研究方向为多模态融合的情感计算，基于语音、面部和身体姿态视频、脑电及生理信号，以及移动可穿戴设备获取的多模态信息，进行情感识别、人格识别、专注度估计、精神状态估计、抑郁症识别以及精神健康评估。主持国家自然科学基金、中国科技部与比利时政府国际合作、陕西省重点研发计划等多项项目，在国内外重要学术刊物和国际会议上发表学术论文90余篇。与比利时布鲁塞尔自由大学有二十年紧密合作关系，与美国加州大学欧文分校（UCI）、匹兹堡大学等都有良好合作。目前正致力于基于手机和移动可穿戴设备获取信息的精神状态监测、精神健康评估和健康导航研究，同时与西京医院合作，进行抑郁症智能评估与精准化管理研究。
1） 多模态情感识别：从语音、视频、脑电和生理信号中判别人的情绪类别，以及愉悦度和活力值。



2）多模态抑郁症评估：从结构式访谈的音视频信号中估计抑郁程度，判别是否抑郁症，判别双相抑郁症的阶段。

3）精神健康估计与健康导航：基于手机和移动可穿戴设备获取的生理信号和音视频，建立人的情感日志，评估抑郁焦虑及精神压力状态，进行预警筛查，并设计个性化自适应的健康导航方案。



荣誉获奖 Awards Information
1）国际听视觉情感挑战赛 (AVEC2019) 精神状态估计竞赛冠军
2）AVEC2018双相抑郁症检测竞赛并列第一名
3）AVEC2017抑郁症估计竞赛第二名
4）AVEC2016抑郁症检测竞赛冠军
5）AVEC2015连续情感识别竞赛冠军
6）国际多模态情感识别挑战赛（MEC2016）视觉组冠军和多模态组冠军
7）陕西高等学校科学技术奖一等奖，2017
8）陕西省自然科学优秀学术论文二等奖，2004.



学术成果 Academic Achievements
在国内外重要学术刊物和国际会议上发表学术论文90余篇，包括在英文期刊IEEE Trans. Multimedia、IEEE Trans. Affective Computing和情感计算领域顶级国际会议ACII上发表的多篇论文。获实用新型专利一项，获授权软件著作权2项。
Recent Journal Papers:
1.Ercheng Pei, Meshia Cedric Oveneke, Yong Zhao, Dongmei Jiang, Hichem Sahli. “Monocular 3D Facial Expression Features for Continuous Affect Recognition”, IEEE Transactions on Multimedia, Print ISSN: 1520-9210, Online ISSN: 1941-0077, DOI: 10.1109/TMM.2020.**.
2. Le Yang, Dongmei Jiang and Hichem Sahli. “Integrating Deep and Shallow Models for Multi-Modal Depression Analysis -- Hybrid Architectures”. IEEE Transactions on Affective Computing, DOI: 10.1109/TAFFC.2018.**.
3.Meshia Cédric Oveneke, Yong Zhao, Ercheng Pei, Abel Dìaz Berenguer, Dongmei Jiang, Hichem Sahli. “Leveraging the Deep Learning Paradigm for Continuous Affect Estimation from Facial Expressions”, IEEE Transactions on Affective Computing. DOI:10.1109/TAFFC.2019.**.
4. Ercheng Pei, Dongmei Jiang and Hichem Sahli. “An efficient model-levelfusion approach for continuous affect recognition from audiovisual signals”, NeuroComputing,Volume 376,pp.42-53, DOI:10.1016/j.neucom.2019.09.037.
5. Lang He, Dongmei Jiang, and Hichem Sahli. “Automatic Depression Analysis using Dynamic Facial Appearance Descriptor and Dirichlet Process Fisher Encoding”. IEEE Transactions on Multimedia. Volume 21,Issue 6, pp.1476-1486, 2019. DIO:10.1109/TMM.2018.**. (SCI: 011)
6.Yong Zhao, Meshia Cedric Oveneke, Dongmei Jiang, Hichem Sahli, Tao Yang. "A Video Prediction Approach for Animating Single Face Image", Multimedia Tools and Applications. Volume 78,Issue12,pp 16389–16410, 2019.
7.Ercheng Pei, Dongmei Jiang, Mitchel Perez Gonzalez, Hichem Sahli. “Continuous Affect Recognition with Weakly Supervision”, Multimedia Tools and Applications, Volume 78,Issue14,pp 19387–19412, 2019.
8. Meshia Oveneke, Isabel Gonzalez, Valentin Enescu, Dongmei Jiang,Hichem Sahli. “Leveraging the Bayesian Filtering Paradigm for Vision-Based Facial Affective State Estimation”.IEEE Transactions on Affective Computing. 9(4), pp.463-477, 2018. DOI:10.1109/TAFFC.2016.**. (SCI:006)
9.Fei Li, Xiuwei Zhang, Lei Zhang, Dongmei Jiang, Yanning Zhang. “Exploiting Structured Sparsity for Hyperspectral Anomaly Detection”, IEEE Transactions on Geoscience and Remote Sensing, Vol. 56, No. 7, pp. 4050-4064, July 2018
10.Li, F., Zhang, L., Zhang, X., Chen, Y., Jiang, D., Zhao, G., & Zhang, Y.. “Structured Background Modeling for Hyperspectral Anomaly Detection”. Sensors, 18(9), 3137.Doi:10.3390/s**, 2018.
11.Diana Torres-Boza, Meshia Cedric Oveneke, Fengna Wang, Dongmei Jiang,Hichem Sahli. “Hierarchical Sparse Coding Framework for Speech Emotion Recognition”,Speech Communication, Vol.99, pp.80-89,https://doi.org/10.1016/j.specom.2018.01.006, 2018.
Recent Conference Papers:
1.Yan Li, Xiaohan Xia, Dongmei Jiang, Hichem Sahli, Ramesh Jain. “MEMOS: A Multi-modal Emotion Stream Database for Temporal Spontaneous Emotional State Detection”, MI-Psychopathology’20, ICMI 2020 workshop, accepted.
2.Le Yang, Itir Onal Ertugrul, Jeffrey F. Cohn, Zakia Hammal, Dongmei Jiang, Hichem Sahli. “FACS3D-Net: 3D Convolution based Spatiotemporal Representation for Action Unit Detection”. Proc. 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII), pp.538-544, Sept.3-6, 2019, Cambridge, UK.
3. Yan Li, Le Yang, Haifeng Chen, Dongmei Jiang, Hichem Sahli. “Audio Visual Multimodal Classification of Bipolar Disorder Episodes”. Proc. 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), pp.115-120, Sept.3-6, 2019, Cambridge, UK.
4. Yan Li, Tao Yang, Le Yang, Xiaohan Xia, Dongmei Jiang, Hichem Sahli. “A Multimodal Framework for State of Mind Assessment with Sentiment Pre-classification”, Proc. of the 9th International Workshop on Audio/Visual Emotion Challenge, AVEC@MM 2019, Oct. 21-25, 2019, Nice, France.
5. Haifeng Chen, Yifan Deng, Shiwen Cheng, Yixuan Wang, Dongmei Jiang, Hichem Sahli. “Efficient Spatial Temporal Convolutional Features for Audiovisual Continuous Affect Recognition”, Proc. of the 9th International Workshop on Audio/Visual Emotion Challenge, AVEC@MM 2019, Oct. 21-25, 2019, Nice, France
6.Le Yang, Yan Li, Haifeng Chen, Dongmei Jiang, Meshia Cedric Oveneke, and Hichem Sahli. “Bipolar Disorder Recognition with Histogram Features of Arousal and Body Gestures”. In Proceedings of the 8th International Workshop on Audio/Visual Emotion Challenge (AVEC 2018), Seoul, Republic of Korea, October 22-26, 2018.
7.Xiaohan Xia, Jiamu Liu, Tao Yang, Dongmei Jiang, Wenjing Han, Hichem Sahli. “Video Emotion Recognition using Hand-Crafted and Deep Learning Features”, 2018 First Asian Conference on Affective Computing and Intelligent Interaction (ACII Asia), May 20-23, Beijing China.
8.Jiamu Liu, Wenjing Han, Huabin Ruan, Xiaomin Chen, Dongmei Jiang, Haifeng Li. “Learning Salient Features for Speech Emotion Recognition Using CNN”, 2018 First Asian Conference on Affective Computing and Intelligent Interaction (ACII Asia), May 20-23, Beijing China.
9.Le Yang, Dongmei Jiang, Wenjing Han, Hichem Sahli. “DCNN and DNN Based Multi-modal Depression Recognition”, 7thInt. Conf. Affective Computing and Intelligent Interaction (ACII2017), Oct. 23-27, 2017, San Antonio, USA.
10.Le Yang, Hichem Sahli, Xiaohan Xia, Ercheng Pei, Meshia Cedric Oveneke, Dongmei Jiang. “Hybrid Depression Classification and Estimation from Audio Video and Text Information”. Audio Visual Emotion Challenge at ACM Multimedia 2017, Oct. 22-27, 2017, Silicon Valley, USA.
11.Le Yang, Dongmei Jiang,Xiaohan Xia, Ercheng Pei, Meshia Cedric Oveneke,Hichem Sahli. “Multimodal Measurement of Depression Using Deep Learning Models”. Audio Visual Emotion Challenge at ACM Multimedia 2017, Oct. 22-27, 2017, Silicon Valley, USA.
12.Le Yang, Dongmei Jiang, Lang He, Ercheng Pei, Meshia Cedric Oveneke, Hichem Sahli. “Decision Tree Based Depression Classification from Audio Video and Language Information”. Proc. of the 5th International Workshop on Audio/Visual Emotion Challenge, Oct. 15-19, 2016, Amsterdam, the Netherland.
13.Ercheng Pei, Xiaohan Xia, Le Yang, Dongmei Jiang, Hichem Sahli. “Deep Neural Network and Switching Kalman Filter Based Continuous Affect Recognition”. Proc. 2016 IEEE International Conference on Multimedia & Expo Workshops, pp.1-6, July. 11-15, 2016, Seattle, USA.
14.Meshia Cédric Oveneke,Mitchel Aliosha-Pérez,Yong Zhao,Dongmei Jiang,Hichem Sahli. “Efficient Convolutional Auto-Encoding via Random Convexification and Frequency-Domain Minimization”.CoRRabs/1611.09232(2016).
15.Ercheng Pei, Le Yang, Dongmei Jiang, Hichem Sahli. “Multimodal Dimensional Affect Recognition Using Deep Bidirectional Long Short-Term Memory Recurrent Neural Networks”. Proc. of 6th Int. Conf. Affective Computing and Intelligent Interaction (ACII2015), pp.208-214, Sept. 21-14, 2015, Xi’an China.
16.Lang He, Dongmei Jiang, Hichem Sahli. “Multimodal Depression Recognition with Dynamic Visual and Audio Cues”. Proc. of 6th Int. Conf. Affective Computing and Intelligent Interaction (ACII2015), pp.260-266, Sept. 21-14, 2015, Xi’an China. (WOS:039)
17.Yong Zhao, Dongmei Jiang, Hichem Sahli. “3D Emotional Facial Animation Synthesis with Factored Conditional Restricted Boltzmann Machines”. Proc. of 6th Int. Conf. Affective Computing and Intelligent Interaction (ACII2015), pp.797-803, Sept. 21-14, 2015, Xi’an China.
18.Lang He, Dongmei Jiang, Le Yang, Ercheng Pei, Peng Wu, Hichem Sahli. “Multimodal Affective Dimension Prediction Using Deep Bidirectional Long Short-Term Memory Recurrent Neural Networks”. Proc. of the 5th International Workshop on Audio/Visual Emotion Challenge, pp.73-80, Oct. 26-30, 2015, Brisbane, Australia.
19.Isabel Gonzalez, Meshia Oveneke, Dongmei Jiang, Werner Verhelst, Hichem Sahli. “Framework for Combination Aware AU Intensity Recognition”. Proc. of the6th Int. Conf. Affective Computing and Intelligent Interaction, pp. 602-608, Sept. 21-14, 2015, Xi’an China.
20.Meshia Cedric Oveneke, Isabel Gonzalez, Weiyi Wang, Dongmei Jiang, Hichem Sahli. “Monocular 3D Facial Information Retrieval for Automated Facial Expression Analysis”. Proc. of the 6th Int. Conf. Affective Computing and Intelligent Interaction, pp. 623-629, Sept. 21-14, 2015, Xi’an China.





社会兼职 Social Appointments
1）中国人工智能学会人工心理与人工情感专业委员会委员
2）中国研究型医院协会头痛与感觉障碍专业委员会委员
3）陕西省计算机学会常务理事
4）陕西省信号处理学会常务理事
5）陕西省图像与图形学会理事
6）第四届多媒体大数据国际会议（BigMM2018）本地组织委会主席
7）第六届情感计算与智能交互国际会议（ACII2015）本地组织委员会主席
8）第八届情感计算与智能交互国际会议（ACII 2019）出版主席
9）ACII Asia 2018 出版主席
10）第七届情感计算与智能交互国际会议（ACII 2017）出版主席
11）ACII2017、ACII2019、AVEC2017-AVEC2019、ACM Multimedia 2019、ACM Multimedia 2020 程序委员会委员



English Version