江俊¹(), 张伟霞², 王莞琪³

¹上海师范大学音乐学院
²上海师范大学教育学院
³上海师范大学商学院, 上海 200234

收稿日期:2019-09-23出版日期:2020-07-15发布日期:2020-05-21
通讯作者:江俊E-mail:jjxytc@163.com

Emotional processing in vocal and instrumental music: An ERP study

JIANG Jun¹(), ZHANG Weixia², WANG Wanqi³

¹Music College, Shanghai Normal University, Shanghai 200234, China
²College of Education, Shanghai Normal University, Shanghai 200234, China
³School of Finance and Business, Shanghai Normal University, Shanghai 200234, China

Received:2019-09-23Online:2020-07-15Published:2020-05-21
Contact:JIANG Jun E-mail:jjxytc@163.com

摘要/Abstract

摘要： 借助跨通道情绪启动范式考察声乐与器乐情绪加工的电生理差异。启动刺激是声乐和器乐曲(小提琴演奏), 目标刺激是与音乐情绪一致或不一致的面孔表情图片。结果显示, 与一致条件相比, 与面孔情绪不一致的器乐曲诱发了N400, 而与面孔情绪不一致的声乐曲诱发了LPC。这些结果表明, 声乐与器乐情绪加工的电生理反应存在差异。

图/表 3

图1跨通道情绪启动范式例子
图1跨通道情绪启动范式例子



图2启动刺激为器乐(a)与声乐(b)时面孔图片在9个代表性电极上诱发的平均脑电波形图 注：阴影区域表示每个时间点平均波幅的95% CI。
图2启动刺激为器乐(a)与声乐(b)时面孔图片在9个代表性电极上诱发的平均脑电波形图 注：阴影区域表示每个时间点平均波幅的95% CI。



图3启动刺激为器乐(a)与声乐(b)时面孔图片在2个时间窗口产生的差异波的头皮分布地形图 注：*表示在特定时间窗口内ERP效应显著的电极。
图3启动刺激为器乐(a)与声乐(b)时面孔图片在2个时间窗口产生的差异波的头皮分布地形图 注：*表示在特定时间窗口内ERP效应显著的电极。

参考文献 36

[1]	龚栩, 黄宇霞, 王妍, 罗跃嘉. (2011). 中国面孔表情图片系统的修订. 中国心理卫生杂志, 25(1), 40-46.
[2]	张伟霞, 王莞琪, 周临舒, 蒋存梅. (2018). 歌词对音乐情绪加工的影响: 行为与ERP研究. 心理学报, 50(12), 1346-1355.
[3]	郑志伟, 黄贤军. (2013). 情绪语音调节面孔表情的识别: ERP证据. 心理科学, 36(1), 33-37.
[4]	Ali, S. O., & Peynircio?lu, Z. F. (2006). Songs and emotions: Are lyrics and melodies equal partners? Psychology of Music, 34(4), 511-534.
[5]	Brattico, E., Alluri, V., Bogert, B., Jacobsen, T., Vartiainen, N., Nieminen, S., & Tervaniemi, M. (2011). A functional MRI study of happy and sad emotions in music with and without lyrics. Frontiers in Psychology, 2, 308. doi: 10.3389/fpsyg.2011.00308. URLpmid: 22144968
[6]	Cheal, J. L., Heisz, J. J., Walsh, J. A., Shedden, J. M., & Rutherford, M. D. (2014). Afterimage induced neural activity during emotional face perception. Brain Research, 1549, 11-21. URLpmid: 24423986
[7]	Diamond, E., & Zhang, Y. (2016). Cortical processing of phonetic and emotional information in speech: A cross-modal priming study. Neuropsychologia, 82, 110-122. doi: 10.1016/j.neuropsychologia.2016.01.019URLpmid: 26796714
[8]	Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175-191. URLpmid: 17695343
[9]	F?cker, J., & R?der, B. (2019). Event-related potentials reveal evidence for late integration of emotional prosody and facial expression in dynamic stimuli: An ERP study. Multisensory Research, 32(6), 473-497.
[10]	Franco, F., Chew, M., & Swaine, J. S. (2017). Preschoolers’ attribution of affect to music: A comparison between vocal and instrumental performance. Psychology of Music, 45(1), 131-149.
[11]	Goerlich, K. S., Witteman, J., Schiller, N. O., van Heuven, V. J., Aleman, A., & Martens, S. (2012). The nature of affective priming in music and speech. Journal of Cognitive Neuroscience, 24(8), 1725-1741. doi: 10.1162/jocn_a_00213URLpmid: 22360592
[12]	Hajcak, G., MacNamara, A., & Olvet, D. M. (2010). Event-related potentials, emotion, and emotion regulation: An integrative review. Developmental Neuropsychology, 35(2), 129-155. doi: 10.1080/87565640903526504URLpmid: 20390599
[13]	Hajcak, G., & Olvet, D. M. (2008). The persistence of attention to emotion: Brain potentials during and after picture presentation. Emotion, 8(2), 250-255. doi: 10.1037/1528-3542.8.2.250URLpmid: 18410198
[14]	Herring, D. R., Taylor, J. H., White, K. R., & Crites Jr, S. L. (2011). Electrophysiological responses to evaluative priming: The LPP is sensitive to incongruity. Emotion, 11(4), 794-806.
[15]	Imbir, K. K., Spustek, T., & ?ygierewicz, J. (2016). Effects of valence and origin of emotions in word processing evidenced by event related potential correlates in a lexical decision task. Frontiers in Psychology, 7, 271. doi: 10.3389/fpsyg.2016.00271.
[16]	Jarymowicz, M. T., & Imbir, K. K. (2015). Toward a human emotions taxonomy (based on their automatic vs. reflective origin). Emotion Review, 7(2), 183-188.
[17]	Kraus, D., & Horowitz-Kraus, T. (2014). The effect of learning on feedback-related potentials in adolescents with dyslexia: An EEG-ERP study. PLoS ONE, 9(6), e100486. doi: 10.1371/journal.pone.0100486.
[18]	Kutas, M., & Federmeier, K. D. (2011). Thirty years and counting: Finding meaning in the N400 component of the event-related brain potential (ERP). Annual Review of Psychology, 62(1), 621-647.
[19]	Loui, P., Bachorik, J. P., Li, H. C., & Schlaug, G. (2013). Effects of voice on emotional arousal. Frontiers in Psychology, 4, 675. doi: 10.3389/fpsyg.2013.00675.
[20]	Luck, S. J.(2014). An introduction to the event-related potential technique (2nd ed.). Cambridge, MA: The MIT Press.
[21]	Maris, E., & Oostenveld, R. (2007). Nonparametric statistical testing of EEG- and MEG-data. Journal of Neuroscience Methods, 164(1), 177-190. URLpmid: 17517438
[22]	Oostenveld, R., Fries, P., Maris, E., & Schoffelen, J.-M. (2011). FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Computational Intelligence and Neuroscience, 1-9. doi: 10.1155/2011/156869.
[23]	Painter, J. G., & Koelsch, S. (2011). Can out-of-context musical sounds convey meaning? An ERP study on the processing of meaning in music. Psychophysiology, 48(5), 645-655. URLpmid: 20883505
[24]	Paulmann, S., & Pell, M. D. (2010). Contextual influences of emotional speech prosody on face processing: How much is enough? Cognitive, Affective, & Behavioral Neuroscience, 10(2), 230-242.
[25]	Paulmann, S., & Uskul, A. K. (2017). Early and late brain signatures of emotional prosody among individuals with high versus low power. Psychophysiology, 54(4), 555-565.
[26]	Pell, M. D., Rothermich, K., Liu, P., Paulmann, S., Sethi, S., & Rigoulot, S. (2015). Preferential decoding of emotion from human non-linguistic vocalizations versus speech prosody. Biological Psychology, 111, 14-25. URLpmid: 26307467
[27]	Schirmer, A., Kotz, S. A., & Friederici, A. D. (2005). On the role of attention for the processing of emotions in speech: Sex differences revisited. Cognitive Brain Research, 24(3), 442-452. URLpmid: 16099357
[28]	Schupp, H. T., Cuthbert, B. N., Bradley, M. M., Cacioppo, J. T., Ito, T., & Lang, P. J. (2000). Affective picture processing: The late positive potential is modulated by motivational relevance. Psychophysiology, 37(2), 257-261. doi: 10.1111/psyp.2000.37.issue-2URL
[29]	Steinbeis, N., & Koelsch, S. (2011). Affective priming effects of musical sounds on the processing of word meaning. Journal of Cognitive Neuroscience, 23(3), 604-621. doi: 10.1162/jocn.2009.21383URL
[30]	Strack, F., & Deutsch, R. (2004). Reflective and impulsive determinants of social behavior. Personality and Social Psychology Review, 8(3), 220-247.
[31]	Stratton, V. N., & Zalanowski, A. H. (1994). Affective impact of music vs. lyrics. Empirical Studies of the Arts, 12(2), 173-184.
[32]	Zhang, Q., Kong, L., & Jiang, Y. (2012). The interaction of arousal and valence in affective priming: Behavioral and electrophysiological evidence. Brain Research, 1474, 60-72. URLpmid: 22820299
[33]	Zhang, Q., Lawson, A., Guo, C., & Jiang, Y. (2006). Electrophysiological correlates of visual affective priming. Brain Research Bulletin, 71(1-3), 316-323. doi: 10.1016/j.brainresbull.2006.09.023URLpmid: 17113962
[34]	Zhang, Q., Li, X., Gold, B. T., & Jiang, Y. (2010). Neural correlates of cross-domain affective priming. Brain Research, 1329, 142-151. URLpmid: 20298681
[35]	Zhang, W. X., Liu, F., Zhou, L. S., Wang, W. Q., Jiang, H. Y., & Jiang, C. M. (2019). The effects of timbre on neural responses to musical emotion. Music Perception, 37(2), 134-146.
[36]	Zhou, L. S., Liu, F., Jiang, J., & Jiang, C. M. (2019). Impaired emotional processing of chords in congenital amusia: Electrophysiological and behavioral evidence. Brain and Cognition, 135, 103577. doi: 10.1016/j.bandc.2019.06.001. doi: 10.1016/j.bandc.2019.06.001URLpmid: 31202155

相关文章 13

[1]	何蔚祺, 李帅霞, 赵东方. 群体面孔情绪感知的神经机制[J]. 心理科学进展, 2021, 29(5): 761-772.
[2]	曾颖, 夏天生. 音乐的神经美学：从审美反应到神经基础[J]. 心理科学进展, 2019, 27(9): 1596-1606.
[3]	余习德;鲁成;熊希灵;高定国. 音乐意义传递的神经证据 ——基于启动范式的发现与思考[J]. 心理科学进展, 2017, 25(5): 742-756.
[4]	陈珊珊;蔡厚德. 丘脑枕核参与情绪信息加工的多条通路[J]. 心理科学进展, 2015, 23(2): 234-240.
[5]	郭春彦;高传吉;李兵兵. FN400效应：外显记忆测量中的概念启动加工[J]. 心理科学进展, 2013, 21(9): 1521-1530.
[6]	聂其阳;罗劲. “啊哈！”和“哈哈！”：顿悟与幽默的脑认知成分比较[J]. 心理科学进展, 2012, 20(2): 219-227.
[7]	张洁尉;王权红. 文字加工中的正字法家族效应[J]. 心理科学进展, 2010, 18(6): 892-899.
[8]	廖成菊; 冯正直. 抑郁症情绪加工与认知控制的脑机制[J]. 心理科学进展, 2010, 18(2): 282-287.
[9]	袁加锦;汪宇;鞠恩霞;李红. 情绪加工的性别差异及神经机制[J]. 心理科学进展, 2010, 18(12): 1899-1908.
[10]	周婷;李娟. 轻度认知损伤重复效应脑电研究：范式及应用[J]. 心理科学进展, 2009, 17(6): 1185-1190.
[11]	曾红玲;刘思耘. 语篇语境对句子理解的影响：来自N400的证据[J]. 心理科学进展, 2009, 17(2): 314-320.
[12]	李鹤;丁妮; 董奇. 情绪加工老化效应的神经机制[J]. 心理科学进展, 2009, 17(2): 356-361.
[13]	罗跃嘉;魏景汉. 中西文的事件相关电位N400研究现状[J]. 心理科学进展, 1998, 6(3): 2-6.

PDF全文下载地址:

http://journal.psych.ac.cn/xlkxjz/CN/article/downloadArticleFile.do?attachType=PDF&id=5107