1 南京师范大学心理学院, 南京 210097
2 中国科学院心理研究所 行为科学重点实验室, 北京 100101
收稿日期:
2019-03-20出版日期:
2019-12-15发布日期:
2019-10-21通讯作者:
张晶晶,杨玉芳E-mail:jinger.zhang@outlook.com;yangyf@psych.ac.cn基金资助:
* 国家自然科学基金青年项目(31800914);江苏省高校自然科学研究面上项目(18KJD190003)Processing of hierarchical structures in language and music
ZHANG Jingjing1(), YANG Yufang2()1 School of Psychology, Nanjing Normal University, Nanjing 210097, China
2 CAS Key Laboratory of Behavioral Science, Institute of psychology, Beijing 100101, China
Received:
2019-03-20Online:
2019-12-15Published:
2019-10-21Contact:
ZHANG Jingjing,YANG Yufang E-mail:jinger.zhang@outlook.com;yangyf@psych.ac.cn摘要/Abstract
摘要: 语言和音乐在呈现过程中, 小单元相互结合组成更大的单元, 最终形成层级结构。已有研究表明, 听者能够将连续的语流和音乐切分成层级结构, 并在大脑中形成层级表征。在感知基础之上, 听者还能将新出现的语言和音乐事件整合到层级结构之中, 形成连贯理解, 最终顺利地完成交流过程。未来研究应剖析边界线索在层级结构感知中的作用, 考察不同层级整合过程的影响因素, 进一步探索语言和音乐层级结构加工的关系。
参考文献 54
[1] | 马谐, 杨玉芳, 张秋月 . ( 2016). 音乐句法的加工. 科学通报, 61( 10), 1099-1111. |
[2] | 叶铮, 周晓林 . ( 2006). 音乐之脑. 心理科学进展, 14( 5), 641-647. |
[3] | 张晶晶, 杨玉芳 . ( 2017). 音乐句法加工的影响因素. 心理科学进展, 25( 11), 1823-1830. |
[4] | 周临舒, 蒋存梅, 杨玉芳 . ( 2012). 音乐和语言句法认知的比较. 科学通报, 57( 28-29), 2674-2685. |
[5] | Berwick, R. C., Friederici, A. D., Chomsky, N., & Bolhuis, J. J . ( 2013). Evolution, brain, and the nature of language. Trends in Cognitive Sciences, 17( 2), 89-98. |
[6] | Cutler, A., &Clifton, C. (1999). Comprehending spoken language: A blueprint of the listener. The Neurocognition of Language, 123-166. |
[7] | Ding, N., Melloni, L., Zhang, H., Tian, X., & Poeppel, D . ( 2016). Cortical tracking of hierarchical linguistic structures in connected speech. Nature Neuroscience, 19( 1), 158-164. |
[8] | Ding, N., & Simon, J. Z . ( 2012). Emergence of neural encoding of auditory objects while listening to competing speakers. Proceedings of the National Academy of Sciences, 109( 29), 11854-11859. |
[9] | Doelling, K. B., &Poeppel, D. (2015). Cortical entrainment to music and its modulation by expertise. Proceedings of the National Academy of Sciences, 112( 45), E6233-E6242. |
[10] | Egidi, G., & Caramazza, A. (2016). Integration processes compared: Cortical differences for consistency evaluation and passive comprehension in local and global coherence. Journal of Cognitive Neuroscience, 28( 10), 1568-1583. |
[11] | Farbood, M. M., Heeger, D. J., Marcus, G., Hasson, U., & Lerner, Y. L . ( 2015). The neural processing of hierarchical structure in music and speech at different timescales. Frontiers in Neuroscience, 9, 157. |
[12] | Glushko, A., Steinhauer, K., DePriest, J., & Koelsch, S . ( 2016). Neurophysiological correlates of musical and prosodic phrasing: Shared processing mechanisms and effects of musical expertise. PloS One, 11( 5), e0155300. |
[13] | Guo, S., & Koelsch, S. (2015). The effects of supervised learning on event-related potential correlates of music- syntactic processing. Brain Research, 1626, 232-246. |
[14] | Guo, S., & Koelsch, S. (2016). Effects of veridical expectations on syntax processing in music: Event-related potential evidence. Scientific Reports, 6, 19064. |
[15] | Hagoort, P., & van Berkum, J. J. A, . ( 2007). Beyond the sentence given. Philosophical Transactions of the Royal Society B: Biological Sciences, 362( 1481), 801-811. |
[16] | Hwang, H., & Steinhauer, K. (2011). Phrase length matters: The interplay between implicit prosody and syntax in Korean “garden path” sentences. Journal of Cognitive Neuroscience, 23( 11), 3555-3575. |
[17] | Inubushi, T., &Sakai, K. L . ( 2013). Functional and anatomical correlates of word-, sentence-, and discourse-level integration in sign language. Frontiers in Human Neuroscience, 7, 681. |
[18] | Jentschke, S., Friederici, A. D., & Koelsch, S . ( 2014). Neural correlates of music-syntactic processing in two-year old children. Developmental Cognitive Neuroscience, 9, 200-208. |
[19] | Kintsch, W. (1998). Comprehension: A paradigm for cognition. New York, NY, US: Cambridge university press. |
[20] | Knösche, T. R., Neuhaus, C., Haueisen, J., Alter, K., Maess, B., Witte, O. W., & Friederici, A. D . ( 2005). Perception of phrase structure in music. Human Brain Mapping, 24( 4), 259-273. |
[21] | Koelsch, S., Gunter, T., Friederici, A. D., & Schröger, E . ( 2000). Brain indices of music processing: “Nonmusicians” are musical. Journal of Cognitive Neuroscience, 12( 3), 520-541. |
[22] | Koelsch, S., Rohrmeier, M., Torrecuso, R., & Jentschke, S . ( 2013). Processing of hierarchical syntactic structure in music. Proceedings of the National Academy of Sciences, 110( 38), 15443-15448. |
[23] | Koelsch, S., Vuust, P., & Friston, K . ( 2018). Predictive processes and the peculiar case of music. Trends in Cognitive Sciences, 23( 1), 63-77. |
[24] | Lagrois, M.-é., Peretz, I., & Zendel, B. R . ( 2018). Neurophysiological and behavioral differences between older and younger adults when processing violations of tonal structure in music. Frontiers in Neuroscience, 12, 54. |
[25] | Lerdahl, F., & Jackendoff, R. S . ( 1983). A generative theory of tonal music. Cambridge, MA: MIT press. |
[26] | Lerner, Y., Honey, C. J., Silbert, L. J., & Hasson, U . ( 2011). Topographic mapping of a hierarchy of temporal receptive windows using a narrated story. Journal of Neuroscience, 31( 8), 2906-2915. |
[27] | Li, W., & Yang, Y. (2009). Perception of prosodic hierarchical boundaries in Mandarin Chinese sentences. Neuroscience, 158( 4), 1416-1425. |
[28] | Li, W., & Yang, Y. (2010). Perception of Chinese poem and its electrophysiological effects. Neuroscience, 168( 3), 757-768. |
[29] | Luo, H., & Poeppel, D. (2007). Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex. Neuron, 54( 6), 1001-1010. |
[30] | Ma, X., Ding, N., Tao, Y., & Yang, Y. F . ( 2018 a). Differences in neurocognitive mechanisms underlying the processing of center-embedded and non-embedded musical structures. Frontiers in Human Neuroscience, 12. |
[31] | Ma, X., Ding, N., Tao, Y., & Yang, Y. F . ( 2018 b). Syntactic complexity and musical proficiency modulate neural processing of non-native music. Neuropsychologia, 121, 164-174. |
[32] | Maess, B., Koelsch, S., Gunter, T. C., & Friederici, A. D . ( 2001). Musical syntax is processed in Broca's area: An MEG study. Nature Neuroscience, 4( 5), 540-545. |
[33] | Nan, Y., Knösche, T. R., & Friederici, A. D . ( 2009). Non- musicians’ perception of phrase boundaries in music: A cross- cultural ERP study. Biological Psychology, 82( 1), 70-81. |
[34] | Nan, Y., Knösche, T. R., Zysset, S., & Friederici, A. D . ( 2008). Cross‐cultural music phrase processing: An fMRI study. Human Brain Mapping, 29( 3), 312-328. |
[35] | Neuhaus, C., Knösche, T. R., & Friederici, A. D . ( 2006). Effects of musical expertise and boundary markers on phrase perception in music. Journal of Cognitive Neuroscience, 18( 3), 472-493. |
[36] | Nozaradan, S., Peretz, I., Missal, M., & Mouraux, A . ( 2011). Tagging the neuronal entrainment to beat and meter. Journal of Neuroscience, 31( 28), 10234-10240. |
[37] | Pannekamp, A., Toepel, U., Alter, K., Hahne, A., & Friederici, A. D . ( 2005). Prosody-driven sentence processing: An event- related brain potential study. Journal of Cognitive Neuroscience, 17( 3), 407-421. |
[38] | Patel, A. D . ( 2010). Music, language, and the brain. New York, NY: Oxford university press. |
[39] | Patel, A. D., Gibson, E., Ratner, J., Besson, M., & Holcomb, P. J . ( 1998). Processing syntactic relations in language and music: An event-related potential study. Journal of Cognitive Neuroscience, 10( 6), 717-733. |
[40] | Patel, A. D., & Morgan, E. (2017). Exploring cognitive relations between prediction in language and music. Cognitive Science, 41( s2), 303-320. |
[41] | Pauker, E., Itzhak, I., Baum, S. R., & Steinhauer, K . ( 2011). Effects of cooperating and conflicting prosody in spoken English garden path sentences: ERP evidence for the boundary deletion hypothesis. Journal of Cognitive Neuroscience, 23( 10), 2731-2751. |
[42] | Peelle, J. E., Gross, J., & Davis, M. H . ( 2012). Phase-locked responses to speech in human auditory cortex are enhanced during comprehension. Cerebral Cortex, 23( 6), 1378-1387. |
[43] | Poulin-Charronnat, B., Bigand, E., & Koelsch, S . ( 2006). Processing of musical syntax tonic versus subdominant: An event-related potential study. Journal of Cognitive Neuroscience, 18( 9), 1545-1554. |
[44] | Silva, S., Branco, P., Barbosa, F., Marques-Teixeira, J., Petersson, K. M., & Castro, S. L . ( 2014). Musical phrase boundaries, wrap-up and the closure positive shift. Brain Research, 1585, 99-107. |
[45] | Steinhauer, K., Alter, K., & Friederici, A. D . ( 1999). Brain potentials indicate immediate use of prosodic cues in natural speech processing. Nature Neuroscience, 2( 2), 191-196. |
[46] | Tillmann, B., & Bigand, E. (2004). The relative importance of local and global structures in music perception. The Journal of Aesthetics and Art Criticism, 62( 2), 211-222. |
[47] | van Berkum, J. J. A., Hagoort, P., & Brown, C. M . ( 1999). Semantic integration in sentences and discourse: Evidence from the N400. Journal of Cognitive Neuroscience, 11( 6), 657-671. |
[48] | van Berkum, J. J. A., Zwitserlood, P., Hagoort, P., & Brown, C. M . ( 2003). When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect. Cognitive Brain Research, 17( 3), 701-718. |
[49] | van Petten, C., & Bloom, P. (1999). Speech boundaries, syntax and the brain. Nature Neuroscience, 2( 2), 103-104. |
[50] | Zendel, B. R., Lagrois, M.-é., Robitaille, N., & Peretz, I . ( 2015). Attending to pitch information inhibits processing of pitch information: The curious case of amusia. Journal of Neuroscience, 35( 9), 3815-3824. |
[51] | Zhang, J. J., Jiang, C. M., Zhou, L. S., & Yang, Y. F . ( 2016). Perception of hierarchical boundaries in music and its modulation by expertise. Neuropsychologia, 91, 490-498. |
[52] | Zhang, J. J., Zhou, X. F., Chang, R. H., & Yang, Y. F . ( 2018). Effects of global and local contexts on chord processing: An ERP study. Neuropsychologia, 109, 149-154. |
[53] | Zhang, Y., Jiang, X. M., Saalbach, H., & Zhou, X. L . ( 2011). Multiple constraints on semantic integration in a hierarchical structure: ERP evidence from German. Brain Research, 1410, 89-100. |
[54] | Zhou, X. L., Jiang, X. M., Ye, Z., Zhang, Y. X., Lou, K. Y., & Zhan, W. D . ( 2010). Semantic integration processes at different levels of syntactic hierarchy during sentence comprehension: An ERP study. Neuropsychologia, 48( 6), 1551-1562. |
相关文章 15
[1] | 隋雪, 史汉文, 李雨桐. 语言加工过程中的观点采择及其认知机制[J]. 心理科学进展, 2021, 29(6): 990-999. |
[2] | 李雅宁, 田杨阳, 吴琦, 冷海州, 蒋重清, 杨伊生. 面孔社会知觉中的表情效应[J]. 心理科学进展, 2021, 29(6): 1022-1029. |
[3] | 于文勃, 王璐, 程幸悦, 王天琳, 张晶晶, 梁丹丹. 语言经验对概率词切分的影响[J]. 心理科学进展, 2021, 29(5): 787-795. |
[4] | 肖承丽, 隋雨檠, 肖苏衡, 周仁来. 空间交互研究新视角:多重社会因素的影响[J]. 心理科学进展, 2021, 29(5): 796-805. |
[5] | 梁笑, 康静梅, 王丽娟. 个体近似数量系统与其数学能力之间的关系:发展研究的证据[J]. 心理科学进展, 2021, 29(5): 827-837. |
[6] | 黄观澜, 周晓璐. 抑郁症患者的语言使用模式[J]. 心理科学进展, 2021, 29(5): 838-848. |
[7] | 霍鹏辉, 冯成志, 陈庭继. 注视者及观察者因素对注视知觉的影响[J]. 心理科学进展, 2021, 29(2): 238-251. |
[8] | 贾磊, 徐玉帆, 王成, 任俊, 汪俊. γ节律神经振荡:反映自闭症多感觉整合失调的一项重要生物指标[J]. 心理科学进展, 2021, 29(1): 31-44. |
[9] | 王葛彤, 席洁, 陈霓虹, 黄昌兵. 双眼视差的神经机制与知觉学习效应[J]. 心理科学进展, 2021, 29(1): 56-69. |
[10] | 孙丽君, 马小龙, 杨玉芳. 听觉线索与个体差异对音乐紧张感加工的影响[J]. 心理科学进展, 2021, 29(1): 70-78. |
[11] | 周璨, 周临舒, 蒋存梅. 音乐愉悦体验的神经机制[J]. 心理科学进展, 2021, 29(1): 123-130. |
[12] | 翁纯纯, 王宁. 时距知觉的动物研究范式及相关神经机制[J]. 心理科学进展, 2020, 28(9): 1478-1492. |
[13] | 徐贵平, 范若琳, 金花. 统计学习的认知神经机制及其与语言的关系[J]. 心理科学进展, 2020, 28(9): 1525-1538. |
[14] | 潘静, 张慧远, 陈东濠, 徐宏格. 动、静态视觉信息在真实世界视觉搜索中的作用[J]. 心理科学进展, 2020, 28(8): 1219-1231. |
[15] | 殷融. “动手不动口”:手部动作与语言进化的关系[J]. 心理科学进展, 2020, 28(7): 1141-1155. |
PDF全文下载地址:
http://journal.psych.ac.cn/xlkxjz/CN/article/downloadArticleFile.do?attachType=PDF&id=4886