连续语音的神经编码——脑电图、脑磁图研究进展
潘珣祎¹, 邹家杰², 金培清², 丁鼐^2,*
1浙江大学外国语言文化与国际交流学院，杭州 310027；²浙江大学生物医学工程教育部重点实验室，生物医学工程与仪器科学学院，杭州 310027
摘要
语音是人类交流的主要方式，语音理解也是人脑特有的核心认知功能。人脑中的动态神经活动如何编码连续语音流的声学特征，并解析出多个层级的语言结构是认知神经科学领域的重要问题。近年来，一系列脑电图、脑磁图研究通过包络跟踪响应、层级跟踪响应等新指标来刻画连续语音的神经加工机制。本文对这些研究进行综述，并聚焦于对两个语音加工问题：一是大脑如何编码语音中连续变化的声学特征。这方面的研究表明，大脑中的低频神经活动可以动态跟踪语音包络并且受到高级认知功能调节。二是大脑如何表征语音中不同大小的语言单元，比如音节、词、短语、语句。研究显示，大脑皮层中不同时间尺度的神经活动分别跟踪不同大小的语言单元，构成对多层级语言单元的并行表征。综合上述，近期研究初步揭示了大脑如何表征连续语音的声学特征并构建不同层次的语言单元，为进一步研究大脑如何加工连续语音提供了新的思路。


关键词： 语音; 语言; 神经活动; 包络跟踪响应; 层级跟踪响应
分类号：Q427

The neural encoding of continuous speech – recent advances in EEG and MEG studies
PAN Xun-Yi¹, ZOU Jia-Jie², JIN Pei-Qing², DING Nai^2,*
1School of International Studies, Zhejiang University, Hangzhou 310027, China；²Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou 310027, China
Abstract
Speech comprehension is a central cognitive function of the human brain. In cognitive neuroscience, a fundamental question is to understand how neural activity encodes the acoustic properties of a continuous speech stream and resolves multiple levels of linguistic structures at the same time. This paper reviews the recently developed research paradigms that employ electroencephalography (EEG) or magnetoencephalography (MEG) to capture neural tracking of acoustic features or linguistic structures of continuous speech. This review focuses on two questions in speech processing: (1) The encoding of continuously changing acoustic properties of speech; (2) The representation of hierarchical linguistic units, including syllables, words, phrases and sentences. Studies have found that the low-frequency cortical activity tracks the speech envelope. In addition, the cortical activities on different time scales track multiple levels of linguistic units and constitute a representation of hierarchically organized linguistic units. The article reviewed these studies, which provided new insights into the processes of continuous speech in the human brain.


Key words: speech; language; neural activity; envelope tracking response; concurrent hierarchical tracking

收稿日期：2019-04-08　　录用日期：2019-08-15
通讯作者：丁鼐　　E-mail: ding_nai@zju.edu.cn
DOI: 10.13294/j.aps.2019.0060
引用本文：
潘珣祎, 邹家杰, 金培清, 丁鼐. 连续语音的神经编码——脑电图、脑磁图研究进展[J]. 生理学报 2019; 71 (6): 935-945.
PAN Xun-Yi, ZOU Jia-Jie, JIN Pei-Qing, DING Nai. The neural encoding of continuous speech – recent advances in EEG and MEG studies. Acta Physiol Sin 2019; 71 (6): 935-945 (in Chinese with English abstract).



PDF全文下载地址:

点我下载PDF