删除或更新信息,请邮件至freekaoyan#163.com(#换成@)

机器人自身噪声环境下的自动语音识别

清华大学 辅仁网/2017-07-07

机器人自身噪声环境下的自动语音识别
王建荣1, 张句1, 路文焕2, 魏建国2, 党建武1
1. 天津大学 计算机科学与技术学院, 天津 300072;
2. 天津大学 软件学院, 天津 300072
Automatic speech recognition with robot noise
WANG Jianrong1, ZHANG Ju1, LU Wenhuan2, WEI Jianguo2, DANG Jianwu1
1. School of Computer Science and Technology, Tianjin University, Tianjin 300072, China;
2. School of Computer Software, Tianjin University, Tianjin 300072, China

摘要:

输出: BibTeX | EndNote (RIS)
摘要当机器人移动身体任何部位时,都会不可避免地产生自身噪声。这些自身噪声由身体关节或其他硬件设备如风扇等引起。由于自身噪声距离机器人麦克风较近,较目标声源更容易被获取。该文根据机器人自身噪声种类,提出了一种将谱减法、关节噪声模板减法、基于标注区域的倒谱均值减法以及多条件训练相结合的方法,从而估计和抑制自身噪声。一系列实验证明了所提出的方法可以有效地减少自身噪声影响,提高语音识别的鲁棒性。
关键词 机器人,语音识别,语音增强
Abstract:Robots inevitably produce noise when they are moving any part of their body. Such noise is caused by the various body joint motors as well as the CPU cooling fans. Moreover, these noises are easily captured by the robots' microphones because they are closer to the microphones than the target speech source. This paper presents a de-noising method using the spectral subtraction, joint noise template substraction, labeled area cepstral mean substraction and multi-condition training to estimate and suppress robot noise. Tests show that this method significantly reduces the effect of robot noise which enhances the automatic speech recognition.
Key wordsrobotspeech recognitionspeech enhancement
收稿日期: 2016-06-20 出版日期: 2017-02-21
通讯作者:路文焕,副教授,E-mail:wenhuan@tju.edu.cnE-mail: wenhuan@tju.edu.cn
引用本文:
王建荣, 张句, 路文焕, 魏建国, 党建武. 机器人自身噪声环境下的自动语音识别[J]. 清华大学学报(自然科学版), 2017, 57(2): 153-157.
WANG Jianrong, ZHANG Ju, LU Wenhuan, WEI Jianguo, DANG Jianwu. Automatic speech recognition with robot noise. Journal of Tsinghua University(Science and Technology), 2017, 57(2): 153-157.
链接本文:
http://jst.tsinghuajournals.com/CN/10.16511/j.cnki.qhdxxb.2017.22.007 http://jst.tsinghuajournals.com/CN/Y2017/V57/I2/153


图表:
图1 机器人自身噪声环境下的语音样本
图2 处在不同幅度下的CPU散热风扇噪声
图3 AldebaranRobotics的NAO机器人
表1 不同技术以及技术组合方法在不同自身噪声下的语音识别结果(距离120cm)
图4 谱减法处理风扇噪声的前后对比
图5 关节噪声模板减法处理前后的对比
图6 基于标注区域倒谱均值减法与全局倒谱均值减法的对比


参考文献:
[1] Ince G, Nakadai K, Rodemann T, et al. A hybrid framework for ego noise cancellation of a robot[C]//2010 IEEE International Conference on Robotics and Automation (ICRA). Piscataway, NJ:IEEE Press, 2010:3623-3628.
[2] Breazeal C L. Designing Sociable Robots[M]. Boston, MA:MIT Press, 2004.
[3] Miwa H, Okuchi T, Itoh K, et al. A new mental model for humanoid robots for human friendly communication introduction of learning system, mood vector and second order equations of emotion[C]//Proc 2003 IEEE International Conference on Robotics and Automation (ICRA). Piscataway, NJ:IEEE Press, 2003, 3:3588-3593.
[4] Nakadai K, Lourens T, Okuno H G, et al. Active audition for humanoid[C]//Proc of the 17th National Conference on Artificial Intelligence and 12th Conference on Innovative Applications of Artificial Intelligence. Palo Alto, CA:AAAI Press, 2000:832-839.
[5] Even J, Sawada H, Saruwatari H, et al. Semi-blind suppression of internal noise for hands-free robot spoken dialog system[C]//Proc 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Piscataway, NJ:IEEE Press, 2009:658-663.
[6] Cohen I, Berdugo B. Speech enhancement for non-stationary noise environments[J]. Signal Processing, 2001, 81(1):2403-2418.
[7] Cohen I, Berdugo B. Noise estimation by minima controlled recursive averaging for robust speech enhancement[J]. IEEE Signal Processing Letters, 2002, 9(1):12-15.
[8] Ito A, Kanayama T, Suzuki M, et al. Internal noise suppression for speech recognition by small robots[J]. IEICE Technical Report Speech, 2005, 105:43-48.
[9] Nishimura Y, Ishizuka M, Nakadai K, et al. Speech recognition for a humanoid with motor noise utilizing missing feature theory[C]//2006 6th IEEE-RAS International Conference on Humanoid Robots. Piscataway, NJ:IEEE Press, 2006:26-33.
[10] Ince G, Nakadai K, Rodemann T, et al. Incremental learning for ego noise estimation of a robot[C]//2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Piscataway, NJ:IEEE Press, 2011:131-136.
[11] Ince G, Nakadai K, Rodemann T, et al. Ego noise suppression of a robot using template subtraction[C]//Proceedings of the 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway, NJ:IEEE Press, 2009:199-204.
[12] Boll S. Suppression of acoustic noise in speech using spectral subtraction[J]. Processing IEEE Transactions on Acoustics Speech & Signal, 1979, 27(2):113-120.
[13] Viikki O, Bye D, Laurila K. A recursive feature vector normalization approach for robust speech recognition in noise[C]//Proc 1998 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway, NJ:IEEE Press, 1998, 2:733-736.


相关文章:
[1]甘振业, 陈浩, 杨鸿武. 结合EEMD与K-SVD字典训练的语音增强算法[J]. 清华大学学报(自然科学版), 2017, 57(3): 286-292.
[2]米吉提·阿不里米提, 艾克白尔·帕塔尔, 艾斯卡尔·艾木都拉. 基于层次化结构的语言模型单元集优化[J]. 清华大学学报(自然科学版), 2017, 57(3): 257-263.
[3]王国磊, 伊强, 缪东晶, 陈恳, 王力强. 面向机器人喷涂的多变量涂层厚度分布模型[J]. 清华大学学报(自然科学版), 2017, 57(3): 324-330.
[4]艾斯卡尔·肉孜, 殷实, 张之勇, 王东, 艾斯卡尔·艾木都拉, 郑方. THUYG-20:免费的维吾尔语语音数据库[J]. 清华大学学报(自然科学版), 2017, 57(2): 182-187.
[5]张鹏远, 计哲, 侯炜, 金鑫, 韩卫生. 小资源下语音识别算法设计与优化[J]. 清华大学学报(自然科学版), 2017, 57(2): 147-152.
[6]张继文, 刘莉, 陈恳. 基于AHRS反馈的仿人机器人步行稳定控制[J]. 清华大学学报(自然科学版), 2016, 56(8): 818-823.
[7]张继文, 刘莉, 陈恳. 小型仿人足球机器人MOS-7的系统设计及局部优化[J]. 清华大学学报(自然科学版), 2016, 56(8): 811-817.
[8]邢安昊, 张鹏远, 潘接林, 颜永红. 基于SVD的DNN裁剪方法和重训练[J]. 清华大学学报(自然科学版), 2016, 56(7): 772-776.
[9]罗磊, 陈恳, 杜峰坡, 马振书. 基于改进型粒子群算法的曲面匹配与位姿获取[J]. 清华大学学报(自然科学版), 2015, 55(10): 1061-1066.
[10]邵君奕,张传清,陈雁,陈恳. 用于空间内曲面喷涂的冗余度机器人轨迹规划方法[J]. 清华大学学报(自然科学版), 2014, 54(6): 799-804.
[11]潘玉龙, 王国磊, 朱丽, 陈雁, 陈恳. 管道喷涂机器人喷枪运动速度优化[J]. 清华大学学报(自然科学版), 2014, 54(2): 212-216.
[12]刘佳君, 孙振国, 张文增, 陈强. 两端吸附式爬壁机器人机械臂运动误差修正算法[J]. 清华大学学报(自然科学版), 2014, 54(2): 185-190.

相关话题/优化 环境 天津大学 设计 技术

闂備浇宕甸崰鎰洪幋锔藉€块柨鏃傛櫕閻濊埖鎱ㄥ璇蹭壕闂佺娅曢幑鍥х暦濮椻偓椤㈡棃宕卞Δ鍐ㄥ箰闂傚倷绀侀崥瀣熆濮椻偓瀹曨垶顢曢姀銏℃闂侀潧顧€婵″洭鍩㈤弮鍫熺厵闁硅鍔曢惃娲煟閻旈绉洪柟顔肩秺瀹曟儼顦查柍閿嬫⒐缁绘繈鍩€椤掑嫬鐒洪柛鎰硶閻鈹戦埥鍡楃仯缁绢厼鐖煎畷鎴﹀箻鐎靛摜鎳濋梺閫炲苯澧撮柕鍡楀€块幊鐐哄Ψ閿曗偓閸斿懘姊洪崷顓炰壕濠⒀冮叄瀹曟垿骞樼€涙ê顎撶紓浣圭☉椤戝棛绱炴繝鍐х箚妞ゆ劑鍊曢。濂告煕閳轰緤鍔熸俊鍙夊姍瀹曞綊顢曢敐鍕攭婵犵數鍋涘Λ娆撳箰缁嬪簱鏋嶉柨鐔哄У閸嬶絿鎲稿鍥e亾濮樼厧骞橀柤娲憾椤㈡瑩鎮欓浣稿姎闂備礁鎲℃笟妤呭储閻撳寒鍤曢柛褎顨嗛悡銉︾箾閹寸儐娈樻い锔奸檮缁绘繈鍩€椤掑嫷鏁傞柛鈩冪懄閿涘繘姊洪崜鑼帥闁哥姵鐗滈弫顕€骞庨懞銉ヤ化闂佸綊鍋婇崜娑氱矓閻戞ü绻嗛柟缁樺笒椤忣偊鏌熸搴⌒i悗鐢靛帶閳诲酣骞嬮悪鍛簥
2婵犵數鍋為崹鍫曞箰缁嬫5娲Ω閳哄绋忛梺鍦劋椤ㄥ棝宕甸埀顒勬⒑閸涘﹤濮﹀ù婊呭仱瀹曟椽鏁撻悩宕囧幘闂佸搫顦悘婵嬪汲濞嗘垟鍋撶憴鍕8闁稿海鏁婚獮鍐╃鐎n偒妫冨┑鐐村灦绾板秹骞夐妶鍡欑闁瑰鍋為ˉ鏍偣娓氬﹦鎮兼俊鍙夊姇閳诲酣骞囬崜浣虹厬婵犵妲呴崹闈涒枍閿濆拋娼╅柕濞炬櫆閻撳繘鏌涢埄鍐╃缂佷胶澧楅妵鍕敃閵忊晛鍓遍梺鎸庣⊕閸旀瑩鐛€n亖鏋庨悘鐐村灊婢规洘绻涙潏鍓ф偧閺嬵亞鈧鍠栭悘婵嬪煘閹达箑纾兼繛鎴i哺閻g晫绱撴担椋庤窗闁稿锕ら锝夘敆閳ь剟鍩㈡惔鈾€鏋庨柟瀵稿濡叉挳姊绘担鍛婂暈闁荤喆鍎甸弫鍐Χ閸滀礁鏅犳繝鐢靛У濮樸劌鐣垫笟鈧幃妤呮濞戞瑥鏆堥梺绯曟櫅閸婃瓕鐏嬮梺缁橆殔閻楃偤宕楅鍌滅<閺夊牄鍔庣粻鎾绘煃閽樺妯€闁诡喕绮欏畷褰掝敃閵堝繒鐭�547闂傚倷绀佸﹢閬嶃€傛禒瀣;闁瑰墽绮埛鎺楁煕閺囨娅呴柣蹇d邯閺岋絽螖鐎n偄顏�4婵犵數鍋為崹鍫曞箰缁嬫5娲晲閸モ晝顦梺鐟邦嚟閸嬬喖鍩㈤弮鈧妵鍕疀閹惧顦遍梺绋款儐閹瑰洤鐣峰鈧、鏃堝幢濡ゅ啫骞愰梻鍌欑閸氬顭垮鈧畷顖烆敃閵忋垺娈鹃梺闈涱檧婵″洭鍩㈤弮鍫熺厵闁硅鍔曢惃娲煟閻旈攱璐$紒杈ㄥ笚瀵板嫮鈧綆浜炴禒鐓庘攽閻愯泛绱﹂柛妤勬珪娣囧﹦鈧稒蓱婵挳鎮峰▎娆戝埌濞存粓绠栭弻娑㈠箛閸忓摜鏁栭梺绯曟櫔缁绘繈寮诲☉婊呯杸闁挎繂鎳庨~鈺呮⒑閸涘﹦鎳曠紒杈ㄦ礋楠炲繘鎮╃拠鑼啋闂佸憡渚楅崹鎶剿囬埡鍛拺閻炴稈鈧厖澹曢梻浣告贡鏋紒銊ㄥ亹缁厽寰勯幇顓犲幘闂佸搫瀚换鎺旇姳閹稿簺浜滈柡鍥悘鑼偓娈垮櫘閸嬪﹤顕g捄琛℃瀻闁诡垎鍏俱倝姊绘担鐟邦嚋缂佸鍨胯棟妞ゆ挶鍨归悞鍨亜閹烘埊鏀婚悗姘炬嫹40缂傚倸鍊风粈渚€藝椤栨粎鐭撶€规洖娲ㄧ粻鏃堟煙閹屽殶闁崇粯姊归幈銊ヮ潨閳ь剛娑甸幖浣告瀬閻庯綆浜堕悢鍡涙偣閸ワ絺鍋撻崗鍛棜缂傚倷娴囨ご鎼佹偡閳哄懎钃熺€光偓閸曨偆顓洪梺鎸庣箓濞茬娀宕戦幘缁樻優閻熸瑥瀚崢褰掓⒑閸濆嫭宸濋柛搴㈠灩濡叉劕饪伴崼鐔哄帾闂佺硶鍓濆ú鏍姳缁寬闂傚倷绶氬ḿ褍螞閺冨倻鐭嗗ù锝堫嚉閻熸嫈鏃堝川椤旇瀵栭梻浣告啞娓氭宕㈤挊澶嗘瀺鐎光偓閸曨剛鍘遍梺鍝勫暞閹稿墽澹曢幐搴涗簻闁靛骏绱曢。鑼磼閺冨倸鏋涙い銏℃礋閹晠顢曢~顓烆棜濠电偠鎻紞鈧い顐㈩樀閹繝鍩€椤掑嫭鈷掗柛灞捐壘閳ь兛绮欓、娆愮節閸曨剦娼熼梺鍓插亝濞叉牜绮荤紒妯镐簻闁规崘娉涢宀勬煛娴e壊鍎忔い顓℃硶閹风娀鍨鹃崗鍛寜闂備線鈧偛鑻崢鎼佹煠閸愯尙鍩e┑锛勬暬閹瑩寮堕幋顓炴婵犳鍠楅敃鈺呭礂濞戞碍顫曢柨婵嗘偪瑜版帗鏅查柛鈩冪懅閻撳倸顪冮妶鍐ㄧ仾缁炬澘绉剁划鈺呮偄绾拌鲸鏅濋梺闈涚墕濞诧箓骞嗛敐澶嬧拺闁圭ǹ娴烽埥澶嬨亜閿旇寮柛鈹惧亾濡炪倖甯掗敃銉р偓姘炬嫹28缂傚倸鍊风欢锟犲磻婢舵劦鏁嬬憸鏃堢嵁閸愵喖绠婚柛鎾茬窔閳瑰繑绻濋姀锝嗙【妤楊亝鎸冲畷婵嬪川鐎涙ḿ鍘遍梺鍝勫暊閸嬫挾绱掔€n偅宕岀€殿噮鍋婇幃浠嬪垂椤愩垹骞戦梻浣告惈濞诧箑顫濋妸鈺傚仭闁宠桨璁插Σ鍫ユ煙閻愵剚缍戦柟鍏兼倐閺屽秷顧侀柛鎾卞姂楠炲繘鏁撻敓锟�1130缂傚倸鍊风粈渚€藝椤栨粎鐭撻柛鎾茬閸ㄦ繈鏌ㄩ悢鍝勑㈢紒鈧崒鐐寸厱婵炴垶锕弨缁樼箾閸繄鐒搁柡灞稿墲瀵板嫮鈧綆浜滈~鍥⒑闁偛鑻晶顕€鏌涙繝鍕殌閾荤偤鏌曢崼婵囧濠殿垰銈搁弻锝夊箣閻忔椿浜濈粋宥夊醇閺囩喓鍘搁梺鍛婃礋濞佳囨倶閿濆棛绡€闁逞屽墴閸╁嫰宕樼捄銊х厬婵犵妲呴崹闈涚暦闂堟侗鍟呮繝闈涚墢绾捐棄霉閿濆毥褰掑汲閺冨牊鐓冪憸婊堝礂濞戞碍顐芥慨妯跨堪閳ь剙鍊块幊鐐哄Ψ閿曗偓閸斿懘姊虹憴鍕姢闁哥喎娼¢幃锟犲即閻愬秵鐩幃褔宕奸鈧崣鏇犵磽娴d粙鍝虹紒璇插暙宀h法鎷犻崣鍌滃枔缁辨帒螣閻戝洨鐣辨い顓℃硶閹瑰嫰鎼归崜鎰剁磿缁辨帡鍨鹃崘宸純閻庢鍣崑鍕煝鎼淬劌绠涙い鎾跺Х閳诲矂姊绘担鐟邦嚋缂佸鍨剁缓浠嬪籍閸屾粌宕ラ柣搴㈢⊕宀e潡鍩㈤弮鍫熺厽婵﹩鍓氶~婕冩繝鐢靛仦濞兼瑩宕ョ€n喗鍤屽Δ锝呭暙缁犵喖鏌熼幆鐗堫棄闂佽¥鍊濋弻娑㈠Ψ閹存繂鏆㈡い鏂款槸閳规垿鎮╁ù瀣級闂侀潧鐗嗛幊搴ㄥ几濞嗘挻鈷戦悹鍥b偓铏亖闂佸憡鏌ㄦ鎼佸煝閹捐绠i柨鏃傜摂濮婂潡姊洪柅鐐茶嫰婢ь噣寮崼銉︾厱閻忕偛甯哄璺虹;闁瑰墽绮弲鎼佹煥閻曞倹瀚�