

1中国科学院心理研究所, 脑与认知科学国家重点实验室, 北京 100101
2中国科学院大学心理学系, 北京 100049
3清华大学未来实验室, 北京 100084
4清华大学美术学院信息艺术设计系, 北京 100084
收稿日期:
2018-05-04出版日期:
2019-04-15发布日期:
2019-02-22通讯作者:
刘烨,徐迎庆E-mail:liuye@psych.ac.cn;yqxu@mail.tsinghua.edu.cn基金资助:
* 中国国家自然科学基金重点项目(61632004);中国国家自然科学基金重点项目(61773379);中国国家自然科学基金重点项目(61375009);中国国家自然科学基金委和德国基金会中德合作项目(NSFC 61621136008/DFG TRR-169);国家重点研发计划课题(2016YFB1001402)The cognitive mechanism of haptic recognition of two-dimension images
YU Wenyuan1,2, LIU Ye1,2(

1 State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China
2 Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
3 Department of Information Art and Design, Academy of Arts and Design, Tsinghua University, Beijing 100084, China
4 The Future Lab, Tsinghua University Beijing 100084, China
Received:
2018-05-04Online:
2019-04-15Published:
2019-02-22Contact:
LIU Ye,XU Yingqing E-mail:liuye@psych.ac.cn;yqxu@mail.tsinghua.edu.cn摘要/Abstract
摘要: 触觉二维图像可以辅助视觉受损人群, 将视觉信息转化为触觉信息, 从而感知外部世界。触觉二维图像的识别可能是通过触觉信息在大脑中进行“视觉转化”的方式而完成, 并且会受到图形的几何特征、视角与透视、视觉经验、视觉表象能力、触觉探索过程、训练以及年龄的影响。探索触觉二维图像识别的认知神经机制, 对于触觉二维图像设计的改进和可用性的提高, 具有重要意义。
参考文献 77
[1] | 谌小猛, 李闻戈 . ( 2016). 触觉地图辅助盲人建构陌生环境空间表征的研究. 中国特殊教育, (9), 36-42. |
[2] | 龚江涛, 於文苑, 曲同, 刘烨, 傅小兰, 徐迎庆 . ( 2018). 影响触觉图像识别因素的量化分析. 计算机辅助设计与图形学学报, 30, (8), 1438-1445. |
[3] | 焦阳, 龚江涛, 史元春, 徐迎庆 . ( 2016). 盲人触觉图形显示器的交互体验研究. 计算机辅助设计与图形学学报, 28, (9), 1571-1576. doi: 10.3969/j.issn.1003-9775.2016.09.021URL |
[4] | 焦阳, 龚江涛, 徐迎庆 . ( 2016). 盲人触觉图像显示器Graille设计研究. 装饰, (1), 94-96. |
[5] | 杨光, 钟经华, 董晶 . ( 2017). 浅谈视障教学中触觉图形的认知. 现代特殊教育, (23), 59-61. |
[6] | 张蕾, 刘建英 . ( 2014). 盲校地理课程触觉地图的开发与应用研究. 中国特殊教育, (3), 24-29. doi: 10.3969/j.issn.1007-3728.2014.03.004URL |
[7] | 周丽丽, 姚欣茹, 汤征宇, 任巧悦, 吕雪靖, 胡理 . ( 2017). 触觉信息处理及其脑机制. 科技导报, 35, (19), 37-43. |
[8] | Amedi A., Jacobson G., Hendler T., Malach R., & Zohary E . ( 2002). Convergence of visual and tactile shape processing in the human lateral occipital complex. Cerebral Cortex, 12, (11), 1202-1212. doi: 10.1093/cercor/12.11.1202URLpmid: 12379608 |
[9] | Barros P., Maciel-Junior N. T., Fernandes B. J. T., Bezerra B. L. D., & Fernandes S. M. M . ( 2017). A dynamic gesture recognition and prediction system using the convexity approach. Computer Vision and Image Understanding, 155, 139-149. doi: 10.1016/j.cviu.2016.10.006URL |
[10] | Bauer C., Yazzolino L., Hirsch G., Cattaneo Z., Vecchi T., & Merabet L. B . ( 2015). Neural correlates associated with superior tactile symmetry perception in the early blind. Cortex, 63, 104-117. doi: 10.1016/j.cortex.2014.08.003URLpmid: 25243993 |
[11] | Baumgartner E., Wiebel C. B., & Gegenfurtner K. R . ( 2015). A comparison of haptic material perception in blind and sighted individuals. Vision Research, 115, 238-245. doi: 10.1016/j.visres.2015.02.006URLpmid: 25711976 |
[12] | Behrmann M., &Ewell C. ( 2003). Expertise in tactile pattern recognition. Psychological Science, 14, (5), 480-486. doi: 10.1111/1467-9280.02458URLpmid: 12930480 |
[13] | Bellik Y., &Clavel C. ( 2017). Geometrical shapes rendering on a dot-matrix display. International Conference on Intelligent Human Computer Interaction( pp. 8-18). Springer, Cham. doi: 10.1007/978-3-319-72038-8_2URL |
[14] | Bouaziz S., Russier S., & Magnan A . ( 2005). The copying of complex geometric drawings by sighted and visually impaired children. Journal of Visual Impairment & Blindness, 99, (12), 765-774. doi: 10.1044/1092-4388(2005/106)URL |
[15] | Brock A. M., Truillet P., Oriola B., Picard D., & Jouffrais C . ( 2015). Interactivity improves usability of geographic maps for visually impaired people. Human-Computer Interaction, 30, (2), 156-194. doi: 10.1080/07370024.2014.924412URL |
[16] | Cattaneo Z., Vecchi T., Cornoldi C., Mammarella I., Bonino D., Ricciardi E., & Pietrini P . ( 2008). Imagery and spatial processes in blindness and visual impairment. Neuroscience and Biobehavioral Reviews, 32, (8), 1346-1360. doi: 10.1016/j.neubiorev.2008.05.002URLpmid: 18571726 |
[17] | Cattaneo Z., Vecchi T., Monegato M., Pece A., & Cornoldi C . ( 2007). Effects of late visual impairment on mental representations activated by visual and tactile stimuli. Brain Research, 1148, 170-176. doi: 10.1016/j.brainres.2007.02.033URLpmid: 17368576 |
[18] | Cecchetto S., &Lawson R. ( 2017). Regularity detection by haptics and vision. Journal of Experimental Psychology Human Perception & Performance, 43, (1), 103. doi: 10.1037/xhp0000283URLpmid: 27808551 |
[19] | Chang D., Nesbitt K. V., & Wilkins K . ( 2007). The Gestalt principles of similarity and proximity apply to both the haptic and visual grouping of elements. Paper presented at the Eight Australasian User Interface Conference (AUIC2007), Ballarat, Australia. |
[20] | Cornoldi C., Tinti C., Mammarella I. C., Re A. M., & Varotto D . ( 2009). Memory for an imagined pathway and strategy effects in sighted and in totally congenitally blind individuals. Acta Psychologica, 130, (1), 11-16. doi: 10.1016/j.actpsy.2008.09.012URLpmid: 19013547 |
[21] | Gallace A., &Spence C. ( 2011). To what extent do gestalt grouping principles influence tactile perception? Psychological Bulletin, 137, (4), 538-561. doi: 10.1037/a0022335URLpmid: 21574680 |
[22] | Grunwald M., Muniyandi M., Kim H., Kim J., Krause F., Mueller S., & Srinivasan M. A . ( 2014). Human haptic perception is interrupted by explorative stops of milliseconds. Front Psychol, 5, (4), 292. doi: 10.3389/fpsyg.2014.00292URLpmid: 3988394 |
[23] | Gual J., Puyuelo M., & Lloveras J . ( 2015). The effect of volumetric (3D) tactile symbols within inclusive tactile maps. Applied Ergonomics, 48, 1-10. doi: 10.1016/j.apergo.2014.10.018URLpmid: 25683526 |
[24] | Hatwell Y., Streri A., & Gentaz E . ( 2003). Touching for knowing: Cognitive psychology of haptic manual perception, John Benjamins Pub. |
[25] | Heller M. A., Brackett D. D., Scroggs E., Steffen H., Heatherly K., & Salik S . ( 2002). Tangible pictures: Viewpoint effects and linear perspective in visually impaired people. Perception, 31, (6), 747-769. doi: 10.1068/p3253URLpmid: 12092800 |
[26] | Heller M. A., Kennedy J. M., Clark A., McCarthy M., Borgert A., Wemple L., .. Riddle T . ( 2006). Viewpoint and orientation influence picture recognition in the blind. Perception, 35, (10), 1397-1420. doi: 10.1068/p5460URLpmid: 17214384 |
[27] | Heller M. A., McCarthy M., & Clark A . ( 2005). Pattern perception and pictures for the blind. Psicologica, 26, (1), 161-171. |
[28] | Heller M. A., Riddle T., Fulkerson E., Wemple L., Walk A. M., Guthrie S., .. Klaus P . ( 2009). The influence of viewpoint and object detail in blind people when matching pictures to complex objects. Perception, 38, (8), 1234-1250. doi: 10.1068/p5596URLpmid: 19817155 |
[29] | Kaas A. L., van Mier H., Visser M., & Goebel R . ( 2013). The neural substrate for working memory of tactile surface texture. Human Brain Mapping, 34, (5), 1148-1162. doi: 10.1002/hbm.21500URLpmid: 22576840 |
[30] | Kalia A., Hopkins R., Jin D., Yazzolino L., Verma S., Merabet L., .. Sinha P . ( 2014). Perception of tactile graphics: Embossings versus cutouts. Multisensory Research, 27, (2), 111-125. doi: 10.1163/22134808-00002450URLpmid: 25296474 |
[31] | Kalia A.A., &Sinha P. ( 2012). Tactile Picture Recognition: Errors are in shape acquisition or object matching? Seeing and Perceiving, 25, (3-4), 287-302. doi: 10.1163/187847511x584443URLpmid: 21871145 |
[32] | Kappers A. M.L., &Tiest W. M.B . ( 2013). Haptic perception. Wiley Interdisciplinary Reviews-Cognitive Science, 4, (4), 357-374. |
[33] | Kennedy J.M., &Juricevic I. ( 2006). Foreshortening, convergence and drawings from a blind adult. Perception, 35, (6), 847-851. doi: 10.1068/p5316URLpmid: 16836049 |
[34] | Klatzky R.L., &Lederman S.J . ( 1988). The intelligent hand. Psychology of Learning & Motivation, 21, 121-151. |
[35] | Ku Y., Zhao D., Bodner M., & Zhou Y-D . ( 2015). Cooperative processing in primary somatosensory cortex and posterior parietal cortex during tactile working memory. European Journal of Neuroscience, 42, (3), 1905-1911. doi: 10.1111/ejn.12950URLpmid: 25980785 |
[36] | Lacey S., &Lawson R. ( 2013). Multisensory Imagery. Springer. |
[37] | Lacey S., &Sathian K. ( 2014). Visuo-haptic multisensory object recognition, categorization, and representation. Frontiers in Psychology, 5. |
[38] | Lacey S., Stilla R., Sreenivasan K., Deshpande G., & Sathian K . ( 2014). Spatial imagery in haptic shape perception. Neuropsychologia, 60, 144-158. doi: 10.1007/978-1-4614-5879-1_11URLpmid: 4122331 |
[39] | Lebaz S., Jouffrais C., & Picard D . ( 2012). Haptic identification of raised-line drawings: High visuospatial imagers outperform low visuospatial imagers. Psychological Research-Psychologische Forschung, 76, (5), 667-675. doi: 10.1007/s00426-011-0351-6URLpmid: 21695471 |
[40] | Lebaz S., Picard D., & Jouffrais C . ( 2010). Haptic recognition of non-figurative tactile pictures in the blind: Does life-time proportion without visual experience matter? Haptics: Generating and Perceiving Tangible Sensations, Pt Ii, Proceedings, 65, (5), 412-417. doi: 10.1007/978-3-642-14075-4_61URL |
[41] | Lederman S. J., Klatzky R. L., Chataway C., & Summers C. D . ( 1990). Visual mediation and the haptic recognition of 2-dimensional pictures of common objects. Perception & Psychophysics, 47, (1), 54-64. doi: 10.3758/BF03208164URLpmid: 2300424 |
[42] | Longo M.R., &Golubova O. ( 2017). Mapping the internal geometry of tactile space. Journal of Experimental Psychology-Human Perception and Performance, 43, (10), 1815-1827. doi: 10.1037/xhp0000434pmid: 28967785 |
[43] | Loomis J. M., Klatzky R. L., & Lederman S. J . ( 1991). Similarity of tactual and visual picture recognition with limited field of view. Perception, 20, (2), 167-177. doi: 10.1068/p200167URLpmid: 1745589 |
[44] | Mazella A., Albaret J. M., & Picard D . ( 2014). Haptic tests for use with children and adults with visual impairments: A literature review. Journal of Visual Impairment & Blindness, 108, (108), 227-237. |
[45] | Mazella A., Albaret J-M., & Picard D . ( 2016). Haptic-2D: A new haptic test battery assessing the tactual abilities of sighted and visually impaired children and adolescents with two-dimensional raised materials. Research in Developmental Disabilities, 48, 103-123. doi: 10.1016/j.ridd.2015.10.012URLpmid: 26551596 |
[46] | Mazella A., Albaret J-M., & Picard D . ( 2018). The development of haptic processing skills from childhood to adulthood by means of two-dimensional materials. Canadian Journal of Experimental Psychology-Revue Canadienne De Psychologie Experimentale, 72, (1), 48-57. doi: 10.1037/cep0000121URL |
[47] | Memeo M., Campus C., & Brayda L . ( 2014). Do blind subjects differ from sighted subjects when exploring virtual tactile maps? Computers Helping People with Special Needs, Icchp 2014, 8548, 12-17. doi: 10.1007/978-3-319-08599-9URL |
[48] | Morash V. S., Pensky A. E. C., Tseng S. T. W., & Miele J. A . ( 2014). Effects of using multiple hands and fingers on haptic performance in individuals who are blind. Perception, 43, (6), 569-588. doi: 10.1068/p7712URL |
[49] | Overvliet K.E., &Krampe R.T . ( 2018). Haptic two-dimensional shape identification in children, adolescents, and young adults. Journal of Experimental Child Psychology, 166, 567-580. doi: 10.1016/j.jecp.2017.09.024URL |
[50] | Overvliet K. E., Krampe R. T., & Wagemans J . ( 2012). Perceptual grouping in haptic search: The influence of proximity, similarity, and good continuation. Journal of Experimental Psychology-Human Perception and Performance, 38, (4), 817-821. doi: 10.1037/a0029222pmid: 22774798 |
[51] | Overvliet K. E., Wagemans J., & Krampe R. T . ( 2013). The effects of aging on haptic 2D shape recognition. Psychology and Aging, 28, (4), 1057-1069. doi: 10.1037/a0033415URLpmid: 23978010 |
[52] | Pawluk D. T., Adams R. J., & Kitada R . ( 2015). Designing haptic assistive technology for individuals who are blind or visually impaired. Ieee Transactions on Haptics, 8, (3), 258-278. doi: 10.1109/TOH.2015.2471300pmid: 26336151 |
[53] | Picard D., Albaret J. M., & Mazella A . ( 2013). Haptic identification of raised-line drawings by children, adolescents and young adults. Haptics-e, 5, (2), 24-28. |
[54] | Picard D., Albaret J-M., & Mazella A . ( 2014). Haptic identification of raised-line drawings when categorical information is given: A comparison between visually impaired and sighted children. Psicologica, 35, (2), 277-290. doi: 10.1006/jcht.1994.1043URL |
[55] | Picard D., Lebaz S., Jouffrais C., & Monnier C . ( 2010). Haptic recognition of two-dimensional raised-line patterns by early-blind, late-blind, and blindfolded sighted adults. Perception, 39, (2), 224-235. doi: 10.1068/p6527URLpmid: 20402244 |
[56] | Picard D., &Monnier C. ( 2009). Short-term memory for spatial configurations in the tactile modality: A comparison with vision. Memory, 17, (8), 789-801. doi: 10.1080/09658210903107838URLpmid: 19606379 |
[57] | Rastogi R., Pawluk T. V. D., & Ketchum J . ( 2013). Intuitive tactile zooming for graphics accessed by individuals who are blind and visually impaired. Ieee Transactions on Neural Systems and Rehabilitation Engineering, 21, (4), 655-663. doi: 10.1109/TNSRE.2013.2250520URLpmid: 23529106 |
[58] | Saal H.P., &Bensmaia S.J . ( 2014). Touch is a team effort: Interplay of submodalities in cutaneous sensibility. Trends in Neurosciences, 37, (12), 689-697. doi: 10.1016/j.tins.2014.08.012URLpmid: 25257208 |
[59] | Sathian K . ( 2016). Analysis of haptic information in the cerebral cortex. Journal of Neurophysiology, 116, (4), 1795-1806. doi: 10.1152/jn.00546.2015URLpmid: 27440247 |
[60] | Segond H., Weiss D., Kawalec M., & Sampaio E . ( 2013). Perceiving space and optical cues via a visuo-tactile sensory substitution system: A methodological approach for training of blind subjects for navigation. Perception, 42, (5), 508-528. doi: 10.1068/p6339URLpmid: 23964377 |
[61] | Snow J. C., Goodale M. A., & Culham J. C . ( 2015). Preserved haptic shape processing after bilateral LOC lesions. Journal of Neuroscience, 35, (40), 13745-13760. doi: 10.1523/JNEUROSCI.0859-14.2015URLpmid: 26446226 |
[62] | Stilla R., &Sathian K. ( 2008). Selective visuo-haptic processing of shape and texture. Human Brain Mapping, 29, (10), 1123-1138. |
[63] | Symmons M., &Richardson B. ( 2000). Raised line drawings are spontaneously explored with a single finger. Perception, 29, (5), 621-626. doi: 10.1068/p2964URLpmid: 10992958 |
[64] | Theurel A., Witt A., Claudet P., Hatwell Y., & Gentaz E . ( 2013). Tactile picture recognition by early blind children: The effect of illustration technique. Journal of Experimental Psychology-Applied, 19, (3), 233-240. doi: 10.1037/a0034255URLpmid: 24059824 |
[65] | Toderita I., Bourgeon S., Voisin J. I. A., & Chapman C. E . ( 2014). Haptic two-dimensional angle categorization and discrimination. Experimental Brain Research, 232, (2), 369-383. doi: 10.1007/s00221-013-3745-4URLpmid: 24170289 |
[66] | Trief E., Cascella P. W., & Bruce S. M . ( 2013). A field study of a standardized tangible symbol system for learners who are visually impaired and have multiple disabilities. Journal of Visual Impairment & Blindness, 107, (3), 180-191. |
[67] | Van Aarsen V., &Overvliet K.E . ( 2016). Perceptual grouping by similarity of surface roughness in haptics: The influence of task difficulty. Experimental Brain Research, 234, (8), 2227-2234. doi: 10.1007/s00221-016-4628-2URLpmid: 27010724 |
[68] | Vidal-Verdu F., &Hafez M. ( 2007). Graphical tactile displays for visually-impaired people. IEEE Transactions on Neural Systems & Rehabilitation Engineering, 15, (1), 119-130. doi: 10.1109/TNSRE.2007.891375URLpmid: 17436884 |
[69] | Vinter A., Fernandes V., Orlandi O., & Morgan P . ( 2012). Exploratory procedures of tactile images in visually impaired and blindfolded sighted children: How they relate to their consequent performance in drawing. Research in Developmental Disabilities, 33, (6), 1819-1831. doi: 10.1016/j.ridd.2012.05.001URLpmid: 22699255 |
[70] | Wijntjes M. W.A., &Kappers A. M.L . ( 2007). Angle discrimination in raised-line drawings. Perception, 36, (6), 865-879. doi: 10.1068/p5603URLpmid: 17718365 |
[71] | Wijntjes M. W. A., van Lienen T., Verstijnen I. M & Kappers A. M. L., . ( 2008). The influence of picture size on recognition and exploratory behaviour in raised-line drawings. Perception, 37, (4), 602-614. doi: 10.1068/p5714URLpmid: 18546666 |
[72] | Wnuczko M., &Kennedy J.M . ( 2014). Pointing to azimuths and elevations of targets: Blind and blindfolded- sighted. Perception, 43, (2-3), 117-128. doi: 10.1068/p7605URLpmid: 24919348 |
[73] | Yang J., Kitada R., Kochiyama T., Yu Y., Kai M., Araki Y., .. Sadato N . ( 2017). Brain networks involved in tactile speed classification of moving dot patterns: The effects of speed and dot periodicity. Scientific Reports, 7, 40931). doi: 10.1038/srep40931URLpmid: 5286508 |
[74] | Yang J., Yu Y., Kunita A., Qiang H., Wu J., Sawamoto N., & Fukuyama H . ( 2014). Tactile priming modulates the activation of the fronto-parietal circuit during tactile angle match and non-match processing: An fMRI study. Frontiers in Human Neuroscience, 8, (926), 926. doi: 10.3389/fnhum.2014.00926URLpmid: 25566010 |
[75] | Yau J. M., Kim S. S., Thakur P. H., & Bensmaia S. J . ( 2016). Feeling form: the neural basis of haptic shape perception. Journal of Neurophysiology, 115, (2), 631-642. doi: 10.1152/jn.00598.2015URLpmid: 26581869 |
[76] | Yoshida T., Yamaguchi A., Tsutsui H., & Wake T . ( 2015). Tactile search for change has less memory than visual search for change. Attention Perception & Psychophysics, 77, (4), 1200-1211. doi: 10.3758/s13414-014-0829-6URLpmid: 25724516 |
[77] | Yu J., Wu Q., Yang J., Takahashi S., Ejima Y., & Wu J . ( 2017). A study of shape discrimination for tactile guide maps. IEEE International Conference on Mechatronics and Automation( pp.565-570). IEEE. doi: 10.1109/ICMA.2017.8015879URL |
相关文章 3
[1] | 王春地, 王大辉. 振动触觉频率信息的工作记忆容量及存储机制[J]. 心理科学进展, 2021, 29(7): 1141-1148. |
[2] | 宋爱霞, 张竹, 唐日新. 喂食动作:视觉信息与触觉信息的竞争[J]. 心理科学进展, 2017, 25(suppl.): 94-94. |
[3] | 周爱保;张彦驰;刘沛汝;尹玉龙;张 奋. 我是谁?——人际间多感觉刺激下的识脸错觉[J]. 心理科学进展, 2015, 23(2): 159-167. |
PDF全文下载地址:
http://journal.psych.ac.cn/xlkxjz/CN/article/downloadArticleFile.do?attachType=PDF&id=4652