), 张慧远, 陈东濠, 徐宏格 中山大学心理学系, 广州 510006
收稿日期:2020-02-11出版日期:2020-08-15发布日期:2020-06-28通讯作者:潘静E-mail:panj27@mail.sysu.edu.cn基金资助:* 国家自然科学基金(319709882);广东省基础与应用基础研究基金(2020A1515010630);中山大学青年教师重点培养项目(19wkzd22)Visual search in real world: The role of dynamic and static optical information
PAN Jing(), ZHANG Huiyuan, CHEN Donghao, XU Hongge Department of Psychology, Sun Yat-sen University, Guangzhou 51006, China
Received:2020-02-11Online:2020-08-15Published:2020-06-28Contact:PAN Jing E-mail:panj27@mail.sysu.edu.cn摘要/Abstract
摘要： 真实环境中的视觉搜索是人和动物赖以生存的重要能力。目前的视觉搜索研究多使用静态的观察者和静止的二维搜索对象, 侧重于探究注意在搜索中的作用; 现有的视觉搜索理论模型主要概括了影响搜索的自上而下的注意因素, 而将自下而上影响因素简单归结为影像显著性, 然而在真实环境中, 观察者或搜索对象是可以运动的, 搜索时可利用的视觉信息包括动态光流和静态影像结构信息。已有的视觉识别研究发现这两种信息相结合可以使观察者准确持久地识别场景、事件和三维结构。在现有视觉搜索理论模型中引入两种视觉信息可以较好还原真实环境中的搜索任务。我们提出研究构想和实验方案,探究利用动、静态视觉信息的视觉搜索过程, 从而完善现有的视觉搜索模型。我们认为充分利用环境信息可以提高搜索效率, 且在视觉搜索训练和智能搜索设计等方面有重要的应用价值。
图/表 3
图1理论模型框架。我们认为视觉信息对真实环境里的视觉搜索起到自下而上的影响, 尤其是光流以及光流和影像结构的交互。本研究补充了光流信息在视觉搜索中的自下而上的作用, 但是运动产生的视觉、运动觉及本体觉信息可能以其它方式对视觉搜索造成自上而下的影响, 有待后续研究。图中实线框为现有理论模型, 主要基于Wolfe的引导搜索模型。虚线框内为本文提出理论构想的关键词。
图1理论模型框架。我们认为视觉信息对真实环境里的视觉搜索起到自下而上的影响, 尤其是光流以及光流和影像结构的交互。本研究补充了光流信息在视觉搜索中的自下而上的作用, 但是运动产生的视觉、运动觉及本体觉信息可能以其它方式对视觉搜索造成自上而下的影响, 有待后续研究。图中实线框为现有理论模型, 主要基于Wolfe的引导搜索模型。虚线框内为本文提出理论构想的关键词。
图2生态光学理论总结。Gibson认为观察者利用环境光里的视觉信息完成知觉任务。环境光里包括静态影像结构信息和动态光流信息。
图2生态光学理论总结。Gibson认为观察者利用环境光里的视觉信息完成知觉任务。环境光里包括静态影像结构信息和动态光流信息。
图3本项目的技术路线总图。其中分三个研究, 分别对应静态三维物体搜索、事件搜索以及视觉搜索训练。
图3本项目的技术路线总图。其中分三个研究, 分别对应静态三维物体搜索、事件搜索以及视觉搜索训练。参考文献 71
| [1] | Bahle, B., Matsukura, M., & Hollingworth, A. (2018). Contrasting gist-based and template-based guidance during real-world visual search. Journal of Experimental Psychology: Human Perception and Performance, 44(3), 367-386. doi: 10.1037/xhp0000468URLpmid: 28795834 |
| [2] | Bingham, G. P., Schmidt, R. C., & Rosenblum, L. D. (1995). Dynamics and the orientation of kinematic forms in visual event recognition. Journal of Experimental Psychology: Human Perception and Performance, 21(6), 1473-1493. doi: 10.1037//0096-1523.21.6.1473URLpmid: 7490589 |
| [3] | Broadbent, D. E. (1991). A word before leaving. In D. E. Meyer & S. Kornblum (Eds.), Attention and performance XIV (pp. 863-879). Cambridge, MA: Bradford Books/MIT Press. |
| [4] | Brooks, D. I., Rasmussen, I. P., & Hollingworth, A. (2010). The nesting of search contexts within natural scenes: Evidence from contextual cuing. Journal of Experimental Psychology: Human Perception and Performance, 36(6), 1406-1418. doi: 10.1037/a0019257URLpmid: 20731525 |
| [5] | Cavanagh, P., Labianca, A. T., & Thornton, I. M. (2001). Attention-based visual routines: Sprites. Cognition, 80(1-2), 47-60. URLpmid: 11245839 |
| [6] | De Vries, J. P., Hooge, I. T. C., Wertheim, A. H., & Verstraten, F. A. J. (2013). Background, an important factor in visual search. Vision Research, 86, 128-138. doi: 10.1016/j.visres.2013.04.010URL |
| [7] | Ding, X., Yin, J., Shui, R., Zhou, J., & Shen, M. (2017). Backward-walking biological motion orients attention to moving away instead of moving toward. Psychonomic Bulletin & Review, 24(2), 447-452. doi: 10.3758/s13423-016-1083-9URLpmid: 27368634 |
| [8] | Domini, F., Vuong, Q. C., & Caudek, C. (2002). Temporal integration in structure from motion. Journal of Experimental Psychology: Human Perception and Performance, 28(4), 816-838. URLpmid: 12190252 |
| [9] | Drew, T., Boettcher, S. E. P., & Wolfe, J. M. (2016). Searching while loaded: Visual working memory does not interfere with hybrid search efficiency but hybrid search uses working memory capacity. Psychonomic Bulletin & Review, 23(1), 201-212. URLpmid: 26055755 |
| [10] | Drew, T., Boettcher, S. E. P., & Wolfe, J. M. (2017). One visual search, many memory searches: An eye-tracking investigation of hybrid search. Journal of Vision, 17(11), 5. doi: 10.1167/17.11.5URLpmid: 28892812 |
| [11] | Duncan, J. S., & Humphreys, G. W. (1989). Visual search and stimulus similarity. Psychological Review, 96(3), 433-458. doi: 10.1037/0033-295x.96.3.433URLpmid: 2756067 |
| [12] | Ehinger, K. A., & Wolfe, J. M. (2016). When is it time to move to the next map? Optimal foraging in guided visual search. Attention, Perception, & Psychophysics, 78(7), 2135-2151. |
| [13] | Eriksen, C. W., & Schultz, D. W. (1979). Information processing in visual search: A continuous flow conception and experimental results. Perception & Psychophysics, 25(4), 249-263. doi: 10.3758/bf03198804URLpmid: 461085 |
| [14] | Foulsham, T., Chapman, C. S., Nasiopoulos, E., & Kingstone, A. (2014). Top-down and bottom-up aspects of active search in a real-world environment. Canadian Journal of Experimental Psychology, 68(1), 8-19. doi: 10.1037/cep0000004URLpmid: 24219246 |
| [15] | Foulsham, T., & Underwood, G. (2009). Does conspicuity enhance distraction? Saliency and eye landing position when searching for objects. The Quarterly Journal of Experimental Psychology, 62(6), 1088-1098. doi: 10.1080/17470210802602433URLpmid: 19142829 |
| [16] | Gibson, J. J. (1958). Visually controlled locomotion and visual orientation in animals. British Journal of Psychology, 49(3), 182-194. URLpmid: 13572790 |
| [17] | Gibson, J. J. (1986). The ecological approach to visual perception. Hillsdale, NJ, US: Lawrence Erlbaum Associates, Inc. (Original work published 1979). |
| [18] | Gold, J. M., Tadin, D., Cook, S. C., & Blake, R. (2008). The efficiency of biological motion perception. Attention Perception & Psychophysics, 70(1), 88-95. |
| [19] | Henderson, J. M., & Hayes, T. R. (2017). Meaning-based guidance of attention in scenes as revealed by meaning maps. Nature Human Behaviour, 1(10), 743-747. doi: 10.1038/s41562-017-0208-0URLpmid: 31024101 |
| [20] | Henderson, J. M., Malcolm, G. L., & Schandl, C. (2009). Searching in the dark: Cognitive relevance drives attention in real-world scenes. Psychonomic Bulletin & Review, 16(5), 850-856. URLpmid: 19815788 |
| [21] | Hickey, C., Chelazzi, L., Theeuwes, J., & Geng, J. J. (2014). Reward-priming of location in visual search. PLoS ONE, 9(7), e103372. URLpmid: 25080218 |
| [22] | Hirai, M., & Hiraki, K. (2006). Visual search for biological motion: An event-related potential study. Neuroscience Letters, 403(3), 299-304. URLpmid: 16716511 |
| [23] | Kamkar, S., Moghaddam, H. A., & Lashgari, R. (2018). Early visual processing of feature saliency tasks: A review of psychophysical experiments. Frontiers in Systems Neuroscience, 12, 54. doi: 10.3389/fnsys.2018.00054URLpmid: 30416433 |
| [24] | Kingstone, A., Smilek, D., & Eastwood, J. D. (2008). Cognitive ethology: A new approach for studying human cognition. British Journal of Psychology, 99, 317-340. URLpmid: 17977481 |
| [25] | Kingstone, A., Smilek, D., Ristic, J., Friesen, C. K., & Eastwood, J. D. (2003). Attention, researchers! It is time to take a look at the real world. Current Directions in Psychological Science, 12(5), 176-180. |
| [26] | Koch, C., & Ullman, S. (1987). Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology, 4(2), 115-141. URLpmid: 4030421 |
| [27] | Koehler, K., Guo, F., Zhang, S., & Eckstein, M. P. (2014). What do saliency models predict. Journal of Vision, 14(3), 14-14. doi: 10.1167/14.3.14URLpmid: 24618107 |
| [28] | Kristjánsson, á., Jóhannesson, ó. I., & Thornton, I. M. (2014). Common attentional constraints in visual foraging. Plos One, 9(6), e100752. URLpmid: 24964082 |
| [29] | Lee, Y. L., Lind, M., Bingham, N. & Bingham, G. P. (2012). Object recognition using metric shape. Vision Research, 69, 23-31. doi: 10.1016/j.visres.2012.07.013URLpmid: 22884632 |
| [30] | Lu, H., Tjan, B. S., & Liu, Z. (2017). Human efficiency in detecting and discriminating biological motion. Journal of Vision, 17(6), 4-4. URLpmid: 28593248 |
| [31] | Mayer, K. M., Riddell, H., & Lappe, M. (2019). Concurrent processing of optic flow and biological motion. Journal of Experimental Psychology: General, 148(11), 1938-1952. |
| [32] | Mayer, K. M., Vuong, Q. C., & Thornton, I. M. (2015). Do People “Pop Out”?. PLOS ONE, 10(10), e0139618. doi: 10.1371/journal.pone.0139618URLpmid: 26441221 |
| [33] | Muchisky, M. M.. & Bingham, G. P. (2002). Trajectory forms as a source of information about events. Attention Perception & Psychophysics, 64(1), 15-31. |
| [34] | Nakayama, K., & Martini, P. (2011). Situating visual search. Vision Research, 51(13), 1526-1537. URLpmid: 20837042 |
| [35] | Ort, E., Fahrenfort, J. J., & Olivers, C. N. L. (2017). Lack of free choice reveals the cost of having to search for more than one object. Psychological Science, 28(8), 1137-1147. URLpmid: 28661761 |
| [36] | Pan, J. S., Bingham, N., & Bingham, G. P. (2013). Embodied memory: Effective and stable perception by combining optic flow and image structure. Journal of Experimental Psychology: Human Perception and Performance, 39(6), 1638-1651. |
| [37] | Pan, J. S., Bingham, N., & Bingham, G. P. (2017). Embodied memory allows accurate and stable perception of hidden objects despite orientation change. Journal of Experimental Psychology: Human Perception and Performance, 43(7), 1343-1358. doi: 10.1037/xhp0000392URLpmid: 28301185 |
| [38] | Pan, J. S., Bingham, N., Chen, C., & Bingham, G. P. (2017). Breaking camouflage and detecting targets require optic flow and image structure information. Applied Optics, 56(22), 6410-6418. URLpmid: 29047842 |
| [39] | Pan, J. S., Li, J., Chen, Z., Mangiaracina, E. A., Connell, C. S., Wu, H., ... Hassan, S. E. (2017). Motion-generated optical information allows event perception despite blurry vision in AMD and amblyopic patients. Journal of Vision, 17(12), 13-13. |
| [40] | Ruddle, R. A., & Lessels, S. (2006). For efficient navigational search, humans require full physical movement, but not a rich visual scene. Psychological Science, 17(6), 460-465. doi: 10.1111/j.1467-9280.2006.01728.xURLpmid: 16771793 |
| [41] | Runeson, S., & Frykholm, G. (1983). Kinematic specification of dynamics as an informational basis for person-and-action perception: Expectation, gender recognition, and deceptive intention. Journal of Experimental Psychology: General, 112(4), 585-615. doi: 10.1037/0096-3445.112.4.585URL |
| [42] | Seidl-Rathkopf, K. N., Turk-Browne, N. B., & Kastner, S. (2015). Automatic guidance of attention during real-world visual search. Attention Perception & Psychophysics, 77(6), 1881-1895. |
| [43] | Smith, A. D., Hood, B. M., & Gilchrist, I. D. (2008). Visual search and foraging compared in a large-scale search task . Cognitive Processing, 9(2), 121-126. URLpmid: 18188627 |
| [44] | Smith, A. D., Hood, B. M., & Gilchrist, I. D. (2010). Probabilistic cuing in large-scale environmental search . Journal of Experimental Psychology: Learning, Memory, and Cognition, 36(3), 605-618. URLpmid: 20438260 |
| [45] | Tatler, B. W., Hayhoe, M. M., Land, M. F., & Ballard, D. H. (2011). Eye guidance in natural vision: Reinterpreting salience. Journal of Vision, 11(5), 5-5. doi: 10.1167/11.5.5URLpmid: 21622729 |
| [46] | Theeuwes, J., Kramer, A. F., & Belopolsky, A. V. (2004). Attentional set interacts with perceptual load in visual search. Psychonomic Bulletin & Review, 11(4), 697-702. URLpmid: 15581120 |
| [47] | Todd, J. T., Tittle, J. S., & Norman, J. F. (1995). Distortions of three-dimensional space in the perceptual analysis of motion and stereo. Perception, 24(1), 75-86. URLpmid: 7617420 |
| [48] | Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113(4), 766-786. URLpmid: 17014302 |
| [49] | Treisman, A. (1982). Perceptual grouping and attention in visual search for features and for objects. Journal of Experimental Psychology, 8(2), 194-214. doi: 10.1037//0096-1523.8.2.194URLpmid: 6461717 |
| [50] | Treisman, A. M., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12(1), 97-136. URLpmid: 7351125 |
| [51] | Treisman, A., & Gormican, S. (1988). Feature analysis in early vision: Evidence from search asymmetries. Psychological Review, 95(1), 15-48. URLpmid: 3353475 |
| [52] | Treisman, A., Sykes, M., & Gelade, G. (1977). Selective attention and stimulus integration. Attention and Performance VI, 333. |
| [53] | Van Boxtel, J. J., & Lu, H. (2011). Visual search by action category. Journal of Vision, 11(7), 19-19. URLpmid: 21709212 |
| [54] | Vo, M. L., & Wolfe, J. M. (2012). When does repeated search in scenes involve memory? Looking at versus looking for objects in scenes. Journal of Experimental Psychology: Human Perception and Performance, 38(1), 23-41. URLpmid: 21688939 |
| [55] | V?, M. L. H., & Wolfe, J. M. (2015). The role of memory for visual search in scenes. Annals of the New York Academy of Sciences, 1339(1), 72-81. doi: 10.1111/nyas.2015.1339.issue-1URL |
| [56] | Wang, L., Zhang, K., He, S., & Jiang, Y. (2010). Searching for life motion signals: Visual search asymmetry in local but not global biological-motion processing. Psychological Science, 21(8), 1083-1089. doi: 10.1177/0956797610376072URL |
| [57] | Wickelgren, E. A. & Bingham, G. P. (2004). Perspective distortion of trajectory forms and perceptual constancy in visual event identification. Attention Perception & Psychophysics, 66, 629-641. |
| [58] | Wickelgren, E. A., & Bingham, G.P. (2008). Trajectory forms as information for visual event recognition: 3D perspectives on path shape and speed profile. Attention Perception & Psychophysics, 70(2), 266-278. |
| [59] | Wolfe, J. M. (1994). Guided Search 2.0: A revised model of visual search. Psychonomic Bulletin &. Review, 1, 202-238 doi: 10.3758/BF03200774URLpmid: 24203471 |
| [60] | Wolfe, J. M. (2003). Moving towards solutions to some enduring controversies in visual search. Trends in Cognitive Sciences, 7(2), 70-76. URLpmid: 12584025 |
| [61] | Wolfe, J. M., Boettcher, S. E. P., Josephs, E. L., Cunningham, C. A., & Drew, T. (2015). You look familiar, but I don’t care: Lure rejection in hybrid visual and memory search is not based on familiarity. Journal of Experimental Psychology: Human Perception and Performance, 41(6), 1576-1587. doi: 10.1037/xhp0000096URLpmid: 26191615 |
| [62] | Wolfe, J. M., Cain, M. S., & Aizenman, A. M. (2019). Guidance and selection history in hybrid foraging visual search. Attention, Perception, & Psychophysics, 81(3), 637-653. |
| [63] | Wolfe, J. M., Cain, M. S., Ehinger, K. A., & Drew, T. (2015). Guided Search 5.0: Meeting the challenge of hybrid search and multiple-target foraging. Journal of Vision, 15(12), 1106-1106. |
| [64] | Wolfe, J. M., Cave, K. R., & Franzel, S. L. (1989). Guided search: An alternative to the feature integration model for visual search. Journal of Experimental Psychology: Human Perception and Performance, 15(3), 419-433. URLpmid: 2527952 |
| [65] | Wolfe, J. M., & Gancarz, G. (1997). Guided Search 3.0. In Basic and clinical applications of vision science (pp. 189-192). Dordrecht: Springer. |
| [66] | Wolfe, J. M., & Gray, W. (2007). Guided search 4.0. Integrated models of cognitive systems, 99-119. |
| [67] | Wolfe, J. M., & Horowitz, T. S. (2017). Five factors that guide attention in visual search. Nature Human Behaviour, 1(3), 0058. |
| [68] | Wolfe, J. M., & van Wert, M. J. (2010). Varying target prevalence reveals two dissociable decision criteria in visual search. Current Biology, 20(2), 121-124. URLpmid: 20079642 |
| [69] | Woodman, G. F., & Chun, M. M. (2006). The role of working memory and long-term memory in visual search. Visual Cognition, 14(4-8), 808-830. |
| [70] | Wu, C., Wick, F. A., & Pomplun, M. (2014). Guidance of visual attention by semantic information in real-world scenes. Frontiers in Psychology, 5, 54-54. doi: 10.3389/fpsyg.2014.00054URLpmid: 24567724 |
| [71] | Wu, H., Wang, X. M., & Pan, J. S. (2019). Perceiving blurry scenes with translational optic flow, rotational optic flow or combined optic flow. Vision Research, 158, 49-57. URLpmid: 30796993 |
相关文章 15
| [1] | 陈晓雯, 蔡文淑, 谢桐, 傅世敏. 孤独症谱系障碍者视觉定向与视觉搜索的特点及神经机制[J]. 心理科学进展, 2020, 28(1): 98-109. |
| [2] | 于明阳, 李富洪, 曹碧华, . 愉快面孔识别优势及其认知神经机制[J]. 心理科学进展, 2018, 26(2): 254-261. |
| [3] | 陈静, 孙伟, 翟广涛, 李黎. 分离光流信息与形状信息对个体朝向目标行进的影响[J]. 心理科学进展, 2017, 25(suppl.): 30-30. |
| [4] | 纪皓月, 蒋毅, 王莉. 社会性注意的视觉适应：社会与非社会线索的知觉对社会注意效应的不同影响[J]. 心理科学进展, 2017, 25(suppl.): 33-33. |
| [5] | 孙沛, 王非, 孙霁, 王紫萱, 林云. 简单动作对后续视觉搜索任务的影响[J]. 心理科学进展, 2017, 25(suppl.): 35-35. |
| [6] | 陈艾睿, 唐晓雨, 王爱君, 张 明. 视觉注意离散性的实验范式[J]. 心理科学进展, 2017, 25(6): 923-932. |
| [7] | 吴虹远; 潘静. 光流信息帮助识别模糊场景[J]. 心理科学进展, 2016, 24(Suppl.): 25-. |
| [8] | 余雪菲; 顾勇. 物体运动对自身运动感知的影响[J]. 心理科学进展, 2016, 24(Suppl.): 72-. |
| [9] | 胡月; 杨顺南; 吉承恕. 攀岩运动员攀爬路线分析的认知加工特征研究[J]. 心理科学进展, 2016, 24(Suppl.): 86-. |
| [10] | 王娜;任衍具. 真实场景搜索中的眼动返回抑制[J]. 心理科学进展, 2014, 22(4): 640-649. |
| [11] | 赵斐斐;任衍具. 空间情境提示效应及其机制[J]. 心理科学进展, 2013, 21(7): 1173-1185. |
| [12] | 康廷虎;范小燕. 情景知觉过程中的视觉记忆[J]. 心理科学进展, 2013, 21(12): 2136-2143. |
| [13] | 魏萍;康冠兰. 奖赏性线索启动和调控视觉搜索额顶网络的神经机制[J]. 心理科学进展, 2012, 20(6): 798-804. |
| [14] | 张豹. 重新检视工作记忆在视觉搜索中的作用[J]. 心理科学进展, 2012, 20(2): 228-239. |
| [15] | 张明;王爱君. 视觉搜索中基于工作记忆内容的注意捕获与抑制[J]. 心理科学进展, 2012, 20(12): 1899-1907. |
PDF全文下载地址:
http://journal.psych.ac.cn/xlkxjz/CN/article/downloadArticleFile.do?attachType=PDF&id=5125
