南京大学社会学院心理学系, 南京 210023
收稿日期:
2020-05-24出版日期:
2021-03-15发布日期:
2021-01-26通讯作者:
李中权E-mail:zqli@nju.edu.cn基金资助:
教育部人文社科规划基金项目(20YJA190004);江苏省教育厅高校哲学社会科学研究重点项目(2018SJZDI203)Game-based psychological assessment
XU Junyi, LI Zhongquan()Department of Psychology, School of Social and Behavioral Sciences, Nanjing University, Nanjing 210023, China
Received:
2020-05-24Online:
2021-03-15Published:
2021-01-26Contact:
LI Zhongquan E-mail:zqli@nju.edu.cn摘要/Abstract
摘要: 基于游戏的心理测评是指通过游戏或游戏化的活动, 对一个人的能力、人格等心理特性和行为进行量化测评。早期主要用于评估教育和训练的效果, 而后发展成对心理特性的测评。基于游戏的测评作为一项新技术在测评形式、测评过程和测评结果上均具有优势。目前基于游戏的测评形成了以证据中心设计为基础的范式, 用于指导建立测评工具和开展实证研究, 并在测评个体认知能力和非认知能力方面均有实践。然而当前该技术仍处于起步阶段, 未来研究可以在任务设计、结果分析及实践应用方面进一步拓展深入。
图/表 1
图1基于证据中心设计建立测评工具的思路框架
图1基于证据中心设计建立测评工具的思路框架
参考文献 59
[1] | 冯翠典. (2012). “以证据为中心”的教育评价设计模式简介. 上海教育科研, 8, 12-16. |
[2] | 李丽, 赵文龙. (2017). 家庭背景、文化资本对认知能力和非认知能力的影响研究. 东岳论丛, 38(04), 142-150. |
[3] | 孙海洋. (2011). 以证据为中心的设计模式及其对口语考试设计的启示. 中国考试, 7, 20-26. |
[4] | 孙鑫, 黎坚, 符植煜. (2018). 利用游戏log-file预测学生推理能力和数学成绩——机器学习的应用. 心理学报, 50(7), 761-770. |
[5] | 温迎, 付玉, 黄贝萱. (2019). 电子游戏测评综述. 电脑知识与技术, 15(8), 184-186. |
[6] | 吴忭, 胡艺龄, 赵玥颖. (2015). 如何使用数据:回归基于理解的深度学习和测评——访国际知名学习科学专家戴维·谢弗. 开放教育研究, 25(1), 6-14. |
[7] | 吴宇. (2015). 浅析严肃游戏在中国的发展. 科技视界, 10, 135+227. |
[8] | 杨振芳, 孙贻文. (2015). 游戏化招聘:人才选拔的新途径. 中国人力资源开发, 342(24), 47-52. |
[9] | Annetta, L. A., Cheng, M. T., & Holmes, S. (2010). Assessing twenty-first-century skills through a teacher-created video game for high school biology students. Research in Science & Technological Education, 28, 101-114. |
[10] | Attali, Y., & Arieli-Attali, M. (2015). Gamification in assessment: Do points affect test performance? Computers & Education, 83, 57-63. |
[11] | Bacos, C. A., McCreery, M. P., & Laferriere, J. R. (2018). Interactive narratives, counterfactual thinking, and personality in video games. HCI International 2018 - Posters' Extended Abstracts, 850, 340-347. |
[12] | Baron, T. (2017). An architecture for designing content agnostic game mechanics for educational burst games (Unpublished doctoral dissertation). Arizona State University. |
[13] | Baumert, A., Schl?sser, T., & Schmitt, M. (2014). Economic games: A performance-based assessment of fairness and altruism. European Journal of Psychological Assessment, 30(3), 178-192. |
[14] | Caballero-Hernández, J. A., Palomo-Duarte, M., & Dodero, J. M. (2017). Skill assessment in learning experiences based on serious games: A systematic mapping study. Computers & Education, 113, 42-60. |
[15] | Csapó, B., Ainley, J., Bennett, R. E., Latour, T., & Law, N. (2012) Technological issues for computer-based assessment. In: P. Griffin, B. McGaw, & E. Care (Eds.), Assessment and Teaching of 21st Century Skills (pp. 143-230). Dordrecht: Springer. |
[16] | Dalveren, G. G. M., Cagiltay, N., & Ozcelik, E. (2015). Personality type indicator models in serious games: A case study in a surgical navigation game. Information Technology Based Higher Education and Training, 1-4 |
[17] | de Klerk, S., Veldkamp, B. P., & Eggen, T. J. H. M. (2015). Psychometric analysis of the performance data of simulation-based assessment: A systematic review and a Bayesian network example. Computers & Education, 85, 23-34. |
[18] | DeRosier, M. E., Craig, A. B., & Sanchez, R. P. (2012). Zoo U: A stealth approach to social skills assessment in schools. Advances in Human-Computer Interaction, 1, 1-7. |
[19] | DeRosier, M. E., & Thomas, J. M. (2018a). Establishing the criterion validity of Zoo U’s game-based social emotional skills assessment for school-based outcomes. Journal of Applied Developmental Psychology, 55, 52-61. |
[20] | DeRosier, M. E., & Thomas, J. M. (2018b). Video games and their impact on teens’ mental health. In: M. Moreno, & A. Radovic (Eds.). Technology and Adolescent Mental Health (pp. 237-253). Cham, Switzerland: Springer. |
[21] | DeRosier, M. E., & Thomas, J. M. (2019). Hall of heroes: A digital game for social skills training with young adolescents. International Journal of Computer Games Technology, 6, 1-12. |
[22] | DiCerbo, K. E. (2014). Game-based assessment of persistence. Educational Technology & Society, 17(1), 17-28. |
[23] | DiCerbo, K. E. (2017). Building the evidentiary argument in game-based assessment. Journal of Applied Testing Technology, 18, 7-18. |
[24] | Dickey, M. D. (2006). Game design and learning: A conjectural analysis of how massively multiple online role-playing games (MMORPGs) foster intrinsic motivation. Educational Technology Research and Development, 55(3), 253-273. |
[25] | Flynn, R. M., Colón-Acosta, N., Zhou, J., & Bower, J. (2019). A game-based repeated assessment for cognitive monitoring: Initial usability and adherence study in a summer camp setting. Journal of Autism and Developmental Disorders, 49(5), 2003-2014. URLpmid: 30656527 |
[26] | Gamberini, L., Marchetti, F., Martino, F., & Spagnolli, A. (2009). Designing a serious game for young users: The case of happy farm. Studies in Health Technology and Informatics, 144, 77-81. URLpmid: 19592735 |
[27] | Gee, J. P.(2008). Learning and games. In: K. Salen (Ed.), Good Video Games and Good Learning (pp. 21-40). New York: Peter Lang Publishing. |
[28] | Guenaga, M., Eguíluz, A., & Rayon, A. (2015). A serious game to develop and assess teamwork competency. International Symposium on Computers in Education, SIIE 2014, 183-188. |
[29] | Hautala, J., Heikkil?, R., Nieminen, L., Rantanen, V., Latvala, J. M., & Richardson, U. (2020). Identification of reading difficulties by a digital game-based assessment technology. Journal of Educational Computing Research, 58(5), 1003-1028. doi: 10.1177/0735633120905309URL |
[30] | Heinzen, T. E., Landrum, R. E., Gurung, R. A. R., & Dunn, D. S.(2015). Game-based assessment: The mash-up we've been waiting for. In: T. Reiners, & L. Wood (Eds.), Gamification in Education and Business (pp. 201-207). Cham, Switzerland: Springer. |
[31] | Keil, J., Michel, A., Sticca, F., Leipold, K., Klein, A. M., Sierau, S., … White, L. O. (2017). The Pizzagame: A virtual public goods game to assess cooperative behavior in children and adolescents. Behavior Research Methods, 49(4), 1432-1443. URLpmid: 27604601 |
[32] | Kim, Y. J., Almond, R. G., & Shute, V. J. (2016). Applying evidence-centered design for the development of game-based assessments in physics playground. International Journal of Testing, 16(2), 142-163. |
[33] | Kim, Y. J., & Ifenthaler, D. (2019). Game-based assessment: The past ten years and moving forward. In: D. Ifenthaler, & Y. J. Kim (Eds.), Game-Based Assessment Revisited. Advances in Game-Based Learning (pp. 3-11). Cham, Switzerland: Springer. |
[34] | Kim, Y. J., & Shute, V. J. (2015). The interplay of game elements with psychometric qualities, learning, and enjoyment in game-based assessment. Computers & Education, 87, 340-356. |
[35] | Manera, V., Petit, P. D., Derreumaux, A., Orvieto, I., Romagnoli, M., Lyttle, G., … Robert, P. H. (2015). “Kitchen and cooking”, a serious game for mild cognitive impairment and Alzheimer's disease: A pilot study. Frontiers in Aging Neuroscience, 7-24. URLpmid: 21647396 |
[36] | Mavridis, A., & Tsiatsos, T. (2017). Game-based assessment: Investigating the impact on test anxiety and exam performance. Journal of Computer Assisted Learning, 33(2), 137-150. |
[37] | Mayer, I., Dierendonck, D. V., Ruijven, T. V., & Wenzler, I. (2014). Stealth assessment of teams in a digital game environment. In: A. De Gloria (Ed.), Lecture Notes in Computer Science (Vol. 8605, pp. 224-235). Cham, Switzerland: Springer. |
[38] | McCreery, M., Krach, S., Bacos, C., Laferriere, J., & Head, D. (2019). Can video games be used as a stealth assessment of aggression?: A criterion-related validity study. International Journal of Gaming and Computer-Mediated Simulations, 11, 40-49. |
[39] | Mislevy, R. J., Almond, R., & Lukas, J. (2003). A brief introduction to evidence-centered design. ETS Research Report Series, 1, 1-29. |
[40] | Mislevy, R. J., Behrens, J., DiCerbo, K. E., & Levy, R. (2012). Design and discovery in educational assessment: Evidence centered design, psychometrics, and data mining. Journal of Educational Data Mining, 4, 11-48. |
[41] | Mislevy, R. J., Steinberg, L., & Almond, R. (2003). Focus article: On the structure of educational assessments. Measurement: Interdisciplinary Research & Perspective, 1(1), 3-62. |
[42] | Nebel, S., & Ninaus, M. (2019). New perspectives on game-gased assessment with process data and physiological signals. In D. Ifenthaler. & Y. J. Kim. (Eds.), Game-Based Assessment Revisited (pp. 141-161). Cham, Switzerland: Springer. |
[43] | Nicholson, S. (2015). A recipe for meaningful gamification. In: T. Reiners, & L. Wood (Eds.), Gamification in Education and Business (pp. 1-20). Cham, Switzerland: Springer. |
[44] | Oranje, A., Mislevy, B., Bauer, M. I., & Jackson, G. T. (2019). Summative game-based assessment. In: D. Ifenthaler, & Y. J. Kim (Eds.), Game-Based Assessment Revisited(pp. 37-65). Cham, Switzerland: Springer. |
[45] | Rupp, A. A., Gushta, M., Mislevy, R. J., & Shaffer, D. W. (2010). Evidence-centered design of epistemic games: Measurement principles for complex learning environments. Journal of Technology, Learning, and Assessment, 8(4), 1-48 |
[46] | Sanchez, D. R., & Langer, M. (2020). Video game pursuit (VGPu) scale development: Designing and validating a scale with implications for game-based learning and assessment. Simulation & Gaming, 51(1), 55-86. |
[47] | Schoedel, R., Au, Q., V?lkel, S. T., Lehmann, F., Becker, D., Buehner, M., … Stachl, C. (2018). Digital footprints of sensation seeking: A traditional concept in the big data era. Zeitschrift Für Psychologie, 226(4), 232-245. |
[48] | Shute, V. J. (2011). Stealth assessment in computer-based games to support learning. In S. Tobias, & J. D. Fletcher (Eds.), Computer Games and Instruction(pp. 503-523). Charlotte: Information Age. |
[49] | Shute, V. J., & Moore, G. R.(2017). Consistency and validity in game-based stealth assessment. In J. Hong, & W. L. Robert (Eds.), Technology Enhanced Innovative Assessment: Development, Modeling, and Scoring From an Interdisciplinary Perspective (pp. 31-51). Charlotte: Information Age. |
[50] | Shute, V. J., Wang, L. B., Greiff, S., Zhao, W. N., & Moore, G. (2016). Measuring problem solving skills via stealth assessment in an engaging video game. Computers in Human Behavior, 63, 106-117. |
[51] | Song, H., Yi, . D. J., & Park, H. J. (2020). Validation of a mobile game-based assessment of cognitive control among children and adolescents. PLoS ONE, 15(3), 1-18. |
[52] | Song, Y, & Sparks, J. R. (2019). Measuring argumentation skills through a game-enhanced scenario-based assessment. Journal of Educational Computing Research, 56(8), 1324-1344. |
[53] | St?Nescu, D. F., Ioni??, C., & Ioni??, A. M. (2020). Game-thinking in personnel recruitment and selection: Advantages and disadvantages. Postmodern Openings / Deschideri Postmoderne, 11(2), 267-276. |
[54] | Turan, Z., & Meral, E. (2018). Game-based versus to non-game-based: The impact of student response systems on students' achievements, engagements and test anxieties. Informatics in Education, 17(1), 105-116. |
[55] | van Nimwegen, C., van Oostendorp, H., Modderman, J., & Bas, M. (2011). A test case for GameDNA: Conceptualizing a serious game to measure personality traits. 16th International Conference on Computer Games, 217-222 |
[56] | Vendlinksi, T., & Stevens, R. (2002). Assessing student problem-solving skills with complex computer-based tasks. The Journal of Technology, Learning and Assessment, 1(3), 1-21. |
[57] | Verma, V., Baron, T., Bansal, A., & Amresh, A. (2019). Emerging practices in game-based assessment. In: D. Ifenthaler, & Y. J. Kim (Eds.), Game-Based Assessment Revisited (pp. 327-346). Cham, Switzerland: Springer. |
[58] | Weiner, E. J. (2019). Cognitive abilitiy in virtual reality: Validity evidence for VR game-based assessment. (Unpublished master’s thesis). San Francisco State University. |
[59] | Wilson, A. J., Dehaene, S., Pinel, P., Revkin, S., Cohen, L., & Cohen, D. (2006). Principles underlying the design of “The Number Race”, an adaptive computer game for remediation of dyscalculia. Behavioral and Brain Functions, 2(1), 2-19. |
相关文章 11
[1] | 刘长江;张跃;郝芳;刘采梦;丁絮;石雨. 利益冲突情境中社会行为的自动激活:合作还是利己?[J]. 心理科学进展, 2016, 24(12): 1897-1906. |
[2] | 李占星;朱莉琪. 道德情绪判断与归因:发展与影响因素[J]. 心理科学进展, 2015, 23(6): 990-999. |
[3] | 王杭;江俊;蒋存梅. 音乐训练对认知能力的影响[J]. 心理科学进展, 2015, 23(3): 419-429. |
[4] | 熊明瑞;张真;施建农. 计算式互惠机制探讨——认知和动机的物种比较[J]. 心理科学进展, 2015, 23(10): 1746-1754. |
[5] | 赵宇晗;余林. 人格特质与认知能力的关系及其年龄差异[J]. 心理科学进展, 2014, 22(12): 1924-1934. |
[6] | 陈彦君;石伟;应虎. 能力的自我评价偏差:邓宁-克鲁格效应[J]. 心理科学进展, 2013, 21(12): 2204-2213. |
[7] | 李旭;陈天勇. 老年人日常认知研究评述[J]. 心理科学进展, 2011, 19(11): 1658-1666. |
[8] | 徐先彩;龚少英. 学业情绪及其影响因素[J]. 心理科学进展, 2009, 17(1): 92-97. |
[9] | 唐素萍. 情景判断测验的开发程序、构思效度及研究趋势[J]. 心理科学进展, 2004, 12(1): 119-125. |
[10] | 刘国雄,方富熹. 关于儿童道德情绪判断的研究进展[J]. 心理科学进展, 2003, 11(1): 55-60. |
[11] | 韩在柱;柏晓利;舒华. 语义范畴特异性损伤的理论研究进展[J]. 心理科学进展, 2002, 10(1): 15-20. |
PDF全文下载地址:
http://journal.psych.ac.cn/xlkxjz/CN/article/downloadArticleFile.do?attachType=PDF&id=5375