Towards a Fusion of Control and Ecological Validity in Virtual Reality Based Cognitive Testing
Pilot Results from our QuestMarket Game
DOI:
https://doi.org/10.54337/aau.icdvrat26.36Abstract
Virtual Reality (VR) devices have been extensively utilized in neuropsychological evaluation in recent years, however, their comparability to traditional neuropsychological tests is always compromised. One reason is researchers tend to utilize stimuli rich virtual environments which can alter performance. To overcome this problem, we created a VR based shopping game, QuestMarket, which employs a real-life mimicking setting but with very minimal environmental stimuli and compared its variables to six traditional neuropsychological tasks. Our study showed moderate comparability between certain cognitive tests and QuestMarket variables indicating that VR based cognitive tests may still measure different functions even in very plain environments.
References
Bürkner, P. C., Schulte, N., & Holling, H. (2019). On the statistical and practical limitations of Thurstonian IRT models. Educational and Psychological Measurement, 79(5), 827-854. Immanuel, S., Teferra, M. N., Baumert, M., & Bidargaddi, N. (2023). Heart rate variability for evaluating psychological stress changes in healthy adults: a scoping review. Neuropsychobiology, 82(4), 187-202. Kourtesis, P., Collina, S., Doumas, L. A., & MacPherson, S. E. (2021). Validation of the Virtual Reality Everyday Assessment Lab (VR-EAL): An immersive virtual reality neuropsychological battery with enhanced ecological validity. Journal of the International Neuropsychological Society, 27(2), 181-196. Kourtesis, P., Linnell, J., Amir, R., Argelaguet, F., & MacPherson, S. E. (2023, January). Cybersickness in virtual reality questionnaire (csq-vr): A validation and comparison against ssq and vrsq. In Virtual Worlds (Vol. 2, No. 1). MDPI. Lee, J. Y., de Jong, N., Donkers, J., Jarodzka, H., & van Merriënboer, J. J. (2023). Measuring cognitive load in virtual reality training via pupillometry. IEEE Transactions on Learning Technologies, 17, 704-710. Maeng, S., Hong, J. P., Kim, W. H., Kim, H., Cho, S. E., Kang, J. M., ... & Cho, S. J. (2021). Effects of virtual reality-based cognitive training in the elderly with and without mild cognitive impairment. Psychiatry investigation, 18(7), 619. Parsons, T. D. (2015). Ecological validity in virtual reality-based neuropsychological assessment. In Encyclopedia of Information Science and Technology, Third Edition (pp. 1006-1015). IGI Global Scientific Publishing. Pieri, L., Tosi, G., & Romano, D. (2023). Virtual reality technology in neuropsychological testing: A systematic review. Journal of Neuropsychology, 17(2), 382-399. Raghavendra, S. (2025). Pupillometry as an Objective Measure of Auditory Perception and Listening Effort Across the Lifespan: A Review. Journal of Otorhinolaryngology, Hearing and Balance Medicine, 6(2), 24. Xue, C., Li, A., Wu, R., Chai, J., Qiang, Y., Zhao, J., & Yang, Q. (2024). VRNPT: A neuropsychological test tool for diagnosing mild cognitive impairment using virtual reality and EEG signals. International Journal of Human–Computer Interaction, 40(20), 6268-6286. Zsebi, S., Sik-Lanyi, C., Szabó, P., Filotás, P., Zsuffa, J. A., & Cserjési, R. (2025). A virtual reality take on the Corsi-Block Tapping Task: Exploring VR for spatial working memory assessment. Acta Psychologica, 261, 105918.
