A Conceptual Mechanistic Framework for Biosensing-Enhanced VR Rehabilitation
DOI:
https://doi.org/10.54337/aau.icdvrat26.25Abstract
Biosensing-enabled Virtual Reality including electroencephalography, electromyography, electrodermal activity, heart-rate variability and other multimodal physiological signals is the next frontier of adaptive and personalised VR rehabilitation systems. This paper reviews the mechanistic evidence of 32 studies utilising biosensing-enabled VR, identified in a broader systematic review, investigating how EEG-based motor imagery, EMG biofeedback, and autonomic biosensors can effectively modulate sensorimotor engagement, volitional activation, emotional and attentional states. This framework outlines neural intention decoding, muscular activation reinforcement, autonomic state modulation, and multimodal integration as potential pathways for incorporating biosensing and closed-loop adaptivity into VR rehabilitation systems.
References
Aamer, A., Esawy, A., Swelam, O., Nabil, T., Anwar, A. & Eldeib, A. (2019), Bci integrated with vr for rehabilitation, in ‘2019 31st International
Conference on Microelectronics (ICM)’, pp. 166–169.
Achanccaray, D., Pacheco, K., Carranza, E. & Hayashibe, M. (2018), Immersive virtual reality feedback in a brain computer interface for upper
limb rehabilitation, in ‘2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC)’, pp. 1006–1010.
Blanco-Mora, D. A., Almeida, Y., Vieira, C. & i. Badia, S. B. (2019), A study on eeg power and connectivity in a virtual reality bimanual
rehabilitation training system, in ‘2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)’, pp. 2818–2822.
Chatragadda, L., Fletcher, A., Delmonico, M. J., Mankodiya, K. & Solanki, D. (2023), Vrgrip: Developing a grip strength training platform
integrating a wireless e-textile forearm band with an adaptive 3d vr game environment, in ‘2023 IEEE MIT Undergraduate Research
Technology Conference (URTC)’, pp. 1–4.
Chatragadda, L., Fletcher, A., Zhong, S., Vargas, F. A., Bhagat, N., Mankodiya, K., Delmonico, M. J. & Solanki, D. (2025), ‘Development and
assessment of a soft wearable for semg-based hand grip detection and control of a virtual environment’, Sensors 25(8), 2431.
Guo, S., Liu, Y., Zhang, Y., Zhang, S. & Yamamoto, K. (2016), A vr-based self-rehabilitation system, in ‘2016 IEEE International Conference
on Mechatronics and Automation’, pp. 1173–1178.
Harris, M. C., Fryer, D. L., Mahmud, M., Rahman, M. A., Vyas, P., Shopland, N., Connor, B., Lewis, J. & Brown, D. J. (2024), Towards a
machine learning model to classify cognitive ability using eeg data and virtual spatial navigation task scores in intellectually disabled adults,
in ‘International Conference on Neural Information Processing’, Springer, pp. 188–202.
Kar´acsony, T., Hansen, J. P., Iversen, H. K. & K., S. P. (2019), Brain computer interface for neuro-rehabilitation with deep learning classification
and virtual reality feedback, in ‘ACM International Conference Proceeding Series’.
Liu, T. H., Chein, C. H., Hsu, H. Y. & Lin, C.W. (2024), Eeg-based assessment of bilateral brain activation comparison and hand functional improvement
using virtual reality mirror therapy combined with robot-assisted upper limb intervention, in ‘2024 17th International Convention
on Rehabilitation Engineering and Assistive Technology (i-CREATe)’, pp. 1–6.
Luu, T. P., He, Y., Brown, S., Nakagame, S. & Contreras-Vidal, J. L. (2016), ‘Gait adaptation to visual kinematic perturbations using a real-time
closed-loop brain-computer interface to a virtual reality avatar’, Journal of Neural Engineering 13, 036006.
Ma, S., Varley, M. R., Richards, J. & Shark, L. K. (2009), Overcoming the information overload problem in a multiform feedback based virtual
reality system for hand motion rehabilitation, in ‘2009 International Conference on CyberWorlds’, pp. 51–56.
Ma, S., Varley, M., Shark, L. K. & Richards, J. (2010), Emg biofeedback based vr system for hand rotation and grasping rehabilitation, in ‘2010
14th International Conference Information Visualisation’, pp. 479–484.
O’Keeffe, R., Mehta, N., Shahar, Y., Mehrdad, S., Lubetzky, A. & Atashzar, S. F. (2024), Measuring changes in cortical processes during
vr-aided physical exercise - an eeg-based approach, in ‘2024 46th Annual International Conference of the IEEE Engineering in Medicine
and Biology Society (EMBC)’, pp. 1–5.
Parente, C., Galletti, C., Bottino, A., Lamberti, F., Podda, J., Tacchino, A., Brichetto, G., Michieli, L. D. & Barresi, G. (2023), A biofeedbackenhanced
virtual exergame for upper limb motor-cognitive rehabilitation, in ‘2023 IEEE 11th International Conference on Serious Games
and Applications for Health (SeGAH)’, pp. 1–8.
Rahman, M. A., Brown, D. J., Mahmud, M., Harris, M., Shopland, N., Heym, N., Sumich, A., Turabee, Z. B., Standen, B., Downes, D. et al.
(2023), ‘Enhancing biofeedback-driven self-guided virtual reality exposure therapy through arousal detection from multimodal data using
machine learning’, Brain Informatics 10(1), 14.
Rahman, M. A., Brown, D. J., Shopland, N., Harris, M. C., Turabee, Z. B., Heym, N., Sumich, A., Standen, B., Downes, D., Xing, Y. et al.
(2022), Towards machine learning driven self-guided virtual reality exposure therapy based on arousal state detection from multimodal data,
in ‘International conference on brain informatics’, Springer, pp. 195–209.
Vourvopoulos, A., Ferreira, A. & i Badia, S. B. B. (2019), Development and assessment of a self-paced bci-vr paradigm using multimodal
stimulation and adaptive performance, in ‘Lecture Notes in Computer Science’, Vol. 10057 LNCS, pp. 1–22.
