A Game-Based Multimodal Data Capture Pipeline for Research on Emotional Regulation in Autistic Adults
DOI:
https://doi.org/10.54337/aau.icdvrat26.13Abstract
Research on emotional regulation in autistic adults requires methods that effectively capture physiological responses and behavioural context. This paper introduces a game-based multimodal data capture pipeline that integrates a controlled environment with synchronised physiological sensing to facilitate future studies. The pipeline records key gameplay events as candidate regulationrelevant anchors and aligns them with multimodal recordings for event-centred analysis. Session outputs are stored with structured metadata and event logs to ensure quality control and reuse. The focus is on technical implementation and feasibility, establishing a foundational pipeline for future ethically approved research on emotional regulation in autistic adults.
References
Ahmad, Z. & Khan, N. (2022), ‘A survey on physiological signal-based emotion recognition’, Bioengineering (Basel) 9(11), 688.
Buxton, D. J., Mahmud, M., Bird, J. J., Hughes-Roberts, T. & Brown, D. J. (2026), A platform-agnostic multimodal digital human modelling framework: Neurophysiological sensing in game-based interaction, in ‘Proceedings of HCII 2026’, Vol. LNCS 16719, pp. 1–10.
D’mello, S. K. & Kory, J. (2015), ‘A review and meta-analysis of multimodal affect detection systems’, ACM Comput. Surv. 47(3), 1–36.
Fok, M., Brush, C. J., Seah, L., DeLucia, E. A. & Scarpa, A. (2025), ‘Emotion reactivity and regulation in autistic adults: A systematic review across RDoC units of analysis’, Psychophysiology 62(12), e70200.
Gkintoni, E., Aroutzidis, A., Antonopoulou, H. & Halkiopoulos, C. (2025), ‘From neural networks to emotional networks: A systematic review of eeg-based emotion recognition in cognitive neuroscience and real-world applications’, Brain Sciences 15(3).
L´opez-Bouzas, N. & Del Moral-P´erez, M. E. (2023), ‘Gamified environments and serious games for students with autistic spectrum disorder: Review of research’, Rev. J. Autism Dev. Disord. 12(1), 1–13.
Mazefsky, C. A. (2015), ‘Emotion regulation and emotional distress in autism spectrum disorder: Foundations and considerations for future research’, J. Autism Dev. Disord. 45(11), 3405–3408.
OpenBCI (2023), ‘Galea Multimodal Biosensing Platform: Technical Documentation’, https://docs.openbci.com.
