Presentation
Integrating Artificial Intelligence and Immersive Virtual Reality for Next-Generation Dementia Assessment and Digital Neurocognitive Evaluation
SessionWednesday Poster Session
DescriptionThis research introduces an AI-driven Virtual Reality (AI-VR) Clinic designed to support next-generation dementia assessment and digital neurocognitive evaluation. The system integrates immersive virtual reality, artificial intelligence, eye-tracking, speech analysis, and real-time sensing to provide more objective, adaptive, and ecologically valid assessments of cognitive decline compared to traditional paper-based methods. The AI-VR Clinic simulates a healthcare environment where patients, caregivers, and healthcare professionals interact within virtual assessment rooms. The platform includes immersive cognitive evaluation tasks, such as a 3D recreation of the Boston Cookie Theft assessment commonly used in dementia screening. During assessments, speech and eye-tracking data are collected and analyzed using advanced natural language processing (NLP) and machine learning models trained on the DementiaBank dataset.
Multiple AI models were evaluated, with the RoBERTa-based model achieving the highest diagnostic performance. The integrated system enables real-time analysis and feedback within the VR environment, supporting personalized and potentially remote cognitive assessment. The research demonstrates the feasibility of integrating AI and immersive VR technologies to improve early dementia detection, increase accessibility to neurocognitive evaluation, and enable longitudinal monitoring of cognitive health.
Multiple AI models were evaluated, with the RoBERTa-based model achieving the highest diagnostic performance. The integrated system enables real-time analysis and feedback within the VR environment, supporting personalized and potentially remote cognitive assessment. The research demonstrates the feasibility of integrating AI and immersive VR technologies to improve early dementia detection, increase accessibility to neurocognitive evaluation, and enable longitudinal monitoring of cognitive health.
Alternate Presenter
Event Type
Poster
TimeWednesday, October 21st5:30pm - 6:30pm PDT
Location