Researchers at The University of Texas at Austin have made a groundbreaking advancement in virtual reality (VR) technology by developing a modified VR headset to measure brain activity. The noninvasive electroencephalogram (EEG) sensor, integrated into a Meta VR headset, allows for a comfortable and extended immersive experience. By measuring the brain’s electrical activity during VR interactions, this innovative device opens up a range of applications, from aiding individuals with anxiety to studying human-robot interactions.
Improving VR EEG integration
Cost and discomfort issues hindered previous attempts to combine VR with EEG sensors. Existing EEG devices, which consist of electrode-covered caps, were incompatible with VR headsets. Individual electrodes also faced difficulty obtaining accurate readings, as hair obstructed direct contact with the scalp. The conventional rigid and comb-shaped electrodes caused discomfort for users.
To overcome these challenges, the research team, led by Professor Nanshu Lu, introduced a spongy electrode made of soft, conductive materials. These electrodes, integrated into the modified VR headset’s top strap and forehead pad, addressed the comfort and accuracy concerns. A flexible circuit with conductive traces, similar to electronic tattoos previously developed by Lu, was incorporated, along with an EEG recording device attached to the back of the headset.
Expanding applications and enhancing human-robot interactions
The potential applications of the VR EEG headset are vast. It can aid individuals using flight simulators, assess mental stress levels, and even allow humans to perceive the world through the eyes of a robot. The latter application plays a crucial role in a significant research project at UT Austin focused on creating a robot delivery network while studying human-robot interactions.
Professor Lu is involved in this groundbreaking project, and the VR headsets will monitor humans either traveling with robots or observing them remotely. The technology allows users to view the environment from the robot’s perspective, enabling clearer insights into human reactions and ensuring safety during potential accidents.
Testing the VR EEG headset
To validate the viability of the VR EEG headset, the researchers designed a driving simulation game in collaboration with brain-machine interface expert Professor José del R. Millán. In the game, users must react to turn commands by pressing a button. The EEG measures the users’ brain activity, providing insight into their attentiveness during the driving simulation.
Next steps and potential collaborations
The research team has filed preliminary patent paperwork for the innovative EEG technology and is open to partnering with VR companies to integrate it into their headsets. The modified VR EEG headset’s enhanced comfort and accurate brain activity measurements have the potential to revolutionize various industries, from healthcare to entertainment.
Collaborators and acknowledgments
The successful development of the VR EEG headset was a collaborative effort. The research team included Hyonyoung Shin, Minsu Zhang, Nicholas Riveira, and Susmita Gangopadahyay from the Chandra Family Department of Electrical and Computer Engineering; Andrew Yu, Heeyong Huh, Zhengjie Li, and Yifan Rao from the Department of Aerospace Engineering and Engineering Mechanics; Sangjun Kim from the Walker Department of Mechanical Engineering; Jessie Peng from the Department of Biomedical Engineering, and Gubeum Kwon from Artue Associates Inc. in South Korea.
With the integration of VR and EEG sensors, this innovative technology promises to redefine how we interact with virtual environments and how we understand brain activity. It holds immense potential for improving various fields, from mental health treatments to human-robot interactions, and its applications are only limited by our imagination.
