I-Corps: Translation Potential of Bidirectional Neural Communication for Extended Reality Technologies

The broader impact of this I-Corps project is the development of next-generation extended reality technologies with integrated wearable biomedical sensors. The development of wearable technology for Augmented Reality/Virtual Reality (AR/VR) headsets has the potential to change how people use and embrace these technologies. By creating a controller platform that relies on user feedback, people can interact with devices that are more user-friendly. Additionally, the ability of these devices to detect materials can allow users to interact with virtual objects using natural hand gestures. By improving the understanding of and response to human actions, these devices will make the AR/VR experience more immersive and enjoyable. Overall, this advancement brings the users closer to seamlessly blending the real and virtual worlds, potentially making these technologies more accessible and beneficial. This I-Corps project utilizes experiential learning coupled with a first-hand investigation of the industry ecosystem to assess the translation potential of the technology. The solution is based on the development of a cost-effective, waterproof sensor made from carbon for Augmented Reality/Virtual Reality (AR/VR) headsets. This sensor will gather data on eye movements (electrooculography - EOG), muscle activity (electromyography - EMG), and brainwaves (electroencephalography - EEG), allowing for the precise prediction of human emotions and responses. The new wearable technology for AR/VR headsets introduces a versatile sensing platform to enable two-way neural communication between users and devices. Its soft, flexible design minimizes motion for accurate data collection, while carbon-based electrodes help maintain a high signal-to-noise ratio. Simultaneously, a piezoelectric sensor detects hand gestures and materials, dynamically enhancing user interaction. This advancement integrates seamlessly with headsets, offering a cost-effective, scalable, and waterproof solution. Drawing from neuroscience, materials science, and artificial intelligence, this interdisciplinary approach expands the possibilities of wearable technology, promising an enhanced user experiences in AR/VR environments. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.