Computer-Brain Interface for Display Control

The basis of the NASA innovation is the brain signal created by flashing light, referred to as a Visually-Evoked Cortical Potential (VECP). The VECP brain signal can be detected by electroencephalogram (EEG) measurements recorded by electrode sensors placed over the brain’s occipital lobe. In the case of the NASA innovation, the flashing light is embedded as an independent function in an electronic display, e.g. backlit LCD or OLED display. The frequency of the flashing light can be controlled separate from the display refresh rate frequency so as to provide a large number of different frequencies for identifying specific display pixels or pixel regions. Also, the independently controlled flashing allows flashing rates to be chosen such that the display user sees no noticeable flickering. Further, because the VECP signal is correlated with the frequency of the signal in specific regions of the display, the approach determines the absolute location of eye fixation, eliminating the need to calibrate the gaze tracker to the display. Another key advantage of this novel method of brain-display eye gaze tracking is that it is only sensitive to where the user is focused and attentive to the information being displayed. Conventional optical eye tracking devices detect where the user is looking, regardless of whether they are paying attention to what they are seeing. <br>An early-stage prototype has proven the viability of this innovation. NASA seeks partners to continue development and commercialization. NASA has developed a novel brain-computer display interface to improve a user’s ability to interact with a computer by automatically and continuously locating the position of the user’s gaze on a computer display. This interaction can significantly increase the user’s ability to communicate with the computer and the systems the computer controls. Compared to commercial optical eye tracking devices, the NASA innovation relies on matching signals from the visual cortex region of the brain to invisible signals embedded in the display information to directly determine the location on the display where the user is looking. A few electrodes arranged over the back part of the user’s head are used to capture these brain signals. Importantly, the NASA innovation indicates eye gaze location only on the area of the display where the user is focused or paying attention, not simply where the user is looking. This technology may be paired with other eye gaze technology to provide robust gaze tracking without requiring the user to calibrate the gaze tracking system. The inventors developed this innovation specifically for aircraft and space vehicle cockpits where users rely heavily on computer display interaction but also have many other competing distractions and actions.