Rollercoaster of Emotions: Exploring Emotions With Virtual Reality

Summary: A virtual rollercoaster ride in combination with EEG helped researchers determine how emotions are processed in the brain.

Source: Max Planck Institute

To the left and right, the landscape drifts idly by, the track in front of you. Suddenly, a fire. The tension builds. The ride reaches its highest point. Only one thing lies ahead: the abyss. Plummeting down into the depths of the earth. These are scenes of a rollercoaster ride as experienced by participants in a recent study at the Max Planck Institute for Human Cognitive and Brain Sciences (MPI CBS) in Leipzig.

However, not in real life, but virtually, with the help of virtual reality (VR) glasses. The aim of the research was to find out what happens in participants’ brains while they experience emotionally engaging situations.

To find out how the human brain processes emotions, highly simplified experiments have been used until now. Researchers would show participants photos of emotional scenes and record their brain activity.

The studies took place under controlled laboratory conditions, so that the results could be easily compared. However, the simulated situations were usually not particularly emotionally arousing and were far removed from the experiences we normally have. This is because emotions are continuously created through an interplay of past experiences and various external influences with which we interact.

With regard to emotions, it is therefore particularly important to create situations that are perceived as real as possible. Only in this way can we assume that the simultaneously measured brain activation comes close to that which occurs in real life outside the laboratory. VR glasses provide a remedy here.

Through them, participants can immerse themselves dynamically and interactively in situations and experience them close to reality. Emotions are thus evoked in a more natural way.

The results of the current study showed that the degree to which a person is emotionally aroused can be seen in a specific form of rhythmic brain activity, the so-called alpha oscillations. Accordingly, the lower the strength of this oscillation in the measured EEG signal, the higher the arousal.

“The findings thus confirm earlier investigations from classical experiments and prove that the signals also occur under conditions that are closer to everyday life,” says Simon M. Hofmann, one of the authors of the underlying study, which has now appeared in the scientific journal eLife.

“Using alpha oscillations, we were able to predict how strongly a person experiences a situation emotionally. Our models learned which brain areas are particularly important for this prediction. Roughly speaking, the less alpha activity measured here, the more aroused the person is,” explains author Felix Klotzsche.

“In the future, it could be possible to apply these findings and methods to practical applications beyond basic research,” adds author Alberto Mariola. VR glasses, for example, are increasingly being used in psychological therapy. Neurophysiological information about the emotional state of patients could lead to an improvement in treatment.

Therapists could, for instance, directly gain an insight into the current emotional feeling during an exposure situation without having to ask the patient directly and thus interrupt the situation.

The scientists investigated these relationships with the help of electroencephalography (EEG), which allowed them to record the participants’ brain waves during the virtual rollercoaster ride—in order to determine what happens in the brain during the ride.

Additionally, the subjects were asked to rate afterwards how excited they were over the course of the VR experience using a video. In this way, the researchers wanted to find out whether the subjective sensations during the ride correlate with the measured data from brain activity.

Since people differ in how much they like to ride on rollercoasters, it was irrelevant whether the situation was perceived as positive or negative. What mattered was the strength of the sensation.

For the evaluation, the researchers used three different machine learning models to predict the subjective sensations as accurately as possible from the EEG data. The authors thereby showed that with the help of these approaches, the connection between EEG signals and emotional feelings can also be confirmed under naturalistic conditions.

Abstract

Decoding subjective emotional arousal from EEG during an immersive virtual reality experience

Immersive virtual reality (VR) enables naturalistic neuroscientific studies while maintaining experimental control, but dynamic and interactive stimuli pose methodological challenges.

We here probed the link between emotional arousal, a fundamental property of affective experience, and parieto-occipital alpha power under naturalistic stimulation: 37 young healthy adults completed an immersive VR experience, which included rollercoaster rides, while their EEG was recorded. They then continuously rated their subjective emotional arousal while viewing a replay of their experience.

The association between emotional arousal and parieto-occipital alpha power was tested and confirmed by (1) decomposing the continuous EEG signal while maximizing the comodulation between alpha power and arousal ratings and by (2) decoding periods of high and low arousal with discriminative common spatial patterns and a long short-term memory recurrent neural network.

We successfully combine EEG and a naturalistic immersive VR experience to extend previous findings on the neurophysiology of emotional arousal towards real-world neuroscience.