# data[].attributes.headline
Paper empirico sobre RV, psicologia y su uso en terapia.

# data[].attributes.subject
Paper empirico sobre RV, psicologia y su uso en terapia.

# data[].attributes.body
Bălan, O., Moise, G., Molvoveanu, A., Leordeanu, M., & Moldoveanu, F. (2020). An investigation of various machine and deep learning techniques applied in autometic fear level detection and acrophobia virtual therapy. Sensors, 20, 1-28.

# data[].attributes.attachment_link.readable_text
Faculty of Automatic Control and Computers, University POLITEHNICA of Bucharest, Bucharest 060042, Romania

Department of Computer Science, Information Technology, Mathematics and Physics, Petroleum-Gas University of Ploiesti, Ploiesti 100680, Romania

Author to whom correspondence should be addressed.

1. Introduction

According to statistics, 13% of the world's population is affected by phobias, a type of anxiety disorder manifested by an extreme and irrational fear towards an object or a situation. 275 million people suffer from anxiety disorders throughout the world and anxiety disorders are ranked as the 6th-most common contributors to global disability [ 1]. Phobias are classified into social phobias (fear of relating to others or speaking in public) and specific phobias (generated by particular objects or situations). Social phobias affect people of all ages, though they usually start to manifest in adolescence. 17% of people with social phobias develop depression. The majority of them turn to medication, and even substance abuse and illegal drugs (nearly 17%) or alcohol (nearly 19%), and only 23% seek specialized help [ 2]. With regard to specific phobias, a significant percent (15-20%) of the world's population faces one specific phobia during their lifetime [ 3]. The most common specific phobias and their prevalence are: acrophobia (fear of height)-7.5%; arachnophobia (fear of spiders)-3.5%; aerophobia (fear of flying)-2.6%; astraphobia (fear of lightning and thunder)-2.1%; and dentophobia (fear of dentist)-2.1%. [ 4]. Specific phobias begin during childhood and can persist throughout one's life, affecting more women than men. Most of these patients do not seek treatment for phobias and, of those who do, only 20% recover completely [ 2].

The treatment for phobias is either medical or psychological. 80% of people suffering from phobias turn to medicines and Cognitive Behavior Therapy (CBT), a form of psychotherapy that encourages patients to modify destructive patterns of cognition and behavior and to replace them with positive thoughts [ 5]. Immersion therapy consists of gradual exposure to anxiety-producing stimuli, in the presence of the therapist who controls the intensity of immersion [ 6]. Thus, the patients are urged to understand their fears and find a way to adjust their attitude towards the anxiety-provoking object/situation in a conscious and apperceptive fashion. The medical or psychological treatment should be continued for as long as required since statistics reveal that phobia tends to relapse in approximately 50% of cases [ 7]. With the technological advancement, Virtual Reality has significantly emerged in recent decades, allowing the design of immersive virtual worlds that provide stimuli in a safe and controlled manner [ 8].

In 1997, Picard published a seminal book entitled Affective Computing, in which are presented the theories and principles of a new interdisciplinary field encompassing computer science, neuroscience, psychology, and engineering [ 9]. Affective Computing (AC) is defined as "computing that relates to, arises from, or influences emotions".

According to Picard, computers need to understand human emotions and even have and express emotions for the purpose of communicating with humans. AC enables an integration of human emotions into technology. The field comprises: the study of affect recognition and generation methods, expressing affection techniques, affect aware systems development, research on the modality in which affect influences human-technology interactions. AC helps people understand psychological phenomena, human behaviors, and to build better software applications [ 10]. AC has many applications in education, game development, health, robots, cyber-psychology, VR, marketing, entertainment, and so on.

The integration of affective information in game development opens the path to new methods of maintaining players' engagement [ 11], by dynamically adjusting game levels difficulty to tailor the users' individual emotional characteristics [ 12]. In healthcare applications, AC involves automatic emotion detection and provides decisions accordingly. Relational agents have been developed in order to help patients in hospitals or to assist childbirth, offering information and emotional support [ 13]. Conversational agents and robots interact with children suffering from ASD, helping them to develop from the socio-emotional point of view [ 14].

In this paper, we propose a VR game for treating acrophobia, based on the idea of real-time automatic adaptation of in-game height exposure according to the subject's level of fear. With physiological signals as input (EEG, GSR and HR), our system determines the subject's current fear level and predicts the next exposure scenario.

The current fear level and the next exposure scenario were obtained using various machine learning (ML) and deep learning (DL) classifiers: Support Vector Machine (SVM), k-Nearest Neighbors (kNN), Linear Discriminant Analysis (LDA), Random Forest (RF), and 4 deep neural network architectural models. The data used for training the classifiers was recorded in a preliminary experiment in which 8 acrophobic subjects were in vivo and virtually exposed to various heights. For computing the accuracy of the classifiers, both a user-dependent and a user-independent modality were used. Therefore, each classifier was trained using the data of the other subjects in the case of the user-independent modality. We calculated cross-validation and test accuracies applying the trained model on the data of the tested user. Moreover, this is the research idea towards which we are inclined, given the fact that training a classifier for every subject is an unfeasible and highly time-consuming activity. On the other hand, in the case of the user-dependent modality, for each subject, each classifier was trained using their own data, obtained from the preliminary experiment. The trained model was then applied on the test records of the same participant. Feature selection was also computed for each classifier in order to improve generalization across subjects.

To validate our method, we performed an experiment with the same 4 acrophobic users, in which they played the proposed acrophobia game twice. The first classifier predicted the current fear level, while the second one estimated the next exposure scenario (or game level to be played next). The results showed a very high cross-validation accuracy on the training set (obtained by the kNN and RF classifiers) and good test accuracies, ranging from 42.5% (for the 4-choice scale) to 89.5% (for the 2-choice scale) (both for SVM, for the player-dependent modality). Also, we determined that the most relevant features for fear level classification were GSR, HR and the values of the EEG in the beta frequency range. For the next exposure scenario prediction, an important role was played by the target fear level.

The paper is organized as follows: Section 2 presents the state of the art regarding the current VR-based therapies, Section 3 introduces a short description of the emotional models and types of physiological signals employed in our research, Section 4 details similar experiments and the modalities in which various machine learning techniques have been used for emotion classification, Section 5 presents our acrophobia game, together with the ML and DL approach for fear level and next exposure scenario prediction, Section 6 provides an insight into the methodology for training, dataset construction and experimental procedure, while Section 7 emphasizes the results of our experiments. Finally, we discuss the research findings in Section 8 and present the conclusions and future work directions in Section 9.

2. VR-Based Phobia Therapy

Virtual Reality has been involved in phobia treatment since the 1990s. In the study presented in [ 15], 60 participants suffering from agoraphobia have been equally divided into two groups: a control group and an experimental group. Eight virtual environment scenes were used to expose 30 participants from the experimental group in session sequences of about 15 min. The Attitude Towards Agoraphobia Questionnaire (ATAQ) and Subjective Unit of Discomfort (SUD) were used as instruments to assess the anxiety states of the subjects. SUD means decreased over the eight sessions, from 5.66 to 2.42, indicating habituation with the agoraphobic stimuli. The results proved that agoraphobic patients can be successfully treated with VR technologies. VR technologies have manifold applications in phobia treatment, from understanding the causes of these disorders, to evaluating and treating them [ 16, 17].

Virtual Reality Exposure Therapy (VRET) is a behavioral treatment for anxiety disorders, including phobias. The patient is immersed in a computer-generated virtual environment which presents stimuli that are dangerous in real-world situations [ 18]. VRET is equally as efficient as the classical evidence-based interventions (CBT and in vivo exposure), provides real-life impact, has good stability of results in time and engages the patients in the therapy as much as in vivo exposure does [ 8, 16]. The existing VRET systems can be classified into platforms, academic research projects or experiments and mobile/desktop game applications.

2.1. Platforms

C2Phobia [ 19] was designed by mental health professionals, psychiatrists, psychologists and psychotherapists. Using a VR headset, the patient is gradually exposed to anxiogenic situations. The system can also be used at home, allowing the specialist to treat patients and prescribe personal exercises at a distance. C2Phobia is recognized as a medical device, a complete therapeutic software, but the developers did not disclose whether they use machine learning techniques or not.

PSIOUS [ 20] provides animated and live VR and Augmented Reality (AR) environments, as well as 360-degree videos for anxiety disorders, fears and phobias treatment. It offers patients monitoring capabilities, generation of automatic reports and the possibility of home training. PSIOUS contains 70 VR scenes. The developers did not disclose whether they used machine learning techniques or not.

Stim Response Virtual Reality [ 21] provides a wide range of virtual worlds for acrophobia, aerophobia and social phobias treatment, as well as physiological data synchronization. The VR and AR scenes change in real time, based on the subject's responses to the environment. It performs automatic data analysis.

Virtual Reality Medical Center [ 22] uses 3D virtual environments, biofeedback and CBT to treat phobias and anxieties (especially pre-surgical anxiety), relieve stress, and teach relaxation skills. Non-invasive physiological monitoring with visual feedback allows control for both the patient and the therapist. Virtually Better [ 23] is a system available only for the therapist's office which is aimed at providing therapeutic applications for treating phobias, job interview anxiety, combat-related post-traumatic stress disorders, and drug or alcohol addiction. Virtually Better has been used by the VR Treatment Program at Duke Faculty [ 24], where the therapist guided the participants through the environment and interacted with them through the entire event. Research studies have indicated that 6 to 12 45-50-minute-long therapy sessions were enough to achieve maximum benefit. The Bravemind system [ 25] was used for treating soldiers who served in Iraq and Afghanistan with anxiety disorders. It works by providing vibrotactile and olfactive sensations associated with war zones. Limbix [ 26] contains interactive scenes made of panoramic images and videos that can be changed by the therapist in real-time. Lastly, PHOBOS [ 27] was designed in consideration of CBT protocols. It provides interactive environments, gradual exposure and realistic crowd and social group dynamics simulations for treating social and specific phobias.

2.2. Academic Research Projects and Experiments

2.3. Mobile/Desktop Game Applications

Some of the most popular desktop game applications available for the Oculus Rift [ 29] and HTC Vive [ 33] headsets are The Climb [ 34], Ritchie's Plank Experience [ 35], Arachnophobia [ 36] and Limelight [ 37]. The first two try to overcome fear of heights, Arachnophobia treats fear of spiders, while Limelight puts the user in front of a crowd with changeable moods where he/she gives lectures or presentations, in order to overcome their fear of public speaking. Samsung Fearless Cityscapes [ 38] and Samsung Fearless Landscapes [ 39] are dedicated to acrophobia therapy and are rendered via Gear VR [ 40] glasses. Hear rate can also be monitored when they are paired with Gear S2 [ 41].

Most of the VR applications mentioned above do not provide any details related to the technologies and the methods used. Thus, we cannot ascertain whether ML techniques were deployed for adapting the therapy. On the other hand, we are interested in building Machine Learning-based applications tailoring therapy to the individual characteristics of each patient.

Our system detects the fear level in real time and automatically selects the next exposure scenario. By training the classifiers in a user-independent way with the data obtained from in vivo and virtual experiments, we aim to construct robust classification models that would accurately evaluate the patients' affective states and adjust the levels of exposure accordingly. Thus, we intend to provide a reliable therapeutic solution for phobia alleviation based on Virtual Reality and human-centered machine learning. Our system can be used in clinics, for home therapy and deployed on mobile devices, incorporating all the advantages of the above-mentioned systems.

3. Emotion Models and Physiological Data

3.1. Emotion Models

Emotion is defined as a feeling deriving from one's circumstances, mood or relationship with others [ 42]. It is a complex psycho-physiological experience generated by the conscious or unconscious perception of an object or situation [ 43], manifested through bodily sensations and changes in mood and behavior. The bodily sensations originate from the autonomic nervous system (increased cardiac activity, dilatation of blood vessels, involuntary changes in the breathing rate), cortex (activation of emotion-related brain areas) and are accompanied by physical expressions such as tremor, crying or running [ 44]. Various classifications of emotions have been proposed, from both the discrete and the dimensional perspective. One of the first categorizations identified six discrete emotions: happiness, sadness, fear, anger, disgust and surprise [ 45]. Consequently, the list was updated with embarrassment, excitement, contempt, shame, pride, satisfaction, amusement, guilt, relief, wonder, ecstasy, and sensory pleasure [ 46]. Complex emotions can be constructed from a combination of basic emotions. Plutchik introduced the wheel of emotions to illustrate how basic emotions (joy versus sadness; anger versus fear; trust versus disgust; surprise versus anticipation) can be mixed to obtain different emotions [ 47]. Plutchik's model is not the only tool used to assess emotional reactions. The Geneva emotional wheel (GEW) uses a circular structure with the axes defined by valence (bipolar subjective evaluation of positive/negative) and control to arrange 40 emotion terms in 20 emotion families [ 48]. The dimensional models organize emotions within a space with two or three dimensions along which the responses vary. Russell's Circumplex Model of Affect [ 49] encompasses valence on the x-axis, indicating the positive or negative component of emotion and arousal along the y-axis, reflecting the degree of mental activation or alertness that is elicited [ 50]. Arousal ranges from inactive (not excited) to active (excited, alert) [ 43]. Besides valence and arousal, a third dimension, called dominance, specifies the degree of control the subject exerts over the stimulus. Dominance ranges from a weak, helplessness feeling to a strong, empowered one. For instance, fear is defined as having low valence, high arousal and low dominance. From the behavioral decision-making perspective, we mention the approach-withdrawal (or appetitive-aversive) motivational model which reflects the tendency of approaching or rejecting the stimulus. According to [ 51], fear is generated by an aversive response that conducts to either active or passive physical reactions.

3.2. Physiological Data

Electroencephalography (EEG) non-invasively measures electrical potentials produced by neural activity which falls in the frequency ranges corresponding to the delta (<3 Hz), theta (3 Hz-8 Hz), alpha (8 Hz-12 Hz), beta (12 Hz-30 Hz) and gamma (>30 Hz) waves. EEG offers high precision time measurements-it can detect brain activity at a resolution of one millisecond-but unfortunately lacks spatial resolution. The recording area of an electrode is approximately one centimeter of the scalp, which corresponds to hundreds of thousands of neurons in the cerebral cortex. Thus, it is difficult to accurately pinpoint the exact source of brain activity or to distinguish between activities occurring at contiguous locations [ 52]. Moreover, EEG signals are prone to electrical interferences or artefacts resulting from body movements (eye blinks, muscular or cardiac activity) or environmental causes.

The ratio of slow waves to fast waves (SW/FW) has a negative correlation with fear [ 65, 66, 67]. There was a statistically significant reduction in the SW/FW ratio (delta/beta and theta/beta) in the left frontal lobe in an experiment where data has been recorded from a single electrode [ 68]. Neutral states are reflected in equal levels of activation in both hemispheres [ 69]. Quantitative EEG studies, and in particular coherence (linear synchronization between EEG signals measured at different brain locations), indicated a lower degree of inter-hemispheric functional connectivity at the frontal region and intra-hemispheric at the temporal region [ 70].

Plethysmography (PPG) is a non-invasive circulatory assessment method that uses an infrared photoelectric sensor to record changes in blood flow from the finger or from the ear lobe. It determines blood volume pulse by calculating how much of the emitted light is reflected back. The PPG values are converted into heart rate, which is measured in beats per minute (bpm). Heart rate variance is a strong indicator of emotion. In [ 71], a decrease in variance while the heart rate was high was an indicator of fear. Heart rate, combined with other variables, can successfully classify emotions [ 72, 73], although in others it was found that it had the smallest contributing factor [ 74].

In conclusion, we consider that the most relevant physiological signals to account for in fear assessment experiments are GSR, HR and the values of the alpha, beta and theta waves. In addition, the ratio of slow/fast waves is a good indicator of fear, together with alpha asymmetry-the difference in cortical activation between the right and left hemisphere in the alpha frequency band.

4. Physiological Data in VR-Based Machine Learning Applications for Treating Phobias

Virtual Reality can induce the same level of anxiety as real-life situations, and physiological data can be used to reflect stress level. In this section, we perform a short review on physiological data analysis in VR and on the ML techniques involved in emotion recognition and phobias treatment.

4.1. Physiological Data in VR-Based Applications for Treating Phobias

In the study presented in [ 79], the authors investigated the physiological responses of both nonphobic and phobic subjects in the VR environment. They monitored the skin resistance (SR), heart rate (HR) and skin temperature of 36 participants suffering from fear of flying and 22 participants with no fear. The anxiety level of the phobic participants was evaluated using Subjective Units of Distress, on a scale from 0 to 100 (0-no anxiety, 100-highest anxiety). The results showed a significant difference in the case of SR between two groups and no major difference in the case of HR and skin temperature. More intensive VR-based therapy sessions applied on the phobic subjects had a greater effect on 33 persons who succeeded to fly by plane after the VR treatment.

More physiological data was recorded in the experiment performed in [ 80], which confirmed the following hypotheses: virtual heights increased the subjects' stress levels and the cognitive load during beam-walking was higher in VR. Heart rate variability, heart rate frequency power, heart rate, electrodermal activity and EEG data have been recorded and analyzed to validate the two hypotheses. Heart rate variability varied from 6.6 beats/min in the unaltered low view to 7 beats/min in low VR conditions and 8.3 beats/min in high VR conditions. Heart rate started from 92 beats/min in unaltered view, continued with 97 beats/min in VR low and 97.1 beats/min in VR high conditions.

Electrodermal activity of five subjects was analyzed in [ 81] to measure stress level in VR conditions. The participants have not been diagnosed with acrophobia, but they claimed a certain discomfort in height situations. Each subject underwent a 15 min session consisting of three sub-sessions: height exposure in the real world (standing on the balcony of a building); height exposure in VR (the users did not interact with the VR environment); and height exposure in VR with VR environment interaction. The results proved that interaction with the environment during phobia treatment is important and that physiological measurements help in assessing emotional states.

Human responses to fear of heights in immersive VR (IVR) conditions were investigated in [ 82]. The authors performed two experiments: the first experiment on 21 subjects with ages ranging from 20 to 32 years and the second on 13 subjects with ages in the interval 20-27 years. During the first experiment, in which the subjects were exposed to four heights: 2, 6, 10, and 14 m in IVR conditions, GSR, heart rate and the participants' view direction were measured. In the second experiment, the subjects were exposed till 40 m in an immersive virtual environment. The authors measured physiological responses and head motion. Also, the participants had to report the perceived anxiety level. The results showed that there was a correlation between the anxiety level and the subjects' head pitch angle and that the anxiety level is accurately visible in phasic skin conductance responses. Also, it was established a correlation between anxiety/height and GSR measurements.

4.2. Machine Learning for Emotion Recognition

Automatic emotion recognition has gained the attention of many researchers in the past few decades. As of now, there are three major approaches to automatic emotion recognition: the first approach consists in analyzing facial expressions and speech, the second approach uses the peripheral physiological signals, and the third approach uses the brain signals recorded from the central nervous system [ 83]. Certainly, a method that will embrace all these three approaches will provide the best results. The emotion recognition models are used in applications such as man-machine interfaces, brain-machine communications, computer-assisted learning, health, art, entertainment, telepresence, telemedicine and driving safety control [ 84, 85, 86].

Machine Learning offers computers the ability to learn from large data sets [ 87]. Among the ML techniques, Deep Learning is increasingly used in various applications, due to its higher accuracy when huge amounts of data are used for training. For emotion recognition, different ML techniques have been employed.

A stack of three autoencoders with two softmax classifiers was used in the EEG-based emotion recognition system proposed in [ 86]. 230 power spectral features of EEG signals extracted in 5 frequency bands (theta, lower alpha, upper alpha, beta and gamma) and the differences between the spectral powers of all the 14 symmetrical pairs of electrodes on the right and on the left hemispheres have been used as inputs for some DL networks. The efficiency of the system was evaluated in four experimental setups: DLN-100 using a DL network with 100 hidden nodes on each layer; DLN-50 using a DL network with 50 hidden nodes; DLN-50 with PCA (Principal Component Analysis to address the overfitting problem); and DLN-50 with PCA and CSA (Covariate Shift Adaptation to solve the problem of non-stationarity in EEG signals). The accuracies obtained for each experiment were: DLN-100: 49.52% for valence and 46.03% for arousal; DLN-50: 47.87% for valence and 45.50% for arousal; DLN-50 with PCA: 50.88% for valence and 48.64% for arousal; DLN-50 with PCA and CSA: 53.42% for valence and 52.03% for arousal.

Bayesian classifiers are used in a multimodal framework for analysis and emotion recognition [ 91]. Eight emotional states: anger, despair, interest, pleasure, sadness, irritation, joy and pride were recognized based on facial expressions, gestures and speech. The authors reported that all emotions except despair can be recognized with more than 70% accuracy and the highest accuracy was recorded for anger recognition (90%) [ 91].

A Deep Convolutional Neural Network-based approach for expression classification on the EmotiW (The Emotion Recognition in the Wild contest) dataset is presented in [ 92]. Seven basic expressions (neutral, happy, surprised, fearful, angry, sad and disgusted) were recognized, with an overall accuracy of 48.5% in the validation set and 55.6% in the test set.

The usage of VR environments as stimuli for human emotion recognition has barely been studied. In most research regarding automatic recognition of human emotions, the stimuli were either images, sequences of films or music. One of the first reports on EEG-based human emotion detection using VR stimuli is presented in [ 93]. Four deep neural networks were tested: standard, deep network with dropout, deep network with L1 regularization and deep network with dropout and L1 regularization. The last one achieved a 79.76% accuracy. Also, a high classification accuracy, close to 96%, was obtained for excitement detection while being immersed in a VR environment.

A more detailed investigation of ML techniques used in emotions classification was performed in [ 95].

Fourteen physiological signals were recorded in VR conditions and used for emotion recognition in [ 96]: EEG f4, vertical and horizontal Electrooculography (EOG), Electromyography (EMG), Electrodermal Activity (EDA), Electrocardiogram (ECG), Chest Respiration (RIP), Abdomen Respiration (RIP), Peripheral Temperature, Heart Rate via PulseOx, Blood Volume (PPG) via PulseOx, Blood Oxygen (SpO2) via PulseOx, Head Acceleration and Rotation, Body Acceleration and Rotation. The Naive Bayes, k-Nearest Neighbor and Support Vector Machine techniques have been used to perform a binary classification: high-arousal or moderate/low arousal. The best accuracy was achieved in the case of SVM (89.19%).

4.3. Machine Learning for Identifying Anxiety Level in Phobia Therapy

In [ 97], a deep convolutional network was used to detect acrophobia level (level 1 = only somewhat strong or not strong, level 2 = moderately strong, level 3 = quite strong, level 4 = very strong). However, a tailored treatment was not performed. Richie's Plank Experience was used as the virtual environment, and EEG data from 60 subjects was acquired to feed a deep learning network model VGG-16. The performance of the model has been measured using the accuracy, recall and precision parameters. The average accuracy obtained was 88.77%.

Currently, VRET is seen as an efficient method for phobia treatment, both from a financial and a comfort point of view. It offers flexibility, confidentiality and trust, encouraging more people to seek treatment [ 16, 96].

As far as we know, the issue of classifying emotion levels in VR conditions, meaning how intensely an emotion is felt based on different factors, has not been yet properly defined.

In the proposed system, we focus our study on the ML and DL methods, which automatically classify fear level using physiological data. The dataset has been acquired in direct relation to our acrophobia therapy application, more specifically, by exposing the users to different heights in both the real-world and virtual environment.

5. The Machine Learning and Deep Neural Networks Approach for the Acrophobia VRET Game

The proposed VR system contains an ML-based decision support that adjusts the playing scenario according to the patient's level of fear. It incorporates a real-time decision engine which uses the patient's physiological data and determines the game level to be played next. In our ML-based decision support, the data obtained from the users contribute to configuring the game in order to suit each patient's individual characteristics.

For this purpose, two classifiers were used: one to estimate the patient's current fear level (C1) and one that determines the appropriate treatment according to the target fear level (C2). In our previous approaches [ 99, 100], we used only deep neural networks as classifiers, but the obtained results pushed us to continue to test with various ML techniques. In this paper, we extended our work by defining a ML-based decision support that relies on various ML techniques such as SVM, kNN, LDA, RF and 4 deep neural network models ( Figure 1).

As in our previous work, we used two different fear level scales [ 99, 100]:

-

2-choice scale, with 2 possible values, 0 and 1. 0 stands for relaxation and 1 stands for fear.

-

4-choice scale, with 4 possible values (0-3). 0-complete relaxation, 1-low fear, 2-moderate fear and 3-high level of anxiety.

The game scenarios consist of different game levels, each game level corresponding to a certain degree of height exposure in different contexts or a combination of certain height exposure degrees. The data recorded in real time from the patient is fed to the C1 classifier and the current fear level (FL cr) is computed. C1 estimates the level of fear the patient currently experiences.

To determine the target fear level (FL t) that ensures a gradual and appropriate exposure to height, we used the following formulas:

if FLcr = = 0 then FLt = 1
if FLcr = =1 then FLt = 0

if FLcr = = 0 or FLcr = = 1 then FLt = FLcr + 1
if FLcr = = 2 then FLt = FLcr
if FLcr= = 3 then FLt = FLcr − 1

The target fear level (FL t), together with the patient's physiological data, are fed to the C2 classifier and the next game scenario (GS pr) is predicted. C2 estimates the phobia treatment.

The user plays the predicted level of the game and new physiological data is acquired. C1 computes a new general fear level and C2 predicts the game scenario to be played next. The process goes on for as long as the patient or the therapist consider appropriate-the patient can exit the game at any time if he/she feels uncomfortable-or a total predefined number of scenarios is reached.

6. Experimental Methodology

The experiment was conducted in summer-autumn 2018 and involved the participation of 8 subjects who played an acrophobia game while their physiological (HR and GSR) and EEG data were recorded. The experiment was approved by the ethics committee of the UEFISCDI project 1/2018 and UPB CRC Research Grant 2017 and University POLITEHNICA of Bucharest, Faculty of Automatic Control and Computers. Prior to the experiment, the subjects signed a consent form and filled in a demographic and a Visual Height Intolerance questionnaire [ 101]. Prior to the tests, they were informed about the purpose of the experiment and research objectives. Moreover, they were presented with the steps of the procedure and the experimenter made sure that they fully understood what they were required to do. From the 8 users (aged 22-50 years, 6 women and 2 men), 2 suffered from a mild form of acrophobia, 4 from a medium-intensity fear of heights and 2 experienced a severe form of height intolerance. This classification resulted by assessing the responses to the Visual Height Intolerance questionnaire. More details can be found in [ 99, 100]. They did not consume coffee or other energizing drinks before the experiment and made sure they had a relaxing sleep in the previous night. With respect to the therapy history, our subjects have not undergone any phobia alleviation treatment beforehand, neither medical nor psychological. Half of the users had previous experience in using VR systems and the others had not. For the second category, we provided some VR introductory sessions to accommodate them with the VR perception. Thus, we explained to them what a VR environment represents, which are the hardware components (VR glasses, controllers, sensors), how they work and how they can be adjusted. We presented the users the actions occurring in the game when each of the buttons from the controllers are pressed. Then, the subjects played a basic demo game which accommodated them with the VR perception.

The EEG data have been acquired using the Acticap Xpress Bundle [ 102] device with 16 dry electrodes, while HR and GSR have been recorded via Shimmers Multi-Sensory [ 103]. The next exposure scenario has been predicted in real-time by C2, based on the EEG, physiological data and the target fear level. The target fear level was calculated according to the formulas mentioned above, by taking into account the patient's current fear level. The current fear level was estimated by C1.

The classifiers we used were: kNN, SVM with linear kernel, RF, LDA and 4 deep neural network models with a varying number of hidden layers and neurons per layer.

6.1. Experiments and Dataset Construction

The 16 dry electrodes of the Acticap Xpress Bundle device [ 102] were placed according to 10/20 system in the following locations: FP1, FP2, FC5, FC1, FC2, FC6, T7, C3, C4, T8, P3, P1, P2, P4, O1 and O2. The log-normalized powers of all the 16 channels in the alpha, beta and theta frequency ranges were recorded and pre-processed in real-time for artefact removal. The ground and reference electrodes were attached to the ears. Using the Shimmer3 GSR+ Unit [ 104] of the Shimmers Multi-Sensory device, we acquired the subjects' electrodermal activity and heart rate values. The Shimmer3 GSR+ Unit, which has Bluetooth connectivity, measures the skin's electrical characteristics in microSiemens and captures a PPG signal (using the Shimmer optical pulse probe) that is later converted to estimate heart rate (HR).

The two classifiers C1 and C2 have been fed with training data originating from two preliminary experiments where the subjects have been both in vivo and virtual y exposed to the first, fourth and sixth floors of a building, as well as on the ground floor, at 4 m, 2 m and a few centimeters away from a terrace's railing. In the virtual environment, the players have been also exposed to the view from the building's rooftop. The experiment in the virtual environment (consisting of three sessions, expanded over three days) has been preceded and succeeded by a real-world session. The EEG, GSR and HR data has been collected, together with the user's perceived level of fear, called Subjective Unit of Distress (SUD), during each trial. Each patient was required to rate his/her fear on the 11-choice scale, a gradual scale with values from 0 to 10, where 0 corresponds to complete relaxation and 10 to extreme fear. The modality of reporting the SUD was verbally for the in vivo experiment and by pointing a virtual laser with the controller on a panel in the virtual environment ( Figure 2).

The acrophobia game was rendered on the HTC Vive head-mounted display [ 33]. Interaction in the virtual environment was ensured through the controllers, so that the player advances in the game by teleportation-he/she presses on the floor in the virtual environment at various positions where he/she wants to go, is free to navigate wherever he/she wants, but he/she has to accomplishes the tasks of collecting coins of different colors (bronze, silver and gold) at 4 m, 2 m and 0 m distance from the balcony's railing at ground level and at the first, fourth, sixth floors, as well as on the roof of the building. A coin is collected by bending and grabbing it with the controller. The game contained only visual and vestibular stimuli. There were no audio cues or animations to accompany the graphical presentation.

In both the real-world and virtual environment, each user totalized several 63 trials (3 sessions × 5 building levels × 3 distances from the railing = 45 in the virtual environment and 2 sessions × 3 building levels × 3 distances from the railing = 18 in the real-world environment). We thus obtained a dataset of 25,000 entries on average for each patient, which was saved in a database and used for training classifiers C1 and C2.

For training C1, we had as input features the physiological data recorded during the 63 trials-the EEG log-normalized powers of the 16 channels in the alpha, beta and theta frequencies, the GSR and HR values. The output feature was the fear level (SUD) on three scales: the 11-choice scale (values as they were recorded, ranked from 0 to 10), 4-choice (fear rates from 0 to 3) and 2-choice (values of either 0 or 1).

The ratings from the 11-choice-scale have been grouped into 4 clusters in order to create the 4-choice-scale ( Table 2):

Similarly, the ratings from the 4-choice-scale have been grouped into 2 clusters in order to create the 2-choice scale:

The classifiers we used were: kNN, SVM with linear kernel, RF, LDA and 4 deep neural network models with different numbers of hidden layers and neurons per hidden layer. We have chosen these classifiers because they have been widely used in the literature (see Section 4.2 and Section 4.3). SVM provides the best results for emotion classification. kNN is used for signal classification. LDA has been used for binary and multi-class classification, being highly employed in the medical field. RF is a top classifier and the deep neural networks provide good classification results due to their ability to learn high-level features from large amounts of data in an incremental way.

The Sequential Forward Selection (SFS) feature selection algorithm was applied for kNN, RF and LDA. kNN is a non-parametric, feature similarity-based method used especially for classifying signals and images. The decision is made by taking into account the class of the majority of the k-nearest neighbors. SVM is a supervised machine learning algorithm that finds the hyperplane best segregating two or more classes. RF operates by constructing an ensemble of decision trees. The predicted class is obtained by combining the prediction of all individual trees, based on the "bagging" method stating that a combination of learning models increases the overall result. LDA is a dimensionality reduction technique that projects the dataset onto a lower dimensional space and finds the axes that maximize the separation between multiple classes, avoiding overfitting and reducing the computational cost. All these algorithms were run in Python, using their corresponding implementations from the scikit-learn library [ 105].

Finally, the model version with the highest accuracy for each network has been selected and further used in the experiment. This procedure was repeated for every user, for the 2-choice, 4-choice and 11-choice scales. This technique was applied and published in [ 99, 100]. In the current stage of research, we also trained ML classifiers (kNN, RF, LDA and SVM) in the same way-for every user, 10 times, for each fear scale-and the model providing the highest accuracy was saved for further use.

Classifier C2 predicts the game level that should be played next, i.e., the next exposure scenario (parameter GS pr). The Sequential Forward Selection (SFS) feature selection algorithm has been applied for kNN, RF and LDA. For training C2, the deep learning and machine learning models received as inputs the EEG, GSR, HR and SUD values, while the output represented an encoding of the height where these physiological values have been recorded-0 for ground floor, 1 for the first floor, 2 for the fourth floor, 3 for the sixth floor, and 4 for the roof of the building. For testing classifier C2, we provide as input EEG, GSR, HR and target fear level (FLt) and obtain as output the encoding of the height where the player should be taken to in the game (from 0 to 4, as mentioned above). Thus, if the user is currently feeling anxious (FLcr = 3), we calculate a target fear level FLt = 2 (so we want him to feel less anxious) and feed this value as input to classifier C2 in order to generate for us the next exposure scenario GSpr, on a scale from 0 to 4: 0 for ground floor, 1 for the first floor, 2 for the fourth floor, 3 for the sixth floor and 4 for the roof of the building.

The same DNN models were used for classifier C1, with the same number of hidden layers and neurons on each hidden layer ( Table 3). Each network had an input layer of 51 neurons (16 neurons for the alpha values, 16 for the beta values, 16 for the theta values, 1 for GSR, 1 for HR and 1 for the "target fear level" feature). The output represented the level in the building from where the user should restart playing the game. The method for obtaining a personalized height exposure model to be validated on test dataset was: we repeated the 10-fold cross-validation procedure 10 times for each subject and saved the weights and the corresponding accuracies of each network in .hdf5 files; the model version with the highest accuracy for each network has been selected and further used in the experiment for all fear scales.

The ML classifiers (kNN, RF, LDA and SVM) were trained in the same way-for every user, 10 times, for each fear scale-and the model resulting in the highest accuracy was saved for further use. For cross-validation, the data has been divided into 70% training and 30% test.

For computing the accuracy of the classifiers, both a user-dependent and a user-independent modality were used. Each classifier was trained using the data of the other subjects in the user-independent modality. We applied the trained model on the data of the tested user in order to calculate cross-validation and test accuracies. This approach makes it possible to calculate the performance of the classifiers in the worst possible case, where the model lacks user specificity. On the other hand, in the case of the user-dependent modality, for each subject, each classifier has been trained, cross-validated and tested on his/her own data. Feature selection has been also computed for each classifier in order to improve generalization across subjects. We used Sequential Forward Selection (SFS), a greedy algorithm that reduces the d-dimensional space to a k-dimensional space. In our case, we set k to 20, so that it would extract the most relevant 20 features from the total number of 50 features (16 EEG channels for the alpha, beta and theta waves, GSR and HR). The goal of feature selection was two-fold: we wanted to improve the computational efficiency and to reduce the generalization error of the model by removing irrelevant features or noise. SFS has been applied for kNN, RF and LDA.

6.2. The Acrophobia Game

In order to extract the EEG data, we applied a bandpass Butterworth temporal filter, time-based epoching with the epoch duration of 1 s, and then squared the input values using the Simple DSP box from Open Vibe Designer. In addition, we averaged the signal and applied log-normalization using again the Simple DSP box. After all this preprocessing of the raw data, the alpha, beta and theta frequency powers have been extracted ( Figure 3).

All data was denoised and preprocessed in real time by applying a method named "the last correct value", introduced by us. In our preprocessing module, all EEG and physiological data were inspected in real-time. As LSL was pulling sample data from the recording devices, before saving it into the corresponding log files, it was inspected to see if faulty values occur. For instance, if a negative value or one exceeding one and a half than the average of the previous values on a 5-seconds time span appeared, it was replaced with the average of the data recorded in the previous 5 s. If the device malfunctioned since the moment it started recording (suppose it took a longer time to initialize or calibrate), we initialized the last correct value with some average values-4.5 microVolts ² for the EEG log-normalized powers, 1 microSiemens for GSR and 75 bpm for HR. This method has been applied because we could not manually remove the noisy data nor stop the recording whenever such type of artefacts occurred in real-time.

In addition, it was saved in a database in both processed and unprocessed format for ulterior study and analysis. At the start of the game, the user was placed on the ground floor, where he/she had to navigate freely in the scene and collect a bronze, a silver and a gold coin ( Figure 4 and Figure 5). The Shimmers Unit has been attached to the left hand and the right hand has been used for holding the HTC Vive controller. In this way, we tried to reduce the chances of introducing hand movement artefacts in the GSR and HR signals. At all time, the users were required to sit on a chair and move only their head and the right hand.

Consequently, he/she reported the perceived SUD by pointing with a virtual laser on a panel which contained a range of options from 0 to 10 for fear level evaluation. The physiological data were averaged and classifier C1 predicted the subject's current level of fear. To validate the accuracy of C1, we collected self-estimated SUDs. C1 predicted the current fear level based on the classification model created using the data from the previous experiment and a measure of assessing its accuracy was by comparing its output with the SUD perceived and acknowledged by the users directly during gameplay (during each trial of the game, we also asked the users to report the perceived fear level (SUD)). This parameter was called test accuracy. Based on the EEG, physiological data and target fear level (obtained using the fear level estimated by classifier C1), the next level of exposure was determined by classifier C2, either on the 2-choice or on the 4-choice scale.

7. Results

The subjects played the game twice-once using the 2-choice and once using the 4-choice model. During each session, they were exposed to and played 10 scenes. At any time, the users could interrupt the game if they felt uncomfortable or the experimenter could terminate the session whenever he/she observed any abnormal events occurring. However, this was not the case, as all the subjects succeeded in completing both sessions without any difficulties. The maximum cross-validation accuracies on the training dataset and the validation (test) accuracies for each model, for both the player-independent and player-dependent modalities, with and without feature selection, are presented in Table 4, Table 5, Table 6 and Table 7. The Test column for the C2 classifier is empty because we did not use any method for testing the accuracy of C2. This classifier has only been cross-validated on the training dataset.

With SFS feature selection, the most selected features were: for the 2-choice scale-alpha FC2, C3, T8, O2, beta P4, theta C3, T8 and HR; for the 4-choice scale-alpha FC5, C3, T8, P4 and O2, beta FP2, FC5, P4 and theta T8; for the 11-choice scale-alpha FC2, C3, T8, beta FP2, C5 and HR. We observed that the most important features where the alpha values in the right pre-frontal area, left central and right temporal, beta values in the frontal and parietal areas, theta values in the temporal area and the heart rate.

The RF algorithm adds the benefit of computing the relative importance of each feature on the prediction. The implementation in the scikit-learn library measures feature importance by looking at how much the tree nodes using that feature reduce impurity for all the trees in the forest. Table 8 presents the most relevant 15 features, in descending order according to their importance, for the 2-choice, 4-choice and 11-choice scales, for both classifiers, for the player-independent modality. Table 9 contains the same attributes, but for the player-dependent modality. FL t stands for "target fear level", B_ for "beta", A_ for "alpha" and T_ for "theta". Thus, B_C3 represents the beta value of the C3 electrode (central scalp position, left side). A_FC6 represents the alpha value of the FC6 electrode (fronto-central position, right side).

For each relevant feature, we counted the total number of times it appeared across the RF classification model for the 2-choice, 4-choice and 11-choice scales. The maximum is 3 for a feature that is relevant for training on all the three fear estimation scales.

The most relevant features for all 3 fear level estimation scales, for the user-independent modality, for Classifier 1 were: B_T8, A_FP1, T_FC6, B_FP1, B_FC5, A_FC6, B_FC6, B_FC2, B_P3, B_C3, HR and GSR. For Classifier C2, the most relevant features were: B_FP1, B_O2, B_FC2, B_C3, B_T8, B_P3, T_FC6, B_FC5, A_FC6, B_FC6, HR, FL t and GSR. With respect to the user-dependent modality, for Classifier C1, for all 3 fear estimation scales, the most relevant features were: B_P3, B_C3, B_O1, T_FC6, B_FP1, A_FC6, B_P2, A_FP1, B_FC6, B_C4, B_FC2, HR and GSR. With respect to classifier C2, we mention: B_O2, B_FC2, T_FC6, B_FP1, B_FC6, A_FC6, GR, FL t and GSR.

8. Discussion

The results presented in Table 4, Table 5, Table 6 and Table 7 show that the cross-validation and test accuracies obtained after SFS feature selection are lower than those obtained without feature selection. In Table 10, we present the classifiers providing the highest cross-validation and test accuracies for both the player-independent and player-dependent cross-validation and testing methods, on the 2-choice, 4-choice and 11-choice fear scales.

With respect to C1, the classifier predicting fear level, we conclude that the highest cross-validation accuracy (over 98%) was obtained by using either the kNN or RF algorithms, for both the player-independent and player-dependent modalities. The same trend occurs for C2, the classifier predicting the game level to be played next, where very high cross-validation accuracies were recorded by the RF classifier. With respect to the test (or validation) accuracy, for the 2-choice scale, the highest accuracy was obtained by DNN_Model_4 (79.12%) for the player-independent modality and SVM (89.5%) for the player-dependent modality. In the case of the 4-choice scale, the highest accuracies were provided by kNN (52.75%) and SVM (42.5%), respectively. We observed that SVM was very efficient for the player-dependent modality. For the 2-choice scale, both accuracies (79.12% and 89.5%) were higher than the random value of 50% when selecting either 0 or 1 by chance. The same happens in the case of the 4-choice scale, where the random, "by chance" accuracy is 25%. Both the kNN and SVM classifiers provided an accuracy higher than 25% (kNN-52.75% for the player-independent modality-and SVM-42.5% for the player-dependent method).

Both the player-independent and player-dependent training and testing modalities offered good classification results, making it difficult to determine which was best. However, we incline towards using the player-independent one, as we want a more general, less user-specific model.

With respect to features importance (determined by the RF classifier), we observed that GSR, HR and the beta waves play a significant role in fear level prediction for C1. They are followed closely by the alpha and theta activations, but on a lower extent. In the case of C2, the classifier predicting the game level to be played next, the "target fear level" feature, the feature we computed based on the user's current fear level plays a dominant role, not only because it has a high feature importance index determined by the RF classifier, but also because it is selected when using all three fear level estimation scales (2-choice, 4-choice and 11-choice), for both the player-independent and player-dependent modalities. Our findings are in line with the state-of-the-art literature supporting the idea that GSR, HR and the beta waves are related to emotions classification, particularly fear assessment [ 111, 112]. As there are no experiments in which the next game level is predicted based on physiological data, we cannot compare the results obtained by cross-validating and testing C2. However, it is worth pointing out that the same GSR, HR and EEG features are elicited and, in addition, to emphasize the important role that the "target fear level" feature plays in predicting the next level of in-game exposure.

Our results are comparable to those obtained by Liu et al. [ 12], who used a dynamic difficulty adjustment of game levels based on simple "if" clauses and obtained a classification accuracy of 78%. Having as features both physiological data, Chanel et al. [ 11] reached a classification accuracy of 63% for the detection of 3 emotional classes in an experiment where 20 participants played a Tetris game with 3 levels of difficulty. Without feature selection, the best classifiers obtained an accuracy of 55% for peripheral features and 48% for EEG features. Feature selection increased the accuracy to 59%, respectively, 56%. Our results are also comparable to those obtained by Lisetti et al. [ 113], who achieved a classification accuracy of 84% when distinguishing 6 emotional states elicited by movie clips. However, our modality of providing stimuli is more realistic and immersive, as we used for training and testing the classifiers both in vivo and 3D VR stimuli.

9. Conclusions

The purpose of our research was to develop a VR game with ML-based decision support in order to adapt the levels of exposure to the patients' physiological characteristics. To determine the best ML techniques for acrophobia therapy, several classifiers have been trained: Support Vector Machine, Random Forest, k-Nearest Neighbors, Linear Discriminant Analysis and 4 deep neural network models. We proposed two classifiers: one classifier that estimates the current fear level, based on the user's physiological recordings and one that predicts the next exposure scenario, i.e., the game level to be played next. We used 3 scales of measuring fear level, with 2, 4 and 11 possible responses (2-choice, 4-choice and 11-choice scale). The validation accuracy is defined as the measure of similarity between the fear level estimated by the first classifier and the Subjective Unit of Distress reported by the user during gameplay. For the 2-choice scale, the highest accuracy has been obtained by DNN_Model_4 (79.12%) for the player-independent modality and SVM (89.5%) for the player-dependent modality. In the case of the 4-choice scale, the highest accuracies were obtained using kNN (52.75%) and SVM (42.5%), respectively. The cross-validation scores are very high for both classifiers, with the best accuracies obtained by the kNN and RF techniques. The most important features for fear level classification were GSR, HR and the values of the EEG in the beta range. For next game level prediction, the "target fear level", a parameter computed by taking into account the estimated fear level, played a dominant role in classification.

A future study would be to implement a VR-based game for treating other types of phobias. Moreover, we will extend the experiments and involve more subjects, while their physiological responses will be collected and used for training and testing the classifiers. Another direction we will pursue is to perform real-world tests with the 8 acrophobic patients who participated in the current study, expose them to in vivo scenarios and evaluate whether their anxiety levels dropped.

Author Contributions

Conceptualization, O.B. and G.M.; methodology, O.B. and G.M.; software, O.B.; validation, O.B., G.M., A.M., F.M., M.L.; investigation, O.B. and G.M.; resources, A.M. and M.L.; writing-original draft preparation, O.N.; writing-review and editing, O.B. and G.M.; supervision, A.M., M.L. and F.M. All authors have read and agreed to the published version of the manuscript.

Funding

The work has been funded by the Operational Programme Human Capital of the Ministry of European Funds through the Financial Agreement 51675/09.07.2019, SMIS code 125125, UEFISCDI project 1/2018 and UPB CRC Research Grant 2017. This work has been funded in part through UEFISCDI, from EEA Grants 2014-2021, project number EEA-RO-NO-2018-0496.

Conflicts of Interest

The authors declare no conflict of interest.

References

1. Depression and Other Common Mental Disorders: Global Health Estimates; World Health Organization: Geneva, Switzerland, 2017.

2. Olesen, J. What Is Fear? Types of Phobias and Their Meanings. 2015. Available online: https://www.fearof.net/what-is-fear-types-of-phobias-and-their-meanings/ (accessed on 20 October 2019).

3. Olesen, J. Phobia Statistics and Surprising Facts about Our Biggest Fears. 2015. Available online: http://www.fearof.net/phobia-statistics-and-surprising-facts-about-our-biggest-fears/ (accessed on 20 October 2019).

4. Uncover the Facts Behind Our Most Common Phobias [Infographic. (2017)]. Available online: https://blog.nationwide.com/common-phobias-statistics/ (accessed on 20 October 2019).

5. Cognitive Behavioral Therapy. 2018. Available online: https://www.psychologytoday.com/us/basics/cognitive-behavioral-therapy (accessed on 20 October 2019).

6. Lamson, R.J. Virtual Reality Immersion Therapy for Treating Psychological, Psychiatric, Medical, Educational and Self-Help Problems; U.S. Patent Office: San Rafael, CA, USA, 2002.

7. Fadden, H. Acrophobia (Definition, Causes, Symptoms and Treatment). 2018. Available online: https://www.thehealthyapron.com/acrophobia-definition-causes-symptoms-treatment.html (accessed on 20 October 2019).

8. Picard, R.W. Affective Computing; MIT Press: Cambridge, MA, USA, 1997. [Google Scholar]

9. Calvo, R.; D'Mello, S.; Gratch, J.; Kappas, A. Introduction to Affective Computing. In The Oxford Handbook of Affective Computing; Calvo, R., D'Mello, S., Gratch, J., Kappas, A., Eds.; Oxford University Press: Oxford, UK, 2015; pp. 1-8. [Google Scholar]

10. Bickmore, T.W. Relational Agents in Health Applications: Leveraging Affective Computing to Promote Healing and Wellness. In The Oxford Handbook of Affective Computing; Calvo, R., D'Mello, S., Gratch, J., Kappas, A., Eds.; Oxford University Press: Oxford, UK, 2015; pp. 537-558. [Google Scholar]

11. Messinger, D.S.; Duvivier, L.L.; Warren, Z.E.; Mahoor, M.; Baker, J.; Warlaumont, A.S.; Ruvolo, P. Affective Computing, Emotional Development, and Autism. In The Oxford Handbook of Affective Computing; Calvo, R., D'Mello, S., Gratch, J., Kappas, A., Eds.; Oxford University Press: Oxford, UK, 2015; pp. 516-536. [Google Scholar]

12. Bălan, O.; Moise, G.; Petrescu, L.; Moldoveanu, A.; Leordeanu, M.; Moldoveanu, F. Towards a Human-Centered Approach for VRET Systems-Case study for acrophobia. In Proceedings of the 28th International Conference on Information Systems Development, Toulon, France, 28-30 August 2019. [Google Scholar]

13. C2Phobia. Available online: https://www.c2.care/en/c2phobia-treating-phobias-in-virtual-reality/ (accessed on 20 October 2019).

14. PSIOUS. Available online: https://www.psious.com/ (accessed on 20 October 2019).

15. Stim Response Virtual Reality. Available online: https://www.biopac.com/application/virtual-reality/ (accessed on 20 October 2019).

16. Virtual Reality Medical Center. Available online: https://vrphobia.com/ (accessed on 20 October 2019).

17. Virtually Better. Available online: www.virtuallybetter.com (accessed on 20 October 2019).

18. VR Treatment Program at Duke University School of Medicine. Available online: https://psychiatry.duke.edu/virtual-reality-therapy-phobias (accessed on 20 October 2019).

19. Bravemind. Available online: http://medvr.ict.usc.edu/projects/bravemind/ (accessed on 20 October 2019).

20. Limbix. Available online: https://www.limbix.com/ (accessed on 20 October 2019).

21. Phobos. Available online: https://samsungvr.com/view/Uu9ME9YXR_B (accessed on 20 October 2019).

22. Activity. Available online: https://www.unitylab.de/ (accessed on 20 October 2019).

23. Oculus Rift. Available online: https://www.oculus.com/?locale=en_US (accessed on 20 October 2019).

24. Microsoft Kinect. Available online: https://developer.microsoft.com/en-us/windows/kinect (accessed on 20 October 2019).

25. HTC Vive. Available online: https://www.vive.com/eu/ (accessed on 20 October 2019).

26. The Climb. Available online: http://www.theclimbgame.com/ (accessed on 20 October 2019).

27. Ritchie's Plank Experience. Available online: https://www.viveport.com/apps/9347a360-c6ea-4e35-aaf1-9fab4f41cb79/Richie's_Plank_Experience/ (accessed on 20 October 2019).

28. Arachnophobia. Available online: https://store.steampowered.com/app/485270/Arachnophobia/ (accessed on 20 October 2019).

29. Limelight. Available online: https://store.steampowered.com/app/544880/Limelight_VR/ (accessed on 20 October 2019).

30. Samsung Fearless Cityscapes. Available online: https://www.oculus.com/experiences/gear-vr/821606624632569/ (accessed on 20 October 2019).

31. Samsung Fearless Landscapes. Available online: https://www.oculus.com/experiences/gear-vr/1290835750988761/ (accessed on 20 October 2019).

32. Samsung Gear V.R. Available online: https://www.samsung.com/global/galaxy/gear-vr/ (accessed on 20 October 2019).

33. Samsung Gear S2. Available online: https://www.samsung.com/global/galaxy/gear-s2/ (accessed on 20 October 2019).

34. Emotion Definition. Available online: https://en.oxforddictionaries.com/definition/emotion (accessed on 20 October 2019).

35. Solomon, C.R. Emotion. Available online: https://www.britannica.com/science/emotion#ref283140 (accessed on 20 October 2019).

36. Plutchik, R. Emotion: Theory, Research, and Experience. In Theories of Emotion: 1; New York Academic: New York, NY, USA, 1980; Volume 1. [Google Scholar]

37. Sacharin, V.; Schlegel, K.; Scherer, K.R. Geneva Emotion Wheel Rating Study (Report); University of Geneva, Swiss Center for Affective Sciences: Geneva, Switzerland, 2012. [Google Scholar]

38. Golumbic-Zion, E. What Is EEG? Available online: https://www.mada.org.il/brain/articles/faces-e.pdf (accessed on 20 October 2019).

39. Solomon, C.R. The Neurobiology of Emotion. Available online: https://www.britannica.com/science/emotion#ref283143 (accessed on 20 October 2019).

40. Petrantonakis, P.G.; Hadjileontiadis, L.J. EEG-based Emotion Recognition Using Hybrid Filtering and Higher Order Crossings. In Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, Amsterdam, The Netherlands, 10-12 September 2009; pp. 1-6. [Google Scholar]

41. Gouizi, K.; Reguig, F.B.; Maaoui, C. Analysis Physiological Signals for Emotion Recognition. In Proceedings of the 2011 7th International Workshop on Systems, Signal Processing and their Applications (WOSSPA), Tipaza, Algeria, 9-11 May 2011; pp. 147-150. [Google Scholar]

42. Muhl, C.; Heylen, D. Cross-Modal Elicitation of Affective Experience. In Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, Amsterdam, The Netherlands, 10-12 September 2019; pp. 1-2. [Google Scholar]

43. Healey, J.A. Affect Detection in the Real World: Recording and Processing Physiological Signals. In Proceedings of the IEEE 3rd International Conference on Affective Computing and Intelligent Interaction, Amsterdam, The Netherlands, 10-12 September 2009; IEEE Press: Amsterdam, The Netherlands, 2009; Volume 1, pp. 729-734. [Google Scholar]

44. Westerink, J.; Ouwerkerk, M.; de Vries, G.-J.; de Waele, S.; van den Eerenbeemd, J.; van Boven, M. Emotion Measurement Platform for Daily Life Situations. In Proceedings of the International Conference (ACII 2009), Amsterdam, The Netherlands, 10-12 September 2009. [Google Scholar]

45. Kritikos, J.; Tzannetos, G.; Zoitaki, C.; Poulopoulou, S.; Koutsouris, D. Anxiety detection from Electrodermal Activity Sensor with movement & interaction during Virtual Reality Simulation. In Proceedings of the 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER), San Francisco, CA, USA, 20-23 March 2019. [Google Scholar]

46. Picard, R.W. Affective Computing. M.I.T Media Laboratory Perceptual Computing Section Technical Report No. 321. 1995. Available online: http://vismod.media.mit.edu/tech-reports/TR-321.pdf (accessed on 20 October 2019).

47. Jerritta, S.; Murugappan, M.; Nagarajan, R.; Wan, K. Physiological Signals Based Human Emotion Recognition: A Review. In Proceedings of the IEEE 7th International Colloquium on Signal Processing and its Applications, Penang, Malaysia, 4-6 March 2011. [Google Scholar] [CrossRef]

48. Wan-Hui, W.; Yu-Hui, Q.; Guang-Yuan, L. Electrocardiography Recording, Feature Extraction and Classification for Emotion Recognition. In Proceedings of the WRI World Congress on Computer Science and Information Engineering Los Angeles, Los Angeles, CA, USA, 31 March-2 April 2009. [Google Scholar]

49. Caridakis, G.; Castellano, G.; Kessous, L.; Raouzaiou, A.; Malatesta, L.; Asteriadis, S.; Karpouzis, K. Multimodal Emotion Recognition from Expressive Faces, Body Gestures and Speech. In Artificial Intelligence and Innovations 2007: From Theory to Applications; Boukis, C., Pnevmatikakis, L., Polymenakos, L., Eds.; Springer: Boston, MA, USA, 2007; Volume 247, pp. 375-388. [Google Scholar]

50. Ng, H.W.; Nguyen, V.D.; Vonikakis, V.; Winkler, S. Deep Learning for Emotion Recognition on Small Datasets using Transfer Learning. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction (ICMI '15), New York, NY, USA, 9-13 November 2015; pp. 443-449. [Google Scholar] [CrossRef]

51. Liu, C.; Rani, P.; Sarkar, N. An Empirical Study of Machine Learning Techniques for Affect Recognition in Human-Robot Interaction. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada, 2-6 August 2005; pp. 1-8. [Google Scholar] [CrossRef]

52. Ray, L.C.; Fukuoka, Y. Machine Learning and Therapeutic Strategies in VR. In Proceedings of the 9th International Conference on Digital and Interactive Arts (Artech 2019), Braga, Portugal, 23-25 October 2019. [Google Scholar]

53. Hu, F.; Wang, H.; Chen, J.; Gong, J. Research on the characteristics of acrophobia in virtual altitude environment. In Proceedings of the 2018 IEEE International Conference on Intelligence and Safety for Robotics, Shenyang, China, 24-27 August 2018. [Google Scholar]

54. Bălan, O.; Moise, G.; Moldoveanu, A.; Leordeanu, M.; Moldoveanu, F. Automatic Adaptation of Exposure Intensity in VR Acrophobia Therapy, Based on Deep Neural Networks. In Proceedings of the Twenty-Seventh European Conference on Information Systems (ECIS2019), Stockholm-Uppsala, Sweden, 8-14 June 2019. [Google Scholar]

55. Bălan, O.; Moise, G.; Moldoveanu, A.; Moldoveanu, F.; Leordeanu, M. Does Automatic Game Difficulty Level Adjustment Improve Acrophobia Therapy? Differences from Baseline. In Proceedings of the VRST '18, Tokyo, Japan, 28 November-1 December 2018. [Google Scholar] [CrossRef]

56. Acticap Xpress Bundle. Available online: https://www.brainproducts.com/productdetails.php?id=66 (accessed on 20 October 2019).

57. Shimmers Multisensory. Available online: http://www.shimmersensing.com/ (accessed on 20 October 2019).

58. Shimmer3 GSR+ Unit. Available online: https://www.shimmersensing.com/products/shimmer3-wireless-gsr-sensor (accessed on 20 October 2019).

59. Scikit Learn Python Library. Available online: http://scikit-learn.org (accessed on 20 November 2018).

60. Tensor Flow Python Framework. Available online: https://www.tensorflow.org/ (accessed on 20 October 2019).

61. Keras Library. Available online: https://keras.io/ (accessed on 20 October 2019).

62. Unity Game Engine. Available online: https://unity.com/ (accessed on 20 October 2019).

63. Open Vibe. Available online: http://openvibe.inria.fr/ (accessed on 20 October 2019).

64. Lab Stream Layer. Available online: https://github.com/sccn/labstreaminglayer (accessed on 20 October 2019).

# data[].attributes.attachment_link.title
An Investigation of Various Machine and Deep Learning Techniques Applied in Automatic Fear Level Detection and Acrophobia Virtual Therapy

# data[].attributes.attachment_link.description
In this paper, we investigate various machine learning classifiers used in our Virtual Reality (VR) system for treating acrophobia. The system automatically estimates fear level based on multimodal sensory data and a self-reported emotion assessment.