logo SBA

ETD

Archivio digitale delle tesi discusse presso l’Università di Pisa

Tesi etd-10262021-105845


Tipo di tesi
Tesi di laurea magistrale
Autore
BALESTRI, FEDERICO
URN
etd-10262021-105845
Titolo
Emotion recognition using multimodal features and subject-adaptive Convolutional Neural Networks
Dipartimento
INGEGNERIA DELL'INFORMAZIONE
Corso di studi
ARTIFICIAL INTELLIGENCE AND DATA ENGINEERING
Relatori
relatore Prof. Cimino, Mario Giovanni Cosimo Antonio
relatore Prof.ssa Vaglini, Gigliola
relatore Dott. Alfeo, Antonio Luca
Parole chiave
  • affecting computing
  • convolutional neural network
  • deep learning
  • electroencephalogram
  • emotion recognition
  • explainable artificial intelligence
  • grad-cam
  • interpretable machine learning
  • transfer learning
Data inizio appello
19/11/2021
Consultabilità
Completa
Riassunto
In recent years, it has become more and more important to detect and recognize the emotion in computer systems which people interact with via BRI (Brain Computer Interface). Among the various types of BCI, one of the most common is the EEG (Electroencephalogram).
In this thesis, we perform emotion recognition using EEG features and BHI (Brain-Heart Interplay) features as input for a subject-adactive Convolutional Neural Network. We test our method on the publicly available DEAP and MAHNOB databases, for each of which we perform experiments subject-specific, subject-independent and fine-tuned leave-one-subject-out.
The grad-CAM visualization technology is also applied to show an intutive representation of the feature importance.
File