ETD

Archivio digitale delle tesi discusse presso l'Università di Pisa

Tesi etd-09042022-115258


Tipo di tesi
Tesi di laurea magistrale
Autore
BIONDI, LORENZO
URN
etd-09042022-115258
Titolo
AI-Assisted 3D Human Head Keypoint Matching for Image Pair Alignment
Dipartimento
INGEGNERIA DELL'INFORMAZIONE
Corso di studi
ARTIFICIAL INTELLIGENCE AND DATA ENGINEERING
Relatori
relatore Prof. Falchi, Fabrizio
relatore Dott. Di Benedetto, Marco
relatore Prof. Tonellotto, Nicola
relatore Dott. Carrara, Fabio
Parole chiave
  • neural network
  • computer vision
  • deep learning
  • artificial intelligence
  • convolutional neural network
  • geometric alignment
  • medical imaging
  • volumes processing
  • 3D
  • data augmentation
  • explainable AI
  • hyperparameters tuning
Data inizio appello
23/09/2022
Consultabilità
Non consultabile
Data di rilascio
23/09/2062
Riassunto
This thesis work is about identifying, through a Computer Vision approach, specific keypoints within MR (”Magnetic Resonance”) volumes of human heads. Such keypoints can be exploited to align the volumes with other targets, such as the Augmented Reality representation of the users' heads or other scanned images. The first phase of the study focused on the identification of training and test datasets, the selection of four non-coplanar points of interest for the alignment, and the identification of the most appropriate neural network architecture to individuate such points. In particular, different 3D CNN ("Convolutional Neural Network") architectures were tested, with different sets of hyperparameters and exploiting multiple volume sampling frequencies. Moreover, we designed a customized data augmentation procedure in order to enlarge the available training samples and better the network generalization capabilities. Once obtained a model with sufficient performances for the alignment, the following steps were the implementation of the prediction phase in JavaScript and, finally, the image-to-image alignment. The dataset collection and keypoints annotation, together with the final model, are an evident contribution of this thesis work to the state of the art.
File