logo SBA

ETD

Digital archive of theses discussed at the University of Pisa

 

Thesis etd-05232019-155650


Thesis type
Tesi di laurea magistrale
URN
etd-05232019-155650
Thesis title
An Empirical Comparison of Recurrent Neural Networks on Sequence Modeling
Department
INFORMATICA
Course of study
INFORMATICA
Supervisors
.
relatore Prof. Micheli, Alessio
relatore Dott. Gallicchio, Claudio
Keywords
  • machine learning
  • neural networks
  • reti neurali
Graduation session start date
14/06/2019
Availability
Withheld
Release date
14/06/2089
Abstract (Inglese)
Abstract (Italiano)
Recurrent Neural Networks (RNNs) are amongst the most powerful Machine Learning models to deal with sequential data. Many RNN architectures have been proposed over the years. We review three of the most used RNN architectures: the Standard Recurrent Network, the Long Short-Term Memory and the Gated Recurrent Unit. Furthermore, the Reservoir Computing (RC) has emerged as an alternative paradigm in the area of RNNs, whose the Echo State Network represents the most used model. In addition, minimum complexity RC-based networks have been developed, such as the Delay Line Reservoir and the Simple Cycle Reservoir.. We conduct several experiments on a varied set of problems, in order to compare their performances and analyze their correlation. Furthermore, we create a software framework to build RC models.
File