logo SBA

ETD

Digital archive of theses discussed at the University of Pisa

 

Thesis etd-11142021-211008


Thesis type
Tesi di laurea magistrale
Author
SANGERMANO, MATTIA
email address
m.sangermano1@studenti.unipi.it, mattiasangermano1997@gmail.com
URN
etd-11142021-211008
Thesis title
Sample condensation in Online Continual Learning
Department
INFORMATICA
Course of study
INFORMATICA
Supervisors
relatore Prof. Bacciu, Davide
relatore Dott. Carta, Antonio
Keywords
  • dataset condensation
  • machine learning
  • online continual learning
Graduation session start date
03/12/2021
Availability
Withheld
Release date
03/12/2091
Summary
Continual learning is a Machine Learning paradigm that studies the problem of learning from a potentially infinite sequence of tasks. The main challenge of Continual Learning is to avoid the catastrophic forgetting phenomena, namely the problem of forgetting the previously acquired knowledge while learning new tasks. We developed a replay-based continual Learning strategy based on the use of Knowledge Condensation techniques to mitigate the catastrophic forgetting problem. These techniques are used to save and compress, in an external memory, the knowledge extracted from the examples provided by the input data stream. The developed strategy is applied to Online Continual Learning, a scenario in which, unlike Continual Learning, the input data stream has no task boundaries, thus it is considered more challenging. The proposed approach is compared with state of the art Online Continual Learning strategies.
File