logo SBA

ETD

Archivio digitale delle tesi discusse presso l’Università di Pisa

Tesi etd-09202022-195828


Tipo di tesi
Tesi di laurea magistrale
Autore
ZONCHEDDU, MICHELE
URN
etd-09202022-195828
Titolo
Enhancing reliability and performance of a production-ready distributed data ingestion system
Dipartimento
INFORMATICA
Corso di studi
INFORMATICA
Relatori
relatore Soldani, Jacopo
relatore Zhang, Joy
Parole chiave
  • distributed system
  • production system
  • performance
  • reliability
  • internship
Data inizio appello
07/10/2022
Consultabilità
Non consultabile
Data di rilascio
07/10/2092
Riassunto
In this thesis, we discuss the design, implementation, and testing of solutions applied to enhance the performance and resiliency of the component handling the ingestion of events, called Intake. For performance, the so-called “protobuf batching” of events in the TCP Intakes managed to reduce the computational load and halve the size of the TCP fleet, all this being fully transparent to the customers. Regarding resiliency, the migration of an Intake’s dependency to its second version increased even more the decoupling between the two components, making Intake to operate safely in case of a dependency failure. In addition, we simulated how Intake would have reacted during a cloud provider network zonal outage. We investigated the discrepancies between the expected and the actual behavior, and we proposed some solutions for making Intake to react effectively to such a type of outage.
File