logo SBA

ETD

Digital archive of theses discussed at the University of Pisa

 

Thesis etd-09202022-195828


Thesis type
Tesi di laurea magistrale
Author
ZONCHEDDU, MICHELE
URN
etd-09202022-195828
Thesis title
Enhancing reliability and performance of a production-ready distributed data ingestion system
Department
INFORMATICA
Course of study
INFORMATICA
Supervisors
relatore Soldani, Jacopo
relatore Zhang, Joy
Keywords
  • distributed system
  • production system
  • performance
  • reliability
  • internship
Graduation session start date
07/10/2022
Availability
Withheld
Release date
07/10/2092
Summary
In this thesis, we discuss the design, implementation, and testing of solutions applied to enhance the performance and resiliency of the component handling the ingestion of events, called Intake. For performance, the so-called “protobuf batching” of events in the TCP Intakes managed to reduce the computational load and halve the size of the TCP fleet, all this being fully transparent to the customers. Regarding resiliency, the migration of an Intake’s dependency to its second version increased even more the decoupling between the two components, making Intake to operate safely in case of a dependency failure. In addition, we simulated how Intake would have reacted during a cloud provider network zonal outage. We investigated the discrepancies between the expected and the actual behavior, and we proposed some solutions for making Intake to react effectively to such a type of outage.
File