Thesis etd-09202022-195828 |
Link copiato negli appunti
Thesis type
Tesi di laurea magistrale
Author
ZONCHEDDU, MICHELE
URN
etd-09202022-195828
Thesis title
Enhancing reliability and performance of a production-ready distributed data ingestion system
Department
INFORMATICA
Course of study
INFORMATICA
Supervisors
relatore Soldani, Jacopo
relatore Zhang, Joy
relatore Zhang, Joy
Keywords
- distributed system
- internship
- performance
- production system
- reliability
Graduation session start date
07/10/2022
Availability
Withheld
Release date
07/10/2092
Summary
In this thesis, we discuss the design, implementation, and testing of solutions applied to enhance the performance and resiliency of the component handling the ingestion of events, called Intake. For performance, the so-called “protobuf batching” of events in the TCP Intakes managed to reduce the computational load and halve the size of the TCP fleet, all this being fully transparent to the customers. Regarding resiliency, the migration of an Intake’s dependency to its second version increased even more the decoupling between the two components, making Intake to operate safely in case of a dependency failure. In addition, we simulated how Intake would have reacted during a cloud provider network zonal outage. We investigated the discrepancies between the expected and the actual behavior, and we proposed some solutions for making Intake to react effectively to such a type of outage.
File
Nome file | Dimensione |
---|---|
The thesis is not available. |