logo SBA

ETD

Archivio digitale delle tesi discusse presso l’Università di Pisa

Tesi etd-04142023-182141


Tipo di tesi
Tesi di laurea magistrale
Autore
BURDO, ROCCO LUIGI GASPARE
URN
etd-04142023-182141
Titolo
Enhancing the vision performance of a demonstration-based robot programming framework through continuous learning and multi-modal data fusion
Dipartimento
INGEGNERIA DELL'INFORMAZIONE
Corso di studi
INGEGNERIA ROBOTICA E DELL'AUTOMAZIONE
Relatori
relatore Prof. Bicchi, Antonio
relatore Prof. Grioli, Giorgio
relatore Ing. Lentini, Gianluca
Parole chiave
  • Color histogram method
  • YOLO
  • Learning from Demostration
  • Continuous Learning
  • IoU
  • object detection
Data inizio appello
04/05/2023
Consultabilità
Tesi non consultabile
Riassunto
Continuous learning is an approach to machine learning where an algorithm is trained to perform different tasks over time. It acquires knowledge and skills from different past experiences to improve its performance in the future. To achieve continuous learning in the vision system of a demonstration-based robot, we use two methods in combination, YOLO and a colour histogram method.
The multi-modal data fusion of these two methods is achieved using the IoU for the label matching phase and the weighted average for the probability combination phase.
This approach proved to be more successful than using the colour histogram method alone, as it is better able to detect objects with the same colour or objects that undergo an abrupt change in illumination.
File