View Proposal

---

Proposer

Radu-Casian Mihailescu

Title

Visual Representation Learning - Collaboration with TII

Goal

Description

This master’s thesis proposal explores the use of transfer learning to seamlessly and efficiently combine two (or more) different camera modalities. Concretely, having a dataset containing RGB images and a dataset containing the correlated thermal images, this proposal has the goal of training a representation embedding for the RGB images (e.g. training an encoder-decoder architecture and then only considering the encoder module), and a representation embedding for the thermal images. The latent spaces containing the RGB and thermal images are then linked together (see “ASIF: Coupled Data Turns Unimodal Model to Multimodal Without Training” [1]). The outcome of the proposal is to use these bridged latent spaces to be able to link any previously unseen RGB image to a subset of previously unseen thermal images The project includes collecting datasets from relevant sources, perform the necessary literature review, and using the aforementioned pipeline to provide simulated and experimental results with (simulated and/or) real data.

Resources

Background

 Machine Learning and Deep Learning: Understanding machine learning algorithms, especially those used in Computer Vision, and deep learning frameworks like PyTorch is crucial.  Python Programming: Python is the primary language for most machine learning and NLP tasks, so a strong command of Python is essential.

Url

Difficulty Level

Variable

Ethical Approval

None

Number Of Students

1

Supervisor

Radu-Casian Mihailescu

Keywords

Degrees

Bachelor of Science in Computer Science
Bachelor of Science in Computer Systems
Bachelor of Science in Information Systems
Bachelor of Science in Software Development for Business (GA)
Master of Engineering in Software Engineering
Master of Design in Games Design and Development
Master of Science in Artificial Intelligence
Master of Science in Artificial Intelligence with SMI
Master of Science in Business Information Management
Master of Science in Computer Science for Cyber Security
Master of Science in Computer Systems Management
Master of Science in Computing (2 Years)
Master of Science in Data Science
Master of Science in Human Robot Interaction
Master of Science in Information Technology (Business)
Master of Science in Information Technology (Software Systems)
Master of Science in Network Security
Master of Science in Robotics
Master of Science in Software Engineering
Bachelor of Science in Computing Science
Bachelor of Engineering in Robotics
Bachelor of Science in Computer Science (Cyber Security)
Master of Science in Robotics with Industrial Application
Postgraduate Diploma in Artificial Intelligence