View Proposal

---

Proposer

Oliver Lemon

Title

Conversational AI for Blind and Partially Sighted users

Goal

To develop and evaluate a conversational system that helps blind people to find out about objects and places around them

Description

You will use a generative AI vision-and-language model such as LLAVA to create a spoken dialogue system which blind/partially sighted people can use to find out about the objects and places near them. For example "Is there somewhere I can sit down?" - "Yes, there is a chair on your left, about 2 metres away" {user moves} "Where is it now?" "The chair is right ahead of you, about 50 centimetres away" You will evaluate the system that you create by using images on a screen that sighted users can ask questions about. You will need to take course F20CA / F21CA to do this project.

Resources

Generative vision-and-language model such as LLAVA

Background

AI, Conversational agents F21CA

Url

External Link

Difficulty Level

Moderate

Ethical Approval

InterfaceOnly

Number Of Students

2

Supervisor

Oliver Lemon

Keywords

generative ai, computer vision, nlp, assistive technology

Degrees

Bachelor of Science in Computer Science
Master of Science in Artificial Intelligence
Master of Science in Artificial Intelligence with SMI
Master of Science in Data Science
Master of Science in Human Robot Interaction
Master of Science in Robotics
Master of Science in Software Engineering
Bachelor of Science in Computing Science
Master of Science in Robotics with Industrial Application