View Proposal

---

Proposer

Oliver Lemon

Title

Generative AI, Spoken Language Technology, NLP (various topics)

Goal

Advance the state of the art in Generative AI, NLP, and/or Spoken Language Technology (talking to computers and robots!)

Description

Conversational AI and spoken language technology is a lively research area encompassing a variety of problems such as speech recognition, language understanding, dialogue management, user modelling, language generation, and Natural Language Processing (NLP) in general. Since the arrival of ChatGPT and similar models, many conversational systems are now built using generative AI methods such as LLMs. For this project you can choose from a variety of topics listed below or propose your own. All must involve an evaluation of what you have achieved (e.g. compared to previous state-of-the-art approaches / systems/ components). - Integrating conversational AI and SDS with graphical talking head / Virtual Characters. e.g. use the FurHat robot head, ARI robot. You may wish to use generative AI models such as GPT, LLAMA etc - using generative AI models in video games (e.g. NPCs, player assistant, visually-aware companion....) - Integrating conversational AI and SDS with vision systems. You may wish to use generative AI vision-and-language models such as LLAVA - Safety and ethical issues of generative AI models - Task-based conversational systems - Your own topic that involves state-of-the-art research in talking to computers. E.g. Personalised or Emotional Natural Language Generation, Machine Learning methods for optimization of NLP, etc. Make sure that there is a method for evaluating your proposed advances! You will need to take course F20CA / F21CA to do this project.

Resources

FurHat robot head, Google ASR, Google Speech API, RASA tools, LLAMA, LLAVA, AutoGen

Background

AI, NLP, python, natural language processing, Conversational Agents F20/21CA

Url

External Link

Difficulty Level

Moderate

Ethical Approval

InterfaceOnly

Number Of Students

4

Supervisor

Oliver Lemon

Keywords

ai, generative ai, llm, speech, conversation, robotics, human-robot interaction, nlp, evaluation, safety

Degrees

Bachelor of Science in Computer Science
Master of Engineering in Software Engineering
Master of Design in Games Design and Development
Master of Science in Artificial Intelligence
Master of Science in Artificial Intelligence with SMI
Master of Science in Computing (2 Years)
Master of Science in Data Science
Master of Science in Human Robot Interaction
Master of Science in Robotics
Master of Science in Software Engineering
Bachelor of Engineering in Robotics
Master of Science in Robotics with Industrial Application
Postgraduate Diploma in Artificial Intelligence