View Proposal
-
Proposer
-
Oliver Lemon
-
Title
-
Speech Interfaces for Role-playing games
-
Goal
-
Build and evaluate a speech interface for an RPG
-
Description
- There are interesting opportunities in adding speech and dialogue capabilities into video games -- for example making game characters that you can really talk to.
New LLMs (large language models) such as GPT 4 are now being used to create games and conversational game characters, see https://en.wikipedia.org/wiki/AI_Dungeon
This project could explore such systems and LLMs and integrate them a into a game engine. For example to drive conversations with NPCs, or develop a visually-aware conversational game companion, search lore etc.
See e.g. https://www.youtube.com/watch?v=DRVCkUN_Mq8 for inspiration
See also
https://www.youtube.com/watch?v=rlZfTHyu5wI&t=34s
You will evaluate the usability and entertainment value of this system versus the baseline game.
See e.g. http://www.voiceattack.com/
This project can be done in collaboration with an industrial partner, for example SpeechGraphics, and
is also suitable for DataLab students.
See https://arxiv.org/html/2402.18659v1 for a recent survey of this area
- Resources
-
A moddable RPG, e.g. Skyrim; Witcher; etc
-
Background
-
AI, speech, and/or games
-
Url
-
External Link
-
Difficulty Level
-
Moderate
-
Ethical Approval
-
InterfaceOnly
-
Number Of Students
-
3
-
Supervisor
-
Oliver Lemon
-
Keywords
-
ai, games, generative ai, llms, speech, evaluation
-
Degrees
-
Bachelor of Science in Computer Science
Master of Engineering in Software Engineering
Master of Design in Games Design and Development
Master of Science in Artificial Intelligence
Master of Science in Artificial Intelligence with SMI
Master of Science in Computing (2 Years)
Master of Science in Data Science
Master of Science in Human Robot Interaction
Master of Science in Robotics
Master of Science in Software Engineering
Bachelor of Science in Computing Science
Bachelor of Engineering in Robotics
Master of Science in Robotics with Industrial Application
Postgraduate Diploma in Artificial Intelligence