View Proposal

---

Proposer

Radu-Casian Mihailescu

Title

Understanding and Predicting Delayed Generalization in Neural Networks

Goal

Description

The phenomenon of "grokking"—the sudden, delayed onset of generalization in overparameterized neural networks—has recently attracted attention for its theoretical significance and practical implications. Despite achieving low training error early on, models may not generalize until significantly later, posing challenges for interpretability and training efficiency. This dissertation explores the underlying mechanisms behind grokking and investigates how measurable factors contribute to the emergence of generalization. Research Problem: What mechanisms drive the delayed generalization phenomenon in neural networks, and how can we predict and harness this behavior to improve training efficiency?

Resources

Background

Url

Difficulty Level

Moderate

Ethical Approval

None

Number Of Students

1

Supervisor

Radu-Casian Mihailescu

Keywords

Degrees

Bachelor of Science in Computer Science
Bachelor of Science in Computer Systems
Bachelor of Science in Information Systems
Master of Engineering in Software Engineering
Master of Design in Games Design and Development
Master of Science in Artificial Intelligence
Master of Science in Artificial Intelligence with SMI
Master of Science in Business Information Management
Master of Science in Computer Science for Cyber Security
Master of Science in Computer Systems Management
Master of Science in Computing (2 Years)
Master of Science in Data Science
Master of Science in Human Robot Interaction
Master of Science in Information Technology (Business)
Master of Science in Information Technology (Software Systems)
Master of Science in Network Security
Master of Science in Robotics
Master of Science in Software Engineering
Bachelor of Science in Computing Science
Bachelor of Engineering in Robotics
Bachelor of Science in Computer Science (Cyber Security)
Master of Science in Robotics with Industrial Application
Postgraduate Diploma in Artificial Intelligence
Bachelor of Science in Statistical Data Science
BSc Data Sciences