Practical Learning To Learn

Please log in to watch this conference skillscast.

Gradient descent continues to be our main work horse for training neural networks. One recurring problem though is the large amount of data required. Meta learning frames the problem not as learning from a single large dataset, but learning how to learn from multiple related smaller datasets. In this talk we'll first discuss some key concepts around gradient descent; fine-tuning, transfer learning, joint training and catastrophic forgetting and compare them to how simple meta learning techniques can make optimisation feasible for much smaller datasets.

YOU MAY ALSO LIKE:

• Self supervised learning & making use of unlabelled data. (SkillsCast recorded in June 2020)
• Making The Black Box Transparent: Lessons in Opacity (SkillsCast recorded in May 2019)
• Game Engines and Machine Learning: Training a Self-Driving Car Without a Car? (SkillsCast recorded in May 2019)