Skip to content

GauravIyer/MAML-Pytorch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 

Repository files navigation

MAML-Pytorch

This is an easy-to-read, basic implementation of some of the supervised experiments in the paper titled "Model Agnostic Meta Learning for Fast Adaptation of Deep Networks" by Chelsea Finn et al. using PyTorch.

Experiment 1: Training a regression model on a sinusoidal function using MAML, and testing it on a new sinusoidal function, given a small number of samples of the new function.

Experiment 2: Training a Convolutional Neural Network on the Omniglot dataset to perform few shot classification. Evaluation is done using N way K shot classification.

Note: The code in this repository merely implements the experiments in the original paper. It does not guarantee replication of results from the original paper.

Link to Omniglot Dataset: https://github.com/brendenlake/omniglot

For training, the data in "images_background" is used. For testing, the data in "images_evaluation" is used.

What is Meta Learning?

Meta learning aims to create models that can learn new tasks/skills and adapt to new environments fast, with access to few training examples. Also sometimes referred to as "learning to learn".

Refer to these great articles if you're interested and want to know more about the field:

https://lilianweng.github.io/lil-log/2018/11/30/meta-learning.html

https://bair.berkeley.edu/blog/2017/07/18/learning-to-learn/

Model Agnostic Meta Learning for Fast Adaptation of Deep Networks

Link to Original Paper: https://arxiv.org/abs/1703.03400

MAML is an initialisation based meta learning algorithm that is model agnostic i.e. it is compatible with any model trained using gradient descent. It is compatible with a variety of tasks, such as regression, classification and reinforcement learning. This project displays this with respect to regression and classification, as done in the paper.

What's Next?

One could explore advancements in the MAML algorithm, such as the first order modification of MAML, and similar algorithms such as Reptile. On the other hand, one could also look into different approaches to meta learning aside from initialisation based methods, such as metric learning, and model based methods.

About

A Pytorch implementation of MAML

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published