Skip to content

karinanguyen/deep-learning-experiments

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Deep Learning Experiments: Style Transfer, Image Captioning

Style Transfer

Implemented the style transfer technique from "Image Style Transfer Using Convolutional Neural Networks" (Gatys et al., CVPR 2015). The general idea is to take two images, and produce a new image that reflects the content of one but the artistic "style" of the other.

Screen Shot 2021-05-30 at 12 12 39 AM Screen Shot 2021-05-30 at 12 13 09 AM Screen Shot 2021-05-30 at 12 14 54 AM

RNN & LSTM Captioning

Vanilla recurrent neural networks to train a model that can generate novel captions for images. Used the 2014 release of the Microsoft COCO dataset for image captioning, which consists of 80,000 training images and 40,000 validation images, each annotated with 5 captions.

Screen Shot 2021-05-30 at 12 02 09 AM Screen Shot 2021-05-30 at 12 03 06 AM

Vanilla RNNs can be tough to train on long sequences due to vanishing and exploding gradiants caused by repeated matrix multiplication. LSTMs solve this problem by replacing the simple update rule of the vanilla RNN with a gating mechanism as follows.

Screen Shot 2021-05-30 at 12 04 09 AM Screen Shot 2021-05-30 at 12 04 55 AM

About

Deep Learning Experiments: Style Transfer, Image Captioning

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages