This repo accompanies the Introduction to Deep Learning for Natural Language Processing to explain the core concepts of deep learning with emphasis on classifying text as the application. Python
is used
The following topics are covered
- What is deep learning?
- Motivation: Some use cases
- Building blocks of Neural Networks (Neuron, Activation Function, Backpropagation Algorithm)
- Word Embedding
word2vec
- Introduction to
keras
- Multi-layer perceptron
- Convolutional Neural Network
- Recurrent Neural Network
- Challenges in Deep Learning
The first step is to obtain access and register the application to interact with the Twitter API. Once the application has been registered, tweets can be extracted using the tweepy package and the Twitter API. The extracted tweets will be stored in the JSON format. The tweets stored in the JSON format are accessed and and will be used as training data. Word2Vec and a LSTM model will be used to generate new tweets from the training data.
The slides used are available here