IIRF Online > Development > Data Science > Natural Language Processing > Natural Language Processing with Deep Learning in Python
Natural Language Processing with Deep Learning in Python by Udemy
Complete guide on deriving and implementing word2vec, GloVe, word embeddings, and sentiment analysis with recursive nets
Course Highlights
- Understand and implement word2vec
- Understand the CBOW method in word2vec
- Understand the skip-gram method in word2vec
- Understand the negative sampling optimization in word2vec
- Understand and implement GloVe using gradient descent and alternating least squares
- Use recurrent neural networks for parts-of-speech tagging
- Use recurrent neural networks for named entity recognition
- Understand and implement recursive neural networks for sentiment analysis
- Understand and implement recursive neural tensor networks for sentiment analysis
- Use Gensim to obtain pretrained word vectors and compute similarities and analogies
Skills you will learn!
Curriculum
5 Topics
Introduction Outline and Review
How to Succeed in this Course
Where to get the code / data for this course
Preprocessed Wikipedia Data
How to Open Files for Windows Users
9 Topics
What are vectors?
What is a word analogy?
Trying to find and assess word vectors using TF-IDF and t-SNE
Pretrained word vectors from GloVe
Pretrained word vectors from word2vec
Text Classification with word vectors
Text Classification in Code
Using pretrained vectors later in the course
Suggestion Box
10 Topics
Review Section Intro
Bigrams and Language Models
Bigrams in Code
Neural Bigram Model
Neural Bigram Model in Code
Neural Network Bigram Model
Neural Network Bigram Model in Code
Improving Efficiency
Improving Efficiency in Code
Review Section Summary
14 Topics
Return of the Bigram
CBOW
Skip-Gram
Hierarchical Softmax
Negative Sampling
Negative Sampling - Important Details
Why do I have 2 word embedding matrices and what do I do with them?
Word2Vec implementation tricks
Word2Vec implementation outline
Word2Vec in Code with Numpy
Tensorflow or Theano - Your Choice!
Word2Vec Tensorflow Implementation Details
Word2Vec Tensorflow in Code
Alternative to Wikipedia Data: Brown Corpus
13 Topics
GloVe Section Introduction
Matrix Factorization for Recommender Systems - Basic Concepts
Matrix Factorization Training
Expanding the Matrix Factorization Model
Regularization for Matrix Factorization
GloVe - Global Vectors for Word Representation
Recap of ways to train GloVe
GloVe in Code - Numpy Gradient Descent
GloVe in Code - Alternating Least Squares
GloVe in Tensorflow with Gradient Descent
Visualizing country analogies with t-SNE
Hyperparameter Challenge
Training GloVe with SVD (Singular Value Decomposition)
2 Topics
Pointwise Mutual Information - Word2Vec as Matrix Factorization
PMI in Code
13 Topics
Parts-of-Speech (POS) Tagging
How can neural networks be used to solve POS tagging?
Parts-of-Speech Tagging Baseline
Parts-of-Speech Tagging Recurrent Neural Network in Theano
Parts-of-Speech Tagging Recurrent Neural Network in Tensorflow
How does an HMM solve POS tagging?
Parts-of-Speech Tagging Hidden Markov Model (HMM)
Named Entity Recognition (NER)
Comparing NER and POS tagging
Named Entity Recognition Baseline
Named Entity Recognition RNN in Theano
Named Entity Recognition RNN in Tensorflow
Hyperparameter Challenge II
10 Topics
Recursive Neural Networks Section Introduction
Sentences as Trees
Data Description for Recursive Neural Networks
What are Recursive Neural Networks / Tree Neural Networks (TNNs)?
Building a TNN with Recursion
Trees to Sequences
Recursive Neural Tensor Networks
RNTN in Tensorflow (Tips)
RNTN in Tensorflow (Code)
Recursive Neural Network in TensorFlow with Recursion
4 Topics
(Review) Theano Basics
(Review) Theano Neural Network in Code
(Review) Tensorflow Basics
(Review) Tensorflow Neural Network in Code
3 Topics
Pre-Installation Check
Anaconda Environment Setup
How to install Numpy Scipy Matplotlib Pandas IPython Theano and TensorFlow
7 Topics
How to install wp2txt or WikiExtractor.py
How to Uncompress a .tar.gz file
How to Code by Yourself (part 1)
How to Code by Yourself (part 2)
Proof that using Jupyter Notebook is the same as not using it
Python 2 vs Python 3
Is Theano Dead?
4 Topics
How to Succeed in this Course (Long Version)
Is this for Beginners or Experts? Academic or Practical? Fast or slow-paced?
Machine Learning and AI Prerequisite Roadmap (pt 1)
Machine Learning and AI Prerequisite Roadmap (pt 2)
2 Topics
What is the Appendix?
BONUS
Natural Language Processing with Deep Learning in Python
Related Natural Language Processing Courses
Thank You!
Your review has been submitted successfully.