Deep Learning (DL)
AD-601-
Unit 1Introduction to Deep Learning
Biological Neuron · Idea of computational units · McCulloch–Pitts Neural Model · Linear Perceptron · Perceptron Learning · Feed Forward and Back Propagation Networks
-
Unit 2Feedforward Networks
Multilayer Perceptron · Gradient Descent · Backpropagation · Empirical Risk Minimization · Regularization · Autoencoders
-
Unit 3Convolutional Networks
Convolution Operation · Variants of the Basic Convolution Function · Structured Outputs · Efficient Convolution Algorithms · Random or Unsupervised Features · LeNet · AlexNet
-
Unit 4Recurrent Neural Networks
Bidirectional RNNs · Deep Recurrent Networks · Recursive Neural Networks · Long Short-Term Memory (LSTM) · Other Gated RNNs
-
Unit 5Deep Generative Models
Boltzmann Machines · Restricted Boltzmann Machines · MCMC and Gibbs Sampling · Gradient Computations in RBMs · Deep Belief Networks · Deep Boltzmann Machines