Skip to content
CampusPrep
CY-802 (B) · Deep & Reinforcement Learning/Official Syllabus

Deep & Reinforcement Learning (CY-802 (B)) - Official Syllabus

1
Unit 1

History of Deep Learning

  • History of Deep Learning
  • McCulloch Pitts Neuron
  • Thresholding Logic
  • Activation functions
  • Gradient Descent ($GD$)
  • Momentum Based GD
  • Nesterov Accelerated GD
  • Stochastic GD
  • AdaGrad
  • RMSProp
  • Adam
  • Eigenvalue Decomposition
  • Recurrent Neural Networks
  • Back propagation through time ($BPTT$)
  • Vanishing and Exploding Gradients
  • Truncated BPTT
  • GRU
  • LSTMs
  • Encoder Decoder Models
  • Attention Mechanism
  • Attention over images
2
Unit 2

Autoencoders and Regularization

  • Autoencoders and relation to PCA
  • Regularization in auto encoders
  • Denoising auto encoders
  • Sparse auto encoders
  • Contractive auto encoders
  • Bias Variance Tradeoff
  • L2 regularization
  • Early stopping
  • Dataset augmentation
  • Parameter sharing and tying
  • Injecting noise at Input
  • Ensemble methods
  • Dropout
  • Batch Normalization
  • Instance Normalization
  • Group Normalization
3
Unit 3

Greedy Layer wise Pre-training and CNNs

  • Greedy Layer wise Pre-training
  • Better activation functions
  • Better weight initialization methods
  • Learning Vectorial Representations of Words
  • Convolutional Neural Networks
  • LeNet
  • AlexNet
  • ZF-Net
  • VGGNet
  • GoogLeNet
  • ResNet
  • Visualizing Convolutional Neural Networks
  • Guided Back propagation
  • Deep Dream
  • Deep Art
  • Recent Trends in Deep Learning Architectures
4
Unit 4

Introduction to reinforcement learning (RL)

  • Introduction to reinforcement learning ($RL$)
  • Bandit algorithms e28093 UCB, PAC, Median Elimination
  • Policy Gradient
  • Full RL & MDPs
  • Bellman Optimality
  • Dynamic Programming - Value iteration, Policy iteration
  • Q-learning & Temporal Difference Methods
  • Temporal-Difference Learning
  • Eligibility Traces
  • Function Approximation
  • Least Squares Methods
5
Unit 5

Fitted Q, Deep Q-Learning and Advanced RL

  • Fitted Q
  • Deep Q-Learning
  • Advanced Q-learning algorithms
  • Learning policies by imitating Optimal controllers
  • DQN & Policy Gradient
  • Policy Gradient Algorithms for Full RL
  • Hierarchical RL
  • POMDPs
  • Actor-Critic Method
  • Inverse reinforcement learning
  • Maximum Entropy Deep Inverse Reinforcement Learning
  • Generative Adversarial Imitation Learning
  • Recent Trends in RL Architectures

Reference Books

  • Deep Learning, An MIT Press book
  • Pattern Classification
  • Reinforcement Learning: An Introduction
  • Reinforcement Learning: State-of-the-Art
Go to where you left off?

Quick Add to Notes

Save questions, your own notes and screenshots into notes filed by unit. It takes a free account.

Create free account

Have an account? Log in