Credits: 4 (3-0-2)
Prerequisites: Any one of ELL409 / ELL784 / AIL701 / COL774/ COL341
Overlaps with: COL775 approx. 80%. APL745 approx. 40%. [COL341, COL774, ELL409, ELL784] < 15%
Description
Introduction to representation learning, limitations of classical ML methods Introduction to DNN Universal approximation theorem, mathematical foundations and introduction to deep architectures, Activation functions, Learning DNN, gradient descent, Computational Graphs and Back Propagation, Regularization - Bias-Variance trade- off, Norm-penalty Early stopping Regularization: Bagging, Boosting, Ada-boost, Dropout, Batch Norm and other regularization techniques Optimization algorithms – SGD, Momentum, RMSProp, Adaptive gradient algorithms (ADAgrad, ADAM etc.) Convolutional Neural Networks (CNNs), Architectures few applications such as Object Localization Detection and Segmentation, Action Classification, sequential Models, BPTI, Problems with Recurrent neural Networks (RNNs), Long Short Term Memory (LSTM) / Gated Recurrent Units (GRUs), Bidirectional LSTMs (BLTSMs), Applications of RNNs to NLP, Language Model Unsupervised representational learning Auto Encoders and its variants, Variational inference and Deep learning: Variational Auto Encoders (VAE) and its variants, Generative Adversarial Networks Graph Convolutional networks (GCNs), Graph Attention Networks (GATs), Deep Reinforcement Learning, Advanced Topics: Fairness and Explainability in DL Adversarial Learning Neuro- Symbolic Reasoning, Neural Architecture Search.
Prerequisite Tree
flowchart TD
AIL721-1235[AIL721]
AIL721-1235 --- Or1236[Any one of]:::empty
Or1236 -.-> ELL409-1237[ELL409]
ELL409-1237 --> MTL106-1237[MTL106]
COL106-1237 --> COL100-1237[COL100]
ELL409-1237 --> COL106-1237[COL106]
Or1236 -.-> ELL784-1238[ELL784]
ELL784-1238 --> MTL106-1238[MTL106]
Or1236 -.-> AIL701-1239[AIL701]
Or1236 -.-> COL774-1240[COL774]
COL774-1240 --> MTL106-1240[MTL106]
COL341-1241 --> COL106-1241[COL106]
Or1236 -.-> COL341-1241[COL341]
COL106-1241 --> COL100-1241[COL100]
COL341-1241 --> MTL106-1241[MTL106]
classDef empty height:17px, fill:transparent, stroke:transparent;
classDef trueEmpty height:0px, width:0px;