Credits: 4 (3-0-2)
Prerequisites: Any one of ELL409/ELL774 / COL341/ COL333/ COL671
Overlaps with: AIL721, APL745
Description
Basics: Introduction, Why Deep Learning, Multi-layered Perceptron, Neural Networks as Universal Function Approximators, Backpropagation, Regularization, Ll-L2 Norms, Early Stopping, Dropouts. Optimization: Stochastic Gradient Descent, First-order and second order methods, Algorithms such as RMSProp, Adams, AdaGrad. Other Topics on Advanced Optimization. Convolutional Networks (CNNs) - kernels, pooling operations, Applications to Computer Vision. Recurrent Neural Networks, LSTMs, Attention, Transformers, Language models: BERT, GPT2 etc. Applications in NLP. Generative Models: Variational Auto-encoders, Generative Adversarial Networks (GANs). Graph Convolutional Networks, Graph Attention Networks, and variations. Deep Reinforcement Learning - basics of (Deep) RL, More Advanced topics such as visual question answering, Neuro-symbolic reasoning, self-supervised learning, Explainability and Fairness, Domain Adaptation etc.
Prerequisite Tree
flowchart TD
COL775-1311[COL775]
COL775-1311 --- Or1312[Any one of]:::empty
ELL409-1313 --> MTL106-1313[MTL106]
ELL409-1313 --> COL106-1313[COL106]
Or1312 -.-> ELL409-1313[ELL409]
COL106-1313 --> COL100-1313[COL100]
Or1312 -.-> ELL774-1314[ELL774]
COL106-1315 --> COL100-1315[COL100]
COL341-1315 --> COL106-1315[COL106]
Or1312 -.-> COL341-1315[COL341]
COL341-1315 --> MTL106-1315[MTL106]
COL106-1316 --> COL100-1316[COL100]
Or1312 -.-> COL333-1316[COL333]
COL333-1316 --> COL106-1316[COL106]
COL106-1317 --> COL100-1317[COL100]
COL671-1317 --> COL106-1317[COL106]
Or1312 -.-> COL671-1317[COL671]
classDef empty height:17px, fill:transparent, stroke:transparent;
classDef trueEmpty height:0px, width:0px;