Lectures
You can download the lectures here (in PDF format). I will try to upload lectures prior to their corresponding classes.
-
Introduction to Deep Learning
tl;dr: What is deep learning? How is it different from machine learning? What is data representation?
-
Mathematical Building Blocks of Neural Networks
tl;dr: What are building blocks of networks, i.e. tensors? How to train a network with gradient descent and backpropagation?
-
Getting Started with Neural Networks
tl;dr: Getting a taste of deep learning with three examples: sentiment analysis, text classification, and regression.
-
Fundamentals of Machine Learning
tl;dr: A general overview of ML, its branches, data representation, feature engineering, overfitting and regularization.
[slides] -
Computer Vision
tl;dr: A review of ConvNets, data augmentation, pre-training, fine tuning, and visualization.
[slides] -
Processing Text and Sequential Data
tl;dr: Recurrent models, SimpleRNN, LSTM, GRU, word embeddings, vanishing gradient problem, attention mechanism, and ID ConvNets
[slides] -
Advanced Models
tl;dr: Multi input/output models, directed acyclic graphs, weight sharing, callbacks, early-stopping and checkpointing, and Tensorboard.
[slides] -
Generative Deep Learning
tl;dr: Text generation with LSTMs, DeepDream, Neural Style Transfer, concept space, variational autoencoders (VAE), generative adversarial networks (GAN)
[slides] -
TensorFlow 2 Tutorial
tl;dr: A set of tutorials, prepared by IUST, on TensorFlow 2 (basically a mini-course): It covers most of the required materials to start coding in TensorFlow, such as defining the computation, designing the model, working the input pipeline, and many more.
[slides]