Descriptif

Abstract
Deep Learning (machine learning based on deep articial neural
networks) has become extremely popular over the last years due to the
very good results it allows for regression, classication or generation.
The objective of this course is to cover the three main types of
networks (multi-layer-perceptron, recurrent-neural-network and con-
volutional neural network). This course range from the perceptron to
the generation of adversarial images.
Each lesson is followed by a corresponding lab where student learn
to implement these networks using the currently most popular frame-
works (tensor
ow, pytorch and keras).

1 Format
6 sessions of 3.5 hours + Exam
2 Teachers
Georoy Peeters, Alasdair Newson (Telecom Paris)
3 Grading
30% labs/project, 70% written exam

Lectures content
Multi-Layer-Perceptron (MLP)
Perceptron, Logistic Regression, Chain rule, Back-propagation, Deep Neural Acti-
vation functions, Vanishing gradient, Initialization, Regularization (L1,L2,DropOut),
Alternative Gradient Descent, Batch-normalization

Recurrent Neural Network (RNN)
Simple RNN, Forward Propagation, Backward Propagation Through Time, Van-
ishing/ Exploding gradients, Gated Units (LSTM, GRU), Various architectures,
Sequence-to-sequence, Attention model

Convolutional Neural Network (CNN)
CNNs use sparse connectivity and weight sharing to reduce parameters and create
more powerful networks , connections are organized in a convolution operation,
CNNs now provide the state-of-the-art in a vast array of problems, we will see how
CNNs work and we will implement them for classication problems

Labs
Content
 text recognition, sentiment classication
 generating music

image recognition
 image generation
Programming language
 Python (numpy, scikit-learn, matplotlib)
 DL frameworks: tensor
ow, pytorch, keras
 Use Telecom computers, your own labtop or colab.research.google.com !
needs a Google account ! open one before the rst Lab !
 a Graphics Processing Unit (GPU) will not be required, however if you have
one, this will speed up the learning process