DEEP LEARNING

DS-GA 1008 ยท SPRING 2020 ยท NYU CENTER FOR DATA SCIENCE

INSTRUCTORS Yann LeCun & Alfredo Canziani
LECTURES Mondays 16:55 โ€“ 18:35, GCASL C95
PRACTICA Tuesdays 19:10 โ€“ 20:00, GCASL C95
PIAZZA Access code: DLSP20
MATERIAL Google Drive, Notebooks

Description

This course concerns the latest techniques in deep learning and representation learning, focusing on supervised and unsupervised deep learning, embedding methods, metric learning, convolutional and recurrent nets, with applications to computer vision, natural language understanding, and speech recognition. The prerequisites include: DS-GA 1001 Intro to Data Science or a graduate-level machine learning course.

Lectures

Legend: ๐Ÿ–ฅ slides, ๐Ÿ““ Jupyter notebook, ๐ŸŽฅ YouTube video.

Week Format Title Resources
โ‘  Lecture History and motivation ๐Ÿ–ฅ๏ธ ๐ŸŽฅ
Evolution and DL
Practicum Neural nets (NN) ๐Ÿ““ ๐Ÿ““ ๐ŸŽฅ
โ‘ก Lecture SGD and backprop ๐Ÿ–ฅ๏ธ ๐ŸŽฅ
Backprop in practice
Practicum NN training ๐Ÿ–ฅ ๐Ÿ““ ๐Ÿ““ ๐ŸŽฅ
โ‘ข Lecture Parameter transformation ๐Ÿ–ฅ๏ธ ๐ŸŽฅ
CNN
Practicum Natural signals' properties ๐Ÿ–ฅ ๐Ÿ““ ๐ŸŽฅ
โ‘ฃ Practicum 1D convolutions ๐Ÿ““ ๐ŸŽฅ
โ‘ค Lecture Optimisation I ๐Ÿ–ฅ๏ธ ๐ŸŽฅ
Optimisation II
Practicum CNN, autograd ๐Ÿ““ ๐Ÿ““ ๐ŸŽฅ
โ‘ฅ Lecture CNN applications ๐Ÿ–ฅ๏ธ ๐Ÿ–ฅ๏ธ ๐ŸŽฅ
RNNs and attention
Practicum Training RNNs ๐Ÿ““ ๐Ÿ““ ๐ŸŽฅ
โ‘ฆ Lecture Energy-Based Models ๐Ÿ–ฅ๏ธ ๐ŸŽฅ
SSL, EBM
Practicum Autoencoders ๐Ÿ–ฅ๏ธ ๐Ÿ““ ๐ŸŽฅ
โ‘ง Lecture Contrastive methods ๐Ÿ–ฅ๏ธ ๐ŸŽฅ
Regularised latent
Practicum Training VAEs ๐Ÿ–ฅ๏ธ ๐Ÿ““ ๐ŸŽฅ
โ‘จ Lecture - ๐Ÿ–ฅ๏ธ
Word model, GANs
Practicum Training GANs ๐Ÿ–ฅ๏ธ ๐Ÿ““
โ‘ฉ Lecture - ๐Ÿ–ฅ๏ธ
-
Practicum - ๐Ÿ–ฅ๏ธ ๐Ÿ““

People

Role Photo Contact About
Instructor Yann LeCun
yann@cs.nyu.edu
Silver Professor in CS at NYU
and Turing Award winner
Instructor Alfredo Canziani
canziani@nyu.edu
Asst. Prof. in CS at NYU
Assistant Mark Goldstein
goldstein@nyu.edu
PhD student in CS at NYU
Webmaster Zeming Lin
zl2799@nyu.edu
PhD student in CS at NYU
Grader Serkan Karakulak
sk7685@nyu.edu
ย 
Grader Raghav Jajodia
rj1408@nyu.edu
ย 
Grader Priyank Pathak
pp1953@nyu.edu
ย 
Grader Chiao-Hsun Wang
chw371@nyu.edu
ย 
Grader Pedro Vidal
pmh314@nyu.edu
ย 
Grader Bixing Yan
by783@nyu.edu
ย