Slides; Deep Learning Summer School 2015

 

 

Figure from Adam Coates's Systems issues and distributed training presentation

 

Here are some of the slides presented at the Deep Learning Summer School 2015. Enjoy !

Day 1, Mon, Aug 3

Pascal Vincent: Intro to ML (9:00-10:30) 

Yoshua Bengio: Theoretical motivations for Representation Learning & Deep Learning (11:00-12:30) 

Leon Bottou: Intro to multi-layer nets (2:00-3:30) 

Day 2, Tue, Aug 4

Hugo Larochelle: Neural nets and backprop (9:00-10:30) 

Leon Bottou: Numerical optimization and SGD, Structured problems & reasoning (11:00-12:30) 

Hugo Larochelle: Directed Graphical Models and NADE (2:00-3:30) 

Intro to Theano (4:00-5:30)

Day 3, Wed, Aug 5

Aaron Courville: Intro to undirected graphical models (9:00-10:30) 

Honglak Lee: Stacks of RBMs (11:00-12:30) 

Pascal Vincent: Denoising and contractive auto-encoders, manifold view (2:00-3:30) 

GPU Programming (4:00-5:30)

Day 4, Th, Aug 6

Roland Memisevic: Visual features (9:00-10:30) 

Honglak Lee: Convolutional networks (11:00-12:30) 

Graham Taylor: Learning similarity  (2:00-3:30) 

Day 5, Fri, Aug 7

Chris Manning: NLP 101 (9:00-10:30) 

Graham Taylor: Modeling human motion, pose estimation and tracking  (11:00-12:30) 

Chris Manning: NLP / Deep Learning (2:00-3:30) 

Theano programming, datasets with Fuel (4:00-5:30)

Day 6, Sat, Aug 8

Ruslan Salakhutdinov: Deep Boltzmann Machines (9:00-10:30) 

Adam Coates: Speech recognition with deep learning (11:00-12:30) 

Ruslan Salakhutdinov: Multi-modal models (2:00-3:30) 

Day 7, Sun, Aug 9

Ian Goodfellow: Structure of optimization problems (9:00-10:30) 

Adam Coates: Systems issues and distributed training (11:00-12:30) 

Ian Goodfellow: Adversarial examples (2:00-3:30) 

Day 8, Mon, Aug 10

Phil Blunsom: From language modeling to machine translation (9:00-10:30) 

Richard Socher: Recurrent neural networks  (11:00-12:30) 

Phil Blunsom: Memory, Reading, and Comprehension (2:00-3:30) 

Theano debugging tools, conv. nets (4:00-5:30)

Day 9, Tue, Aug 11

Richard Socher: DMN for NLP (9:00-10:30) 

Mark Schmidt: Smooth, Finite, and Convex Optimization (11:00-12:30) 

Roland Memisevic: Visual Features II (2:00-3:30)

Theano implementation of iterations (scan), RNNs (4:00-5:30)

Day 10, Wed, Aug 12

Mark Schmidt: Non-Smooth, Non-Finite, and Non-Convex Optimization (9:00-10:30) 

Aaron Courville: VAEs and deep generative models for vision (11:00-12:30) 

Yoshua Bengio: Generative models from auto-encoders (2:00-3:30) 

Theano programming: overflow session (4:00-5:00)

 

  Join the CompressiveSensing subreddit or the Google+ Community or the Facebook page and post there !
Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.