Figure from Adam Coates's Systems issues and distributed training presentation
Here are some of the slides presented at the Deep Learning Summer School 2015. Enjoy !
Day 1, Mon, Aug 3
Pascal Vincent: Intro to ML (9:00-10:30)
Yoshua Bengio: Theoretical motivations for Representation Learning & Deep Learning (11:00-12:30)
Leon Bottou: Intro to multi-layer nets (2:00-3:30)
Day 2, Tue, Aug 4
Hugo Larochelle: Neural nets and backprop (9:00-10:30)
Leon Bottou: Numerical optimization and SGD, Structured problems & reasoning (11:00-12:30)
Hugo Larochelle: Directed Graphical Models and NADE (2:00-3:30)
Intro to Theano (4:00-5:30)
Day 3, Wed, Aug 5
Aaron Courville: Intro to undirected graphical models (9:00-10:30)
Honglak Lee: Stacks of RBMs (11:00-12:30)
Pascal Vincent: Denoising and contractive auto-encoders, manifold view (2:00-3:30)
GPU Programming (4:00-5:30)
Day 4, Th, Aug 6
Roland Memisevic: Visual features (9:00-10:30)
Honglak Lee: Convolutional networks (11:00-12:30)
Graham Taylor: Learning similarity (2:00-3:30)
Day 5, Fri, Aug 7
Chris Manning: NLP 101 (9:00-10:30)
Graham Taylor: Modeling human motion, pose estimation and tracking (11:00-12:30)
Chris Manning: NLP / Deep Learning (2:00-3:30)
Theano programming, datasets with Fuel (4:00-5:30)
Day 6, Sat, Aug 8
Ruslan Salakhutdinov: Deep Boltzmann Machines (9:00-10:30)
Adam Coates: Speech recognition with deep learning (11:00-12:30)
Ruslan Salakhutdinov: Multi-modal models (2:00-3:30)
Day 7, Sun, Aug 9
Ian Goodfellow: Structure of optimization problems (9:00-10:30)
Adam Coates: Systems issues and distributed training (11:00-12:30)
Ian Goodfellow: Adversarial examples (2:00-3:30)
Day 8, Mon, Aug 10
Phil Blunsom: From language modeling to machine translation (9:00-10:30)
Richard Socher: Recurrent neural networks (11:00-12:30)
Phil Blunsom: Memory, Reading, and Comprehension (2:00-3:30)
Theano debugging tools, conv. nets (4:00-5:30)
Day 9, Tue, Aug 11
Richard Socher: DMN for NLP (9:00-10:30)
Mark Schmidt: Smooth, Finite, and Convex Optimization (11:00-12:30)
Roland Memisevic: Visual Features II (2:00-3:30)
Theano implementation of iterations (scan), RNNs (4:00-5:30)
Day 10, Wed, Aug 12
Mark Schmidt: Non-Smooth, Non-Finite, and Non-Convex Optimization (9:00-10:30)
Aaron Courville: VAEs and deep generative models for vision (11:00-12:30)
Yoshua Bengio: Generative models from auto-encoders (2:00-3:30)
Theano programming: overflow session (4:00-5:00)
No comments:
Post a Comment