Slides: IPAM Deep Learning, Feature Learning Graduate Summer School

Here is the program and the slides of the Deep Learning, Feature Learning Graduate Summer School that took place at IPAM, July 9 - 27, 2012

Monday, July 09, 2012
Morning Session
8:00 - 8:45	Check-In/Breakfast (Hosted by IPAM)
8:45 - 9:00	Welcome and Opening Remarks
9:00 - 10:00	Geoffrey Hinton (University of Toronto) "PART 1: Introduction to Deep Learning & Deep Belief Nets (PDF Parts 1 & 2)"  Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Geoffrey Hinton (University of Toronto) "PART 2: Using backpropagation for fine-tuning a generative model to be better at discrimination"
11:30 - 12:00	Break
12:00 - 1:00	Joint talk: James Bergstra (Harvard), Clement Farabet (NYU)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Yann LeCun (New York University) "Deep Learning, Graphical Models, EnergyBased Models, Structured Prediction" Presentation (PDF File)
3:30 - 4:00	Break
4:00 - 5:00	Yann LeCun (New York University) "Deep Learning, Graphical Models, EnergyBased Models, Structured Prediction" Presentation (PDF File)
5:00 - 6:30	Reception (Hosted by IPAM)
Tuesday, July 10, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Andrew Ng (Stanford University) "Deep Learning, Self-Taught Learning and Unsupervised Feature Learning (Part 1 Slides1-68; Part 2 Slides 69-109)" Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Andrew Ng (Stanford University) "Advanced topics + Research philosophy / Neural Networks: Representation" Presentation (PDF File)
11:30 - 12:00	Break
12:00 - 1:00	Andrew Ng (Stanford University) "Non-linear hypotheses"
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Andrew Ng (Stanford University) "Non-linear hypotheses"
3:30 - 4:00	Break
4:00 - 5:00	Joint talk: James Bergstra (Harvard), Clement Farabet (NYU)
Wednesday, July 11, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Yann LeCun (New York University) "Learning Hierarchies of Invariant Features (Parts 1 & 2)" Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Yann LeCun (New York University) "Deep Learning, Graphical Models, EnergyBased Models, Structured Prediction" Presentation (PDF File)
11:30 - 12:00	Break
12:00 - 1:00	Joint talk: James Bergstra (Harvard), Clement Farabet (NYU)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Geoffrey Hinton (University of Toronto) "PART 3: Some applications of deep learning (Slides 1-38)" Presentation (PDF File)
3:30 - 4:00	Break
4:00 - 5:00	Geoffrey Hinton (University of Toronto) "PART 4: A computational principle that explains sex, the brain, and sparse coding (Slides 39-92)" Presentation (PDF File)
Thursday, July 12, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Rob Fergus (New York University) "Deep Learning Methods for Vision" Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Rob Fergus (New York University) "Deep Learning Methods for Vision" Presentation (PDF File)
11:30 - 12:00	Break
12:00 - 1:00	Geoffrey Hinton (University of Toronto) Presentation (PDF File)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Alan Yuille (University of California, Los Angeles (UCLA))
3:30 - 4:00	Break
4:00 - 5:00	Joint talk: James Bergstra (Harvard), Clement Farabet (NYU)
Friday, July 13, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Graham Taylor (University of Guelph) Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Graham Taylor (University of Guelph) Presentation (PDF File)
11:30 - 12:00	Break
12:00 - 1:00	Alan Yuille (University of California, Los Angeles (UCLA))
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Alan Yuille (University of California, Los Angeles (UCLA))
3:30 - 4:00	Break
4:00 - 5:00	Yann LeCun (New York University) "Deep Learning, Graphical Models, EnergyBased Models, Structured Prediction" Presentation (PDF File)
Monday, July 16, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Yoshua Bengio (University of Montreal)
10:00 - 10:30	Break
10:30 - 11:30	Yoshua Bengio (University of Montreal)
11:30 - 12:00	Break
12:00 - 1:00	Stephen Wright (University of Wisconsin-Madison) "Some Relevant Topics in Optimization (Part 1) - (Slides Cover Parts 1 & 2)" Presentation (PDF File)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Stephen Wright (University of Wisconsin-Madison) "Some Relevant Topics in Optimization (Part 2)"
3:30 - 4:00	Break
4:00 - 5:00	Arthur Szlam (New York University) "A tutorial on sparse modeling." Presentation (PDF File)
5:00 - 6:30	Reception (Hosted by IPAM)
Tuesday, July 17, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Stephen Wright (University of Wisconsin-Madison) "Sparse and Regularized Optimization Part 1 (Slides Cover Parts 1 & 2)" Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Stephen Wright (University of Wisconsin-Madison) "Sparse and Regularized Optimization Part 2" Presentation (PDF File)
11:30 - 12:00	Break
12:00 - 1:00	Arthur Szlam (New York University)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Yoshua Bengio (University of Montreal)
3:30 - 4:00	Break
4:00 - 5:00	Yoshua Bengio (University of Montreal)
Wednesday, July 18, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Stéphane Mallat (École Polytechnique) "Scattering Invariant Deep Networks for Classification " Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Stéphane Mallat (École Polytechnique) "Scattering Invariant Deep Networks for Classification " Presentation (PDF File)
11:30 - 12:00	Break
12:00 - 1:00	Kai Yu (Baidu Inc.)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Kai Yu (Baidu Inc.)
3:30 - 4:00	Break
4:00 - 5:00	Jorge Nocedal (Northwestern University) "Tutorial on Optimization methods for machine learning" Presentation (PDF File)
Thursday, July 19, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Jorge Nocedal (Northwestern University) "Tutorial on Optimization methods for machine learning" Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Jorge Nocedal (Northwestern University)
11:30 - 2:00	Lunch (on your own)
Afternoon Session
2:00 - 3:30	Stéphane Mallat (École Polytechnique)
3:30 - 4:00	Break
4:00 - 5:00	Jason Morton (Pennsylvania State University) "An Algebraic Perspective on Deep Learning" Presentation (PDF File)
Friday, July 20, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Jason Morton (Pennsylvania State University) "An Algebraic Perspective on Deep Learning" Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Jason Morton (Pennsylvania State University) "An Algebraic Perspective on Deep Learning" Presentation (PDF File)
11:30 - 12:00	Break
12:00 - 1:00	Yoshua Bengio (University of Montreal)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Stanley Osher (University of California, Los Angeles (UCLA))
3:30 - 4:00	Break
4:00 - 5:00	Stanley Osher (University of California, Los Angeles (UCLA))
Monday, July 23, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Ruslan Salakhutdinov (University of Toronto) Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Ruslan Salakhutdinov (University of Toronto) Presentation (PDF File)
11:30 - 12:00	Break
12:00 - 1:00	Marc'Aurelio Ranzato (Google Inc.) "Deep Gated MRF's - part 1" Presentation (PDF File)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Marc'Aurelio Ranzato (Google Inc.) "Deep Gated MRF's - part 2" Presentation (PDF File)
3:30 - 4:00	Break
4:00 - 5:00	Jason Weston (Google Research)
5:00 - 6:30	Reception (Hosted by IPAM)
6:30 - 7:30	Brian Milch (Google Inc.) "From Text to Concepts at Google"
Tuesday, July 24, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Jason Weston (Google Research)
10:00 - 10:30	Break
10:30 - 11:30	Jason Weston (Google Research)
11:30 - 12:00	Break
12:00 - 1:00	Ruslan Salakhutdinov (University of Toronto) Presentation (PDF File)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Bruno Olshausen (University of California, Berkeley (UC Berkeley)) "From natural scene statistics to models of neural coding and representation (part 1)" Presentation (PDF File)
3:30 - 4:00	Break
4:00 - 5:00	Marc'Aurelio Ranzato (Google Inc.) "Large Scale Deep Learning" Presentation (PDF File)
Wednesday, July 25, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Thomas Serre (Brown University) "Deep learning in the visual cortex - Part 1" Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Thomas Serre (Brown University) "Deep learning in the visual cortex - Part 2" Presentation (PDF File)
11:30 - 12:00	Break
12:00 - 1:00	Roland Memisevic (Johann Wolfgang Goethe-Universität Frankfurt) "Multiview Feature Learning - Part 1" Presentation (PDF File)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Roland Memisevic (Johann Wolfgang Goethe-Universität Frankfurt) "Multiview Feature Learning - Part 2" Presentation (PDF File)
3:30 - 4:00	Break
4:00 - 5:00	Bruno Olshausen (University of California, Berkeley (UC Berkeley)) "From natural scene statistics to models of neural coding and representation (part 2)" Presentation (PDF File)
Thursday, July 26, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Iain Murray (University of Edinburgh) "Introduction to MCMC for deep learning" Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Iain Murray (University of Edinburgh) "Density estimation" Presentation (PDF File)
11:30 - 12:00	Break
12:00 - 1:00	Nando de Freitas (University of British Columbia)
1:00 - 2:30	Lunch (on your own)
Afternoon Session
2:30 - 3:30	Nando de Freitas (University of British Columbia)
3:30 - 4:00	Break
4:00 - 5:00	Thomas Serre (Brown University) "Deep learning in the visual cortex - Part 3" Presentation (PDF File)
Friday, July 27, 2012
Morning Session
8:00 - 9:00	Continental Breakfast
9:00 - 10:00	Nando de Freitas (University of British Columbia) "An Informal Mathematical Tour of Feature Learning" Presentation (PDF File)
10:00 - 10:30	Break
10:30 - 11:30	Nando de Freitas (University of British Columbia)

Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.