Nuit Blanche in Review (April 2017)

April 2017 was pretty eventful. At LightOn, we just came out with our second newsletter. We attended ICLR in Toulon, and much like Libby , we noticed the millenia CPU paper as well as the current thought processes going on in finding rules of thumbs for new architectures on the algorithm side (see Understanding section below) and on the hardware side (see MLHardware section). We also noted that some of these insights might be automated (see Architecture section). Kudos to the ICLR organizers for streamlining and eventually putting the videos of the event in real time. Other highlights included what is going on in sequencing (see Sunday Morning Insight), a thesis and some jobs. Enjoy !

Nuit Blanche in Review for March 2017 is here.

Sunday Morning Insight:

• Sunday Morning Insight: "No Need for the Map of a Cat, Mr Feynman" or The Long Game in Nanopore Sequencing.

Implementation (implementation tag)

• CSVideoNet: A Real-time End-to-end Learning Framework for High-frame-rate Video Compressive Sensing - implementation -
• Improved Training of Wasserstein GANs - implementation -
• AutoGP: Exploring the Capabilities and Limitations of Gaussian Process Models - implementation -

Architectures (MetaLearning tag)

• Designing Neural Network Architectures using Reinforcement Learning
• Random Feature Expansions for Deep Gaussian Processes / AutoGP: Exploring the Capabilities and Limitations of Gaussian Process Models - implementation -

ML Hardware (MLHardware tag)

• In-Datacenter Performance Analysis of a Tensor Processing Unit​ (TM)
• MLHardware: Understanding and Optimizing Asynchronous Low-Precision Stochastic Gradient Descent / WRPN: Training and Inference using Wide Reduced-Precision Networks
• It's all about convolutions: YodaNN, TrueNorth computing, FPGAs and a comparison between HOG and CNNs on Hardware

CSHardware (CSHardware tag)

• Lensless Imaging with Compressive Ultrafast Sensing

In-depth

• Online Natural Gradient as a Kalman Filter
• Stochastic Gradient Descent as Approximate Bayesian Inference
• Phase Transitions of Spectral Initialization for High-Dimensional Nonconvex Estimation
• F2F: A Library For Fast Kernel Expansions

Understanding

• Understanding Shallower Networks
• Understanding Deep Neural Networks; Opening the Black Box, Energy Propagation in DNNs, Exploring loss function topology

Thesis (Thesis tag)

• Thesis: Randomized Algorithms for Large-Scale Data Analysis by Farhad Pourkamali-Anaraki

Highly Technical Reference page:

• Highly Technical Reference Page: The Incredible PyTorch

Videos:

• Saturday Morning Videos: #ICLR2017 videos

Conferences

• #ICLR2017 Monday Morning Program
• #ICLR2017 Monday Afternoon Program
• #ICLR2017 Tuesday Morning Program
• #ICLR2017 Tuesday Afternoon Program
• ICLR2017, third and last day.

Jobs: (CSjobs tag)

• Two jobs, Research Scientists, NVIDIA

Credit photo: NASA, JPL-Caltech, SSI,  enhanced by Sophia Nasr

Join the CompressiveSensing subreddit or the Google+ Community or the Facebook page and post there !
Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.