Nuit Blanche in Review ( October 2015 )

Wow, many things happened since the last Nuit Blanche in Review ( September 2015 ) !

My co-authors and I put out a new preprint on ArXiv entitled Approximating Kernels at the Speed of Light, Nuit Blanche saw the 400th implementation made available by their authors. We also had quite a few summaries and related big picture articles coming out:

• 50 years of Data Science by David Donoho
• Is audio signal processing still useful in the era of machine learning?
• Phase Retrieval: An Overview of Recent Developments
• Learning to Hash for Indexing Big Data - A Survey
• Fast genome and metagenome distance estimation using MinHash / Machine learning for metagenomics: methods and tools
• When Are Nonconvex Problems Not Scary? 

Two papers may have far reaching consequences:

• A Faster Cutting Plane Method and its Implications for Combinatorial and Convex Optimization
• Generalization in Adaptive Data Analysis and Holdout Reuse, Generalization in Adaptive Data Analysis and Holdout Reuse - part 2 -

We also had three Sunday Morning Insights:

• Sunday Morning Insight: Miller's Wave and Genomics
• Sunday Morning Insight: "Ca change tout" and the second inflection point in Genome Sequencing
• Sunday Morning Insight: The Second Inflection Point in Genome Sequencing

There were a few implementations made available:

• Clustering Noisy Signals with Structured Sparsity Using Time-Frequency Representation
• Neural Networks with Few Multiplications / BinaryConnect
• On the Complexity of Robust PCA and $\ell_1$-norm Low-Rank Matrix Approximation
• FastEmbed: Compressive spectral embedding: sidestepping the SVD
• Simple sublinear Fourier sampling , the 400th implementation.
• Gradient-based Hyperparameter Optimization through Reversible Learning ( Autograd implementation ) 

 A few insights:

• True BLAS-3 Performance QRCP using Random Sampling
• Randomized Alternating Least Squares for Canonical Tensor Decompositions: Application to a PDE with Random Data / Sparse sensing and DMD based identification of flow regimes and bifurcations in complex flows
• Lectures on Deep Learning by Quoc Le / A Primer on Neural Network Models for Natural Language Processing by Yoav Goldberg 
• Input Sparsity and Hardness for Robust Subspace Approximation 
• A Picture is Worth a Billion Bits: Real-Time Image Reconstruction from Dense Binary Pixels 
• Compressive Imaging in Scanning Transmission Electron Microscopy and Microwave Ghost Imaging 
• Boolean Matrix Factorization and Completion via Message Passing 
• Efficient scalable compression of sparsely sampled images 
• Stable recovery of low-dimensional cones in Hilbert spaces: One RIP to rule them all
•  Sketching for Simultaneously Sparse and Low-Rank Covariance Matrices  
• Linear-time Learning on Distributions with Approximate Kernel Embeddings 
• ℓ1-regularized Neural Networks are Improperly Learnable in Polynomial Time 
• Tensor vs Matrix Methods: Robust Tensor Decomposition under Block Sparse Perturbations 
• Dual Principal Component Pursuit  
• Sparse SPM: Sparse-Dictionary Learning for Resting-state Functional Connectivity MRI Analysis
• Random Features: Sketching for Large-Scale Learning of Mixture Models, Structured Transforms for Small-Footprint Deep Learning, Optical Beam Forming Network Tuning
• Random Features Roundup: Dual Control for Approximate Bayesian RL, Scatter Component Analysis, Spherical Random Features
• Memory and Computation Efficient PCA via Very Sparse Random Projections
• Intensity-only optical compressive imaging using a multiply scattering material : a double phase retrieval system

Paris ML Meetup

• Tonight: Paris Machine Learning #2 Season 3: Extreme Multi-class, Infosec, RTB and more.

Some job offers:

• CSJob: Postdoc positions in Graph Signal Processing / Dimension Reduction / Compressive Learning, Rennes, France
• CSjob: Postdoc, Statistical Inference, Compressed Sensing, Information Theory, Machine learning and Statistical Physics, ENS Paris, France
• CSjob: Postdoc, Computational Sensing Strategies for Low-Complexity Signal Models, Louvain, Belgium

Videos

• Saturday Morning Videos: ICML 2015 in Lille
• Saturday Morning Videos: Talks at RecSys2015 and RecSys2014
• Saturday Morning Video: Gaussian Processes with Neil Lawrence

 
Other

• The Communities: Nuit Blanche, Defeating the Data Tsunami one Algorithm at a Time.
• Ceci n'est toujours pas le site de la Nuit Blanche

Credit: NASA/SOHO/SDO

  Join the CompressiveSensing subreddit or the Google+ Community or the Facebook page and post there !
Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.