SUNLayer: Stable denoising with generative networks

Dustin just let me know of the following item to be added to The Great Convergence:

Hi Igor, 

I wanted to point you to a recent paper on the arXiv: 

https://arxiv.org/abs/1803.09319 

I think you'll like Figure 1 in particular.

Apparently, GANs provide signal models that allow for extremely good denoising in a high-noise regime. To denoise, we hunt for the point in the GAN model that's closest to the noisy image. Surprisingly, local minimization works well in practice. To help explain this, we provide theory for a certain model of neural networks using techniques from spherical harmonics. This is joint work with Soledad Villar (NYU).

Cheers,

Dustin

Yes, you're right, I do like Figure 1 ! 

SUNLayer: Stable denoising with generative networks by Dustin G. Mixon, Soledad Villar

It has been experimentally established that deep neural networks can be used to produce good generative models for real world data. It has also been established that such generative models can be exploited to solve classical inverse problems like compressed sensing and super resolution. In this work we focus on the classical signal processing problem of image denoising. We propose a theoretical setting that uses spherical harmonics to identify what mathematical properties of the activation functions will allow signal denoising with local methods.

Join the CompressiveSensing subreddit or the Google+ Community or the Facebook page and post there !
Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.