Going back to Suresh's blog entry on NIPS2012, I noted his mention of Stephane Mallat's scattering operator as featured recently in Small-sample brain mapping: sparse recovery on spatially correlated designs with randomization and clustering. There Michael Eickenberg Alexandre Gramfort and Bertrand Thirion were showing a potential match-up between the scattering operation and what is actually happening in the brain (Multilayer Scattering Image Analysis Fits fMRI Activity in Visual Areas also here). Since I last featured the code, there seems to have been a larger edition I missed. Here it is, with a tutorial.
- Image scattering toolbox v3 : Released July 11 2012.
A supporting document of interest is the PhD thesis of Joan Bruna entitled Scattering Representations for Recognition which came out in Nov 2012. The abstract reads:
This thesis addresses the problem of pattern and texture recognition from a mathematical perspective. These high level tasks require signal representations enjoying speciﬁc invariance, stability and consistency properties, which are not satisﬁed by linear representations. Scattering operators cascade wavelet decompositions and complex modulus, followed by a lowpass ﬁltering. They deﬁne a non-linear representation which is locally translation invariant and Lipschitz continuous to the action of diffeomorphisms. They also deﬁne a texture representation capturing high order moments and which can be consistently estimated from few realizations.The thesis derives new mathematical properties of scattering representations and demonstrates its eﬃciency on pattern and texture recognition tasks. Thanks to its Lipschitz continuity to the action of diﬀeomorphisms, small deformations of the signal are linearized, which can be exploited in applications with a generative aﬃne classiﬁer yielding state-of-the-art results on handwritten digit classiﬁcation. Expected scattering representations are applied on image and auditory texture datasets, showing their capacity to capture high order moments information with consistent estimators. Scattering representations are particularly eﬃcient for the estimation and characterization of fractal parameters. A renormalization of scattering coeﬃcients is introduced, giving a new insight on fractal description, with the ability in particular to characterize multifractal intermittency using consistent estimators.
As of right now, this approach is orthogonal to what we do in vanilla compressive sensing.
Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.