**Igor Carron**

**LightOn || @Google Scholar || @LinkedIn ||@Twitter || @Webpage**

+

*Papers:*

**Approximating Kernels at the speed of Light**

**Imaging with Nature**

**LightOn****Our Newsletter ||Twitter || LinkedIn**

**Nuit Blanche**community@Google+(2813) || @Facebook (413) || @Reddit (2091)

Compressive Sensing @LinkedIn (3933)

Advanced Matrix Factorization @Linkedin (1299)

*Paris Machine Learning*( MLParis.org )@Meetup.com (6774 members) || @archives || @LinkedIn (1975) || @Google+(522) ||

@Facebook (388) || @Twitter (2312 followers)

The Big Picture in Compressive Sensing|| Learning Compressive Sensing ||

Advanced Matrix Factorization Jungle Page ||

*Reference pages*The Big Picture in Compressive Sensing|| Learning Compressive Sensing ||

Advanced Matrix Factorization Jungle Page ||

**Highly Technical Reference Pages - Aggregators**||

These Technologies Do Not Exist || CAI: Cable And Igor's Adventures in Matrix Factorization || Search ||These Technologies Do Not Exist || CAI: Cable And Igor's Adventures in Matrix Factorization || Search ||

**Reproducible Research page**

Subscribe to:
Post Comments (Atom)

## 2 comments:

I am not sure the machine learning community at large is really consistent on variable names, at least not as consistent as the stats people are. For instance parameters to be tuned are called weights and represented by a matrix W (in case there are many output to predict) while the statisticians doing linear regression will call one row of W beta.

Still, identifying common notations and comparing them across domains is useful for the new comers (esp. in CS where the notation seem rather unique).

Hi Igor,

I've encountered some other expressions in stat/ML literature as well. (see e.g., http://en.wikipedia.org/wiki/Dependent_and_independent_variables#Alternative_terminology_in_statistics)

Other than the 'irrepressntability' condition, conditions similar/equivalent to RIP are Restricted Eigenvalue Property, Restricted Strong Convexity.

Also, sometimes they call the measurement matrix the "design (matrix)".

By the way I think n(or N) is not the number of observations, it's the number of features, assuming that we call the observed predictions, observations.

Finally, I'd like to mention that even though there are many analogies between CS and stat/ML framework there's a fundamental difference. In CS often the "signal" is often, if not always, independent of the "measurement matrix", but in stat/ML most of the time there's a conditional distribution which relates the weights/parameters vector, the design matrix, and the observations/labels.

Post a Comment