Anyone know how I can find the relevant attributes of a data set from the model coefficients lasso? That is, I have to pay attention, the largest coefficients? the largest absolute value?

asked May 03 '13 at 12:33

byfnk's gravatar image

byfnk
21336

edited May 03 '13 at 12:43

1

As I know, when variables have high correlation, LASSO will show randomness, that is, it will select one of the correlated variables randomly.

(May 03 '13 at 14:34) Ziyuan Lin

Thanks for your answer! It is a question for a faculty homework machine learning. I fit the linear and lasso and pick up the coefficients associated and ask me to determine which are the most characteristic attributes (so the most important)

(May 03 '13 at 22:59) byfnk

Is it asking you to pick up coefficients relevant to the response?

(May 04 '13 at 12:02) Ziyuan Lin

One Answer:

The idea of lasso is to bring non-relevant attributes' coefficients to zero, so you may be interested in non-zero coefficients. More here:

http://fastml.com/large-scale-l1-feature-selection-with-vowpal-wabbit/

answered May 05 '13 at 18:28

Zygmunt%20Zaj%C4%85c's gravatar image

Zygmunt ZajÄ…c
46114

thanks this was the answer.

(Jun 12 '13 at 12:35) byfnk
Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.