2
2

Hello all,

what are some good papers or books on feature extraction? Guyon et al's book seems to treat feature selection. Note that I know about the answers from here.

asked Sep 06 '11 at 13:17

Lucian%20Sasu's gravatar image

Lucian Sasu
513172634

edited Sep 06 '11 at 14:26

It seems that the question title and question details are not consistent. Can you fix the wrong one (I think the title)?

(Sep 06 '11 at 13:28) ogrisel

I think he wants to know about feature extraction (hence the tag). Unfortunately, apart from more general methods of dimensionality reduction this is fairly domain-specific (as far as I know). Feature extraction in speech, vision, and bioinformatics have (again, as far as I know) rather little overlap. What area are you interested in?

(Sep 06 '11 at 14:15) Jacob Jensen

@ogrisel: thanks, I corrected the title. @Jacob: especially on computational chemistry.

(Sep 06 '11 at 14:28) Lucian Sasu
1

I know almost nothing about computational chemistry. You might want to look up protein prediction? Though there's probably stuff better suited to your purpose.

(Sep 06 '11 at 17:43) Jacob Jensen
2

Do you mean feature engineering, what people do in NLP, which is thinking very hard about the problem domain and then writing simple pattern matchers that are known to either correlate or anticorrelate with the answer?

Do you mean feature extraction as performed by vision people, where you run lots of edge detectors, multiscale filters, and descriptor extractors (like SIFT), and then vector quantize these to get features for classification/clustering?

Or do you mean the deep learning kind of feature extraction, which is roughly domain agnostic and is based on training RBMs or autoencoders on top of enough other RBMs or autoencoders and then maybe training an SVM on the "higher-level" activations of the neurons of these deep neural networks?

(Sep 07 '11 at 07:06) Alexandre Passos ♦

@Alexandre: most likely the 2nd approach is what I mean. However, also the last direction is quite new for me - do you have some pointers for them, too?

(Sep 07 '11 at 09:04) Lucian Sasu
1

@lmsasu: Sure. For the second alternative, search for SIFT, descriptors, edge detectors, feature bagging, etc, on google scholar or the archives of high-profile computer vision conferences. For the third alternative help yourself to the deeplearning.net reading list: http://deeplearning.net/reading-list/

(Sep 07 '11 at 09:07) Alexandre Passos ♦
showing 5 of 7 show all
Be the first one to answer this question!
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.