4
2

Are there implementations of Machine Learning Algorithm on Map-Reduce Frameworks such as hadoop?

asked Jun 30 '10 at 23:54

anon's gravatar image

anon
1323510

reverted Jul 01 '10 at 18:30

Joseph%20Turian's gravatar image

Joseph Turian ♦♦
561050122143

anon, I have reverted this question since the answers are fine.

(Jul 01 '10 at 18:29) Joseph Turian ♦♦

5 Answers:
12

Check out Mahout

answered Jul 01 '10 at 01:01

Vaclav%20Petricek's gravatar image

Vaclav Petricek
4053911

edited Jul 01 '10 at 01:02

Jimmy Lin and Chris Dyer recently published a book (freely available), which discusses some of the patterns used in Map-Reduce'ing a particular algorithm.

answered Jul 01 '10 at 01:09

Joseph%20Turian's gravatar image

Joseph Turian ♦♦
561050122143

edited Jul 01 '10 at 01:09

See Mahout ASF project.

answered Jul 01 '10 at 17:25

Otis's gravatar image

Otis
613

Ridge regression/regularized least-squares classification for Hadoop/Mapreduce example at:

Parallel Machine Learning for Hadoop/Mapreduce - a Python Example

Corresponding Code at Github

(disclaimer: I wrote the example and code)

answered Nov 06 '10 at 01:46

Amund%20Tveit's gravatar image

Amund Tveit
163

edited Nov 06 '10 at 01:49

Also check out this paper by Andrew Ng and students which describes Hadoop versions of things "locally weighted linear regression(LWLR), k-means, logistic regression, naiveBayes, SVM, ICA, PCA, gaussian discriminant analysis, EM and backpropagation(NN)".

answered Jul 01 '10 at 02:53

Jurgen's gravatar image

Jurgen
99531319

1

That NIPS paper was based on a single machine implementation of map-reduce, not on a viable general purpose platform. In fact, that paper was much of the inspiration for the Apache Mahout project.

(Jul 03 '10 at 14:02) Ted Dunning
Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.