3
6

Which textbooks on optimization can you recommend?

In particular, I am looking for the book that is for optimization what Russel+Norvig is for AI and what Jurafsky+Martin is for NLP, i.e. presents the basics, the (consolidated) state of the art, tons of examples, gives a nice overview plus pointers to advanced literature, goes deep enough for a real understanding (both for theory and applications).

Best regards, Z.

asked Jul 01 '10 at 11:31

zeno's gravatar image

zeno
2111510

edited Jul 01 '10 at 11:32


7 Answers:
10

I'll start with a standard: CVXbook by Stephen Boyd and Lieven Vandenberghe

answered Jul 01 '10 at 12:03

osdf's gravatar image

osdf
67031119

Stephen Boyd's lectures are also available online (look for "Convex Optimization") and are quite helpful.

(Nov 07 '10 at 23:06) sbirch

I'd recommend Numerical Optimization, by Nocedal and Wright. It was first recommended to me by Tammy Kolda, who's done a fair amount of original work in optimization herself. Her assessment was that it was the best book for someone who knows math but not optimization, and I agree; I dip into it all the time.

answered Jul 02 '10 at 16:27

Philip%20Kegelmeyer's gravatar image

Philip Kegelmeyer
151226

2

+1 for that. I don't understand why people are so positive about Convex Optimization. It's a great book, for sure, but it covers such a small part of the optimization literature. Nocedal and Wright provides (to my taste) much more breadth and depth.

(Jul 02 '10 at 17:44) Jurgen

I go with osdf's answer about "Convex Optimization", by Boyd and Vandenberghe. A good complement to that book might be "Nonlinear Programming" by Dimitri Bertsekas.

answered Jul 01 '10 at 14:46

ualex's gravatar image

ualex
1614611

You can find some useful references in Numerical Recipes. Always take that book with a grain of salt, yadda yadda, but I find it very useful to get a superficial (and mostly wrong) understanding of the motivations of some methods and/or to get a quick and dirty implementation started.

answered Jul 01 '10 at 12:10

Alexandre%20Passos's gravatar image

Alexandre Passos ♦
2554154278421

I like the books from Dmitri Bertsekas... amazon They explain things well, at least for me.

answered Jul 02 '10 at 18:23

timwee's gravatar image

timwee
163

edited Jul 02 '10 at 18:25

I don't think this one is the "Russel and Norvig" of optimization, but it is quite good:

"Convex Optimization & Euclidean Distance Geometry", by Jon Datorro.

Available online.

answered Nov 09 '10 at 12:19

Alejandro's gravatar image

Alejandro
301610

Your answer
toggle preview

powered by OSQA

User submitted content is under Creative Commons: Attribution - Share Alike; Other things copyright (C) 2010, MetaOptimize LLC.