|
I have this optimization function 1/2au^2 + bu + lambda |c+ u| This paper says that the solution is given by
where Can anyone please tell me how it was derived? |
|
This is derived by doing a proximal gradient algorithm, where you at each step minimize a convex upper bound on the lasso problem. If the function you're minimizing looks like f(x) + lambda |x|_1, where f is smooth (has a lipschitz continuous gradient), you can upper bound this function by
Minimizing this upper bound leads to a gradient-and-thresholding algorithm, which can also be implemented as doing a gradient step with learning rate 1/C and then applying a proximal operator. See how to derive the tresholding operation in this previous answer. |

