Sparse methods and dictionary learning are another example of strong topic with recent mathematical developments, notably by the cross-fertilization of the machine learning / statistics community on the one hand and the signal processing / compressed sensing community.
Dictionary learning with sparse priors is also converging with the deep learning approach (were several layers of regularized encoders are stacked and train unsupervisedly to minimize a reconstruction error penalized with a sparsity inducing term).