Article,

Robust Uncertainty Principles: Exact Signal Reconstruction from Highly Incomplete Frequency Information

, , and .
Information Theory, IEEE Transactions on, 52 (2): 489--509 (2006)
DOI: 10.1109/TIT.2005.862083

Abstract

This paper considers the model problem of reconstructing an object from incomplete frequency samples. Consider a discrete-time signal f&isin;C<sup>N</sup> and a randomly chosen set of frequencies &Omega;. Is it possible to reconstruct f from the partial knowledge of its Fourier coefficients on the set &Omega;? A typical result of this paper is as follows. Suppose that f is a superposition of |T| spikes f(t)=&sigma;<sub>&tau;&isin;T</sub>f(&tau;)&delta;(t-&tau;) obeying |T|&le;C<sub>M</sub>&middot;(log N)<sup>-1</sup> &middot; |&Omega;| for some constant C<sub>M</sub>>0. We do not know the locations of the spikes nor their amplitudes. Then with probability at least 1-O(N<sup>-M</sup>), f can be reconstructed exactly as the solution to the &#8467;<sub>1</sub> minimization problem. In short, exact recovery may be obtained by solving a convex optimization problem. We give numerical values for C<sub>M</sub> which depend on the desired probability of success. Our result may be interpreted as a novel kind of nonlinear sampling theorem. In effect, it says that any signal made out of |T| spikes may be recovered by convex programming from almost every set of frequencies of size O(|T|&middot;logN). Moreover, this is nearly optimal in the sense that any method succeeding with probability 1-O(N<sup>-M</sup>) would in general require a number of frequency samples at least proportional to |T|&middot;logN. The methodology extends to a variety of other situations and higher dimensions. For example, we show how one can reconstruct a piecewise constant (one- or two-dimensional) object from incomplete frequency samples - provided that the number of jumps (discontinuities) obeys the condition above - by minimizing other convex functionals such as the total variation of f.

Tags

Users

  • @ytyoun

Comments and Reviews