Technical Report ERGO 09-010

Phase transitions for greedy sparse approximation algorithms
Jeffrey D. Blanchard, Coralia Cartis, Jared Tanner and Andrew Thompson


A major enterprise in compressed sensing and sparse approximation is the design and analysis of computationally tractable algorithms for recovering sparse, exact or approximate, solutions of underdetermined linear systems of equations. Many such algorithms have now been proven using the ubiquitous Restricted Isometry Property (RIP) to have optimal-order uniform recovery guarantees. However, it is unclear when the RIP-based sufficient conditions on the algorithms are satisfied. We present a framework in which this task can be achieved; translating these conditions for Gaussian measurement matrices into requirements on the signal's sparsity level, size and number of measurements. We illustrate this approach on three of the state-of-the-art greedy algorithms: CoSaMP, Subspace Pursuit (SP) and Iterated Hard Thresholding (IHT). Designed to allow a direct comparison of existing theory, our framework implies that IHT, the lowest of the three in computational cost, also requires fewer compressed sensing measurements than CoSaMP and SP.


Compressed sensing, sparsity, sparse approximation, sparse solutions to underdetermined systems, greedy algorithms, sparse solutions to underdetermined systems, restricted isometry property, phase transitions, Gaussian matrices




Published in Applied and Computational Harmonic Analysis.